Aug 05 06:04:52 devstack cinder-volume[77596]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Aug 05 06:04:52 devstack cinder-volume[77596]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Aug 05 06:04:52 devstack cinder-volume[77596]: we strongly recommend against using it for new projects. Aug 05 06:04:52 devstack cinder-volume[77596]: If you are already using Eventlet, we recommend migrating to a different Aug 05 06:04:52 devstack cinder-volume[77596]: framework. For more detail see Aug 05 06:04:52 devstack cinder-volume[77596]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Aug 05 06:04:52 devstack cinder-volume[77596]: import eventlet # noqa Aug 05 06:04:55 devstack cinder-volume[77596]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=77596) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 05 06:04:55 devstack cinder-volume[77596]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=77596) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 05 06:04:55 devstack cinder-volume[77596]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=77596) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 05 06:04:56 devstack cinder-volume[77596]: INFO dbcounter [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] Registered counter for database cinder Aug 05 06:04:56 devstack cinder-volume[77596]: DEBUG oslo_db.sqlalchemy.engines [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=77596) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 05 06:04:57 devstack cinder-volume[77596]: DEBUG dbcounter [-] [77596] Writer thread running {{(pid=77596) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 05 06:04:57 devstack cinder-volume[77596]: INFO cinder.rpc [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Aug 05 06:04:57 devstack cinder-volume[77596]: INFO cinder.rpc [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Aug 05 06:04:57 devstack cinder-volume[77596]: DEBUG oslo_db.sqlalchemy.engines [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=77596) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 05 06:04:57 devstack cinder-volume[77596]: INFO cinder.volume.manager [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] Determined volume DB was empty at startup. Aug 05 06:04:57 devstack cinder-volume[77596]: DEBUG cinder.volume.manager [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=77596) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Aug 05 06:04:57 devstack cinder-volume[77596]: INFO cinder.volume.manager [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] Service not found for updating active_backend_id, assuming default for driver init. Aug 05 06:04:57 devstack cinder-volume[77596]: WARNING stevedore.named [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Aug 05 06:04:57 devstack cinder-volume[77596]: WARNING castellan.key_manager [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 05 06:04:57 devstack cinder-volume[77596]: WARNING cinder.keymgr.conf_key_mgr [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 05 06:04:57 devstack cinder-volume[77596]: DEBUG cinder.volume.drivers.lvm [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=77596) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Aug 05 06:04:57 devstack cinder-volume[77596]: DEBUG oslo_concurrency.processutils [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=77596) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:04:57 devstack cinder-volume[77596]: DEBUG oslo_concurrency.processutils [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] CMD "cinder-rtstool verify" returned: 0 in 0.423s {{(pid=77596) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:04:57 devstack cinder-volume[77596]: DEBUG oslo_db.sqlalchemy.engines [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=77596) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 05 06:04:57 devstack cinder-volume[77596]: INFO cinder.rpc [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Aug 05 06:04:57 devstack cinder-volume[77596]: INFO cinder.rpc [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Aug 05 06:04:57 devstack cinder-volume[77596]: WARNING stevedore.named [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Aug 05 06:04:57 devstack cinder-volume[77596]: WARNING castellan.key_manager [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 05 06:04:57 devstack cinder-volume[77596]: INFO cinder.volume.manager [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Aug 05 06:04:57 devstack cinder-volume[77596]: DEBUG oslo_db.sqlalchemy.engines [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=77596) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 05 06:04:58 devstack cinder-volume[77596]: INFO oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] Starting 1 workers Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] Started child 77746 {{(pid=77596) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] Full set of CONF: {{(pid=77596) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] ******************************************************************************** {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3518}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] Configuration options gathered from: {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3519}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3520}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3521}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] ================================================================================ {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3526}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] allow_availability_zone_fallback = False {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] allow_compression_on_image_upload = False {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] allowed_direct_url_schemes = [] {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] api_rate_limit = True {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] auth_strategy = keystone {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] az_cache_duration = 3600 {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] backend_availability_zone = None {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] backend_host = None {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] backend_name = None {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] backend_stats_polling_interval = 60 {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] backup_api_class = cinder.backup.api.API {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] backup_name_template = backup-%s {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] backup_use_same_host = False {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] backup_use_temp_snapshot = False {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] chap_password = **** {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] chap_username = {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] cinder_internal_tenant_project_id = 09e694c4172e42d0a131fac439e6bddb {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] cinder_internal_tenant_user_id = aee7c84432484698b925b0cc683db29c {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] cloned_volume_same_az = True {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] cluster = None {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] compression_format = gzip {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] compute_api_class = cinder.compute.nova.API {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] config_dir = [] {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] config_source = [] {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] control_exchange = openstack {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] debug = True {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] default_availability_zone = None {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] default_group_type = None {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] default_volume_type = lvmdriver-1 {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] disk_geometry = None {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] driver_client_cert = None {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] driver_client_cert_key = None {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] driver_data_namespace = None {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] driver_ssl_cert_path = None {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] driver_ssl_cert_verify = False {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] driver_use_ssl = False {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] enable_force_upload = False {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] enable_new_services = True {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] enable_unsupported_driver = False {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:04:58 devstack cinder-volume[77746]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] enabled_backends = ['lvmdriver-1'] {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] enforce_multipath_for_image_xfer = False {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] filter_function = None {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] glance_api_insecure = False {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] glance_api_servers = ['http://192.168.122.36/image'] {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] glance_api_ssl_compression = False {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] glance_ca_certificates_file = None {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] glance_catalog_info = image:glance:publicURL {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] glance_certfile = None {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] glance_keyfile = None {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] glance_num_retries = 3 {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] glance_request_timeout = None {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] goodness_function = None {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] graceful_shutdown_timeout = 5 {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] group_api_class = cinder.group.api.API {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] host = devstack {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] image_compress_on_upload = True {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] image_conversion_address_space_limit = 1 {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] image_conversion_cpu_limit = 60 {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] image_conversion_disable = False {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] image_upload_use_cinder_backend = False {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] image_upload_use_internal_tenant = False {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] image_volume_cache_enabled = False {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] image_volume_cache_max_count = 0 {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] image_volume_cache_max_size_gb = 0 {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] init_host_max_objects_retrieval = 0 {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] instance_format = [instance: %(uuid)s] {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] iscsi_target_flags = {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] iscsi_write_cache = on {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] iser_helper = tgtadm {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] iser_ip_address = 192.168.122.36 {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] iser_port = 3260 {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] log_color = False {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] log_config_append = None {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] log_dir = None {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] log_file = None {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] log_options = True {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] log_rotate_interval = 1 {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] log_rotate_interval_type = days {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] log_rotation_type = none {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] max_age = 0 {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] max_logfile_count = 30 {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] max_logfile_size_mb = 200 {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] max_over_subscription_ratio = 20.0 {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] message_reap_interval = 86400 {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] message_ttl = 2592000 {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] migration_create_volume_timeout_secs = 300 {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] monkey_patch = False {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] monkey_patch_modules = [] {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] my_ip = 192.168.122.36 {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] no_snapshot_gb_quota = False {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] num_iser_scan_tries = 3 {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] num_shell_tries = 3 {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] num_volume_device_scan_tries = 3 {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] nvmeof_conn_info_version = 1 {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] nvmet_ns_id = 10 {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] nvmet_port_id = 1 {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] osapi_max_limit = 1000 {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] osapi_volume_ext_list = [] {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] osapi_volume_listen = 0.0.0.0 {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] osapi_volume_listen_port = 8776 {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] osapi_volume_use_ssl = False {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] osapi_volume_workers = None {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] per_volume_size_limit = -1 {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] periodic_fuzzy_delay = 60 {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] periodic_interval = 60 {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] project_id_regex = [0-9a-f\-]+ {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] public_endpoint = None {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] publish_errors = False {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] quota_backup_gigabytes = 1000 {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] quota_backups = 10 {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] quota_gigabytes = 1000 {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] quota_groups = 10 {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] quota_snapshots = 10 {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] quota_volumes = 10 {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] rate_limit_burst = 0 {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] rate_limit_except_level = CRITICAL {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] rate_limit_interval = 0 {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] reinit_driver_count = 3 {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] replication_device = **** {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] report_discard_supported = False {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] report_interval = 120 {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] reservation_clean_interval = 86400 {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] reservation_expire = 86400 {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] reserved_image_namespaces = [] {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] reserved_percentage = 0 {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] rpc_response_timeout = 120 {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] run_external_periodic_tasks = True {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] scst_target_driver = iscsi {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] scst_target_iqn_name = None {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] service_down_time = 720 {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] shell_completion = None {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] snapshot_name_template = snapshot-%s {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] snapshot_same_host = True {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] split_loggers = False {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] state_path = /opt/stack/data/cinder {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] storage_availability_zone = nova {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] storage_protocol = iSCSI {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] syslog_log_facility = LOG_USER {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] target_helper = lioadm {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] target_ip_address = 192.168.122.36 {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] target_port = 3260 {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] target_protocol = iscsi {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] target_secondary_ip_addresses = [] {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] trace_flags = None {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] transfer_api_class = cinder.transfer.api.API {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] transport_url = **** {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] until_refresh = 0 {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] use_chap_auth = False {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] use_default_quota_class = True {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] use_journal = False {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] use_json = False {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] use_multipath_for_image_xfer = False {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] use_stderr = False {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] use_syslog = False {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] verify_glance_signatures = enabled {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] volume_api_class = cinder.volume.api.API {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] volume_backend_name = None {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] volume_clear = zero {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] volume_clear_ionice = None {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] volume_clear_size = 0 {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] volume_copy_bps_limit = 0 {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] volume_dd_blocksize = 1M {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] volume_name_template = volume-%s {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] volume_service_inithost_offload = False {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] volume_usage_audit_period = month {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] zoning_mode = None {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] oslo_concurrency.disable_process_locking = False {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] keystone_authtoken.auth_section = None {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] keystone_authtoken.auth_type = password {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] keystone_authtoken.auth_version = None {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] keystone_authtoken.cache = None {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] keystone_authtoken.certfile = None {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] keystone_authtoken.delay_auth_decision = False {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] keystone_authtoken.http_connect_timeout = None {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] keystone_authtoken.include_service_catalog = True {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] keystone_authtoken.insecure = False {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] keystone_authtoken.interface = public {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] keystone_authtoken.keyfile = None {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] keystone_authtoken.memcache_password = {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] keystone_authtoken.memcache_username = {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] keystone_authtoken.region_name = None {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] keystone_authtoken.service_token_roles_required = True {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] keystone_authtoken.service_type = None {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] keystone_authtoken.token_cache_time = 300 {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.36/identity {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] cache.backend = dogpile.cache.null {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] cache.backend_argument = **** {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] cache.backend_expiration_time = None {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] cache.config_prefix = cache.oslo {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] cache.debug_cache_backend = False {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] cache.enable_retry_client = False {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] cache.enable_socket_keepalive = False {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] cache.enabled = False {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] cache.expiration_time = 600 {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] cache.hashclient_retry_attempts = 2 {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] cache.memcache_dead_retry = 300 {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] cache.memcache_pool_maxsize = 10 {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] cache.memcache_sasl_enabled = False {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] cache.password = **** {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] cache.proxies = [] {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] cache.redis_db = 0 {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77746]: INFO cinder.volume.manager [None req-ed35921b-f986-4c63-a230-dab9c0262393 None None] Starting volume driver LVMVolumeDriver (3.0.0) Aug 05 06:04:58 devstack cinder-volume[77746]: DEBUG oslo_concurrency.processutils [None req-ed35921b-f986-4c63-a230-dab9c0262393 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77746) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] cache.redis_sentinel_service_name = mymaster {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] cache.redis_server = localhost:6379 {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] cache.retry_attempts = 2 {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] cache.retry_delay = 0.0 {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] cache.socket_keepalive_count = 1 {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] cache.socket_keepalive_idle = 1 {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] cache.socket_keepalive_interval = 1 {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] cache.socket_timeout = 1.0 {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] cache.tls_allowed_ciphers = None {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] cache.tls_cafile = None {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] cache.tls_certfile = None {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] cache.tls_enabled = False {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] cache.tls_keyfile = None {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] cache.username = None {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] coordination.backend_url = **** {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] database.asyncio_connection = **** {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] database.asyncio_slave_connection = **** {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] database.backend = sqlalchemy {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] database.connection = **** {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] database.connection_debug = 0 {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] database.connection_parameters = {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] database.connection_recycle_time = 3600 {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] database.connection_trace = False {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] database.db_inc_retry_interval = True {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] database.db_max_retries = 20 {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] database.db_max_retry_interval = 10 {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] database.db_retry_interval = 1 {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] database.max_overflow = 50 {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] database.max_pool_size = 5 {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] database.max_retries = 10 {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] database.mysql_wsrep_sync_wait = None {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] database.pool_timeout = None {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] database.retry_interval = 10 {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] database.slave_connection = **** {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] database.sqlite_synchronous = True {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] database.synchronous_reader = True {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] database.use_db_reconnect = False {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] profiler.connection_string = messaging:// {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] profiler.enabled = False {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77746]: DEBUG oslo_concurrency.processutils [None req-ed35921b-f986-4c63-a230-dab9c0262393 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.048s {{(pid=77746) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] profiler.es_doc_type = notification {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] profiler.es_scroll_size = 10000 {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] profiler.es_scroll_time = 2m {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] profiler.filter_error_trace = False {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] profiler.hmac_keys = **** {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] profiler.sentinel_service_name = mymaster {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] profiler.socket_timeout = 0.1 {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] profiler.trace_requests = False {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] profiler.trace_sqlalchemy = False {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] profiler_jaeger.process_tags = {} {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] profiler_jaeger.service_name_prefix = None {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] profiler_otlp.service_name_prefix = None {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] oslo_policy.enforce_new_defaults = True {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] oslo_policy.policy_default_rule = default {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] oslo_policy.policy_file = policy.yaml {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] oslo_policy.remote_timeout = 60.0 {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] privsep_osbrick.group = None {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77746]: DEBUG oslo_concurrency.processutils [None req-ed35921b-f986-4c63-a230-dab9c0262393 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77746) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] privsep_osbrick.helper_command = None {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] privsep_osbrick.user = None {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] cinder_sys_admin.group = None {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] cinder_sys_admin.helper_command = None {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] cinder_sys_admin.user = None {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] service_user.auth_section = None {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] service_user.auth_type = password {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] service_user.cafile = None {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] service_user.certfile = None {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] service_user.collect_timing = False {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] service_user.insecure = False {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] service_user.keyfile = None {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] service_user.send_service_user_token = True {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] service_user.split_loggers = False {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] service_user.timeout = None {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] glance.auth_section = None {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] glance.auth_type = password {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] glance.certfile = None {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] glance.collect_timing = False {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] glance.insecure = False {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] glance.keyfile = None {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] glance.region_name = None {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] glance.split_loggers = False {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] glance.timeout = None {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] backend_defaults.backend_availability_zone = None {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] backend_defaults.chap_password = **** {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] backend_defaults.chap_username = {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] backend_defaults.disk_geometry = None {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] backend_defaults.driver_client_cert = None {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] backend_defaults.driver_client_cert_key = None {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] backend_defaults.driver_data_namespace = None {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] backend_defaults.driver_use_ssl = False {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] backend_defaults.enable_unsupported_driver = False {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] backend_defaults.extra_capabilities = {} {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] backend_defaults.filter_function = None {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] backend_defaults.goodness_function = None {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] backend_defaults.iscsi_target_flags = {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] backend_defaults.iscsi_write_cache = on {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] backend_defaults.iser_helper = tgtadm {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] backend_defaults.iser_ip_address = 192.168.122.36 {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] backend_defaults.iser_port = 3260 {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77746]: DEBUG oslo_concurrency.processutils [None req-ed35921b-f986-4c63-a230-dab9c0262393 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.055s {{(pid=77746) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] backend_defaults.lvm_mirrors = 0 {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] backend_defaults.lvm_share_target = False {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77746]: DEBUG oslo_concurrency.processutils [None req-ed35921b-f986-4c63-a230-dab9c0262393 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77746) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] backend_defaults.lvm_type = auto {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] backend_defaults.num_shell_tries = 3 {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] backend_defaults.nvmet_port_id = 1 {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] backend_defaults.replication_device = **** {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] backend_defaults.report_discard_supported = False {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] backend_defaults.reserved_percentage = 0 {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] backend_defaults.scst_target_driver = iscsi {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] backend_defaults.scst_target_iqn_name = None {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] backend_defaults.storage_protocol = iSCSI {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] backend_defaults.target_helper = tgtadm {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] backend_defaults.target_ip_address = 192.168.122.36 {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] backend_defaults.target_port = 3260 {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] backend_defaults.target_protocol = iscsi {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] backend_defaults.trace_flags = None {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] backend_defaults.unique_fqdn_network = True {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] backend_defaults.use_chap_auth = False {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] backend_defaults.volume_backend_name = None {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] backend_defaults.volume_clear = zero {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] backend_defaults.volume_clear_ionice = None {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] backend_defaults.volume_clear_size = 0 {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] backend_defaults.volume_group = cinder-volumes {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] oslo_reports.file_event_handler = None {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] oslo_reports.log_dir = None {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] lvmdriver-1.backend_availability_zone = None {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] lvmdriver-1.backend_host = None {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] lvmdriver-1.chap_password = **** {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] lvmdriver-1.chap_username = None {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] lvmdriver-1.chiscsi_conf = None {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] lvmdriver-1.disk_geometry = None {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] lvmdriver-1.driver_client_cert = None {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] lvmdriver-1.driver_data_namespace = None {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] lvmdriver-1.driver_use_ssl = None {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] lvmdriver-1.extra_capabilities = None {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] lvmdriver-1.filter_function = None {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] lvmdriver-1.goodness_function = None {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77746]: DEBUG oslo_concurrency.processutils [None req-ed35921b-f986-4c63-a230-dab9c0262393 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.048s {{(pid=77746) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] lvmdriver-1.iser_helper = None {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77746]: DEBUG oslo_concurrency.processutils [None req-ed35921b-f986-4c63-a230-dab9c0262393 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=77746) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] lvmdriver-1.iser_ip_address = None {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] lvmdriver-1.iser_port = None {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] lvmdriver-1.iser_target_prefix = None {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] lvmdriver-1.lvm_conf_file = None {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] lvmdriver-1.lvm_mirrors = None {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] lvmdriver-1.lvm_share_target = None {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] lvmdriver-1.lvm_type = auto {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] lvmdriver-1.num_shell_tries = None {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] lvmdriver-1.nvmet_port_id = None {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] lvmdriver-1.replication_device = **** {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] lvmdriver-1.report_discard_supported = None {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] lvmdriver-1.reserved_percentage = None {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] lvmdriver-1.scst_target_driver = None {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] lvmdriver-1.storage_protocol = None {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] lvmdriver-1.target_helper = lioadm {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] lvmdriver-1.target_ip_address = None {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] lvmdriver-1.target_port = 3260 {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] lvmdriver-1.target_protocol = iscsi {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] lvmdriver-1.trace_flags = None {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] lvmdriver-1.use_chap_auth = None {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] lvmdriver-1.volume_clear = zero {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] lvmdriver-1.volume_clear_size = None {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] lvmdriver-1.volumes_dir = None {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack sudo[77825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Aug 05 06:04:58 devstack sudo[77825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] oslo_messaging_rabbit.ssl = False {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] oslo_messaging_rabbit.ssl_version = {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] oslo_messaging_notifications.driver = [] {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] oslo_messaging_notifications.retry = -1 {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] oslo_messaging_notifications.transport_url = **** {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] key_manager.fixed_key = **** {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] barbican.barbican_api_version = None {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] barbican.barbican_endpoint = None {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] barbican.barbican_endpoint_type = public {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] barbican.barbican_region_name = None {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] barbican.cafile = None {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] barbican.certfile = None {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] barbican.collect_timing = False {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] barbican.insecure = False {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] barbican.keyfile = None {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] barbican.number_of_retries = 60 {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] barbican.retry_delay = 1 {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] barbican.send_service_user_token = False {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] barbican.split_loggers = False {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] barbican.timeout = None {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] barbican.verify_ssl = True {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] barbican.verify_ssl_path = None {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] barbican_service_user.auth_section = None {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] barbican_service_user.auth_type = None {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] barbican_service_user.cafile = None {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] barbican_service_user.certfile = None {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] barbican_service_user.collect_timing = False {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] barbican_service_user.insecure = False {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] barbican_service_user.keyfile = None {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] barbican_service_user.split_loggers = False {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] barbican_service_user.timeout = None {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] vault.approle_role_id = **** {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] vault.approle_secret_id = **** {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] vault.auth_method = approle {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] vault.auth_path = None {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] vault.kv_mountpoint = secret {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] vault.kv_path = None {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] vault.kv_version = 2 {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] vault.namespace = None {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] vault.root_token_id = **** {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] vault.ssl_ca_crt_file = None {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] vault.timeout = 60.0 {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] vault.token_file = None {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] vault.token_role = None {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] vault.use_ssl = False {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:04:58 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] ******************************************************************************** {{(pid=77596) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3552}} Aug 05 06:04:58 devstack sudo[77825]: pam_unix(sudo:session): session closed for user root Aug 05 06:04:58 devstack cinder-volume[77746]: DEBUG oslo_concurrency.processutils [None req-ed35921b-f986-4c63-a230-dab9c0262393 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.324s {{(pid=77746) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:04:58 devstack cinder-volume[77746]: DEBUG oslo_concurrency.processutils [None req-ed35921b-f986-4c63-a230-dab9c0262393 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77746) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:04:58 devstack sudo[77943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 05 06:04:58 devstack sudo[77943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:04:58 devstack sudo[77943]: pam_unix(sudo:session): session closed for user root Aug 05 06:04:58 devstack cinder-volume[77746]: DEBUG oslo_concurrency.processutils [None req-ed35921b-f986-4c63-a230-dab9c0262393 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.262s {{(pid=77746) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:04:58 devstack cinder-volume[77746]: DEBUG oslo_concurrency.processutils [None req-ed35921b-f986-4c63-a230-dab9c0262393 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=77746) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 05 06:04:58 devstack cinder-volume[77746]: INFO cinder.brick.local_dev.lvm [None req-ed35921b-f986-4c63-a230-dab9c0262393 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Aug 05 06:04:58 devstack cinder-volume[77746]: DEBUG oslo_concurrency.processutils [None req-ed35921b-f986-4c63-a230-dab9c0262393 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77746) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:04:58 devstack cinder-volume[77746]: DEBUG oslo_concurrency.processutils [None req-ed35921b-f986-4c63-a230-dab9c0262393 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.021s {{(pid=77746) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:04:58 devstack cinder-volume[77746]: DEBUG oslo_concurrency.processutils [None req-ed35921b-f986-4c63-a230-dab9c0262393 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77746) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:04:58 devstack sudo[78032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 05 06:04:58 devstack sudo[78032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:04:59 devstack sudo[78032]: pam_unix(sudo:session): session closed for user root Aug 05 06:04:59 devstack cinder-volume[77746]: DEBUG oslo_concurrency.processutils [None req-ed35921b-f986-4c63-a230-dab9c0262393 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.276s {{(pid=77746) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:04:59 devstack cinder-volume[77746]: DEBUG cinder.brick.local_dev.lvm [None req-ed35921b-f986-4c63-a230-dab9c0262393 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=77746) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Aug 05 06:04:59 devstack cinder-volume[77746]: DEBUG oslo_concurrency.processutils [None req-ed35921b-f986-4c63-a230-dab9c0262393 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77746) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:04:59 devstack sudo[78119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 05 06:04:59 devstack sudo[78119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:04:59 devstack sudo[78119]: pam_unix(sudo:session): session closed for user root Aug 05 06:04:59 devstack cinder-volume[77746]: DEBUG oslo_concurrency.processutils [None req-ed35921b-f986-4c63-a230-dab9c0262393 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.586s {{(pid=77746) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:04:59 devstack cinder-volume[77746]: DEBUG oslo_concurrency.processutils [None req-ed35921b-f986-4c63-a230-dab9c0262393 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77746) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:04:59 devstack cinder-volume[77746]: DEBUG oslo_concurrency.processutils [None req-ed35921b-f986-4c63-a230-dab9c0262393 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.046s {{(pid=77746) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:04:59 devstack cinder-volume[77746]: DEBUG oslo_concurrency.processutils [None req-ed35921b-f986-4c63-a230-dab9c0262393 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77746) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:04:59 devstack sudo[78356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 05 06:04:59 devstack sudo[78356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:05:00 devstack sudo[78356]: pam_unix(sudo:session): session closed for user root Aug 05 06:05:00 devstack cinder-volume[77746]: DEBUG oslo_concurrency.processutils [None req-ed35921b-f986-4c63-a230-dab9c0262393 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.269s {{(pid=77746) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:05:00 devstack cinder-volume[77746]: DEBUG oslo_concurrency.processutils [None req-ed35921b-f986-4c63-a230-dab9c0262393 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77746) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:05:00 devstack cinder-volume[77746]: DEBUG oslo_concurrency.processutils [None req-ed35921b-f986-4c63-a230-dab9c0262393 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.015s {{(pid=77746) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:05:00 devstack cinder-volume[77746]: DEBUG oslo_concurrency.processutils [None req-ed35921b-f986-4c63-a230-dab9c0262393 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=77746) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:05:00 devstack sudo[78360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Aug 05 06:05:00 devstack sudo[78360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:05:00 devstack sudo[78360]: pam_unix(sudo:session): session closed for user root Aug 05 06:05:00 devstack cinder-volume[77746]: DEBUG oslo_concurrency.processutils [None req-ed35921b-f986-4c63-a230-dab9c0262393 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.256s {{(pid=77746) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:05:00 devstack cinder-volume[77746]: DEBUG oslo_concurrency.processutils [None req-ed35921b-f986-4c63-a230-dab9c0262393 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77746) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:05:00 devstack sudo[78421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 05 06:05:00 devstack sudo[78421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:05:00 devstack sudo[78421]: pam_unix(sudo:session): session closed for user root Aug 05 06:05:00 devstack cinder-volume[77746]: DEBUG oslo_concurrency.processutils [None req-ed35921b-f986-4c63-a230-dab9c0262393 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.342s {{(pid=77746) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:05:00 devstack cinder-volume[77746]: DEBUG oslo_concurrency.processutils [None req-ed35921b-f986-4c63-a230-dab9c0262393 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77746) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:05:00 devstack sudo[78447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 05 06:05:00 devstack sudo[78447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:05:01 devstack sudo[78447]: pam_unix(sudo:session): session closed for user root Aug 05 06:05:01 devstack cinder-volume[77746]: DEBUG oslo_concurrency.processutils [None req-ed35921b-f986-4c63-a230-dab9c0262393 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.325s {{(pid=77746) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:05:01 devstack cinder-volume[77746]: DEBUG oslo_concurrency.processutils [None req-ed35921b-f986-4c63-a230-dab9c0262393 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77746) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:05:01 devstack sudo[78489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 05 06:05:01 devstack sudo[78489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:05:01 devstack sudo[78489]: pam_unix(sudo:session): session closed for user root Aug 05 06:05:01 devstack cinder-volume[77746]: DEBUG oslo_concurrency.processutils [None req-ed35921b-f986-4c63-a230-dab9c0262393 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.569s {{(pid=77746) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:05:01 devstack cinder-volume[77746]: DEBUG oslo_concurrency.processutils [None req-ed35921b-f986-4c63-a230-dab9c0262393 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77746) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:05:01 devstack sudo[78560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 05 06:05:01 devstack sudo[78560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:05:01 devstack sudo[78560]: pam_unix(sudo:session): session closed for user root Aug 05 06:05:01 devstack cinder-volume[77746]: DEBUG oslo_concurrency.processutils [None req-ed35921b-f986-4c63-a230-dab9c0262393 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.287s {{(pid=77746) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:05:01 devstack cinder-volume[77746]: DEBUG oslo_concurrency.processutils [None req-ed35921b-f986-4c63-a230-dab9c0262393 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77746) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:05:01 devstack cinder-volume[77746]: DEBUG oslo_concurrency.processutils [None req-ed35921b-f986-4c63-a230-dab9c0262393 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.024s {{(pid=77746) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:05:01 devstack cinder-volume[77746]: DEBUG oslo_concurrency.processutils [None req-ed35921b-f986-4c63-a230-dab9c0262393 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77746) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:05:01 devstack sudo[78567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 05 06:05:01 devstack sudo[78567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:05:02 devstack sudo[78567]: pam_unix(sudo:session): session closed for user root Aug 05 06:05:02 devstack cinder-volume[77746]: DEBUG oslo_concurrency.processutils [None req-ed35921b-f986-4c63-a230-dab9c0262393 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.301s {{(pid=77746) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:05:02 devstack cinder-volume[77746]: INFO cinder.volume.drivers.lvm [None req-ed35921b-f986-4c63-a230-dab9c0262393 None None] Enabling LVM thin provisioning by default because a thin pool exists. Aug 05 06:05:02 devstack cinder-volume[77746]: DEBUG oslo_concurrency.processutils [None req-ed35921b-f986-4c63-a230-dab9c0262393 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77746) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:05:02 devstack cinder-volume[77746]: DEBUG oslo_concurrency.processutils [None req-ed35921b-f986-4c63-a230-dab9c0262393 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=77746) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:05:02 devstack cinder-volume[77746]: DEBUG oslo_concurrency.processutils [None req-ed35921b-f986-4c63-a230-dab9c0262393 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77746) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:05:02 devstack sudo[78581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 05 06:05:02 devstack sudo[78581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:05:02 devstack sudo[78581]: pam_unix(sudo:session): session closed for user root Aug 05 06:05:02 devstack cinder-volume[77746]: DEBUG oslo_concurrency.processutils [None req-ed35921b-f986-4c63-a230-dab9c0262393 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.267s {{(pid=77746) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:05:02 devstack cinder-volume[77746]: DEBUG cinder.volume.drivers.lvm [None req-ed35921b-f986-4c63-a230-dab9c0262393 None None] Updating volume stats {{(pid=77746) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 05 06:05:02 devstack cinder-volume[77746]: DEBUG oslo_concurrency.processutils [None req-ed35921b-f986-4c63-a230-dab9c0262393 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77746) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:05:02 devstack sudo[78590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 05 06:05:02 devstack sudo[78590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:05:02 devstack sudo[78590]: pam_unix(sudo:session): session closed for user root Aug 05 06:05:02 devstack cinder-volume[77746]: DEBUG oslo_concurrency.processutils [None req-ed35921b-f986-4c63-a230-dab9c0262393 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.280s {{(pid=77746) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:05:02 devstack cinder-volume[77746]: DEBUG oslo_concurrency.processutils [None req-ed35921b-f986-4c63-a230-dab9c0262393 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77746) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:05:02 devstack sudo[78593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 05 06:05:02 devstack sudo[78593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:05:03 devstack sudo[78593]: pam_unix(sudo:session): session closed for user root Aug 05 06:05:03 devstack cinder-volume[77746]: DEBUG oslo_concurrency.processutils [None req-ed35921b-f986-4c63-a230-dab9c0262393 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.282s {{(pid=77746) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:05:03 devstack cinder-volume[77746]: DEBUG oslo_concurrency.processutils [None req-ed35921b-f986-4c63-a230-dab9c0262393 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77746) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:05:03 devstack sudo[78596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 05 06:05:03 devstack sudo[78596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:05:03 devstack sudo[78596]: pam_unix(sudo:session): session closed for user root Aug 05 06:05:03 devstack cinder-volume[77746]: DEBUG oslo_concurrency.processutils [None req-ed35921b-f986-4c63-a230-dab9c0262393 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.246s {{(pid=77746) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:05:03 devstack cinder-volume[77746]: DEBUG oslo_concurrency.processutils [None req-ed35921b-f986-4c63-a230-dab9c0262393 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77746) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:05:03 devstack sudo[78599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 05 06:05:03 devstack sudo[78599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:05:03 devstack sudo[78599]: pam_unix(sudo:session): session closed for user root Aug 05 06:05:03 devstack cinder-volume[77746]: DEBUG oslo_concurrency.processutils [None req-ed35921b-f986-4c63-a230-dab9c0262393 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.245s {{(pid=77746) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:05:03 devstack cinder-volume[77746]: INFO cinder.volume.driver [None req-ed35921b-f986-4c63-a230-dab9c0262393 None None] Driver hasn't implemented _init_vendor_properties() Aug 05 06:05:03 devstack cinder-volume[77746]: DEBUG cinder.volume.driver [None req-ed35921b-f986-4c63-a230-dab9c0262393 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=77746) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Aug 05 06:05:03 devstack cinder-volume[77746]: DEBUG oslo_db.sqlalchemy.engines [None req-ed35921b-f986-4c63-a230-dab9c0262393 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=77746) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 05 06:05:03 devstack cinder-volume[77746]: DEBUG dbcounter [-] [77746] Writer thread running {{(pid=77746) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 05 06:05:03 devstack cinder-volume[77746]: DEBUG cinder.db.api [None req-ed35921b-f986-4c63-a230-dab9c0262393 None None] Building query based on filter {{(pid=77746) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Aug 05 06:05:03 devstack cinder-volume[77746]: DEBUG cinder.image.image_utils [None req-ed35921b-f986-4c63-a230-dab9c0262393 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=77746) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Aug 05 06:05:03 devstack cinder-volume[77746]: INFO cinder.keymgr.migration [None req-3b648df8-52e6-485c-8975-87b8e2dc535b None None] Not migrating encryption keys because the ConfKeyManager is still in use. Aug 05 06:05:03 devstack cinder-volume[77746]: DEBUG cinder.volume.drivers.lvm [None req-ed35921b-f986-4c63-a230-dab9c0262393 None None] Updating volume stats {{(pid=77746) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 05 06:05:03 devstack cinder-volume[77746]: DEBUG oslo_concurrency.processutils [None req-ed35921b-f986-4c63-a230-dab9c0262393 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77746) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:05:03 devstack sudo[78604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 05 06:05:03 devstack sudo[78604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:05:04 devstack sudo[78604]: pam_unix(sudo:session): session closed for user root Aug 05 06:05:04 devstack cinder-volume[77746]: DEBUG oslo_concurrency.processutils [None req-ed35921b-f986-4c63-a230-dab9c0262393 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.262s {{(pid=77746) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:05:04 devstack cinder-volume[77746]: DEBUG oslo_concurrency.processutils [None req-ed35921b-f986-4c63-a230-dab9c0262393 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77746) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:05:04 devstack sudo[78608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 05 06:05:04 devstack sudo[78608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:05:04 devstack sudo[78608]: pam_unix(sudo:session): session closed for user root Aug 05 06:05:04 devstack cinder-volume[77746]: DEBUG oslo_concurrency.processutils [None req-ed35921b-f986-4c63-a230-dab9c0262393 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.248s {{(pid=77746) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:05:04 devstack cinder-volume[77746]: DEBUG oslo_concurrency.processutils [None req-ed35921b-f986-4c63-a230-dab9c0262393 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77746) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:05:04 devstack sudo[78611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 05 06:05:04 devstack sudo[78611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:05:04 devstack sudo[78611]: pam_unix(sudo:session): session closed for user root Aug 05 06:05:04 devstack cinder-volume[77746]: DEBUG oslo_concurrency.processutils [None req-ed35921b-f986-4c63-a230-dab9c0262393 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.256s {{(pid=77746) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:05:04 devstack cinder-volume[77746]: DEBUG oslo_concurrency.processutils [None req-ed35921b-f986-4c63-a230-dab9c0262393 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77746) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:05:04 devstack sudo[78615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 05 06:05:04 devstack sudo[78615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:05:04 devstack sudo[78615]: pam_unix(sudo:session): session closed for user root Aug 05 06:05:04 devstack cinder-volume[77746]: DEBUG oslo_concurrency.processutils [None req-ed35921b-f986-4c63-a230-dab9c0262393 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.275s {{(pid=77746) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:05:04 devstack cinder-volume[77746]: DEBUG cinder.manager [None req-ed35921b-f986-4c63-a230-dab9c0262393 None None] Notifying Schedulers of capabilities ... {{(pid=77746) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 06:05:04 devstack cinder-volume[77746]: INFO cinder.volume.manager [None req-ed35921b-f986-4c63-a230-dab9c0262393 None None] Driver initialization completed successfully. Aug 05 06:05:04 devstack cinder-volume[77746]: INFO cinder.manager [None req-ed35921b-f986-4c63-a230-dab9c0262393 None None] Initiating service 2 cleanup Aug 05 06:05:04 devstack cinder-volume[77746]: INFO cinder.manager [None req-ed35921b-f986-4c63-a230-dab9c0262393 None None] Service 2 cleanup completed. Aug 05 06:05:04 devstack cinder-volume[77746]: DEBUG cinder.service [None req-ed35921b-f986-4c63-a230-dab9c0262393 None None] Creating RPC server for service cinder-volume {{(pid=77746) start /opt/stack/cinder/cinder/service.py:231}} Aug 05 06:05:04 devstack cinder-volume[77746]: DEBUG cinder.service [None req-ed35921b-f986-4c63-a230-dab9c0262393 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=77746) start /opt/stack/cinder/cinder/service.py:237}} Aug 05 06:05:05 devstack cinder-volume[77746]: INFO cinder.volume.manager [None req-ed35921b-f986-4c63-a230-dab9c0262393 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Aug 05 06:05:05 devstack cinder-volume[77746]: DEBUG cinder.volume.drivers.lvm [None req-ed35921b-f986-4c63-a230-dab9c0262393 None None] Updating volume stats {{(pid=77746) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 05 06:05:05 devstack cinder-volume[77746]: DEBUG oslo_concurrency.processutils [None req-ed35921b-f986-4c63-a230-dab9c0262393 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77746) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:05:05 devstack sudo[78619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 05 06:05:05 devstack sudo[78619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:05:05 devstack sudo[78619]: pam_unix(sudo:session): session closed for user root Aug 05 06:05:05 devstack cinder-volume[77746]: DEBUG oslo_concurrency.processutils [None req-ed35921b-f986-4c63-a230-dab9c0262393 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.267s {{(pid=77746) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:05:05 devstack cinder-volume[77746]: DEBUG oslo_concurrency.processutils [None req-ed35921b-f986-4c63-a230-dab9c0262393 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77746) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:05:05 devstack sudo[78622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 05 06:05:05 devstack sudo[78622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:05:05 devstack sudo[78622]: pam_unix(sudo:session): session closed for user root Aug 05 06:05:05 devstack cinder-volume[77746]: DEBUG oslo_concurrency.processutils [None req-ed35921b-f986-4c63-a230-dab9c0262393 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.264s {{(pid=77746) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:05:05 devstack cinder-volume[77746]: DEBUG oslo_concurrency.processutils [None req-ed35921b-f986-4c63-a230-dab9c0262393 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77746) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:05:05 devstack sudo[78625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 05 06:05:05 devstack sudo[78625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:05:05 devstack sudo[78625]: pam_unix(sudo:session): session closed for user root Aug 05 06:05:05 devstack cinder-volume[77746]: DEBUG oslo_concurrency.processutils [None req-ed35921b-f986-4c63-a230-dab9c0262393 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.243s {{(pid=77746) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:05:05 devstack cinder-volume[77746]: DEBUG oslo_concurrency.processutils [None req-ed35921b-f986-4c63-a230-dab9c0262393 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77746) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:05:05 devstack sudo[78628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 05 06:05:05 devstack sudo[78628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:05:06 devstack sudo[78628]: pam_unix(sudo:session): session closed for user root Aug 05 06:05:06 devstack cinder-volume[77746]: DEBUG oslo_concurrency.processutils [None req-ed35921b-f986-4c63-a230-dab9c0262393 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.250s {{(pid=77746) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:05:06 devstack cinder-volume[77746]: INFO cinder.volume.manager [None req-ed35921b-f986-4c63-a230-dab9c0262393 None None] Driver post RPC initialization completed successfully. Aug 05 06:05:07 devstack cinder-volume[77596]: DEBUG dbcounter [-] [77596] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=77596) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 06:05:14 devstack cinder-volume[77746]: DEBUG dbcounter [-] [77746] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=77746) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 06:05:16 devstack cinder-volume[77746]: DEBUG dbcounter [-] [77746] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=77746) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 06:05:43 devstack cinder-volume[77746]: DEBUG oslo_service.periodic_task [None req-3e68c506-4272-4967-bfd7-3d44a8441e07 None None] Running periodic task VolumeManager._thread_info {{(pid=77746) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 06:05:43 devstack cinder-volume[77746]: DEBUG cinder.volume.manager [None req-3e68c506-4272-4967-bfd7-3d44a8441e07 None None] thread count: 6 {{(pid=77746) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 05 06:05:43 devstack cinder-volume[77746]: DEBUG cinder.volume.manager [None req-3e68c506-4272-4967-bfd7-3d44a8441e07 None None] thread info: [<_MainThread(MainThread, started 132031521796224)>, , , , , ] {{(pid=77746) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 05 06:06:43 devstack cinder-volume[77746]: DEBUG oslo_service.periodic_task [None req-3e68c506-4272-4967-bfd7-3d44a8441e07 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=77746) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 06:06:43 devstack cinder-volume[77746]: DEBUG cinder.volume.drivers.lvm [None req-3e68c506-4272-4967-bfd7-3d44a8441e07 None None] Updating volume stats {{(pid=77746) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 05 06:06:43 devstack cinder-volume[77746]: DEBUG oslo_concurrency.processutils [None req-3e68c506-4272-4967-bfd7-3d44a8441e07 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77746) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:06:43 devstack sudo[83850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 05 06:06:43 devstack sudo[83850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:06:43 devstack sudo[83850]: pam_unix(sudo:session): session closed for user root Aug 05 06:06:43 devstack cinder-volume[77746]: DEBUG oslo_concurrency.processutils [None req-3e68c506-4272-4967-bfd7-3d44a8441e07 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.267s {{(pid=77746) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:06:43 devstack cinder-volume[77746]: DEBUG oslo_concurrency.processutils [None req-3e68c506-4272-4967-bfd7-3d44a8441e07 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77746) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:06:43 devstack sudo[83853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 05 06:06:43 devstack sudo[83853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:06:43 devstack sudo[83853]: pam_unix(sudo:session): session closed for user root Aug 05 06:06:43 devstack cinder-volume[77746]: DEBUG oslo_concurrency.processutils [None req-3e68c506-4272-4967-bfd7-3d44a8441e07 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.255s {{(pid=77746) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:06:43 devstack cinder-volume[77746]: DEBUG oslo_concurrency.processutils [None req-3e68c506-4272-4967-bfd7-3d44a8441e07 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77746) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:06:43 devstack sudo[83856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 05 06:06:43 devstack sudo[83856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:06:43 devstack sudo[83856]: pam_unix(sudo:session): session closed for user root Aug 05 06:06:43 devstack cinder-volume[77746]: DEBUG oslo_concurrency.processutils [None req-3e68c506-4272-4967-bfd7-3d44a8441e07 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.265s {{(pid=77746) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:06:43 devstack cinder-volume[77746]: DEBUG oslo_concurrency.processutils [None req-3e68c506-4272-4967-bfd7-3d44a8441e07 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77746) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:06:43 devstack sudo[83859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 05 06:06:43 devstack sudo[83859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:06:44 devstack sudo[83859]: pam_unix(sudo:session): session closed for user root Aug 05 06:06:44 devstack cinder-volume[77746]: DEBUG oslo_concurrency.processutils [None req-3e68c506-4272-4967-bfd7-3d44a8441e07 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.267s {{(pid=77746) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:06:44 devstack cinder-volume[77746]: DEBUG cinder.manager [None req-3e68c506-4272-4967-bfd7-3d44a8441e07 None None] Notifying Schedulers of capabilities ... {{(pid=77746) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 06:06:44 devstack cinder-volume[77746]: DEBUG oslo_service.periodic_task [None req-3e68c506-4272-4967-bfd7-3d44a8441e07 None None] Running periodic task VolumeManager._thread_info {{(pid=77746) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 06:06:44 devstack cinder-volume[77746]: DEBUG cinder.volume.manager [None req-3e68c506-4272-4967-bfd7-3d44a8441e07 None None] thread count: 6 {{(pid=77746) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 05 06:06:44 devstack cinder-volume[77746]: DEBUG cinder.volume.manager [None req-3e68c506-4272-4967-bfd7-3d44a8441e07 None None] thread info: [<_MainThread(MainThread, started 132031521796224)>, , , , , ] {{(pid=77746) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 05 06:07:16 devstack cinder-volume[77746]: DEBUG dbcounter [-] [77746] Writing DB stats cinder:SELECT=1 {{(pid=77746) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 06:07:16 devstack cinder-volume[77746]: DEBUG dbcounter [-] [77746] Writing DB stats cinder:UPDATE=1 {{(pid=77746) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 06:07:43 devstack cinder-volume[77746]: DEBUG oslo_service.periodic_task [None req-3e68c506-4272-4967-bfd7-3d44a8441e07 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=77746) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 06:07:43 devstack cinder-volume[77746]: DEBUG cinder.volume.drivers.lvm [None req-3e68c506-4272-4967-bfd7-3d44a8441e07 None None] Updating volume stats {{(pid=77746) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 05 06:07:43 devstack cinder-volume[77746]: DEBUG oslo_concurrency.processutils [None req-3e68c506-4272-4967-bfd7-3d44a8441e07 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77746) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:07:43 devstack sudo[85422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 05 06:07:43 devstack sudo[85422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:07:43 devstack sudo[85422]: pam_unix(sudo:session): session closed for user root Aug 05 06:07:43 devstack cinder-volume[77746]: DEBUG oslo_concurrency.processutils [None req-3e68c506-4272-4967-bfd7-3d44a8441e07 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.269s {{(pid=77746) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:07:43 devstack cinder-volume[77746]: DEBUG oslo_concurrency.processutils [None req-3e68c506-4272-4967-bfd7-3d44a8441e07 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77746) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:07:43 devstack sudo[85458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 05 06:07:43 devstack sudo[85458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:07:43 devstack sudo[85458]: pam_unix(sudo:session): session closed for user root Aug 05 06:07:43 devstack cinder-volume[77746]: DEBUG oslo_concurrency.processutils [None req-3e68c506-4272-4967-bfd7-3d44a8441e07 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.262s {{(pid=77746) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:07:43 devstack cinder-volume[77746]: DEBUG oslo_concurrency.processutils [None req-3e68c506-4272-4967-bfd7-3d44a8441e07 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77746) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:07:43 devstack sudo[85463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 05 06:07:43 devstack sudo[85463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:07:43 devstack sudo[85463]: pam_unix(sudo:session): session closed for user root Aug 05 06:07:43 devstack cinder-volume[77746]: DEBUG oslo_concurrency.processutils [None req-3e68c506-4272-4967-bfd7-3d44a8441e07 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.293s {{(pid=77746) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:07:43 devstack cinder-volume[77746]: DEBUG oslo_concurrency.processutils [None req-3e68c506-4272-4967-bfd7-3d44a8441e07 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77746) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:07:43 devstack sudo[85466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 05 06:07:43 devstack sudo[85466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:07:44 devstack sudo[85466]: pam_unix(sudo:session): session closed for user root Aug 05 06:07:44 devstack cinder-volume[77746]: DEBUG oslo_concurrency.processutils [None req-3e68c506-4272-4967-bfd7-3d44a8441e07 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.273s {{(pid=77746) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:07:44 devstack cinder-volume[77746]: DEBUG cinder.manager [None req-3e68c506-4272-4967-bfd7-3d44a8441e07 None None] Notifying Schedulers of capabilities ... {{(pid=77746) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 06:07:44 devstack cinder-volume[77746]: DEBUG oslo_service.periodic_task [None req-3e68c506-4272-4967-bfd7-3d44a8441e07 None None] Running periodic task VolumeManager._thread_info {{(pid=77746) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 06:07:44 devstack cinder-volume[77746]: DEBUG cinder.volume.manager [None req-3e68c506-4272-4967-bfd7-3d44a8441e07 None None] thread count: 6 {{(pid=77746) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 05 06:07:44 devstack cinder-volume[77746]: DEBUG cinder.volume.manager [None req-3e68c506-4272-4967-bfd7-3d44a8441e07 None None] thread info: [<_MainThread(MainThread, started 132031521796224)>, , , , , ] {{(pid=77746) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 05 06:08:43 devstack cinder-volume[77746]: DEBUG oslo_service.periodic_task [None req-3e68c506-4272-4967-bfd7-3d44a8441e07 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=77746) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 06:08:43 devstack cinder-volume[77746]: DEBUG cinder.volume.drivers.lvm [None req-3e68c506-4272-4967-bfd7-3d44a8441e07 None None] Updating volume stats {{(pid=77746) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 05 06:08:43 devstack cinder-volume[77746]: DEBUG oslo_concurrency.processutils [None req-3e68c506-4272-4967-bfd7-3d44a8441e07 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77746) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:08:43 devstack sudo[86856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 05 06:08:43 devstack sudo[86856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:08:43 devstack sudo[86856]: pam_unix(sudo:session): session closed for user root Aug 05 06:08:43 devstack cinder-volume[77746]: DEBUG oslo_concurrency.processutils [None req-3e68c506-4272-4967-bfd7-3d44a8441e07 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.256s {{(pid=77746) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:08:43 devstack cinder-volume[77746]: DEBUG oslo_concurrency.processutils [None req-3e68c506-4272-4967-bfd7-3d44a8441e07 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77746) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:08:43 devstack sudo[86859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 05 06:08:43 devstack sudo[86859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:08:43 devstack sudo[86859]: pam_unix(sudo:session): session closed for user root Aug 05 06:08:43 devstack cinder-volume[77746]: DEBUG oslo_concurrency.processutils [None req-3e68c506-4272-4967-bfd7-3d44a8441e07 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.279s {{(pid=77746) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:08:43 devstack cinder-volume[77746]: DEBUG oslo_concurrency.processutils [None req-3e68c506-4272-4967-bfd7-3d44a8441e07 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77746) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:08:43 devstack sudo[86886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 05 06:08:43 devstack sudo[86886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:08:43 devstack sudo[86886]: pam_unix(sudo:session): session closed for user root Aug 05 06:08:43 devstack cinder-volume[77746]: DEBUG oslo_concurrency.processutils [None req-3e68c506-4272-4967-bfd7-3d44a8441e07 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.265s {{(pid=77746) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:08:43 devstack cinder-volume[77746]: DEBUG oslo_concurrency.processutils [None req-3e68c506-4272-4967-bfd7-3d44a8441e07 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77746) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:08:43 devstack sudo[86898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 05 06:08:43 devstack sudo[86898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:08:44 devstack sudo[86898]: pam_unix(sudo:session): session closed for user root Aug 05 06:08:44 devstack cinder-volume[77746]: DEBUG oslo_concurrency.processutils [None req-3e68c506-4272-4967-bfd7-3d44a8441e07 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.266s {{(pid=77746) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:08:44 devstack cinder-volume[77746]: DEBUG cinder.manager [None req-3e68c506-4272-4967-bfd7-3d44a8441e07 None None] Notifying Schedulers of capabilities ... {{(pid=77746) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 06:08:44 devstack cinder-volume[77746]: DEBUG oslo_service.periodic_task [None req-3e68c506-4272-4967-bfd7-3d44a8441e07 None None] Running periodic task VolumeManager._thread_info {{(pid=77746) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 06:08:44 devstack cinder-volume[77746]: DEBUG cinder.volume.manager [None req-3e68c506-4272-4967-bfd7-3d44a8441e07 None None] thread count: 6 {{(pid=77746) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 05 06:08:44 devstack cinder-volume[77746]: DEBUG cinder.volume.manager [None req-3e68c506-4272-4967-bfd7-3d44a8441e07 None None] thread info: [<_MainThread(MainThread, started 132031521796224)>, , , , , ] {{(pid=77746) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 05 06:09:16 devstack cinder-volume[77746]: DEBUG dbcounter [-] [77746] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=77746) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 06:09:26 devstack cinder-volume[77596]: INFO oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] Caught SIGTERM, stopping children Aug 05 06:09:26 devstack cinder-volume[77596]: DEBUG oslo_concurrency.lockutils [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] Acquiring lock "singleton_lock" {{(pid=77596) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 05 06:09:26 devstack cinder-volume[77596]: DEBUG oslo_concurrency.lockutils [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] Acquired lock "singleton_lock" {{(pid=77596) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 05 06:09:26 devstack cinder-volume[77596]: DEBUG oslo_concurrency.lockutils [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] Releasing lock "singleton_lock" {{(pid=77596) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 05 06:09:26 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] Stop services. {{(pid=77596) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Aug 05 06:09:26 devstack cinder-volume[77596]: DEBUG oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] Killing children. {{(pid=77596) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Aug 05 06:09:26 devstack cinder-volume[77596]: INFO oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] Waiting on 1 children to exit Aug 05 06:09:30 devstack cinder-volume[77746]: DEBUG oslo_concurrency.lockutils [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] Acquiring lock "singleton_lock" {{(pid=77746) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 05 06:09:30 devstack cinder-volume[77746]: DEBUG oslo_concurrency.lockutils [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] Acquired lock "singleton_lock" {{(pid=77746) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 05 06:09:30 devstack cinder-volume[77746]: DEBUG oslo_concurrency.lockutils [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] Releasing lock "singleton_lock" {{(pid=77746) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 05 06:09:30 devstack cinder-volume[77746]: WARNING amqp [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] Received method (60, 30) during closing channel 1. This method will be ignored Aug 05 06:09:30 devstack cinder-volume[77746]: WARNING amqp [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] Received method (60, 30) during closing channel 1. This method will be ignored Aug 05 06:09:30 devstack cinder-volume[77596]: INFO oslo_service.backend._eventlet.service [None req-df33e8aa-1404-4e28-a554-65ab98268845 None None] Child 77746 exited with status 0 Aug 05 06:09:30 devstack cinder-volume[87898]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Aug 05 06:09:30 devstack cinder-volume[87898]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Aug 05 06:09:30 devstack cinder-volume[87898]: we strongly recommend against using it for new projects. Aug 05 06:09:30 devstack cinder-volume[87898]: If you are already using Eventlet, we recommend migrating to a different Aug 05 06:09:30 devstack cinder-volume[87898]: framework. For more detail see Aug 05 06:09:30 devstack cinder-volume[87898]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Aug 05 06:09:30 devstack cinder-volume[87898]: import eventlet # noqa Aug 05 06:09:32 devstack cinder-volume[87898]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=87898) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 05 06:09:32 devstack cinder-volume[87898]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=87898) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 05 06:09:32 devstack cinder-volume[87898]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=87898) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 05 06:09:33 devstack cinder-volume[87898]: INFO dbcounter [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] Registered counter for database cinder Aug 05 06:09:33 devstack cinder-volume[87898]: DEBUG oslo_db.sqlalchemy.engines [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87898) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 05 06:09:33 devstack cinder-volume[87898]: DEBUG dbcounter [-] [87898] Writer thread running {{(pid=87898) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 05 06:09:33 devstack cinder-volume[87898]: INFO cinder.rpc [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Aug 05 06:09:33 devstack cinder-volume[87898]: INFO cinder.rpc [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Aug 05 06:09:33 devstack cinder-volume[87898]: DEBUG oslo_db.sqlalchemy.engines [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87898) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 05 06:09:33 devstack cinder-volume[87898]: INFO cinder.volume.manager [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] Determined volume DB was empty at startup. Aug 05 06:09:33 devstack cinder-volume[87898]: DEBUG cinder.volume.manager [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] Cinder Volume DB check: vol_db_empty=True {{(pid=87898) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Aug 05 06:09:33 devstack cinder-volume[87898]: INFO cinder.volume.manager [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] Service not found for updating active_backend_id, assuming default for driver init. Aug 05 06:09:33 devstack cinder-volume[87898]: WARNING stevedore.named [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Aug 05 06:09:33 devstack cinder-volume[87898]: WARNING castellan.key_manager [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 05 06:09:33 devstack cinder-volume[87898]: WARNING cinder.keymgr.conf_key_mgr [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 05 06:09:33 devstack cinder-volume[87898]: INFO cinder.volume.manager [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] Image-volume cache disabled for host devstack@QuobyteHD. Aug 05 06:09:33 devstack cinder-volume[87898]: DEBUG oslo_db.sqlalchemy.engines [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87898) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 05 06:09:34 devstack cinder-volume[87898]: INFO oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] Starting 1 workers Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] Started child 88114 {{(pid=87898) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] Full set of CONF: {{(pid=87898) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] ******************************************************************************** {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3518}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] Configuration options gathered from: {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3519}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3520}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3521}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] ================================================================================ {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3526}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] allow_availability_zone_fallback = False {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] allow_compression_on_image_upload = False {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] allowed_direct_url_schemes = [] {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] api_rate_limit = True {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] auth_strategy = keystone {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] backend_availability_zone = None {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:34 devstack cinder-volume[88114]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] backend_host = None {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] backend_name = None {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] backend_stats_polling_interval = 60 {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] backup_api_class = cinder.backup.api.API {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] backup_name_template = backup-%s {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] backup_use_same_host = False {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] backup_use_temp_snapshot = False {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] chap_password = **** {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] chap_username = {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] cinder_internal_tenant_project_id = 09e694c4172e42d0a131fac439e6bddb {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] cinder_internal_tenant_user_id = aee7c84432484698b925b0cc683db29c {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] cluster = None {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] compression_format = gzip {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] compute_api_class = cinder.compute.nova.API {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] config_dir = [] {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] config_source = [] {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] control_exchange = openstack {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] debug = True {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] default_availability_zone = None {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] default_group_type = None {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] default_volume_type = QuobyteHD {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] disk_geometry = None {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] driver_client_cert = None {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] driver_client_cert_key = None {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] driver_data_namespace = None {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] driver_ssl_cert_path = None {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] driver_ssl_cert_verify = False {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] driver_use_ssl = False {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] enable_new_services = True {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] enable_unsupported_driver = False {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] enabled_backends = ['QuobyteHD'] {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] enforce_multipath_for_image_xfer = False {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] filter_function = None {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] glance_api_insecure = False {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] glance_api_servers = ['http://192.168.122.36/image'] {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] glance_api_ssl_compression = False {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] glance_ca_certificates_file = None {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] glance_catalog_info = image:glance:publicURL {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] glance_certfile = None {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] glance_keyfile = None {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] glance_num_retries = 3 {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] glance_request_timeout = None {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] goodness_function = None {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] graceful_shutdown_timeout = 5 {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] group_api_class = cinder.group.api.API {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] host = devstack {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] image_compress_on_upload = True {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] image_conversion_address_space_limit = 1 {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] image_conversion_cpu_limit = 60 {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] image_conversion_disable = False {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] image_upload_use_cinder_backend = False {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] image_upload_use_internal_tenant = False {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] image_volume_cache_enabled = False {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] image_volume_cache_max_count = 0 {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] image_volume_cache_max_size_gb = 0 {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] init_host_max_objects_retrieval = 0 {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] instance_format = [instance: %(uuid)s] {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] iscsi_target_flags = {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] iscsi_write_cache = on {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] iser_helper = tgtadm {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] iser_ip_address = 192.168.122.36 {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] iser_port = 3260 {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] log_color = False {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] log_config_append = None {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] log_dir = None {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] log_file = None {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] log_options = True {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] log_rotate_interval = 1 {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] log_rotate_interval_type = days {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] log_rotation_type = none {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] max_age = 0 {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] max_logfile_count = 30 {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] max_logfile_size_mb = 200 {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] max_over_subscription_ratio = 20.0 {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] message_reap_interval = 86400 {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:34 devstack cinder-volume[88114]: INFO cinder.volume.manager [None req-8518e94a-cb82-411d-a86f-357ebf4f616d None None] Starting volume driver QuobyteDriver (1.2) Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] message_ttl = 2592000 {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] migration_create_volume_timeout_secs = 300 {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] monkey_patch = False {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] monkey_patch_modules = [] {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] my_ip = 192.168.122.36 {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] no_snapshot_gb_quota = False {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] num_iser_scan_tries = 3 {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:34 devstack cinder-volume[88114]: DEBUG cinder.volume.drivers.remotefs [None req-8518e94a-cb82-411d-a86f-357ebf4f616d None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=88114) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] num_shell_tries = 3 {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] num_volume_device_scan_tries = 3 {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] nvmeof_conn_info_version = 1 {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] nvmet_ns_id = 10 {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] nvmet_port_id = 1 {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] osapi_max_limit = 1000 {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] osapi_volume_ext_list = [] {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] osapi_volume_listen = 0.0.0.0 {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] osapi_volume_listen_port = 8776 {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] osapi_volume_use_ssl = False {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] osapi_volume_workers = None {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] per_volume_size_limit = -1 {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] periodic_fuzzy_delay = 60 {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] periodic_interval = 60 {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] project_id_regex = [0-9a-f\-]+ {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] public_endpoint = None {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] publish_errors = False {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] quota_backup_gigabytes = 1000 {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] quota_backups = 10 {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] quota_gigabytes = 1000 {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] quota_groups = 10 {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] quota_snapshots = 10 {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] quota_volumes = 10 {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] rate_limit_burst = 0 {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] rate_limit_except_level = CRITICAL {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] rate_limit_interval = 0 {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] reinit_driver_count = 3 {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] replication_device = **** {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] report_discard_supported = False {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] report_interval = 120 {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] reservation_clean_interval = 86400 {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] reservation_expire = 86400 {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] reserved_image_namespaces = [] {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] reserved_percentage = 0 {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] rpc_response_timeout = 120 {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] run_external_periodic_tasks = True {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] scst_target_driver = iscsi {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] scst_target_iqn_name = None {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] service_down_time = 720 {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] shell_completion = None {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] snapshot_name_template = snapshot-%s {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] split_loggers = False {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] state_path = /opt/stack/data/cinder {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] storage_availability_zone = nova {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] storage_protocol = iSCSI {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] syslog_log_facility = LOG_USER {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] target_helper = lioadm {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] target_ip_address = 192.168.122.36 {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] target_port = 3260 {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] target_protocol = iscsi {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] target_secondary_ip_addresses = [] {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] trace_flags = None {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] transfer_api_class = cinder.transfer.api.API {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] transport_url = **** {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] until_refresh = 0 {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] use_chap_auth = False {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] use_default_quota_class = True {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] use_journal = False {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] use_json = False {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] use_multipath_for_image_xfer = False {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] use_stderr = False {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] use_syslog = False {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] verify_glance_signatures = enabled {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] volume_api_class = cinder.volume.api.API {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] volume_backend_name = None {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] volume_clear = zero {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] volume_clear_ionice = None {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] volume_clear_size = 0 {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] volume_copy_bps_limit = 0 {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] volume_dd_blocksize = 1M {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] volume_name_template = volume-%s {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] volume_service_inithost_offload = False {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] volume_usage_audit_period = month {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] zoning_mode = None {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] oslo_concurrency.disable_process_locking = False {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] os_brick.lightos_discovery_client_address = localhost {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] os_brick.wait_mpath_device_interval = 1 {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] keystone_authtoken.auth_section = None {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] keystone_authtoken.auth_type = password {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] keystone_authtoken.auth_version = None {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] keystone_authtoken.cache = None {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] keystone_authtoken.certfile = None {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] keystone_authtoken.delay_auth_decision = False {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] keystone_authtoken.http_connect_timeout = None {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] keystone_authtoken.include_service_catalog = True {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] keystone_authtoken.insecure = False {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[88114]: DEBUG cinder.volume.drivers.quobyte [None req-8518e94a-cb82-411d-a86f-357ebf4f616d None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=88114) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:307}} Aug 05 06:09:34 devstack cinder-volume[88114]: WARNING cinder.volume.drivers.quobyte [None req-8518e94a-cb82-411d-a86f-357ebf4f616d None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Aug 05 06:09:34 devstack cinder-volume[88114]: WARNING cinder.volume.drivers.quobyte [None req-8518e94a-cb82-411d-a86f-357ebf4f616d None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Aug 05 06:09:34 devstack cinder-volume[88114]: DEBUG oslo_concurrency.processutils [None req-8518e94a-cb82-411d-a86f-357ebf4f616d None None] Running cmd (subprocess): mount.quobyte {{(pid=88114) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] keystone_authtoken.interface = public {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] keystone_authtoken.keyfile = None {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] keystone_authtoken.memcache_password = {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] keystone_authtoken.memcache_secret_key = **** {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] keystone_authtoken.memcache_security_strategy = None {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] keystone_authtoken.memcache_username = {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] keystone_authtoken.region_name = None {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] keystone_authtoken.service_token_roles_required = True {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] keystone_authtoken.service_type = None {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] keystone_authtoken.token_cache_time = 300 {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.36/identity {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] cache.backend = dogpile.cache.null {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] cache.backend_argument = **** {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] cache.backend_expiration_time = None {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] cache.config_prefix = cache.oslo {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] cache.debug_cache_backend = False {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] cache.enable_retry_client = False {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] cache.enable_socket_keepalive = False {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] cache.enabled = False {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] cache.expiration_time = 600 {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] cache.hashclient_dead_timeout = 60.0 {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] cache.hashclient_retry_attempts = 2 {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] cache.hashclient_retry_timeout = 1.0 {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] cache.memcache_dead_retry = 300 {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] cache.memcache_pool_maxsize = 10 {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] cache.memcache_pool_unused_timeout = 60 {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] cache.memcache_sasl_enabled = False {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] cache.memcache_servers = ['localhost:11211'] {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] cache.password = **** {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] cache.proxies = [] {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] cache.redis_db = 0 {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] cache.redis_sentinel_service_name = mymaster {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] cache.redis_server = localhost:6379 {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] cache.retry_attempts = 2 {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] cache.retry_delay = 0.0 {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] cache.socket_keepalive_count = 1 {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] cache.socket_keepalive_idle = 1 {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] cache.socket_keepalive_interval = 1 {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] cache.socket_timeout = 1.0 {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] cache.tls_allowed_ciphers = None {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] cache.tls_cafile = None {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] cache.tls_certfile = None {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] cache.tls_enabled = False {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] cache.tls_keyfile = None {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] cache.username = None {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] coordination.backend_url = **** {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] database.asyncio_connection = **** {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] database.asyncio_slave_connection = **** {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] database.backend = sqlalchemy {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] database.connection = **** {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] database.connection_debug = 0 {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] database.connection_parameters = {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] database.connection_recycle_time = 3600 {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] database.connection_trace = False {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] database.db_inc_retry_interval = True {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] database.db_max_retries = 20 {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] database.db_max_retry_interval = 10 {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] database.db_retry_interval = 1 {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] database.max_overflow = 50 {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] database.max_pool_size = 5 {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] database.max_retries = 10 {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] database.mysql_sql_mode = TRADITIONAL {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] database.mysql_wsrep_sync_wait = None {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] database.pool_timeout = None {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] database.retry_interval = 10 {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] database.slave_connection = **** {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] database.sqlite_synchronous = True {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] database.synchronous_reader = True {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] database.use_db_reconnect = False {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] oslo_messaging_metrics.metrics_process_name = {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] profiler.connection_string = messaging:// {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] profiler.enabled = False {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] profiler.es_doc_type = notification {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] profiler.es_scroll_size = 10000 {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] profiler.es_scroll_time = 2m {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] profiler.filter_error_trace = False {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] profiler.hmac_keys = **** {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] profiler.sentinel_service_name = mymaster {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] profiler.socket_timeout = 0.1 {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] profiler.trace_requests = False {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] profiler.trace_sqlalchemy = False {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] profiler_jaeger.process_tags = {} {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] profiler_jaeger.service_name_prefix = None {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] profiler_otlp.service_name_prefix = None {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] oslo_policy.enforce_new_defaults = True {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] oslo_policy.policy_default_rule = default {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] oslo_policy.policy_file = policy.yaml {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] oslo_policy.remote_timeout = 60.0 {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] privsep_osbrick.capabilities = [21, 2] {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] privsep_osbrick.group = None {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] privsep_osbrick.helper_command = None {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] privsep_osbrick.log_daemon_traceback = False {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] privsep_osbrick.thread_pool_size = 4 {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] privsep_osbrick.user = None {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] cinder_sys_admin.group = None {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] cinder_sys_admin.helper_command = None {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] cinder_sys_admin.user = None {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] service_user.auth_section = None {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] service_user.auth_type = password {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] service_user.cafile = None {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] service_user.certfile = None {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] service_user.collect_timing = False {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] service_user.insecure = False {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] service_user.keyfile = None {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] service_user.send_service_user_token = True {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] service_user.split_loggers = False {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] service_user.timeout = None {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] glance.auth_section = None {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] glance.auth_type = password {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] glance.certfile = None {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] glance.collect_timing = False {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] glance.insecure = False {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] glance.keyfile = None {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] glance.region_name = None {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] glance.split_loggers = False {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] glance.timeout = None {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] backend_defaults.backend_availability_zone = None {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] backend_defaults.chap_password = **** {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] backend_defaults.chap_username = {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] backend_defaults.disk_geometry = None {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] backend_defaults.driver_client_cert = None {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] backend_defaults.driver_client_cert_key = None {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] backend_defaults.driver_data_namespace = None {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] backend_defaults.driver_ssl_cert_path = None {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] backend_defaults.driver_use_ssl = False {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] backend_defaults.enable_unsupported_driver = False {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] backend_defaults.extra_capabilities = {} {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] backend_defaults.filter_function = None {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] backend_defaults.goodness_function = None {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] backend_defaults.image_volume_cache_enabled = False {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] backend_defaults.iscsi_target_flags = {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] backend_defaults.iscsi_write_cache = on {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] backend_defaults.iser_helper = tgtadm {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] backend_defaults.iser_ip_address = 192.168.122.36 {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] backend_defaults.iser_port = 3260 {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] backend_defaults.nas_host = {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] backend_defaults.nas_login = admin {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] backend_defaults.nas_mount_options = None {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] backend_defaults.nas_password = **** {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] backend_defaults.nas_private_key = {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] backend_defaults.nas_secure_file_operations = auto {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] backend_defaults.nas_share_path = {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] backend_defaults.nas_ssh_port = 22 {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] backend_defaults.nas_volume_prov_type = thin {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] backend_defaults.num_shell_tries = 3 {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] backend_defaults.nvmet_ns_id = 10 {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] backend_defaults.nvmet_port_id = 1 {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] backend_defaults.quobyte_client_cfg = None {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] backend_defaults.quobyte_volume_url = None {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] backend_defaults.replication_device = **** {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] backend_defaults.report_discard_supported = False {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] backend_defaults.reserved_percentage = 0 {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] backend_defaults.scst_target_driver = iscsi {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] backend_defaults.scst_target_iqn_name = None {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] backend_defaults.storage_protocol = iSCSI {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] backend_defaults.target_helper = tgtadm {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] backend_defaults.target_ip_address = 192.168.122.36 {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] backend_defaults.target_port = 3260 {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] backend_defaults.target_protocol = iscsi {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] backend_defaults.trace_flags = None {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] backend_defaults.unique_fqdn_network = True {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] backend_defaults.use_chap_auth = False {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] backend_defaults.volume_backend_name = None {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] backend_defaults.volume_clear = zero {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] backend_defaults.volume_clear_ionice = None {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] backend_defaults.volume_clear_size = 0 {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] oslo_reports.file_event_handler = None {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] oslo_reports.file_event_handler_interval = 1 {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] oslo_reports.log_dir = None {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] QuobyteHD.backend_availability_zone = None {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] QuobyteHD.backend_host = None {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] QuobyteHD.chap_password = **** {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] QuobyteHD.chap_username = None {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] QuobyteHD.chiscsi_conf = None {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] QuobyteHD.disk_geometry = None {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] QuobyteHD.driver_client_cert = None {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] QuobyteHD.driver_client_cert_key = None {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] QuobyteHD.driver_data_namespace = None {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] QuobyteHD.driver_use_ssl = None {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] QuobyteHD.enable_unsupported_driver = True {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] QuobyteHD.extra_capabilities = None {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] QuobyteHD.filter_function = None {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] QuobyteHD.goodness_function = None {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] QuobyteHD.iscsi_target_flags = None {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] QuobyteHD.iscsi_write_cache = None {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] QuobyteHD.iser_helper = None {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] QuobyteHD.iser_ip_address = None {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] QuobyteHD.iser_port = None {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] QuobyteHD.iser_target_prefix = None {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] QuobyteHD.nas_host = None {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] QuobyteHD.nas_login = None {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] QuobyteHD.nas_mount_options = None {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] QuobyteHD.nas_password = **** {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] QuobyteHD.nas_private_key = None {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] QuobyteHD.nas_secure_file_operations = false {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] QuobyteHD.nas_share_path = None {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] QuobyteHD.nas_ssh_port = None {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] QuobyteHD.nas_volume_prov_type = None {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] QuobyteHD.num_iser_scan_tries = None {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] QuobyteHD.num_shell_tries = None {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack quobyte-client[88119]: Reading configuration file: /etc/quobyte/client.cfg Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] QuobyteHD.nvmet_ns_id = None {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] QuobyteHD.nvmet_port_id = None {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack quobyte-client[88119]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] QuobyteHD.replication_device = **** {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] QuobyteHD.report_discard_supported = None {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] QuobyteHD.reserved_percentage = None {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] QuobyteHD.scst_target_driver = None {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] QuobyteHD.scst_target_iqn_name = None {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] QuobyteHD.storage_protocol = None {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] QuobyteHD.target_helper = None {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] QuobyteHD.target_ip_address = None {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[88114]: DEBUG oslo_concurrency.processutils [None req-8518e94a-cb82-411d-a86f-357ebf4f616d None None] CMD "mount.quobyte" returned: 1 in 0.114s {{(pid=88114) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] QuobyteHD.target_port = None {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] QuobyteHD.target_prefix = None {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[88114]: DEBUG oslo_concurrency.lockutils [None req-8518e94a-cb82-411d-a86f-357ebf4f616d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88114) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] QuobyteHD.target_protocol = None {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[88114]: DEBUG oslo_concurrency.lockutils [None req-8518e94a-cb82-411d-a86f-357ebf4f616d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88114) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] QuobyteHD.trace_flags = None {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] QuobyteHD.unique_fqdn_network = None {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] QuobyteHD.use_chap_auth = None {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[88114]: DEBUG cinder.volume.drivers.quobyte [None req-8518e94a-cb82-411d-a86f-357ebf4f616d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] QuobyteHD.volume_clear = None {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] QuobyteHD.volume_clear_ionice = None {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[88114]: INFO cinder.volume.drivers.quobyte [None req-8518e94a-cb82-411d-a86f-357ebf4f616d None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 ... Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] QuobyteHD.volume_clear_size = None {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[88114]: DEBUG oslo_concurrency.processutils [None req-8518e94a-cb82-411d-a86f-357ebf4f616d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce -c /etc/quobyte/client-cinder.cfg {{(pid=88114) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] QuobyteHD.volume_dd_blocksize = None {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] QuobyteHD.volumes_dir = None {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] oslo_messaging_rabbit.hostname = devstack {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] oslo_messaging_rabbit.ssl = False {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] oslo_messaging_rabbit.ssl_version = {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] oslo_messaging_notifications.driver = [] {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] oslo_messaging_notifications.retry = -1 {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] oslo_messaging_notifications.transport_url = **** {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] key_manager.fixed_key = **** {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] barbican.barbican_api_version = None {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] barbican.barbican_endpoint = None {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] barbican.barbican_endpoint_type = public {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] barbican.barbican_region_name = None {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] barbican.cafile = None {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] barbican.certfile = None {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] barbican.collect_timing = False {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] barbican.insecure = False {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] barbican.keyfile = None {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] barbican.number_of_retries = 60 {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] barbican.retry_delay = 1 {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] barbican.send_service_user_token = False {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] barbican.split_loggers = False {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] barbican.timeout = None {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] barbican.verify_ssl = True {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] barbican.verify_ssl_path = None {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] barbican_service_user.auth_section = None {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] barbican_service_user.auth_type = None {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] barbican_service_user.cafile = None {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] barbican_service_user.certfile = None {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] barbican_service_user.collect_timing = False {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] barbican_service_user.insecure = False {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] barbican_service_user.keyfile = None {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] barbican_service_user.split_loggers = False {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] barbican_service_user.timeout = None {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] vault.approle_role_id = **** {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] vault.approle_secret_id = **** {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] vault.auth_method = approle {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] vault.auth_path = None {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] vault.kv_mountpoint = secret {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] vault.kv_path = None {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] vault.kv_version = 2 {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] vault.namespace = None {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] vault.root_token_id = **** {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] vault.ssl_ca_crt_file = None {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] vault.timeout = 60.0 {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] vault.token_file = None {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] vault.token_role = None {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] vault.use_ssl = False {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:34 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] ******************************************************************************** {{(pid=87898) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3552}} Aug 05 06:09:34 devstack sudo[88120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce -c /etc/quobyte/client-cinder.cfg Aug 05 06:09:34 devstack sudo[88120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:09:34 devstack sudo[88120]: pam_unix(sudo:session): session closed for user root Aug 05 06:09:34 devstack cinder-volume[88114]: DEBUG oslo_concurrency.processutils [None req-8518e94a-cb82-411d-a86f-357ebf4f616d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.413s {{(pid=88114) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:09:34 devstack cinder-volume[88114]: INFO cinder.volume.drivers.quobyte [None req-8518e94a-cb82-411d-a86f-357ebf4f616d None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 succeeded Aug 05 06:09:34 devstack cinder-volume[88114]: DEBUG cinder.volume.drivers.quobyte [None req-8518e94a-cb82-411d-a86f-357ebf4f616d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:09:34 devstack cinder-volume[88114]: DEBUG oslo_concurrency.lockutils [None req-8518e94a-cb82-411d-a86f-357ebf4f616d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.429s {{(pid=88114) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:09:34 devstack cinder-volume[88114]: DEBUG oslo_concurrency.processutils [None req-8518e94a-cb82-411d-a86f-357ebf4f616d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce {{(pid=88114) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:09:34 devstack sudo[88189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce Aug 05 06:09:34 devstack sudo[88189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:09:34 devstack sudo[88189]: pam_unix(sudo:session): session closed for user root Aug 05 06:09:34 devstack cinder-volume[88114]: DEBUG oslo_concurrency.processutils [None req-8518e94a-cb82-411d-a86f-357ebf4f616d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce" returned: 0 in 0.239s {{(pid=88114) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:09:34 devstack cinder-volume[88114]: INFO cinder.volume.driver [None req-8518e94a-cb82-411d-a86f-357ebf4f616d None None] Driver hasn't implemented _init_vendor_properties() Aug 05 06:09:34 devstack cinder-volume[88114]: DEBUG cinder.volume.driver [None req-8518e94a-cb82-411d-a86f-357ebf4f616d None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.743049621582, 'free_capacity_gb': 1775.743049621582, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=88114) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Aug 05 06:09:35 devstack cinder-volume[88114]: DEBUG oslo_db.sqlalchemy.engines [None req-8518e94a-cb82-411d-a86f-357ebf4f616d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88114) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 05 06:09:35 devstack cinder-volume[88114]: DEBUG dbcounter [-] [88114] Writer thread running {{(pid=88114) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 05 06:09:35 devstack cinder-volume[88114]: DEBUG cinder.db.api [None req-8518e94a-cb82-411d-a86f-357ebf4f616d None None] Building query based on filter {{(pid=88114) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Aug 05 06:09:35 devstack cinder-volume[88114]: DEBUG cinder.image.image_utils [None req-8518e94a-cb82-411d-a86f-357ebf4f616d None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=88114) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Aug 05 06:09:35 devstack cinder-volume[88114]: INFO cinder.keymgr.migration [None req-87c32bc7-e971-4d62-a6ae-d404058db134 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Aug 05 06:09:35 devstack cinder-volume[88114]: DEBUG oslo_concurrency.lockutils [None req-8518e94a-cb82-411d-a86f-357ebf4f616d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88114) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:09:35 devstack cinder-volume[88114]: DEBUG oslo_concurrency.lockutils [None req-8518e94a-cb82-411d-a86f-357ebf4f616d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88114) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:09:35 devstack cinder-volume[88114]: DEBUG cinder.volume.drivers.quobyte [None req-8518e94a-cb82-411d-a86f-357ebf4f616d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:09:35 devstack cinder-volume[88114]: DEBUG cinder.volume.drivers.quobyte [None req-8518e94a-cb82-411d-a86f-357ebf4f616d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:09:35 devstack cinder-volume[88114]: DEBUG oslo_concurrency.lockutils [None req-8518e94a-cb82-411d-a86f-357ebf4f616d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88114) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:09:35 devstack cinder-volume[88114]: DEBUG oslo_concurrency.processutils [None req-8518e94a-cb82-411d-a86f-357ebf4f616d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce {{(pid=88114) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:09:35 devstack sudo[88192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce Aug 05 06:09:35 devstack sudo[88192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:09:35 devstack sudo[88192]: pam_unix(sudo:session): session closed for user root Aug 05 06:09:35 devstack cinder-volume[88114]: DEBUG oslo_concurrency.processutils [None req-8518e94a-cb82-411d-a86f-357ebf4f616d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce" returned: 0 in 0.238s {{(pid=88114) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:09:35 devstack cinder-volume[88114]: DEBUG cinder.manager [None req-8518e94a-cb82-411d-a86f-357ebf4f616d None None] Notifying Schedulers of capabilities ... {{(pid=88114) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 06:09:35 devstack cinder-volume[88114]: INFO cinder.volume.manager [None req-8518e94a-cb82-411d-a86f-357ebf4f616d None None] Driver initialization completed successfully. Aug 05 06:09:35 devstack cinder-volume[88114]: INFO cinder.manager [None req-8518e94a-cb82-411d-a86f-357ebf4f616d None None] Initiating service 3 cleanup Aug 05 06:09:35 devstack cinder-volume[88114]: INFO cinder.manager [None req-8518e94a-cb82-411d-a86f-357ebf4f616d None None] Service 3 cleanup completed. Aug 05 06:09:35 devstack cinder-volume[88114]: DEBUG cinder.service [None req-8518e94a-cb82-411d-a86f-357ebf4f616d None None] Creating RPC server for service cinder-volume {{(pid=88114) start /opt/stack/cinder/cinder/service.py:231}} Aug 05 06:09:35 devstack cinder-volume[88114]: DEBUG cinder.service [None req-8518e94a-cb82-411d-a86f-357ebf4f616d None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=88114) start /opt/stack/cinder/cinder/service.py:237}} Aug 05 06:09:35 devstack cinder-volume[88114]: INFO cinder.volume.manager [None req-8518e94a-cb82-411d-a86f-357ebf4f616d None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2) Aug 05 06:09:35 devstack cinder-volume[88114]: DEBUG oslo_concurrency.lockutils [None req-8518e94a-cb82-411d-a86f-357ebf4f616d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88114) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:09:35 devstack cinder-volume[88114]: DEBUG oslo_concurrency.lockutils [None req-8518e94a-cb82-411d-a86f-357ebf4f616d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88114) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:09:35 devstack cinder-volume[88114]: DEBUG cinder.volume.drivers.quobyte [None req-8518e94a-cb82-411d-a86f-357ebf4f616d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88114) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:09:35 devstack cinder-volume[88114]: DEBUG cinder.volume.drivers.quobyte [None req-8518e94a-cb82-411d-a86f-357ebf4f616d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88114) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:09:35 devstack cinder-volume[88114]: DEBUG oslo_concurrency.lockutils [None req-8518e94a-cb82-411d-a86f-357ebf4f616d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88114) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:09:35 devstack cinder-volume[88114]: DEBUG oslo_concurrency.processutils [None req-8518e94a-cb82-411d-a86f-357ebf4f616d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce {{(pid=88114) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:09:35 devstack sudo[88195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce Aug 05 06:09:35 devstack sudo[88195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:09:35 devstack sudo[88195]: pam_unix(sudo:session): session closed for user root Aug 05 06:09:35 devstack cinder-volume[88114]: DEBUG oslo_concurrency.processutils [None req-8518e94a-cb82-411d-a86f-357ebf4f616d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce" returned: 0 in 0.249s {{(pid=88114) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:09:35 devstack cinder-volume[88114]: INFO cinder.volume.manager [None req-8518e94a-cb82-411d-a86f-357ebf4f616d None None] Driver post RPC initialization completed successfully. Aug 05 06:09:39 devstack cinder-volume[87898]: INFO oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] Caught SIGTERM, stopping children Aug 05 06:09:39 devstack cinder-volume[87898]: DEBUG oslo_concurrency.lockutils [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] Acquiring lock "singleton_lock" {{(pid=87898) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 05 06:09:39 devstack cinder-volume[87898]: DEBUG oslo_concurrency.lockutils [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] Acquired lock "singleton_lock" {{(pid=87898) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 05 06:09:39 devstack cinder-volume[87898]: DEBUG oslo_concurrency.lockutils [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] Releasing lock "singleton_lock" {{(pid=87898) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 05 06:09:39 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] Stop services. {{(pid=87898) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Aug 05 06:09:39 devstack cinder-volume[87898]: DEBUG oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] Killing children. {{(pid=87898) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Aug 05 06:09:39 devstack cinder-volume[87898]: INFO oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] Waiting on 1 children to exit Aug 05 06:09:43 devstack cinder-volume[88114]: DEBUG oslo_concurrency.lockutils [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] Acquiring lock "singleton_lock" {{(pid=88114) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 05 06:09:43 devstack cinder-volume[88114]: DEBUG oslo_concurrency.lockutils [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] Acquired lock "singleton_lock" {{(pid=88114) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 05 06:09:43 devstack cinder-volume[88114]: DEBUG oslo_concurrency.lockutils [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] Releasing lock "singleton_lock" {{(pid=88114) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 05 06:09:43 devstack cinder-volume[88114]: WARNING amqp [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] Received method (60, 30) during closing channel 1. This method will be ignored Aug 05 06:09:43 devstack cinder-volume[88114]: WARNING amqp [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] Received method (60, 30) during closing channel 1. This method will be ignored Aug 05 06:09:43 devstack cinder-volume[87898]: INFO oslo_service.backend._eventlet.service [None req-694e819e-cd18-4efe-a77d-81395d604a7f None None] Child 88114 exited with status 0 Aug 05 06:09:44 devstack cinder-volume[88398]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Aug 05 06:09:44 devstack cinder-volume[88398]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Aug 05 06:09:44 devstack cinder-volume[88398]: we strongly recommend against using it for new projects. Aug 05 06:09:44 devstack cinder-volume[88398]: If you are already using Eventlet, we recommend migrating to a different Aug 05 06:09:44 devstack cinder-volume[88398]: framework. For more detail see Aug 05 06:09:44 devstack cinder-volume[88398]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Aug 05 06:09:44 devstack cinder-volume[88398]: import eventlet # noqa Aug 05 06:09:46 devstack cinder-volume[88398]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=88398) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 05 06:09:46 devstack cinder-volume[88398]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=88398) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 05 06:09:46 devstack cinder-volume[88398]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=88398) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 05 06:09:47 devstack cinder-volume[88398]: INFO dbcounter [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] Registered counter for database cinder Aug 05 06:09:47 devstack cinder-volume[88398]: DEBUG oslo_db.sqlalchemy.engines [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88398) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 05 06:09:47 devstack cinder-volume[88398]: DEBUG dbcounter [-] [88398] Writer thread running {{(pid=88398) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 05 06:09:47 devstack cinder-volume[88398]: INFO cinder.rpc [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Aug 05 06:09:47 devstack cinder-volume[88398]: INFO cinder.rpc [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Aug 05 06:09:47 devstack cinder-volume[88398]: DEBUG oslo_db.sqlalchemy.engines [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88398) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 05 06:09:47 devstack cinder-volume[88398]: INFO cinder.volume.manager [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] Determined volume DB was empty at startup. Aug 05 06:09:47 devstack cinder-volume[88398]: DEBUG cinder.volume.manager [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=88398) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Aug 05 06:09:47 devstack cinder-volume[88398]: WARNING stevedore.named [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Aug 05 06:09:47 devstack cinder-volume[88398]: WARNING castellan.key_manager [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 05 06:09:47 devstack cinder-volume[88398]: WARNING cinder.keymgr.conf_key_mgr [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 05 06:09:47 devstack cinder-volume[88398]: INFO cinder.volume.manager [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] Image-volume cache disabled for host devstack@QuobyteHD. Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_db.sqlalchemy.engines [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88398) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 05 06:09:48 devstack cinder-volume[88398]: INFO oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] Starting 1 workers Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] Started child 88695 {{(pid=88398) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] Full set of CONF: {{(pid=88398) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] ******************************************************************************** {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3518}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] Configuration options gathered from: {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3519}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3520}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3521}} Aug 05 06:09:48 devstack cinder-volume[88695]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] ================================================================================ {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3526}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] allow_availability_zone_fallback = False {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] allow_compression_on_image_upload = False {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] allowed_direct_url_schemes = [] {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] api_rate_limit = True {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] auth_strategy = keystone {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] backend_availability_zone = None {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] backend_host = None {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] backend_name = None {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] backend_stats_polling_interval = 60 {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] backup_api_class = cinder.backup.api.API {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] backup_name_template = backup-%s {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] backup_use_same_host = False {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] backup_use_temp_snapshot = False {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] chap_password = **** {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] chap_username = {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] cinder_internal_tenant_project_id = 09e694c4172e42d0a131fac439e6bddb {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] cinder_internal_tenant_user_id = aee7c84432484698b925b0cc683db29c {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] cluster = None {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] compression_format = gzip {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] compute_api_class = cinder.compute.nova.API {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] config_dir = [] {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] config_source = [] {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] control_exchange = openstack {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] debug = True {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] default_availability_zone = None {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] default_group_type = None {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] default_volume_type = QuobyteHD {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] disk_geometry = None {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] driver_client_cert = None {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] driver_client_cert_key = None {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] driver_data_namespace = None {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] driver_ssl_cert_path = None {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] driver_ssl_cert_verify = False {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] driver_use_ssl = False {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] enable_new_services = True {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] enable_unsupported_driver = False {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] enabled_backends = ['QuobyteHD'] {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] enforce_multipath_for_image_xfer = False {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] filter_function = None {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] glance_api_insecure = False {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] glance_api_servers = ['http://192.168.122.36/image'] {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] glance_api_ssl_compression = False {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] glance_ca_certificates_file = None {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] glance_catalog_info = image:glance:publicURL {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] glance_certfile = None {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] glance_keyfile = None {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] glance_num_retries = 3 {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] glance_request_timeout = None {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] goodness_function = None {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] graceful_shutdown_timeout = 5 {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] group_api_class = cinder.group.api.API {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] host = devstack {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] image_compress_on_upload = True {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] image_conversion_address_space_limit = 1 {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] image_conversion_cpu_limit = 60 {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] image_conversion_disable = False {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] image_upload_use_cinder_backend = False {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] image_upload_use_internal_tenant = False {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] image_volume_cache_enabled = False {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] image_volume_cache_max_count = 0 {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] image_volume_cache_max_size_gb = 0 {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] init_host_max_objects_retrieval = 0 {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] instance_format = [instance: %(uuid)s] {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] iscsi_target_flags = {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] iscsi_write_cache = on {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] iser_helper = tgtadm {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] iser_ip_address = 192.168.122.36 {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] iser_port = 3260 {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] log_color = False {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] log_config_append = None {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] log_dir = None {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] log_file = None {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] log_options = True {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] log_rotate_interval = 1 {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] log_rotate_interval_type = days {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] log_rotation_type = none {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:48 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-b22e21e8-3f13-4edc-84c8-9c9a4b4e88c5 None None] Starting volume driver QuobyteDriver (1.2) Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] max_age = 0 {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] max_logfile_count = 30 {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:48 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-b22e21e8-3f13-4edc-84c8-9c9a4b4e88c5 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=88695) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] max_logfile_size_mb = 200 {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] max_over_subscription_ratio = 20.0 {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] message_reap_interval = 86400 {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] message_ttl = 2592000 {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] migration_create_volume_timeout_secs = 300 {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] monkey_patch = False {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] monkey_patch_modules = [] {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] my_ip = 192.168.122.36 {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] no_snapshot_gb_quota = False {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] num_iser_scan_tries = 3 {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] num_shell_tries = 3 {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] num_volume_device_scan_tries = 3 {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] nvmeof_conn_info_version = 1 {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] nvmet_ns_id = 10 {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] nvmet_port_id = 1 {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] osapi_max_limit = 1000 {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] osapi_volume_ext_list = [] {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] osapi_volume_listen = 0.0.0.0 {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] osapi_volume_listen_port = 8776 {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] osapi_volume_use_ssl = False {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] osapi_volume_workers = None {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] per_volume_size_limit = -1 {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] periodic_fuzzy_delay = 60 {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] periodic_interval = 60 {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] project_id_regex = [0-9a-f\-]+ {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] public_endpoint = None {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] publish_errors = False {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] quota_backup_gigabytes = 1000 {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] quota_backups = 10 {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] quota_gigabytes = 1000 {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] quota_groups = 10 {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] quota_snapshots = 10 {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] quota_volumes = 10 {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] rate_limit_burst = 0 {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] rate_limit_except_level = CRITICAL {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] rate_limit_interval = 0 {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] reinit_driver_count = 3 {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] replication_device = **** {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] report_discard_supported = False {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] report_interval = 120 {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] reservation_clean_interval = 86400 {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] reservation_expire = 86400 {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] reserved_image_namespaces = [] {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] reserved_percentage = 0 {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] rpc_response_timeout = 120 {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] run_external_periodic_tasks = True {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] scst_target_driver = iscsi {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] scst_target_iqn_name = None {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] service_down_time = 720 {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] shell_completion = None {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] snapshot_name_template = snapshot-%s {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] split_loggers = False {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] state_path = /opt/stack/data/cinder {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] storage_availability_zone = nova {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] storage_protocol = iSCSI {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] syslog_log_facility = LOG_USER {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] target_helper = lioadm {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] target_ip_address = 192.168.122.36 {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] target_port = 3260 {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] target_protocol = iscsi {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] target_secondary_ip_addresses = [] {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] trace_flags = None {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] transfer_api_class = cinder.transfer.api.API {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] transport_url = **** {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] until_refresh = 0 {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] use_chap_auth = False {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] use_default_quota_class = True {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] use_journal = False {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] use_json = False {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] use_multipath_for_image_xfer = False {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] use_stderr = False {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] use_syslog = False {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] verify_glance_signatures = enabled {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] volume_api_class = cinder.volume.api.API {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] volume_backend_name = None {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] volume_clear = zero {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] volume_clear_ionice = None {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] volume_clear_size = 0 {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] volume_copy_bps_limit = 0 {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] volume_dd_blocksize = 1M {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] volume_name_template = volume-%s {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] volume_service_inithost_offload = False {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] volume_usage_audit_period = month {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] zoning_mode = None {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] oslo_concurrency.disable_process_locking = False {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] keystone_authtoken.auth_section = None {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] keystone_authtoken.auth_type = password {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] keystone_authtoken.auth_version = None {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] keystone_authtoken.cache = None {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] keystone_authtoken.certfile = None {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] keystone_authtoken.delay_auth_decision = False {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] keystone_authtoken.http_connect_timeout = None {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] keystone_authtoken.include_service_catalog = True {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] keystone_authtoken.insecure = False {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] keystone_authtoken.interface = public {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] keystone_authtoken.keyfile = None {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] keystone_authtoken.memcache_password = {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] keystone_authtoken.memcache_username = {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] keystone_authtoken.region_name = None {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] keystone_authtoken.service_token_roles_required = True {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] keystone_authtoken.service_type = None {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] keystone_authtoken.token_cache_time = 300 {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.36/identity {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] cache.backend = dogpile.cache.null {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] cache.backend_argument = **** {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] cache.backend_expiration_time = None {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] cache.config_prefix = cache.oslo {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] cache.debug_cache_backend = False {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] cache.enable_retry_client = False {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] cache.enable_socket_keepalive = False {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] cache.enabled = False {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] cache.expiration_time = 600 {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] cache.hashclient_retry_attempts = 2 {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] cache.memcache_dead_retry = 300 {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] cache.memcache_pool_maxsize = 10 {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] cache.memcache_sasl_enabled = False {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] cache.password = **** {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] cache.proxies = [] {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] cache.redis_db = 0 {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] cache.redis_sentinel_service_name = mymaster {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] cache.redis_server = localhost:6379 {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] cache.retry_attempts = 2 {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] cache.retry_delay = 0.0 {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] cache.socket_keepalive_count = 1 {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] cache.socket_keepalive_idle = 1 {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-b22e21e8-3f13-4edc-84c8-9c9a4b4e88c5 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=88695) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:307}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] cache.socket_keepalive_interval = 1 {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] cache.socket_timeout = 1.0 {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] cache.tls_allowed_ciphers = None {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] cache.tls_cafile = None {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] cache.tls_certfile = None {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88695]: WARNING cinder.volume.drivers.quobyte [None req-b22e21e8-3f13-4edc-84c8-9c9a4b4e88c5 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Aug 05 06:09:48 devstack cinder-volume[88695]: WARNING cinder.volume.drivers.quobyte [None req-b22e21e8-3f13-4edc-84c8-9c9a4b4e88c5 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Aug 05 06:09:48 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-b22e21e8-3f13-4edc-84c8-9c9a4b4e88c5 None None] Running cmd (subprocess): mount.quobyte {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] cache.tls_enabled = False {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] cache.tls_keyfile = None {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] cache.username = None {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] coordination.backend_url = **** {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] database.asyncio_connection = **** {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] database.asyncio_slave_connection = **** {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] database.backend = sqlalchemy {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] database.connection = **** {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] database.connection_debug = 0 {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] database.connection_parameters = {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] database.connection_recycle_time = 3600 {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] database.connection_trace = False {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] database.db_inc_retry_interval = True {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] database.db_max_retries = 20 {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] database.db_max_retry_interval = 10 {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] database.db_retry_interval = 1 {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] database.max_overflow = 50 {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] database.max_pool_size = 5 {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] database.max_retries = 10 {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] database.mysql_wsrep_sync_wait = None {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] database.pool_timeout = None {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] database.retry_interval = 10 {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] database.slave_connection = **** {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] database.sqlite_synchronous = True {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] database.synchronous_reader = True {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] database.use_db_reconnect = False {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] profiler.connection_string = messaging:// {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] profiler.enabled = False {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] profiler.es_doc_type = notification {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] profiler.es_scroll_size = 10000 {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] profiler.es_scroll_time = 2m {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] profiler.filter_error_trace = False {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] profiler.hmac_keys = **** {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] profiler.sentinel_service_name = mymaster {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] profiler.socket_timeout = 0.1 {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] profiler.trace_requests = False {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] profiler.trace_sqlalchemy = False {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] profiler_jaeger.process_tags = {} {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] profiler_jaeger.service_name_prefix = None {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] profiler_otlp.service_name_prefix = None {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] oslo_policy.enforce_new_defaults = True {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] oslo_policy.policy_default_rule = default {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] oslo_policy.policy_file = policy.yaml {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] oslo_policy.remote_timeout = 60.0 {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] privsep_osbrick.group = None {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] privsep_osbrick.helper_command = None {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] privsep_osbrick.user = None {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] cinder_sys_admin.group = None {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] cinder_sys_admin.helper_command = None {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] cinder_sys_admin.user = None {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] service_user.auth_section = None {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] service_user.auth_type = password {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] service_user.cafile = None {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] service_user.certfile = None {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] service_user.collect_timing = False {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] service_user.insecure = False {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] service_user.keyfile = None {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] service_user.send_service_user_token = True {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] service_user.split_loggers = False {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] service_user.timeout = None {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] glance.auth_section = None {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] glance.auth_type = password {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] glance.certfile = None {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] glance.collect_timing = False {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] glance.insecure = False {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] glance.keyfile = None {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] glance.region_name = None {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] glance.split_loggers = False {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] glance.timeout = None {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] backend_defaults.backend_availability_zone = None {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] backend_defaults.chap_password = **** {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack quobyte-client[88699]: Reading configuration file: /etc/quobyte/client.cfg Aug 05 06:09:48 devstack quobyte-client[88699]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] backend_defaults.chap_username = {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] backend_defaults.disk_geometry = None {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] backend_defaults.driver_client_cert = None {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] backend_defaults.driver_client_cert_key = None {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] backend_defaults.driver_data_namespace = None {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] backend_defaults.driver_use_ssl = False {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] backend_defaults.enable_unsupported_driver = False {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] backend_defaults.extra_capabilities = {} {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-b22e21e8-3f13-4edc-84c8-9c9a4b4e88c5 None None] CMD "mount.quobyte" returned: 1 in 0.066s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] backend_defaults.filter_function = None {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] backend_defaults.goodness_function = None {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-b22e21e8-3f13-4edc-84c8-9c9a4b4e88c5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-b22e21e8-3f13-4edc-84c8-9c9a4b4e88c5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-b22e21e8-3f13-4edc-84c8-9c9a4b4e88c5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] backend_defaults.iscsi_target_flags = {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] backend_defaults.iscsi_write_cache = on {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] backend_defaults.iser_helper = tgtadm {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] backend_defaults.iser_ip_address = 192.168.122.36 {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] backend_defaults.iser_port = 3260 {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] backend_defaults.nas_host = {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] backend_defaults.nas_login = admin {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] backend_defaults.nas_mount_options = None {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] backend_defaults.nas_password = **** {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] backend_defaults.nas_private_key = {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] backend_defaults.nas_share_path = {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] backend_defaults.nas_ssh_port = 22 {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] backend_defaults.num_shell_tries = 3 {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] backend_defaults.nvmet_port_id = 1 {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] backend_defaults.quobyte_client_cfg = None {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-b22e21e8-3f13-4edc-84c8-9c9a4b4e88c5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-b22e21e8-3f13-4edc-84c8-9c9a4b4e88c5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-b22e21e8-3f13-4edc-84c8-9c9a4b4e88c5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] backend_defaults.quobyte_volume_url = None {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] backend_defaults.replication_device = **** {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] backend_defaults.report_discard_supported = False {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] backend_defaults.reserved_percentage = 0 {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] backend_defaults.scst_target_driver = iscsi {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] backend_defaults.scst_target_iqn_name = None {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] backend_defaults.storage_protocol = iSCSI {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] backend_defaults.target_helper = tgtadm {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] backend_defaults.target_ip_address = 192.168.122.36 {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] backend_defaults.target_port = 3260 {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] backend_defaults.target_protocol = iscsi {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] backend_defaults.trace_flags = None {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] backend_defaults.unique_fqdn_network = True {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] backend_defaults.use_chap_auth = False {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] backend_defaults.volume_backend_name = None {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] backend_defaults.volume_clear = zero {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] backend_defaults.volume_clear_ionice = None {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] backend_defaults.volume_clear_size = 0 {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] oslo_reports.file_event_handler = None {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] oslo_reports.log_dir = None {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] QuobyteHD.backend_availability_zone = None {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] QuobyteHD.backend_host = None {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] QuobyteHD.chap_password = **** {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] QuobyteHD.chap_username = None {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] QuobyteHD.chiscsi_conf = None {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] QuobyteHD.disk_geometry = None {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] QuobyteHD.driver_client_cert = None {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] QuobyteHD.driver_client_cert_key = None {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] QuobyteHD.driver_data_namespace = None {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] QuobyteHD.driver_use_ssl = None {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] QuobyteHD.extra_capabilities = None {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] QuobyteHD.filter_function = None {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] QuobyteHD.goodness_function = None {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] QuobyteHD.iscsi_target_flags = None {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] QuobyteHD.iscsi_write_cache = None {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] QuobyteHD.iser_helper = None {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] QuobyteHD.iser_ip_address = None {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] QuobyteHD.iser_port = None {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] QuobyteHD.iser_target_prefix = None {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] QuobyteHD.nas_host = None {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] QuobyteHD.nas_login = None {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] QuobyteHD.nas_mount_options = None {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] QuobyteHD.nas_password = **** {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] QuobyteHD.nas_private_key = None {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] QuobyteHD.nas_share_path = None {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] QuobyteHD.nas_ssh_port = None {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] QuobyteHD.num_shell_tries = None {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] QuobyteHD.nvmet_ns_id = None {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] QuobyteHD.nvmet_port_id = None {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] QuobyteHD.replication_device = **** {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] QuobyteHD.report_discard_supported = None {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] QuobyteHD.reserved_percentage = None {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] QuobyteHD.scst_target_driver = None {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] QuobyteHD.storage_protocol = None {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] QuobyteHD.target_helper = None {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] QuobyteHD.target_ip_address = None {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] QuobyteHD.target_port = None {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] QuobyteHD.target_prefix = None {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] QuobyteHD.target_protocol = None {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] QuobyteHD.trace_flags = None {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] QuobyteHD.unique_fqdn_network = None {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] QuobyteHD.use_chap_auth = None {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] QuobyteHD.volume_clear = None {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] QuobyteHD.volume_clear_ionice = None {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] QuobyteHD.volume_clear_size = None {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] QuobyteHD.volumes_dir = None {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack sudo[88700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack sudo[88700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] oslo_messaging_rabbit.ssl = False {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] oslo_messaging_rabbit.ssl_version = {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] oslo_messaging_notifications.driver = [] {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] oslo_messaging_notifications.retry = -1 {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] oslo_messaging_notifications.transport_url = **** {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] key_manager.fixed_key = **** {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] barbican.barbican_api_version = None {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] barbican.barbican_endpoint = None {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] barbican.barbican_endpoint_type = public {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] barbican.barbican_region_name = None {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] barbican.cafile = None {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] barbican.certfile = None {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] barbican.collect_timing = False {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] barbican.insecure = False {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] barbican.keyfile = None {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] barbican.number_of_retries = 60 {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] barbican.retry_delay = 1 {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] barbican.send_service_user_token = False {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] barbican.split_loggers = False {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] barbican.timeout = None {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] barbican.verify_ssl = True {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] barbican.verify_ssl_path = None {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] barbican_service_user.auth_section = None {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] barbican_service_user.auth_type = None {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] barbican_service_user.cafile = None {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] barbican_service_user.certfile = None {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] barbican_service_user.collect_timing = False {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] barbican_service_user.insecure = False {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] barbican_service_user.keyfile = None {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] barbican_service_user.split_loggers = False {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] barbican_service_user.timeout = None {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] vault.approle_role_id = **** {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] vault.approle_secret_id = **** {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] vault.auth_method = approle {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] vault.auth_path = None {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] vault.kv_mountpoint = secret {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] vault.kv_path = None {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] vault.kv_version = 2 {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] vault.namespace = None {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] vault.root_token_id = **** {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] vault.ssl_ca_crt_file = None {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] vault.timeout = 60.0 {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] vault.token_file = None {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] vault.token_role = None {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] vault.use_ssl = False {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 06:09:48 devstack cinder-volume[88398]: DEBUG oslo_service.backend._eventlet.service [None req-5d9e9c21-fa42-4456-9443-701eb3bcf915 None None] ******************************************************************************** {{(pid=88398) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3552}} Aug 05 06:09:48 devstack sudo[88700]: pam_unix(sudo:session): session closed for user root Aug 05 06:09:48 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-b22e21e8-3f13-4edc-84c8-9c9a4b4e88c5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce" returned: 0 in 0.258s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:09:48 devstack cinder-volume[88695]: INFO cinder.volume.driver [None req-b22e21e8-3f13-4edc-84c8-9c9a4b4e88c5 None None] Driver hasn't implemented _init_vendor_properties() Aug 05 06:09:48 devstack cinder-volume[88695]: DEBUG cinder.volume.driver [None req-b22e21e8-3f13-4edc-84c8-9c9a4b4e88c5 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.743049621582, 'free_capacity_gb': 1775.743049621582, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=88695) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Aug 05 06:09:48 devstack cinder-volume[88695]: DEBUG oslo_db.sqlalchemy.engines [None req-b22e21e8-3f13-4edc-84c8-9c9a4b4e88c5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88695) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 05 06:09:48 devstack cinder-volume[88695]: DEBUG dbcounter [-] [88695] Writer thread running {{(pid=88695) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 05 06:09:48 devstack cinder-volume[88695]: DEBUG cinder.db.api [None req-b22e21e8-3f13-4edc-84c8-9c9a4b4e88c5 None None] Building query based on filter {{(pid=88695) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Aug 05 06:09:48 devstack cinder-volume[88695]: DEBUG cinder.image.image_utils [None req-b22e21e8-3f13-4edc-84c8-9c9a4b4e88c5 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=88695) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Aug 05 06:09:48 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-b22e21e8-3f13-4edc-84c8-9c9a4b4e88c5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:09:48 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-b22e21e8-3f13-4edc-84c8-9c9a4b4e88c5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:09:48 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-b22e21e8-3f13-4edc-84c8-9c9a4b4e88c5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:09:48 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-b22e21e8-3f13-4edc-84c8-9c9a4b4e88c5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:09:48 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-b22e21e8-3f13-4edc-84c8-9c9a4b4e88c5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:09:48 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-b22e21e8-3f13-4edc-84c8-9c9a4b4e88c5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:09:48 devstack cinder-volume[88695]: INFO cinder.keymgr.migration [None req-7882a972-cc92-4479-980c-f395262b0dcd None None] Not migrating encryption keys because the ConfKeyManager is still in use. Aug 05 06:09:48 devstack sudo[88711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce Aug 05 06:09:48 devstack sudo[88711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:09:48 devstack sudo[88711]: pam_unix(sudo:session): session closed for user root Aug 05 06:09:48 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-b22e21e8-3f13-4edc-84c8-9c9a4b4e88c5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce" returned: 0 in 0.258s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:09:48 devstack cinder-volume[88695]: DEBUG cinder.manager [None req-b22e21e8-3f13-4edc-84c8-9c9a4b4e88c5 None None] Notifying Schedulers of capabilities ... {{(pid=88695) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 06:09:48 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-b22e21e8-3f13-4edc-84c8-9c9a4b4e88c5 None None] Driver initialization completed successfully. Aug 05 06:09:48 devstack cinder-volume[88695]: INFO cinder.manager [None req-b22e21e8-3f13-4edc-84c8-9c9a4b4e88c5 None None] Initiating service 3 cleanup Aug 05 06:09:48 devstack cinder-volume[88695]: INFO cinder.manager [None req-b22e21e8-3f13-4edc-84c8-9c9a4b4e88c5 None None] Service 3 cleanup completed. Aug 05 06:09:48 devstack cinder-volume[88695]: DEBUG cinder.service [None req-b22e21e8-3f13-4edc-84c8-9c9a4b4e88c5 None None] Creating RPC server for service cinder-volume {{(pid=88695) start /opt/stack/cinder/cinder/service.py:231}} Aug 05 06:09:49 devstack cinder-volume[88695]: DEBUG cinder.service [None req-b22e21e8-3f13-4edc-84c8-9c9a4b4e88c5 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=88695) start /opt/stack/cinder/cinder/service.py:237}} Aug 05 06:09:49 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-b22e21e8-3f13-4edc-84c8-9c9a4b4e88c5 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2) Aug 05 06:09:49 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-b22e21e8-3f13-4edc-84c8-9c9a4b4e88c5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:09:49 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-b22e21e8-3f13-4edc-84c8-9c9a4b4e88c5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:09:49 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-b22e21e8-3f13-4edc-84c8-9c9a4b4e88c5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:09:49 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-b22e21e8-3f13-4edc-84c8-9c9a4b4e88c5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:09:49 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-b22e21e8-3f13-4edc-84c8-9c9a4b4e88c5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:09:49 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-b22e21e8-3f13-4edc-84c8-9c9a4b4e88c5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:09:49 devstack sudo[88728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce Aug 05 06:09:49 devstack sudo[88728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:09:49 devstack sudo[88728]: pam_unix(sudo:session): session closed for user root Aug 05 06:09:49 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-b22e21e8-3f13-4edc-84c8-9c9a4b4e88c5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce" returned: 0 in 0.237s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:09:49 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-b22e21e8-3f13-4edc-84c8-9c9a4b4e88c5 None None] Driver post RPC initialization completed successfully. Aug 05 06:09:58 devstack cinder-volume[88398]: DEBUG dbcounter [-] [88398] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=88398) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 06:09:58 devstack cinder-volume[88695]: DEBUG dbcounter [-] [88695] Writing DB stats cinder:SELECT=2 {{(pid=88695) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 06:09:59 devstack cinder-volume[88695]: DEBUG dbcounter [-] [88695] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=88695) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 06:10:00 devstack cinder-volume[88695]: DEBUG oslo_service.periodic_task [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] Running periodic task VolumeManager._thread_info {{(pid=88695) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 06:10:00 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] thread count: 6 {{(pid=88695) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 05 06:10:00 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] thread info: [<_MainThread(MainThread, started 134469211893888)>, , , , , ] {{(pid=88695) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 05 06:10:45 devstack cinder-volume[88695]: DEBUG cinder.volume.flows.manager.create_volume [None req-692211d6-3492-4f31-a591-dca4215ef064 tempest-DeleteServersTestJSON-1335824393 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88695) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 06:10:45 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-692211d6-3492-4f31-a591-dca4215ef064 tempest-DeleteServersTestJSON-1335824393 None] Flow 'volume_create_manager' (978d80ad-0911-4d6a-920f-4b1f321c3527) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:10:45 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-692211d6-3492-4f31-a591-dca4215ef064 tempest-DeleteServersTestJSON-1335824393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88999f15-fa70-4efe-822d-e799dc5dee02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:10:46 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-692211d6-3492-4f31-a591-dca4215ef064 tempest-DeleteServersTestJSON-1335824393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88999f15-fa70-4efe-822d-e799dc5dee02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:10:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-738747023',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=943bcf04-e177-4340-96e5-ee722dea2dd0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8956cd48f41457fb1170dd0d7c3e006',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:10:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:10:46Z,use_quota=True,user_id='87f5170d51014027ab1faa1a53186343',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:10:46 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-692211d6-3492-4f31-a591-dca4215ef064 tempest-DeleteServersTestJSON-1335824393 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a64b9700-4766-41dd-8a90-96b9dd3688e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:10:46 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-692211d6-3492-4f31-a591-dca4215ef064 tempest-DeleteServersTestJSON-1335824393 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a64b9700-4766-41dd-8a90-96b9dd3688e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:10:46 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-692211d6-3492-4f31-a591-dca4215ef064 tempest-DeleteServersTestJSON-1335824393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b03b4390-2c9f-4cca-b702-c6a06a975de8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:10:46 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-692211d6-3492-4f31-a591-dca4215ef064 tempest-DeleteServersTestJSON-1335824393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b03b4390-2c9f-4cca-b702-c6a06a975de8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '943bcf04-e177-4340-96e5-ee722dea2dd0', 'volume_name': 'volume-943bcf04-e177-4340-96e5-ee722dea2dd0', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:10:46 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-692211d6-3492-4f31-a591-dca4215ef064 tempest-DeleteServersTestJSON-1335824393 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddf4b345-4182-46d5-9435-cfbb4d07fc76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:10:46 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-692211d6-3492-4f31-a591-dca4215ef064 tempest-DeleteServersTestJSON-1335824393 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddf4b345-4182-46d5-9435-cfbb4d07fc76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:10:46 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-692211d6-3492-4f31-a591-dca4215ef064 tempest-DeleteServersTestJSON-1335824393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad676a02-6b9d-4bce-bf00-cd0f02f1bc8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:10:46 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-692211d6-3492-4f31-a591-dca4215ef064 tempest-DeleteServersTestJSON-1335824393 None] Volume 943bcf04-e177-4340-96e5-ee722dea2dd0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-943bcf04-e177-4340-96e5-ee722dea2dd0', 'volume_size': 1} Aug 05 06:10:46 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-692211d6-3492-4f31-a591-dca4215ef064 tempest-DeleteServersTestJSON-1335824393 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:10:46 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-692211d6-3492-4f31-a591-dca4215ef064 tempest-DeleteServersTestJSON-1335824393 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:10:46 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-692211d6-3492-4f31-a591-dca4215ef064 tempest-DeleteServersTestJSON-1335824393 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:10:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-738747023',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=943bcf04-e177-4340-96e5-ee722dea2dd0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8956cd48f41457fb1170dd0d7c3e006',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:10:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:10:46Z,use_quota=True,user_id='87f5170d51014027ab1faa1a53186343',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)}" {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 06:10:46 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-692211d6-3492-4f31-a591-dca4215ef064 tempest-DeleteServersTestJSON-1335824393 None] Creating volume 943bcf04-e177-4340-96e5-ee722dea2dd0 {{(pid=88695) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 06:10:46 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-692211d6-3492-4f31-a591-dca4215ef064 tempest-DeleteServersTestJSON-1335824393 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:10:46 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-692211d6-3492-4f31-a591-dca4215ef064 tempest-DeleteServersTestJSON-1335824393 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:10:46 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-692211d6-3492-4f31-a591-dca4215ef064 tempest-DeleteServersTestJSON-1335824393 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:10:46 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-692211d6-3492-4f31-a591-dca4215ef064 tempest-DeleteServersTestJSON-1335824393 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:10:46 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-692211d6-3492-4f31-a591-dca4215ef064 tempest-DeleteServersTestJSON-1335824393 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:10:46 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-692211d6-3492-4f31-a591-dca4215ef064 tempest-DeleteServersTestJSON-1335824393 None] Selected osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 as target Quobyte volume. {{(pid=88695) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 06:10:46 devstack cinder-volume[88695]: INFO cinder.volume.drivers.remotefs [None req-692211d6-3492-4f31-a591-dca4215ef064 tempest-DeleteServersTestJSON-1335824393 None] casted to osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 Aug 05 06:10:46 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-692211d6-3492-4f31-a591-dca4215ef064 tempest-DeleteServersTestJSON-1335824393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-943bcf04-e177-4340-96e5-ee722dea2dd0 1073741824 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:10:46 devstack sudo[89225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-943bcf04-e177-4340-96e5-ee722dea2dd0 1073741824 Aug 05 06:10:46 devstack sudo[89225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:10:46 devstack cinder-volume[88695]: DEBUG cinder.volume.flows.manager.create_volume [req-24f732e8-df1d-4e6b-be58-c5276f55d292 req-e349e406-7787-49ac-b79c-f0d4c8ad382d tempest-VolumesGetTestJSON-1640255637 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88695) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 06:10:46 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [req-24f732e8-df1d-4e6b-be58-c5276f55d292 req-e349e406-7787-49ac-b79c-f0d4c8ad382d tempest-VolumesGetTestJSON-1640255637 None] Flow 'volume_create_manager' (3ac86043-ce65-4188-a1eb-5c310ef575a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:10:46 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [req-24f732e8-df1d-4e6b-be58-c5276f55d292 req-e349e406-7787-49ac-b79c-f0d4c8ad382d tempest-VolumesGetTestJSON-1640255637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eccbf49d-6827-4879-9ecd-2ee4c6122850) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:10:46 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [req-24f732e8-df1d-4e6b-be58-c5276f55d292 req-e349e406-7787-49ac-b79c-f0d4c8ad382d tempest-VolumesGetTestJSON-1640255637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eccbf49d-6827-4879-9ecd-2ee4c6122850) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:09:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1454641723',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58b3e633-b9cf-4a4a-a4bb-789252dd3dc3,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0c21d30df36147e8aadfd2cb6fc00340',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:10:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:10:47Z,use_quota=True,user_id='0716f6556164476bb21212a8888035f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:10:46 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [req-24f732e8-df1d-4e6b-be58-c5276f55d292 req-e349e406-7787-49ac-b79c-f0d4c8ad382d tempest-VolumesGetTestJSON-1640255637 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (005bfac0-4f66-47a6-bbc5-c9b83737ff9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:10:46 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [req-24f732e8-df1d-4e6b-be58-c5276f55d292 req-e349e406-7787-49ac-b79c-f0d4c8ad382d tempest-VolumesGetTestJSON-1640255637 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (005bfac0-4f66-47a6-bbc5-c9b83737ff9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:10:46 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [req-24f732e8-df1d-4e6b-be58-c5276f55d292 req-e349e406-7787-49ac-b79c-f0d4c8ad382d tempest-VolumesGetTestJSON-1640255637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff0aecd0-76d1-4d03-b931-49b4e204f738) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:10:46 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [req-24f732e8-df1d-4e6b-be58-c5276f55d292 req-e349e406-7787-49ac-b79c-f0d4c8ad382d tempest-VolumesGetTestJSON-1640255637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff0aecd0-76d1-4d03-b931-49b4e204f738) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '58b3e633-b9cf-4a4a-a4bb-789252dd3dc3', 'volume_name': 'volume-58b3e633-b9cf-4a4a-a4bb-789252dd3dc3', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:10:46 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [req-24f732e8-df1d-4e6b-be58-c5276f55d292 req-e349e406-7787-49ac-b79c-f0d4c8ad382d tempest-VolumesGetTestJSON-1640255637 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad1217e8-a875-42cd-ace4-009e7abb12c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:10:46 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [req-24f732e8-df1d-4e6b-be58-c5276f55d292 req-e349e406-7787-49ac-b79c-f0d4c8ad382d tempest-VolumesGetTestJSON-1640255637 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad1217e8-a875-42cd-ace4-009e7abb12c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:10:46 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [req-24f732e8-df1d-4e6b-be58-c5276f55d292 req-e349e406-7787-49ac-b79c-f0d4c8ad382d tempest-VolumesGetTestJSON-1640255637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b49556d1-875d-43d4-b07c-24ff6129f312) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:10:46 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [req-24f732e8-df1d-4e6b-be58-c5276f55d292 req-e349e406-7787-49ac-b79c-f0d4c8ad382d tempest-VolumesGetTestJSON-1640255637 None] Volume 58b3e633-b9cf-4a4a-a4bb-789252dd3dc3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-58b3e633-b9cf-4a4a-a4bb-789252dd3dc3', 'volume_size': 1} Aug 05 06:10:46 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [req-24f732e8-df1d-4e6b-be58-c5276f55d292 req-e349e406-7787-49ac-b79c-f0d4c8ad382d tempest-VolumesGetTestJSON-1640255637 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:10:46 devstack sudo[89225]: pam_unix(sudo:session): session closed for user root Aug 05 06:10:46 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-692211d6-3492-4f31-a591-dca4215ef064 tempest-DeleteServersTestJSON-1335824393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-943bcf04-e177-4340-96e5-ee722dea2dd0 1073741824" returned: 0 in 0.797s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:10:46 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-692211d6-3492-4f31-a591-dca4215ef064 tempest-DeleteServersTestJSON-1335824393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-943bcf04-e177-4340-96e5-ee722dea2dd0 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:10:47 devstack sudo[89550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-943bcf04-e177-4340-96e5-ee722dea2dd0 Aug 05 06:10:47 devstack sudo[89550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:10:47 devstack sudo[89550]: pam_unix(sudo:session): session closed for user root Aug 05 06:10:47 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-692211d6-3492-4f31-a591-dca4215ef064 tempest-DeleteServersTestJSON-1335824393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-943bcf04-e177-4340-96e5-ee722dea2dd0" returned: 0 in 0.473s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:10:47 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-692211d6-3492-4f31-a591-dca4215ef064 tempest-DeleteServersTestJSON-1335824393 None] <== create_volume: return (1417ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'} {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 06:10:47 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-692211d6-3492-4f31-a591-dca4215ef064 tempest-DeleteServersTestJSON-1335824393 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.420s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:10:47 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [req-24f732e8-df1d-4e6b-be58-c5276f55d292 req-e349e406-7787-49ac-b79c-f0d4c8ad382d tempest-VolumesGetTestJSON-1640255637 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.743s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:10:47 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [req-24f732e8-df1d-4e6b-be58-c5276f55d292 req-e349e406-7787-49ac-b79c-f0d4c8ad382d tempest-VolumesGetTestJSON-1640255637 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:09:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1454641723',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58b3e633-b9cf-4a4a-a4bb-789252dd3dc3,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0c21d30df36147e8aadfd2cb6fc00340',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:10:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:10:47Z,use_quota=True,user_id='0716f6556164476bb21212a8888035f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)}" {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 06:10:47 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [req-24f732e8-df1d-4e6b-be58-c5276f55d292 req-e349e406-7787-49ac-b79c-f0d4c8ad382d tempest-VolumesGetTestJSON-1640255637 None] Creating volume 58b3e633-b9cf-4a4a-a4bb-789252dd3dc3 {{(pid=88695) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 06:10:47 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [req-24f732e8-df1d-4e6b-be58-c5276f55d292 req-e349e406-7787-49ac-b79c-f0d4c8ad382d tempest-VolumesGetTestJSON-1640255637 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:10:47 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [req-24f732e8-df1d-4e6b-be58-c5276f55d292 req-e349e406-7787-49ac-b79c-f0d4c8ad382d tempest-VolumesGetTestJSON-1640255637 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:10:47 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [req-24f732e8-df1d-4e6b-be58-c5276f55d292 req-e349e406-7787-49ac-b79c-f0d4c8ad382d tempest-VolumesGetTestJSON-1640255637 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:10:47 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [req-24f732e8-df1d-4e6b-be58-c5276f55d292 req-e349e406-7787-49ac-b79c-f0d4c8ad382d tempest-VolumesGetTestJSON-1640255637 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:10:47 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [req-24f732e8-df1d-4e6b-be58-c5276f55d292 req-e349e406-7787-49ac-b79c-f0d4c8ad382d tempest-VolumesGetTestJSON-1640255637 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:10:47 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [req-24f732e8-df1d-4e6b-be58-c5276f55d292 req-e349e406-7787-49ac-b79c-f0d4c8ad382d tempest-VolumesGetTestJSON-1640255637 None] Selected osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 as target Quobyte volume. {{(pid=88695) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 06:10:47 devstack cinder-volume[88695]: INFO cinder.volume.drivers.remotefs [req-24f732e8-df1d-4e6b-be58-c5276f55d292 req-e349e406-7787-49ac-b79c-f0d4c8ad382d tempest-VolumesGetTestJSON-1640255637 None] casted to osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 Aug 05 06:10:47 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [req-24f732e8-df1d-4e6b-be58-c5276f55d292 req-e349e406-7787-49ac-b79c-f0d4c8ad382d tempest-VolumesGetTestJSON-1640255637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-58b3e633-b9cf-4a4a-a4bb-789252dd3dc3 1073741824 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:10:47 devstack sudo[89560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-58b3e633-b9cf-4a4a-a4bb-789252dd3dc3 1073741824 Aug 05 06:10:47 devstack sudo[89560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:10:47 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-692211d6-3492-4f31-a591-dca4215ef064 tempest-DeleteServersTestJSON-1335824393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad676a02-6b9d-4bce-bf00-cd0f02f1bc8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-943bcf04-e177-4340-96e5-ee722dea2dd0', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:10:47 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-692211d6-3492-4f31-a591-dca4215ef064 tempest-DeleteServersTestJSON-1335824393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4958cbd8-4796-4a8e-914d-34ef75055d24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:10:47 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-692211d6-3492-4f31-a591-dca4215ef064 tempest-DeleteServersTestJSON-1335824393 None] Volume volume-943bcf04-e177-4340-96e5-ee722dea2dd0 (943bcf04-e177-4340-96e5-ee722dea2dd0): created successfully Aug 05 06:10:47 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-692211d6-3492-4f31-a591-dca4215ef064 tempest-DeleteServersTestJSON-1335824393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4958cbd8-4796-4a8e-914d-34ef75055d24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:10:47 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-692211d6-3492-4f31-a591-dca4215ef064 tempest-DeleteServersTestJSON-1335824393 None] Flow 'volume_create_manager' (978d80ad-0911-4d6a-920f-4b1f321c3527) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:10:47 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-692211d6-3492-4f31-a591-dca4215ef064 tempest-DeleteServersTestJSON-1335824393 None] Created volume successfully. Aug 05 06:10:48 devstack sudo[89560]: pam_unix(sudo:session): session closed for user root Aug 05 06:10:48 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [req-24f732e8-df1d-4e6b-be58-c5276f55d292 req-e349e406-7787-49ac-b79c-f0d4c8ad382d tempest-VolumesGetTestJSON-1640255637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-58b3e633-b9cf-4a4a-a4bb-789252dd3dc3 1073741824" returned: 0 in 0.812s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:10:48 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [req-24f732e8-df1d-4e6b-be58-c5276f55d292 req-e349e406-7787-49ac-b79c-f0d4c8ad382d tempest-VolumesGetTestJSON-1640255637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-58b3e633-b9cf-4a4a-a4bb-789252dd3dc3 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:10:48 devstack sudo[89570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-58b3e633-b9cf-4a4a-a4bb-789252dd3dc3 Aug 05 06:10:48 devstack sudo[89570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:10:49 devstack sudo[89570]: pam_unix(sudo:session): session closed for user root Aug 05 06:10:49 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [req-24f732e8-df1d-4e6b-be58-c5276f55d292 req-e349e406-7787-49ac-b79c-f0d4c8ad382d tempest-VolumesGetTestJSON-1640255637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-58b3e633-b9cf-4a4a-a4bb-789252dd3dc3" returned: 0 in 0.773s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:10:49 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [req-24f732e8-df1d-4e6b-be58-c5276f55d292 req-e349e406-7787-49ac-b79c-f0d4c8ad382d tempest-VolumesGetTestJSON-1640255637 None] <== create_volume: return (1703ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'} {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 06:10:49 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [req-24f732e8-df1d-4e6b-be58-c5276f55d292 req-e349e406-7787-49ac-b79c-f0d4c8ad382d tempest-VolumesGetTestJSON-1640255637 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.709s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:10:49 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [req-24f732e8-df1d-4e6b-be58-c5276f55d292 req-e349e406-7787-49ac-b79c-f0d4c8ad382d tempest-VolumesGetTestJSON-1640255637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b49556d1-875d-43d4-b07c-24ff6129f312) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58b3e633-b9cf-4a4a-a4bb-789252dd3dc3', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:10:49 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [req-24f732e8-df1d-4e6b-be58-c5276f55d292 req-e349e406-7787-49ac-b79c-f0d4c8ad382d tempest-VolumesGetTestJSON-1640255637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea56bb89-bcfc-4644-9928-ce2a0e391af6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:10:49 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [req-24f732e8-df1d-4e6b-be58-c5276f55d292 req-e349e406-7787-49ac-b79c-f0d4c8ad382d tempest-VolumesGetTestJSON-1640255637 None] Volume volume-58b3e633-b9cf-4a4a-a4bb-789252dd3dc3 (58b3e633-b9cf-4a4a-a4bb-789252dd3dc3): created successfully Aug 05 06:10:49 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [req-24f732e8-df1d-4e6b-be58-c5276f55d292 req-e349e406-7787-49ac-b79c-f0d4c8ad382d tempest-VolumesGetTestJSON-1640255637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea56bb89-bcfc-4644-9928-ce2a0e391af6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:10:49 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [req-24f732e8-df1d-4e6b-be58-c5276f55d292 req-e349e406-7787-49ac-b79c-f0d4c8ad382d tempest-VolumesGetTestJSON-1640255637 None] Flow 'volume_create_manager' (3ac86043-ce65-4188-a1eb-5c310ef575a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:10:49 devstack cinder-volume[88695]: INFO cinder.volume.manager [req-24f732e8-df1d-4e6b-be58-c5276f55d292 req-e349e406-7787-49ac-b79c-f0d4c8ad382d tempest-VolumesGetTestJSON-1640255637 None] Created volume successfully. Aug 05 06:10:50 devstack cinder-volume[88695]: DEBUG cinder.coordination [req-1c4ad697-9abc-4596-ad2a-291332e554cb req-c8b362f6-3774-4537-a93c-eed10bea0475 tempest-VolumesGetTestJSON-1640255637 None] Acquiring lock "cinder-58b3e633-b9cf-4a4a-a4bb-789252dd3dc3-delete_volume" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:10:50 devstack cinder-volume[88695]: DEBUG cinder.coordination [req-1c4ad697-9abc-4596-ad2a-291332e554cb req-c8b362f6-3774-4537-a93c-eed10bea0475 tempest-VolumesGetTestJSON-1640255637 None] Lock "cinder-58b3e633-b9cf-4a4a-a4bb-789252dd3dc3-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:10:51 devstack cinder-volume[88695]: DEBUG cinder.coordination [req-1c4ad697-9abc-4596-ad2a-291332e554cb req-c8b362f6-3774-4537-a93c-eed10bea0475 tempest-VolumesGetTestJSON-1640255637 None] Acquiring lock "cinder-quobyte-58b3e633-b9cf-4a4a-a4bb-789252dd3dc3" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:10:51 devstack cinder-volume[88695]: DEBUG cinder.coordination [req-1c4ad697-9abc-4596-ad2a-291332e554cb req-c8b362f6-3774-4537-a93c-eed10bea0475 tempest-VolumesGetTestJSON-1640255637 None] Lock "cinder-quobyte-58b3e633-b9cf-4a4a-a4bb-789252dd3dc3" acquired by "delete_volume" :: waited 0.035s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:10:51 devstack cinder-volume[88695]: INFO oslo.privsep.daemon [req-1c4ad697-9abc-4596-ad2a-291332e554cb req-c8b362f6-3774-4537-a93c-eed10bea0475 tempest-VolumesGetTestJSON-1640255637 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpp9lwb1xb/privsep.sock'] Aug 05 06:10:51 devstack sudo[89642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpp9lwb1xb/privsep.sock Aug 05 06:10:51 devstack sudo[89642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:10:52 devstack cinder-volume[88695]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Aug 05 06:10:52 devstack cinder-volume[88695]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Aug 05 06:10:52 devstack cinder-volume[88695]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Aug 05 06:10:52 devstack cinder-volume[88695]: WARNING oslo.privsep.daemon [-] privsep log: Aug 05 06:10:52 devstack cinder-volume[88695]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Aug 05 06:10:52 devstack cinder-volume[88695]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Aug 05 06:10:52 devstack cinder-volume[88695]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Aug 05 06:10:52 devstack cinder-volume[88695]: WARNING oslo.privsep.daemon [-] privsep log: Aug 05 06:10:52 devstack cinder-volume[88695]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Aug 05 06:10:52 devstack cinder-volume[88695]: WARNING py.warnings [req-a86bd675-dc08-4d1d-b201-c8d70333a2d3 req-d5bf57a6-303b-4afe-8dc9-8656325d85d5 tempest-DeleteServersTestJSON-1335824393 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volume_attachment". Apply join condition(s) between each element to resolve. Aug 05 06:10:52 devstack cinder-volume[88695]: .first() Aug 05 06:10:52 devstack cinder-volume[88695]: Aug 05 06:10:52 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [req-a86bd675-dc08-4d1d-b201-c8d70333a2d3 req-d5bf57a6-303b-4afe-8dc9-8656325d85d5 tempest-DeleteServersTestJSON-1335824393 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:10:52 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [req-a86bd675-dc08-4d1d-b201-c8d70333a2d3 req-d5bf57a6-303b-4afe-8dc9-8656325d85d5 tempest-DeleteServersTestJSON-1335824393 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:10:52 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [req-a86bd675-dc08-4d1d-b201-c8d70333a2d3 req-d5bf57a6-303b-4afe-8dc9-8656325d85d5 tempest-DeleteServersTestJSON-1335824393 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:10:52 devstack sudo[89642]: pam_unix(sudo:session): session closed for user root Aug 05 06:10:52 devstack cinder-volume[88695]: INFO oslo.privsep.daemon [req-1c4ad697-9abc-4596-ad2a-291332e554cb req-c8b362f6-3774-4537-a93c-eed10bea0475 tempest-VolumesGetTestJSON-1640255637 None] Spawned new privsep daemon via rootwrap Aug 05 06:10:52 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [req-1c4ad697-9abc-4596-ad2a-291332e554cb req-c8b362f6-3774-4537-a93c-eed10bea0475 tempest-VolumesGetTestJSON-1640255637 None] Accepted privsep connection to /tmp/tmpp9lwb1xb/privsep.sock {{(pid=88695) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Aug 05 06:10:52 devstack cinder-volume[88695]: INFO oslo.privsep.daemon [-] privsep daemon starting Aug 05 06:10:52 devstack cinder-volume[88695]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Aug 05 06:10:52 devstack cinder-volume[88695]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Aug 05 06:10:52 devstack cinder-volume[88695]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 89672 Aug 05 06:10:52 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[af8f13d1-f71d-4312-957e-d39ed0669129]: (2,) {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:10:52 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [req-a86bd675-dc08-4d1d-b201-c8d70333a2d3 req-d5bf57a6-303b-4afe-8dc9-8656325d85d5 tempest-DeleteServersTestJSON-1335824393 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087', 'name': 'volume-943bcf04-e177-4340-96e5-ee722dea2dd0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '282c0d1e-eced-4ef2-9c84-0d7d0c8dcce8', 'enforce_multipath': True} {{(pid=88695) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 05 06:10:52 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bb76b23-7b9b-41e9-ac33-ca0e75766f5a]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:10:52 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [req-1c4ad697-9abc-4596-ad2a-291332e554cb req-c8b362f6-3774-4537-a93c-eed10bea0475 tempest-VolumesGetTestJSON-1640255637 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-58b3e633-b9cf-4a4a-a4bb-789252dd3dc3 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:10:52 devstack cinder-volume[88695]: INFO cinder.volume.manager [req-a86bd675-dc08-4d1d-b201-c8d70333a2d3 req-d5bf57a6-303b-4afe-8dc9-8656325d85d5 tempest-DeleteServersTestJSON-1335824393 None] attachment_update completed successfully. Aug 05 06:10:52 devstack sudo[89675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-58b3e633-b9cf-4a4a-a4bb-789252dd3dc3 Aug 05 06:10:52 devstack sudo[89675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:10:53 devstack sudo[89675]: pam_unix(sudo:session): session closed for user root Aug 05 06:10:53 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [req-1c4ad697-9abc-4596-ad2a-291332e554cb req-c8b362f6-3774-4537-a93c-eed10bea0475 tempest-VolumesGetTestJSON-1640255637 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-58b3e633-b9cf-4a4a-a4bb-789252dd3dc3" returned: 0 in 0.421s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:10:53 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [req-1c4ad697-9abc-4596-ad2a-291332e554cb req-c8b362f6-3774-4537-a93c-eed10bea0475 tempest-VolumesGetTestJSON-1640255637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-58b3e633-b9cf-4a4a-a4bb-789252dd3dc3 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:10:53 devstack sudo[89703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-58b3e633-b9cf-4a4a-a4bb-789252dd3dc3 Aug 05 06:10:53 devstack sudo[89703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:10:53 devstack sudo[89703]: pam_unix(sudo:session): session closed for user root Aug 05 06:10:53 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [req-1c4ad697-9abc-4596-ad2a-291332e554cb req-c8b362f6-3774-4537-a93c-eed10bea0475 tempest-VolumesGetTestJSON-1640255637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-58b3e633-b9cf-4a4a-a4bb-789252dd3dc3" returned: 0 in 0.315s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:10:53 devstack cinder-volume[88695]: DEBUG cinder.coordination [req-1c4ad697-9abc-4596-ad2a-291332e554cb req-c8b362f6-3774-4537-a93c-eed10bea0475 tempest-VolumesGetTestJSON-1640255637 None] Lock "cinder-quobyte-58b3e633-b9cf-4a4a-a4bb-789252dd3dc3" released by "delete_volume" :: held 2.541s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:10:53 devstack cinder-volume[88695]: WARNING cinder.quota [req-1c4ad697-9abc-4596-ad2a-291332e554cb req-c8b362f6-3774-4537-a93c-eed10bea0475 tempest-VolumesGetTestJSON-1640255637 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Aug 05 06:10:53 devstack cinder-volume[88695]: WARNING cinder.quota [req-1c4ad697-9abc-4596-ad2a-291332e554cb req-c8b362f6-3774-4537-a93c-eed10bea0475 tempest-VolumesGetTestJSON-1640255637 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Aug 05 06:10:53 devstack cinder-volume[88695]: DEBUG cinder.quota [req-1c4ad697-9abc-4596-ad2a-291332e554cb req-c8b362f6-3774-4537-a93c-eed10bea0475 tempest-VolumesGetTestJSON-1640255637 None] Created reservations ['4967f17d-9469-438a-be15-65b50af558e2', 'c34e4214-f80f-42c1-975d-2de441719f03', 'fbe45ae4-b735-41f3-b58b-226c3c14a740', '59dc7c69-2c84-41a7-8421-8cbdfcbabcf4'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:10:53 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [req-1c4ad697-9abc-4596-ad2a-291332e554cb req-c8b362f6-3774-4537-a93c-eed10bea0475 tempest-VolumesGetTestJSON-1640255637 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:10:53 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [req-1c4ad697-9abc-4596-ad2a-291332e554cb req-c8b362f6-3774-4537-a93c-eed10bea0475 tempest-VolumesGetTestJSON-1640255637 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:10:53 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [req-1c4ad697-9abc-4596-ad2a-291332e554cb req-c8b362f6-3774-4537-a93c-eed10bea0475 tempest-VolumesGetTestJSON-1640255637 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:10:53 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [req-1c4ad697-9abc-4596-ad2a-291332e554cb req-c8b362f6-3774-4537-a93c-eed10bea0475 tempest-VolumesGetTestJSON-1640255637 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:10:53 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [req-1c4ad697-9abc-4596-ad2a-291332e554cb req-c8b362f6-3774-4537-a93c-eed10bea0475 tempest-VolumesGetTestJSON-1640255637 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:10:53 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [req-1c4ad697-9abc-4596-ad2a-291332e554cb req-c8b362f6-3774-4537-a93c-eed10bea0475 tempest-VolumesGetTestJSON-1640255637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:10:53 devstack sudo[90069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce Aug 05 06:10:53 devstack sudo[90069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:10:54 devstack sudo[90069]: pam_unix(sudo:session): session closed for user root Aug 05 06:10:54 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [req-1c4ad697-9abc-4596-ad2a-291332e554cb req-c8b362f6-3774-4537-a93c-eed10bea0475 tempest-VolumesGetTestJSON-1640255637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce" returned: 0 in 0.342s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:10:54 devstack cinder-volume[88695]: DEBUG cinder.manager [req-1c4ad697-9abc-4596-ad2a-291332e554cb req-c8b362f6-3774-4537-a93c-eed10bea0475 tempest-VolumesGetTestJSON-1640255637 None] Notifying Schedulers of capabilities ... {{(pid=88695) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 06:10:54 devstack cinder-volume[88695]: INFO cinder.volume.manager [req-1c4ad697-9abc-4596-ad2a-291332e554cb req-c8b362f6-3774-4537-a93c-eed10bea0475 tempest-VolumesGetTestJSON-1640255637 None] Deleted volume successfully. Aug 05 06:10:54 devstack cinder-volume[88695]: DEBUG cinder.coordination [req-1c4ad697-9abc-4596-ad2a-291332e554cb req-c8b362f6-3774-4537-a93c-eed10bea0475 tempest-VolumesGetTestJSON-1640255637 None] Lock "cinder-58b3e633-b9cf-4a4a-a4bb-789252dd3dc3-delete_volume" released by "delete_volume" :: held 3.278s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:10:59 devstack cinder-volume[88695]: INFO cinder.volume.manager [req-5fc362e9-ae3f-4268-b309-4e6aedefe05e req-ae79780c-c92d-4a26-9ead-b840915f0f77 tempest-DeleteServersTestJSON-1335824393 None] Terminate volume connection completed successfully. Aug 05 06:10:59 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [req-5fc362e9-ae3f-4268-b309-4e6aedefe05e req-ae79780c-c92d-4a26-9ead-b840915f0f77 tempest-DeleteServersTestJSON-1335824393 None] Deleting attachment 282c0d1e-eced-4ef2-9c84-0d7d0c8dcce8. {{(pid=88695) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 05 06:11:00 devstack cinder-volume[88695]: DEBUG oslo_service.periodic_task [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88695) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 06:11:00 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:11:00 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:11:00 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:11:00 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:11:00 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:11:00 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:11:00 devstack sudo[90237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce Aug 05 06:11:00 devstack sudo[90237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:11:00 devstack sudo[90237]: pam_unix(sudo:session): session closed for user root Aug 05 06:11:00 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce" returned: 0 in 0.331s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:11:00 devstack cinder-volume[88695]: DEBUG cinder.manager [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] Notifying Schedulers of capabilities ... {{(pid=88695) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 06:11:00 devstack cinder-volume[88695]: DEBUG oslo_service.periodic_task [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] Running periodic task VolumeManager._thread_info {{(pid=88695) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 06:11:00 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] thread count: 8 {{(pid=88695) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 05 06:11:00 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] thread info: [<_MainThread(MainThread, started 134469211893888)>, , , , , , , ] {{(pid=88695) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 05 06:11:01 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-9416877e-3848-4f6d-be27-5bb39d6f8b88 tempest-DeleteServersTestJSON-1335824393 None] Acquiring lock "cinder-943bcf04-e177-4340-96e5-ee722dea2dd0-delete_volume" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:11:01 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-9416877e-3848-4f6d-be27-5bb39d6f8b88 tempest-DeleteServersTestJSON-1335824393 None] Lock "cinder-943bcf04-e177-4340-96e5-ee722dea2dd0-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:11:01 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-9416877e-3848-4f6d-be27-5bb39d6f8b88 tempest-DeleteServersTestJSON-1335824393 None] Acquiring lock "cinder-quobyte-943bcf04-e177-4340-96e5-ee722dea2dd0" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:11:01 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-9416877e-3848-4f6d-be27-5bb39d6f8b88 tempest-DeleteServersTestJSON-1335824393 None] Lock "cinder-quobyte-943bcf04-e177-4340-96e5-ee722dea2dd0" acquired by "delete_volume" :: waited 0.021s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:11:01 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a5005b1-ab39-48f5-bc0a-13a3642e815f]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:11:01 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-9416877e-3848-4f6d-be27-5bb39d6f8b88 tempest-DeleteServersTestJSON-1335824393 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-943bcf04-e177-4340-96e5-ee722dea2dd0 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:11:01 devstack sudo[90241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-943bcf04-e177-4340-96e5-ee722dea2dd0 Aug 05 06:11:01 devstack sudo[90241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:11:01 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-cf457adf-18a1-49e5-a56b-0b59e4a394b1 tempest-BackendsCapabilitiesAdminTestsJSON-1165126438 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.743049621582, 'free_capacity_gb': 1775.743049621582, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=88695) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Aug 05 06:11:01 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-60ece9c4-b9d2-4783-965d-881375cb0239 tempest-BackendsCapabilitiesAdminTestsJSON-1165126438 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.743049621582, 'free_capacity_gb': 1775.743049621582, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=88695) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Aug 05 06:11:01 devstack sudo[90241]: pam_unix(sudo:session): session closed for user root Aug 05 06:11:01 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-9416877e-3848-4f6d-be27-5bb39d6f8b88 tempest-DeleteServersTestJSON-1335824393 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-943bcf04-e177-4340-96e5-ee722dea2dd0" returned: 0 in 0.504s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:11:01 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-9416877e-3848-4f6d-be27-5bb39d6f8b88 tempest-DeleteServersTestJSON-1335824393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-943bcf04-e177-4340-96e5-ee722dea2dd0 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:11:01 devstack sudo[90246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-943bcf04-e177-4340-96e5-ee722dea2dd0 Aug 05 06:11:01 devstack sudo[90246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:11:02 devstack sudo[90246]: pam_unix(sudo:session): session closed for user root Aug 05 06:11:02 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-9416877e-3848-4f6d-be27-5bb39d6f8b88 tempest-DeleteServersTestJSON-1335824393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-943bcf04-e177-4340-96e5-ee722dea2dd0" returned: 0 in 0.481s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:11:02 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-9416877e-3848-4f6d-be27-5bb39d6f8b88 tempest-DeleteServersTestJSON-1335824393 None] Lock "cinder-quobyte-943bcf04-e177-4340-96e5-ee722dea2dd0" released by "delete_volume" :: held 1.051s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:11:02 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-9416877e-3848-4f6d-be27-5bb39d6f8b88 tempest-DeleteServersTestJSON-1335824393 None] Created reservations ['81b0e33b-091c-4222-846c-b82c2cf98a90', '3ca315d1-6416-4bac-a080-09b773bc6713', '437e8053-5823-4b36-8e40-f8a17e5b1a08', '452329ff-9cd1-4398-9790-cefac08b505a'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:11:02 devstack cinder-volume[88695]: DEBUG cinder.volume.flows.manager.create_volume [None req-8092c70e-c445-403b-b316-4d24c5331dcb tempest-VolumesAdminNegativeTest-936490151 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88695) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 06:11:02 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-8092c70e-c445-403b-b316-4d24c5331dcb tempest-VolumesAdminNegativeTest-936490151 None] Flow 'volume_create_manager' (89f982a0-eeba-4cfa-a4b3-223e0dcddc5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:11:02 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-8092c70e-c445-403b-b316-4d24c5331dcb tempest-VolumesAdminNegativeTest-936490151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0be3531-2980-4522-bafb-3fb19f359178) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:11:02 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-8092c70e-c445-403b-b316-4d24c5331dcb tempest-VolumesAdminNegativeTest-936490151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0be3531-2980-4522-bafb-3fb19f359178) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:11:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1438265593',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=986061c3-0e3a-4f73-839f-6db8201e18e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3ef910df8e4429ba6a89122b19c0457',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:11:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:11:02Z,use_quota=True,user_id='7bc42793fec6482390807ad882dd9eb1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:11:02 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-8092c70e-c445-403b-b316-4d24c5331dcb tempest-VolumesAdminNegativeTest-936490151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3aa2c811-cf38-4d9e-b880-23d7c2f76102) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:11:02 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-8092c70e-c445-403b-b316-4d24c5331dcb tempest-VolumesAdminNegativeTest-936490151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3aa2c811-cf38-4d9e-b880-23d7c2f76102) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:11:02 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-8092c70e-c445-403b-b316-4d24c5331dcb tempest-VolumesAdminNegativeTest-936490151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a847698-07ca-4322-b6d3-6e02ab83acb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:11:02 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-8092c70e-c445-403b-b316-4d24c5331dcb tempest-VolumesAdminNegativeTest-936490151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a847698-07ca-4322-b6d3-6e02ab83acb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '986061c3-0e3a-4f73-839f-6db8201e18e3', 'volume_name': 'volume-986061c3-0e3a-4f73-839f-6db8201e18e3', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:11:02 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-8092c70e-c445-403b-b316-4d24c5331dcb tempest-VolumesAdminNegativeTest-936490151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a2b9e65-50c2-4abd-a30c-3da10b5bbe6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:11:02 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-8092c70e-c445-403b-b316-4d24c5331dcb tempest-VolumesAdminNegativeTest-936490151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a2b9e65-50c2-4abd-a30c-3da10b5bbe6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:11:02 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-8092c70e-c445-403b-b316-4d24c5331dcb tempest-VolumesAdminNegativeTest-936490151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0056ff65-ec92-45f9-a0f0-1a24875bb457) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:11:02 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-8092c70e-c445-403b-b316-4d24c5331dcb tempest-VolumesAdminNegativeTest-936490151 None] Volume 986061c3-0e3a-4f73-839f-6db8201e18e3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-986061c3-0e3a-4f73-839f-6db8201e18e3', 'volume_size': 1} Aug 05 06:11:02 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-8092c70e-c445-403b-b316-4d24c5331dcb tempest-VolumesAdminNegativeTest-936490151 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:11:02 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-8092c70e-c445-403b-b316-4d24c5331dcb tempest-VolumesAdminNegativeTest-936490151 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:11:02 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-8092c70e-c445-403b-b316-4d24c5331dcb tempest-VolumesAdminNegativeTest-936490151 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:11:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1438265593',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=986061c3-0e3a-4f73-839f-6db8201e18e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3ef910df8e4429ba6a89122b19c0457',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:11:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:11:02Z,use_quota=True,user_id='7bc42793fec6482390807ad882dd9eb1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)}" {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 06:11:02 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-8092c70e-c445-403b-b316-4d24c5331dcb tempest-VolumesAdminNegativeTest-936490151 None] Creating volume 986061c3-0e3a-4f73-839f-6db8201e18e3 {{(pid=88695) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 06:11:02 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-8092c70e-c445-403b-b316-4d24c5331dcb tempest-VolumesAdminNegativeTest-936490151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:11:02 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-8092c70e-c445-403b-b316-4d24c5331dcb tempest-VolumesAdminNegativeTest-936490151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:11:02 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-8092c70e-c445-403b-b316-4d24c5331dcb tempest-VolumesAdminNegativeTest-936490151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:11:02 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-8092c70e-c445-403b-b316-4d24c5331dcb tempest-VolumesAdminNegativeTest-936490151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:11:02 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-8092c70e-c445-403b-b316-4d24c5331dcb tempest-VolumesAdminNegativeTest-936490151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:11:02 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-8092c70e-c445-403b-b316-4d24c5331dcb tempest-VolumesAdminNegativeTest-936490151 None] Selected osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 as target Quobyte volume. {{(pid=88695) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 06:11:02 devstack cinder-volume[88695]: INFO cinder.volume.drivers.remotefs [None req-8092c70e-c445-403b-b316-4d24c5331dcb tempest-VolumesAdminNegativeTest-936490151 None] casted to osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 Aug 05 06:11:02 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-8092c70e-c445-403b-b316-4d24c5331dcb tempest-VolumesAdminNegativeTest-936490151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-986061c3-0e3a-4f73-839f-6db8201e18e3 1073741824 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:11:02 devstack sudo[90250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-986061c3-0e3a-4f73-839f-6db8201e18e3 1073741824 Aug 05 06:11:02 devstack sudo[90250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:11:02 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-9416877e-3848-4f6d-be27-5bb39d6f8b88 tempest-DeleteServersTestJSON-1335824393 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:11:02 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-9416877e-3848-4f6d-be27-5bb39d6f8b88 tempest-DeleteServersTestJSON-1335824393 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:11:02 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-9416877e-3848-4f6d-be27-5bb39d6f8b88 tempest-DeleteServersTestJSON-1335824393 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:11:02 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-9416877e-3848-4f6d-be27-5bb39d6f8b88 tempest-DeleteServersTestJSON-1335824393 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:11:02 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-9416877e-3848-4f6d-be27-5bb39d6f8b88 tempest-DeleteServersTestJSON-1335824393 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:11:02 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-9416877e-3848-4f6d-be27-5bb39d6f8b88 tempest-DeleteServersTestJSON-1335824393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:11:02 devstack sudo[90253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce Aug 05 06:11:02 devstack sudo[90253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:11:03 devstack sudo[90253]: pam_unix(sudo:session): session closed for user root Aug 05 06:11:03 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-9416877e-3848-4f6d-be27-5bb39d6f8b88 tempest-DeleteServersTestJSON-1335824393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce" returned: 0 in 0.405s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:11:03 devstack cinder-volume[88695]: DEBUG cinder.manager [None req-9416877e-3848-4f6d-be27-5bb39d6f8b88 tempest-DeleteServersTestJSON-1335824393 None] Notifying Schedulers of capabilities ... {{(pid=88695) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 06:11:03 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-9416877e-3848-4f6d-be27-5bb39d6f8b88 tempest-DeleteServersTestJSON-1335824393 None] Deleted volume successfully. Aug 05 06:11:03 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-9416877e-3848-4f6d-be27-5bb39d6f8b88 tempest-DeleteServersTestJSON-1335824393 None] Lock "cinder-943bcf04-e177-4340-96e5-ee722dea2dd0-delete_volume" released by "delete_volume" :: held 2.002s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:11:03 devstack sudo[90250]: pam_unix(sudo:session): session closed for user root Aug 05 06:11:03 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-8092c70e-c445-403b-b316-4d24c5331dcb tempest-VolumesAdminNegativeTest-936490151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-986061c3-0e3a-4f73-839f-6db8201e18e3 1073741824" returned: 0 in 0.734s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:11:03 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-8092c70e-c445-403b-b316-4d24c5331dcb tempest-VolumesAdminNegativeTest-936490151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-986061c3-0e3a-4f73-839f-6db8201e18e3 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:11:03 devstack sudo[90260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-986061c3-0e3a-4f73-839f-6db8201e18e3 Aug 05 06:11:03 devstack sudo[90260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:11:03 devstack sudo[90260]: pam_unix(sudo:session): session closed for user root Aug 05 06:11:03 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-8092c70e-c445-403b-b316-4d24c5331dcb tempest-VolumesAdminNegativeTest-936490151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-986061c3-0e3a-4f73-839f-6db8201e18e3" returned: 0 in 0.505s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:11:03 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-8092c70e-c445-403b-b316-4d24c5331dcb tempest-VolumesAdminNegativeTest-936490151 None] <== create_volume: return (1296ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'} {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 06:11:03 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-8092c70e-c445-403b-b316-4d24c5331dcb tempest-VolumesAdminNegativeTest-936490151 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.301s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:11:03 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-8092c70e-c445-403b-b316-4d24c5331dcb tempest-VolumesAdminNegativeTest-936490151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0056ff65-ec92-45f9-a0f0-1a24875bb457) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-986061c3-0e3a-4f73-839f-6db8201e18e3', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:11:03 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-8092c70e-c445-403b-b316-4d24c5331dcb tempest-VolumesAdminNegativeTest-936490151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cecfc4e7-1c83-422a-b5ab-c2c0e7f04651) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:11:03 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-8092c70e-c445-403b-b316-4d24c5331dcb tempest-VolumesAdminNegativeTest-936490151 None] Volume volume-986061c3-0e3a-4f73-839f-6db8201e18e3 (986061c3-0e3a-4f73-839f-6db8201e18e3): created successfully Aug 05 06:11:03 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-8092c70e-c445-403b-b316-4d24c5331dcb tempest-VolumesAdminNegativeTest-936490151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cecfc4e7-1c83-422a-b5ab-c2c0e7f04651) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:11:03 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-8092c70e-c445-403b-b316-4d24c5331dcb tempest-VolumesAdminNegativeTest-936490151 None] Flow 'volume_create_manager' (89f982a0-eeba-4cfa-a4b3-223e0dcddc5a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:11:03 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-8092c70e-c445-403b-b316-4d24c5331dcb tempest-VolumesAdminNegativeTest-936490151 None] Created volume successfully. Aug 05 06:11:05 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-92cc4129-701d-49e4-bc22-ea02192a1eed tempest-VolumesAdminNegativeTest-936490151 None] Acquiring lock "cinder-986061c3-0e3a-4f73-839f-6db8201e18e3-delete_volume" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:11:05 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-92cc4129-701d-49e4-bc22-ea02192a1eed tempest-VolumesAdminNegativeTest-936490151 None] Lock "cinder-986061c3-0e3a-4f73-839f-6db8201e18e3-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:11:05 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-92cc4129-701d-49e4-bc22-ea02192a1eed tempest-VolumesAdminNegativeTest-936490151 None] Acquiring lock "cinder-quobyte-986061c3-0e3a-4f73-839f-6db8201e18e3" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:11:05 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-92cc4129-701d-49e4-bc22-ea02192a1eed tempest-VolumesAdminNegativeTest-936490151 None] Lock "cinder-quobyte-986061c3-0e3a-4f73-839f-6db8201e18e3" acquired by "delete_volume" :: waited 0.026s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:11:05 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9ca3826-8967-4419-8c15-d73a00c269fc]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:11:05 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-92cc4129-701d-49e4-bc22-ea02192a1eed tempest-VolumesAdminNegativeTest-936490151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-986061c3-0e3a-4f73-839f-6db8201e18e3 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:11:05 devstack sudo[90263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-986061c3-0e3a-4f73-839f-6db8201e18e3 Aug 05 06:11:05 devstack sudo[90263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:11:06 devstack sudo[90263]: pam_unix(sudo:session): session closed for user root Aug 05 06:11:06 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-92cc4129-701d-49e4-bc22-ea02192a1eed tempest-VolumesAdminNegativeTest-936490151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-986061c3-0e3a-4f73-839f-6db8201e18e3" returned: 0 in 0.551s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:11:06 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-92cc4129-701d-49e4-bc22-ea02192a1eed tempest-VolumesAdminNegativeTest-936490151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-986061c3-0e3a-4f73-839f-6db8201e18e3 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:11:06 devstack sudo[90269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-986061c3-0e3a-4f73-839f-6db8201e18e3 Aug 05 06:11:06 devstack sudo[90269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:11:06 devstack sudo[90269]: pam_unix(sudo:session): session closed for user root Aug 05 06:11:06 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-92cc4129-701d-49e4-bc22-ea02192a1eed tempest-VolumesAdminNegativeTest-936490151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-986061c3-0e3a-4f73-839f-6db8201e18e3" returned: 0 in 0.377s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:11:06 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-92cc4129-701d-49e4-bc22-ea02192a1eed tempest-VolumesAdminNegativeTest-936490151 None] Lock "cinder-quobyte-986061c3-0e3a-4f73-839f-6db8201e18e3" released by "delete_volume" :: held 0.985s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:11:06 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-92cc4129-701d-49e4-bc22-ea02192a1eed tempest-VolumesAdminNegativeTest-936490151 None] Created reservations ['be80490f-1638-45dd-a147-57facb4a4886', '3251f934-a645-4f4a-8299-58262fe0536c', '17094919-de89-4c51-ba51-995c99769ff5', '0b223b64-be95-4804-8684-9da2b866be8c'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:11:06 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-92cc4129-701d-49e4-bc22-ea02192a1eed tempest-VolumesAdminNegativeTest-936490151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:11:06 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-92cc4129-701d-49e4-bc22-ea02192a1eed tempest-VolumesAdminNegativeTest-936490151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:11:06 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-92cc4129-701d-49e4-bc22-ea02192a1eed tempest-VolumesAdminNegativeTest-936490151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:11:06 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-92cc4129-701d-49e4-bc22-ea02192a1eed tempest-VolumesAdminNegativeTest-936490151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:11:06 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-92cc4129-701d-49e4-bc22-ea02192a1eed tempest-VolumesAdminNegativeTest-936490151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:11:06 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-92cc4129-701d-49e4-bc22-ea02192a1eed tempest-VolumesAdminNegativeTest-936490151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:11:06 devstack sudo[90273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce Aug 05 06:11:07 devstack sudo[90273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:11:07 devstack sudo[90273]: pam_unix(sudo:session): session closed for user root Aug 05 06:11:07 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-92cc4129-701d-49e4-bc22-ea02192a1eed tempest-VolumesAdminNegativeTest-936490151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce" returned: 0 in 0.359s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:11:07 devstack cinder-volume[88695]: DEBUG cinder.manager [None req-92cc4129-701d-49e4-bc22-ea02192a1eed tempest-VolumesAdminNegativeTest-936490151 None] Notifying Schedulers of capabilities ... {{(pid=88695) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 06:11:07 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-92cc4129-701d-49e4-bc22-ea02192a1eed tempest-VolumesAdminNegativeTest-936490151 None] Deleted volume successfully. Aug 05 06:11:07 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-92cc4129-701d-49e4-bc22-ea02192a1eed tempest-VolumesAdminNegativeTest-936490151 None] Lock "cinder-986061c3-0e3a-4f73-839f-6db8201e18e3-delete_volume" released by "delete_volume" :: held 1.844s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:11:10 devstack cinder-volume[88695]: DEBUG cinder.volume.flows.manager.create_volume [None req-eabc864c-cf16-41bb-8ec0-8bc50e16d4f0 tempest-VolumeQuotasNegativeTestJSON-1399549751 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88695) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 06:11:10 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-eabc864c-cf16-41bb-8ec0-8bc50e16d4f0 tempest-VolumeQuotasNegativeTestJSON-1399549751 None] Flow 'volume_create_manager' (f1959136-bd91-447f-a52e-e75fc2938067) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:11:10 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-eabc864c-cf16-41bb-8ec0-8bc50e16d4f0 tempest-VolumeQuotasNegativeTestJSON-1399549751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ac4f296-af22-4f68-88a1-97b76ed95490) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:11:10 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-eabc864c-cf16-41bb-8ec0-8bc50e16d4f0 tempest-VolumeQuotasNegativeTestJSON-1399549751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ac4f296-af22-4f68-88a1-97b76ed95490) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:11:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-84321547',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2342f85b-5e66-4513-86c8-d974feaaeff4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed5e169fa3234d60b515cda6f93a90e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:11:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:11:11Z,use_quota=True,user_id='f1b8f8dd958344f88d58ec80f9b26130',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:11:10 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-eabc864c-cf16-41bb-8ec0-8bc50e16d4f0 tempest-VolumeQuotasNegativeTestJSON-1399549751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57ddf021-4ee2-4da9-9be7-60de1f625fe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:11:10 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-eabc864c-cf16-41bb-8ec0-8bc50e16d4f0 tempest-VolumeQuotasNegativeTestJSON-1399549751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57ddf021-4ee2-4da9-9be7-60de1f625fe5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:11:10 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-eabc864c-cf16-41bb-8ec0-8bc50e16d4f0 tempest-VolumeQuotasNegativeTestJSON-1399549751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88f0eabc-b830-41e7-87e2-038c29401945) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:11:10 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-eabc864c-cf16-41bb-8ec0-8bc50e16d4f0 tempest-VolumeQuotasNegativeTestJSON-1399549751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88f0eabc-b830-41e7-87e2-038c29401945) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2342f85b-5e66-4513-86c8-d974feaaeff4', 'volume_name': 'volume-2342f85b-5e66-4513-86c8-d974feaaeff4', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:11:10 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-eabc864c-cf16-41bb-8ec0-8bc50e16d4f0 tempest-VolumeQuotasNegativeTestJSON-1399549751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cb8da81-52eb-41a2-bb62-4fc922214273) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:11:10 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-eabc864c-cf16-41bb-8ec0-8bc50e16d4f0 tempest-VolumeQuotasNegativeTestJSON-1399549751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cb8da81-52eb-41a2-bb62-4fc922214273) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:11:10 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-eabc864c-cf16-41bb-8ec0-8bc50e16d4f0 tempest-VolumeQuotasNegativeTestJSON-1399549751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0aa12168-3680-4c99-b15e-93ab976eff32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:11:10 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-eabc864c-cf16-41bb-8ec0-8bc50e16d4f0 tempest-VolumeQuotasNegativeTestJSON-1399549751 None] Volume 2342f85b-5e66-4513-86c8-d974feaaeff4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2342f85b-5e66-4513-86c8-d974feaaeff4', 'volume_size': 1} Aug 05 06:11:10 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-eabc864c-cf16-41bb-8ec0-8bc50e16d4f0 tempest-VolumeQuotasNegativeTestJSON-1399549751 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:11:10 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-eabc864c-cf16-41bb-8ec0-8bc50e16d4f0 tempest-VolumeQuotasNegativeTestJSON-1399549751 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:11:10 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-eabc864c-cf16-41bb-8ec0-8bc50e16d4f0 tempest-VolumeQuotasNegativeTestJSON-1399549751 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:11:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-84321547',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2342f85b-5e66-4513-86c8-d974feaaeff4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed5e169fa3234d60b515cda6f93a90e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:11:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:11:11Z,use_quota=True,user_id='f1b8f8dd958344f88d58ec80f9b26130',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)}" {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 06:11:10 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-eabc864c-cf16-41bb-8ec0-8bc50e16d4f0 tempest-VolumeQuotasNegativeTestJSON-1399549751 None] Creating volume 2342f85b-5e66-4513-86c8-d974feaaeff4 {{(pid=88695) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 06:11:10 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-eabc864c-cf16-41bb-8ec0-8bc50e16d4f0 tempest-VolumeQuotasNegativeTestJSON-1399549751 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:11:10 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-eabc864c-cf16-41bb-8ec0-8bc50e16d4f0 tempest-VolumeQuotasNegativeTestJSON-1399549751 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:11:10 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-eabc864c-cf16-41bb-8ec0-8bc50e16d4f0 tempest-VolumeQuotasNegativeTestJSON-1399549751 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:11:10 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-eabc864c-cf16-41bb-8ec0-8bc50e16d4f0 tempest-VolumeQuotasNegativeTestJSON-1399549751 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:11:10 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-eabc864c-cf16-41bb-8ec0-8bc50e16d4f0 tempest-VolumeQuotasNegativeTestJSON-1399549751 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:11:10 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-eabc864c-cf16-41bb-8ec0-8bc50e16d4f0 tempest-VolumeQuotasNegativeTestJSON-1399549751 None] Selected osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 as target Quobyte volume. {{(pid=88695) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 06:11:10 devstack cinder-volume[88695]: INFO cinder.volume.drivers.remotefs [None req-eabc864c-cf16-41bb-8ec0-8bc50e16d4f0 tempest-VolumeQuotasNegativeTestJSON-1399549751 None] casted to osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 Aug 05 06:11:10 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-eabc864c-cf16-41bb-8ec0-8bc50e16d4f0 tempest-VolumeQuotasNegativeTestJSON-1399549751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-2342f85b-5e66-4513-86c8-d974feaaeff4 1073741824 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:11:10 devstack sudo[90310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-2342f85b-5e66-4513-86c8-d974feaaeff4 1073741824 Aug 05 06:11:10 devstack sudo[90310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:11:11 devstack sudo[90310]: pam_unix(sudo:session): session closed for user root Aug 05 06:11:11 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-eabc864c-cf16-41bb-8ec0-8bc50e16d4f0 tempest-VolumeQuotasNegativeTestJSON-1399549751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-2342f85b-5e66-4513-86c8-d974feaaeff4 1073741824" returned: 0 in 0.579s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:11:11 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-eabc864c-cf16-41bb-8ec0-8bc50e16d4f0 tempest-VolumeQuotasNegativeTestJSON-1399549751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-2342f85b-5e66-4513-86c8-d974feaaeff4 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:11:11 devstack sudo[90317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-2342f85b-5e66-4513-86c8-d974feaaeff4 Aug 05 06:11:11 devstack sudo[90317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:11:11 devstack sudo[90317]: pam_unix(sudo:session): session closed for user root Aug 05 06:11:11 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-eabc864c-cf16-41bb-8ec0-8bc50e16d4f0 tempest-VolumeQuotasNegativeTestJSON-1399549751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-2342f85b-5e66-4513-86c8-d974feaaeff4" returned: 0 in 0.327s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:11:11 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-eabc864c-cf16-41bb-8ec0-8bc50e16d4f0 tempest-VolumeQuotasNegativeTestJSON-1399549751 None] <== create_volume: return (975ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'} {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 06:11:11 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-eabc864c-cf16-41bb-8ec0-8bc50e16d4f0 tempest-VolumeQuotasNegativeTestJSON-1399549751 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.978s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:11:11 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-eabc864c-cf16-41bb-8ec0-8bc50e16d4f0 tempest-VolumeQuotasNegativeTestJSON-1399549751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0aa12168-3680-4c99-b15e-93ab976eff32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2342f85b-5e66-4513-86c8-d974feaaeff4', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:11:11 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-eabc864c-cf16-41bb-8ec0-8bc50e16d4f0 tempest-VolumeQuotasNegativeTestJSON-1399549751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8013033-bb36-48c7-bbd8-767faeb3e7f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:11:11 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-eabc864c-cf16-41bb-8ec0-8bc50e16d4f0 tempest-VolumeQuotasNegativeTestJSON-1399549751 None] Volume volume-2342f85b-5e66-4513-86c8-d974feaaeff4 (2342f85b-5e66-4513-86c8-d974feaaeff4): created successfully Aug 05 06:11:11 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-eabc864c-cf16-41bb-8ec0-8bc50e16d4f0 tempest-VolumeQuotasNegativeTestJSON-1399549751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8013033-bb36-48c7-bbd8-767faeb3e7f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:11:11 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-eabc864c-cf16-41bb-8ec0-8bc50e16d4f0 tempest-VolumeQuotasNegativeTestJSON-1399549751 None] Flow 'volume_create_manager' (f1959136-bd91-447f-a52e-e75fc2938067) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:11:11 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-eabc864c-cf16-41bb-8ec0-8bc50e16d4f0 tempest-VolumeQuotasNegativeTestJSON-1399549751 None] Created volume successfully. Aug 05 06:11:13 devstack cinder-volume[88695]: DEBUG cinder.volume.flows.manager.create_volume [None req-d096a056-98fa-4a2c-b49c-f29f162017ed tempest-VolumesTestJSON-1223388473 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88695) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 06:11:13 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-d096a056-98fa-4a2c-b49c-f29f162017ed tempest-VolumesTestJSON-1223388473 None] Flow 'volume_create_manager' (e99a59e9-963e-4247-8690-9ae761fb9146) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:11:13 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-d096a056-98fa-4a2c-b49c-f29f162017ed tempest-VolumesTestJSON-1223388473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (635ccb1d-1e84-486b-a20a-3f80e7b10a40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:11:14 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-d096a056-98fa-4a2c-b49c-f29f162017ed tempest-VolumesTestJSON-1223388473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (635ccb1d-1e84-486b-a20a-3f80e7b10a40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:11:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-502050977',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54874d3f-c040-4ef7-8266-e3fd91a1553d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='53e9d06a6aa74644b68a26e92bab181d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:11:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:11:14Z,use_quota=True,user_id='dc5ff01ced2441da84a1e6d9c093de24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:11:14 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-d096a056-98fa-4a2c-b49c-f29f162017ed tempest-VolumesTestJSON-1223388473 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73e379af-231a-40bb-9652-a300ee1034c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:11:14 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-d096a056-98fa-4a2c-b49c-f29f162017ed tempest-VolumesTestJSON-1223388473 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73e379af-231a-40bb-9652-a300ee1034c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:11:14 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-d096a056-98fa-4a2c-b49c-f29f162017ed tempest-VolumesTestJSON-1223388473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a66698a-5e98-493d-bc16-e1aac6a5acce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:11:14 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-d096a056-98fa-4a2c-b49c-f29f162017ed tempest-VolumesTestJSON-1223388473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a66698a-5e98-493d-bc16-e1aac6a5acce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '54874d3f-c040-4ef7-8266-e3fd91a1553d', 'volume_name': 'volume-54874d3f-c040-4ef7-8266-e3fd91a1553d', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:11:14 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-d096a056-98fa-4a2c-b49c-f29f162017ed tempest-VolumesTestJSON-1223388473 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (648c6f33-d133-49b9-8e6f-590b5f4fd5a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:11:14 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-d096a056-98fa-4a2c-b49c-f29f162017ed tempest-VolumesTestJSON-1223388473 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (648c6f33-d133-49b9-8e6f-590b5f4fd5a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:11:14 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-d096a056-98fa-4a2c-b49c-f29f162017ed tempest-VolumesTestJSON-1223388473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3596e6c-a53e-4c02-884c-de5289f34a25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:11:14 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-d096a056-98fa-4a2c-b49c-f29f162017ed tempest-VolumesTestJSON-1223388473 None] Volume 54874d3f-c040-4ef7-8266-e3fd91a1553d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-54874d3f-c040-4ef7-8266-e3fd91a1553d', 'volume_size': 1} Aug 05 06:11:14 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-d096a056-98fa-4a2c-b49c-f29f162017ed tempest-VolumesTestJSON-1223388473 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:11:14 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-d096a056-98fa-4a2c-b49c-f29f162017ed tempest-VolumesTestJSON-1223388473 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:11:14 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-d096a056-98fa-4a2c-b49c-f29f162017ed tempest-VolumesTestJSON-1223388473 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:11:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-502050977',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54874d3f-c040-4ef7-8266-e3fd91a1553d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='53e9d06a6aa74644b68a26e92bab181d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:11:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:11:14Z,use_quota=True,user_id='dc5ff01ced2441da84a1e6d9c093de24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)}" {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 06:11:14 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-d096a056-98fa-4a2c-b49c-f29f162017ed tempest-VolumesTestJSON-1223388473 None] Creating volume 54874d3f-c040-4ef7-8266-e3fd91a1553d {{(pid=88695) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 06:11:14 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-d096a056-98fa-4a2c-b49c-f29f162017ed tempest-VolumesTestJSON-1223388473 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:11:14 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-d096a056-98fa-4a2c-b49c-f29f162017ed tempest-VolumesTestJSON-1223388473 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:11:14 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-d096a056-98fa-4a2c-b49c-f29f162017ed tempest-VolumesTestJSON-1223388473 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:11:14 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-d096a056-98fa-4a2c-b49c-f29f162017ed tempest-VolumesTestJSON-1223388473 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:11:14 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-d096a056-98fa-4a2c-b49c-f29f162017ed tempest-VolumesTestJSON-1223388473 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:11:14 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-d096a056-98fa-4a2c-b49c-f29f162017ed tempest-VolumesTestJSON-1223388473 None] Selected osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 as target Quobyte volume. {{(pid=88695) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 06:11:14 devstack cinder-volume[88695]: INFO cinder.volume.drivers.remotefs [None req-d096a056-98fa-4a2c-b49c-f29f162017ed tempest-VolumesTestJSON-1223388473 None] casted to osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 Aug 05 06:11:14 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-d096a056-98fa-4a2c-b49c-f29f162017ed tempest-VolumesTestJSON-1223388473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-54874d3f-c040-4ef7-8266-e3fd91a1553d 1073741824 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:11:14 devstack sudo[90321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-54874d3f-c040-4ef7-8266-e3fd91a1553d 1073741824 Aug 05 06:11:14 devstack sudo[90321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:11:14 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-4d5b0c4d-0ea2-41b8-ac5f-311ffbf6cfa4 tempest-VolumeQuotasNegativeTestJSON-1399549751 None] Acquiring lock "cinder-2342f85b-5e66-4513-86c8-d974feaaeff4-delete_volume" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:11:14 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-4d5b0c4d-0ea2-41b8-ac5f-311ffbf6cfa4 tempest-VolumeQuotasNegativeTestJSON-1399549751 None] Lock "cinder-2342f85b-5e66-4513-86c8-d974feaaeff4-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:11:14 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-4d5b0c4d-0ea2-41b8-ac5f-311ffbf6cfa4 tempest-VolumeQuotasNegativeTestJSON-1399549751 None] Acquiring lock "cinder-quobyte-2342f85b-5e66-4513-86c8-d974feaaeff4" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:11:14 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-4d5b0c4d-0ea2-41b8-ac5f-311ffbf6cfa4 tempest-VolumeQuotasNegativeTestJSON-1399549751 None] Lock "cinder-quobyte-2342f85b-5e66-4513-86c8-d974feaaeff4" acquired by "delete_volume" :: waited 0.030s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:11:14 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c16b807-45df-40d1-84b1-357eab6ce7f3]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:11:14 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-4d5b0c4d-0ea2-41b8-ac5f-311ffbf6cfa4 tempest-VolumeQuotasNegativeTestJSON-1399549751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-2342f85b-5e66-4513-86c8-d974feaaeff4 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:11:14 devstack sudo[90321]: pam_unix(sudo:session): session closed for user root Aug 05 06:11:14 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-d096a056-98fa-4a2c-b49c-f29f162017ed tempest-VolumesTestJSON-1223388473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-54874d3f-c040-4ef7-8266-e3fd91a1553d 1073741824" returned: 0 in 0.540s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:11:14 devstack sudo[90327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-2342f85b-5e66-4513-86c8-d974feaaeff4 Aug 05 06:11:14 devstack sudo[90327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:11:14 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-d096a056-98fa-4a2c-b49c-f29f162017ed tempest-VolumesTestJSON-1223388473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-54874d3f-c040-4ef7-8266-e3fd91a1553d {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:11:14 devstack sudo[90329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-54874d3f-c040-4ef7-8266-e3fd91a1553d Aug 05 06:11:14 devstack sudo[90329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:11:15 devstack sudo[90329]: pam_unix(sudo:session): session closed for user root Aug 05 06:11:15 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-d096a056-98fa-4a2c-b49c-f29f162017ed tempest-VolumesTestJSON-1223388473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-54874d3f-c040-4ef7-8266-e3fd91a1553d" returned: 0 in 0.328s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:11:15 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-d096a056-98fa-4a2c-b49c-f29f162017ed tempest-VolumesTestJSON-1223388473 None] <== create_volume: return (980ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'} {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 06:11:15 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-d096a056-98fa-4a2c-b49c-f29f162017ed tempest-VolumesTestJSON-1223388473 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.983s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:11:15 devstack sudo[90327]: pam_unix(sudo:session): session closed for user root Aug 05 06:11:15 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-4d5b0c4d-0ea2-41b8-ac5f-311ffbf6cfa4 tempest-VolumeQuotasNegativeTestJSON-1399549751 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-2342f85b-5e66-4513-86c8-d974feaaeff4" returned: 0 in 0.592s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:11:15 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-4d5b0c4d-0ea2-41b8-ac5f-311ffbf6cfa4 tempest-VolumeQuotasNegativeTestJSON-1399549751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-2342f85b-5e66-4513-86c8-d974feaaeff4 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:11:15 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-d096a056-98fa-4a2c-b49c-f29f162017ed tempest-VolumesTestJSON-1223388473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3596e6c-a53e-4c02-884c-de5289f34a25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54874d3f-c040-4ef7-8266-e3fd91a1553d', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:11:15 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-d096a056-98fa-4a2c-b49c-f29f162017ed tempest-VolumesTestJSON-1223388473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba0f1037-4be9-435f-8ef3-1b2fa24e84ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:11:15 devstack sudo[90335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-2342f85b-5e66-4513-86c8-d974feaaeff4 Aug 05 06:11:15 devstack sudo[90335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:11:15 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-d096a056-98fa-4a2c-b49c-f29f162017ed tempest-VolumesTestJSON-1223388473 None] Volume volume-54874d3f-c040-4ef7-8266-e3fd91a1553d (54874d3f-c040-4ef7-8266-e3fd91a1553d): created successfully Aug 05 06:11:15 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-d096a056-98fa-4a2c-b49c-f29f162017ed tempest-VolumesTestJSON-1223388473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba0f1037-4be9-435f-8ef3-1b2fa24e84ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:11:15 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-d096a056-98fa-4a2c-b49c-f29f162017ed tempest-VolumesTestJSON-1223388473 None] Flow 'volume_create_manager' (e99a59e9-963e-4247-8690-9ae761fb9146) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:11:15 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-d096a056-98fa-4a2c-b49c-f29f162017ed tempest-VolumesTestJSON-1223388473 None] Created volume successfully. Aug 05 06:11:15 devstack sudo[90335]: pam_unix(sudo:session): session closed for user root Aug 05 06:11:15 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-4d5b0c4d-0ea2-41b8-ac5f-311ffbf6cfa4 tempest-VolumeQuotasNegativeTestJSON-1399549751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-2342f85b-5e66-4513-86c8-d974feaaeff4" returned: 0 in 0.283s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:11:15 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-4d5b0c4d-0ea2-41b8-ac5f-311ffbf6cfa4 tempest-VolumeQuotasNegativeTestJSON-1399549751 None] Lock "cinder-quobyte-2342f85b-5e66-4513-86c8-d974feaaeff4" released by "delete_volume" :: held 0.932s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:11:15 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-4d5b0c4d-0ea2-41b8-ac5f-311ffbf6cfa4 tempest-VolumeQuotasNegativeTestJSON-1399549751 None] Created reservations ['b547b22b-66b6-410e-bbd4-2e8d84366dd3', '6ef1d7f4-4bfb-4f51-a5a0-038481036511', 'c10ce87b-7947-4826-9993-dff3331118f9', 'ef98db6b-644d-4532-a8c6-58b080f5e26b'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:11:15 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-4d5b0c4d-0ea2-41b8-ac5f-311ffbf6cfa4 tempest-VolumeQuotasNegativeTestJSON-1399549751 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:11:15 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-4d5b0c4d-0ea2-41b8-ac5f-311ffbf6cfa4 tempest-VolumeQuotasNegativeTestJSON-1399549751 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:11:15 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-4d5b0c4d-0ea2-41b8-ac5f-311ffbf6cfa4 tempest-VolumeQuotasNegativeTestJSON-1399549751 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:11:15 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-4d5b0c4d-0ea2-41b8-ac5f-311ffbf6cfa4 tempest-VolumeQuotasNegativeTestJSON-1399549751 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:11:15 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-4d5b0c4d-0ea2-41b8-ac5f-311ffbf6cfa4 tempest-VolumeQuotasNegativeTestJSON-1399549751 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:11:15 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-4d5b0c4d-0ea2-41b8-ac5f-311ffbf6cfa4 tempest-VolumeQuotasNegativeTestJSON-1399549751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:11:15 devstack sudo[90338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce Aug 05 06:11:15 devstack sudo[90338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:11:15 devstack sudo[90338]: pam_unix(sudo:session): session closed for user root Aug 05 06:11:15 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-4d5b0c4d-0ea2-41b8-ac5f-311ffbf6cfa4 tempest-VolumeQuotasNegativeTestJSON-1399549751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce" returned: 0 in 0.308s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:11:15 devstack cinder-volume[88695]: DEBUG cinder.manager [None req-4d5b0c4d-0ea2-41b8-ac5f-311ffbf6cfa4 tempest-VolumeQuotasNegativeTestJSON-1399549751 None] Notifying Schedulers of capabilities ... {{(pid=88695) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 06:11:15 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-4d5b0c4d-0ea2-41b8-ac5f-311ffbf6cfa4 tempest-VolumeQuotasNegativeTestJSON-1399549751 None] Deleted volume successfully. Aug 05 06:11:15 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-4d5b0c4d-0ea2-41b8-ac5f-311ffbf6cfa4 tempest-VolumeQuotasNegativeTestJSON-1399549751 None] Lock "cinder-2342f85b-5e66-4513-86c8-d974feaaeff4-delete_volume" released by "delete_volume" :: held 1.545s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:11:16 devstack cinder-volume[88695]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4d06ce1-7012-4757-b7ad-49eabe891e23 tempest-VolumesTestJSON-1223388473 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88695) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 06:11:16 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-d4d06ce1-7012-4757-b7ad-49eabe891e23 tempest-VolumesTestJSON-1223388473 None] Flow 'volume_create_manager' (ddc5d7b4-affe-4ef4-ad14-3f9a4ed651b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:11:16 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-d4d06ce1-7012-4757-b7ad-49eabe891e23 tempest-VolumesTestJSON-1223388473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ff15c5d-19ce-4cd1-a95d-1b6fc6add666) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:11:16 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-d4d06ce1-7012-4757-b7ad-49eabe891e23 tempest-VolumesTestJSON-1223388473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ff15c5d-19ce-4cd1-a95d-1b6fc6add666) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:11:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-972149538',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ac6ce13-5176-4955-b99b-f2f0a7a26ae0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='53e9d06a6aa74644b68a26e92bab181d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:11:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:11:17Z,use_quota=True,user_id='dc5ff01ced2441da84a1e6d9c093de24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:11:16 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-d4d06ce1-7012-4757-b7ad-49eabe891e23 tempest-VolumesTestJSON-1223388473 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cd173da-05a8-4ddf-9cc7-6fcfa04a0c69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:11:16 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-d4d06ce1-7012-4757-b7ad-49eabe891e23 tempest-VolumesTestJSON-1223388473 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cd173da-05a8-4ddf-9cc7-6fcfa04a0c69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:11:16 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-d4d06ce1-7012-4757-b7ad-49eabe891e23 tempest-VolumesTestJSON-1223388473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab4cb69b-5b43-4d3f-a472-46fd12162bb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:11:16 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-d4d06ce1-7012-4757-b7ad-49eabe891e23 tempest-VolumesTestJSON-1223388473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab4cb69b-5b43-4d3f-a472-46fd12162bb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ac6ce13-5176-4955-b99b-f2f0a7a26ae0', 'volume_name': 'volume-4ac6ce13-5176-4955-b99b-f2f0a7a26ae0', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:11:16 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-d4d06ce1-7012-4757-b7ad-49eabe891e23 tempest-VolumesTestJSON-1223388473 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cef9c20-1140-4450-a145-e51f16ce0e22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:11:16 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-d4d06ce1-7012-4757-b7ad-49eabe891e23 tempest-VolumesTestJSON-1223388473 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cef9c20-1140-4450-a145-e51f16ce0e22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:11:16 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-d4d06ce1-7012-4757-b7ad-49eabe891e23 tempest-VolumesTestJSON-1223388473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fea20e3-e743-4850-8824-8f9a6e8e125d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:11:16 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-d4d06ce1-7012-4757-b7ad-49eabe891e23 tempest-VolumesTestJSON-1223388473 None] Volume 4ac6ce13-5176-4955-b99b-f2f0a7a26ae0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ac6ce13-5176-4955-b99b-f2f0a7a26ae0', 'volume_size': 1} Aug 05 06:11:16 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-d4d06ce1-7012-4757-b7ad-49eabe891e23 tempest-VolumesTestJSON-1223388473 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:11:16 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-d4d06ce1-7012-4757-b7ad-49eabe891e23 tempest-VolumesTestJSON-1223388473 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:11:16 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-d4d06ce1-7012-4757-b7ad-49eabe891e23 tempest-VolumesTestJSON-1223388473 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:11:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-972149538',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ac6ce13-5176-4955-b99b-f2f0a7a26ae0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='53e9d06a6aa74644b68a26e92bab181d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:11:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:11:17Z,use_quota=True,user_id='dc5ff01ced2441da84a1e6d9c093de24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)}" {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 06:11:16 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-d4d06ce1-7012-4757-b7ad-49eabe891e23 tempest-VolumesTestJSON-1223388473 None] Creating volume 4ac6ce13-5176-4955-b99b-f2f0a7a26ae0 {{(pid=88695) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 06:11:16 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-d4d06ce1-7012-4757-b7ad-49eabe891e23 tempest-VolumesTestJSON-1223388473 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:11:16 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-d4d06ce1-7012-4757-b7ad-49eabe891e23 tempest-VolumesTestJSON-1223388473 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:11:16 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-d4d06ce1-7012-4757-b7ad-49eabe891e23 tempest-VolumesTestJSON-1223388473 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:11:16 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-d4d06ce1-7012-4757-b7ad-49eabe891e23 tempest-VolumesTestJSON-1223388473 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:11:16 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-d4d06ce1-7012-4757-b7ad-49eabe891e23 tempest-VolumesTestJSON-1223388473 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:11:16 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-d4d06ce1-7012-4757-b7ad-49eabe891e23 tempest-VolumesTestJSON-1223388473 None] Selected osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 as target Quobyte volume. {{(pid=88695) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 06:11:16 devstack cinder-volume[88695]: INFO cinder.volume.drivers.remotefs [None req-d4d06ce1-7012-4757-b7ad-49eabe891e23 tempest-VolumesTestJSON-1223388473 None] casted to osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 Aug 05 06:11:16 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-d4d06ce1-7012-4757-b7ad-49eabe891e23 tempest-VolumesTestJSON-1223388473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-4ac6ce13-5176-4955-b99b-f2f0a7a26ae0 1073741824 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:11:16 devstack sudo[90342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-4ac6ce13-5176-4955-b99b-f2f0a7a26ae0 1073741824 Aug 05 06:11:16 devstack sudo[90342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:11:17 devstack sudo[90342]: pam_unix(sudo:session): session closed for user root Aug 05 06:11:17 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-d4d06ce1-7012-4757-b7ad-49eabe891e23 tempest-VolumesTestJSON-1223388473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-4ac6ce13-5176-4955-b99b-f2f0a7a26ae0 1073741824" returned: 0 in 0.568s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:11:17 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-d4d06ce1-7012-4757-b7ad-49eabe891e23 tempest-VolumesTestJSON-1223388473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-4ac6ce13-5176-4955-b99b-f2f0a7a26ae0 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:11:17 devstack sudo[90349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-4ac6ce13-5176-4955-b99b-f2f0a7a26ae0 Aug 05 06:11:17 devstack sudo[90349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:11:17 devstack sudo[90349]: pam_unix(sudo:session): session closed for user root Aug 05 06:11:17 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-d4d06ce1-7012-4757-b7ad-49eabe891e23 tempest-VolumesTestJSON-1223388473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-4ac6ce13-5176-4955-b99b-f2f0a7a26ae0" returned: 0 in 0.304s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:11:17 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-d4d06ce1-7012-4757-b7ad-49eabe891e23 tempest-VolumesTestJSON-1223388473 None] <== create_volume: return (926ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'} {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 06:11:17 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-d4d06ce1-7012-4757-b7ad-49eabe891e23 tempest-VolumesTestJSON-1223388473 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.930s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:11:17 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-d4d06ce1-7012-4757-b7ad-49eabe891e23 tempest-VolumesTestJSON-1223388473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fea20e3-e743-4850-8824-8f9a6e8e125d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ac6ce13-5176-4955-b99b-f2f0a7a26ae0', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:11:17 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-d4d06ce1-7012-4757-b7ad-49eabe891e23 tempest-VolumesTestJSON-1223388473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e7e7bde-886b-4790-95da-1e0f84686917) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:11:17 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-d4d06ce1-7012-4757-b7ad-49eabe891e23 tempest-VolumesTestJSON-1223388473 None] Volume volume-4ac6ce13-5176-4955-b99b-f2f0a7a26ae0 (4ac6ce13-5176-4955-b99b-f2f0a7a26ae0): created successfully Aug 05 06:11:17 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-d4d06ce1-7012-4757-b7ad-49eabe891e23 tempest-VolumesTestJSON-1223388473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e7e7bde-886b-4790-95da-1e0f84686917) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:11:17 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-d4d06ce1-7012-4757-b7ad-49eabe891e23 tempest-VolumesTestJSON-1223388473 None] Flow 'volume_create_manager' (ddc5d7b4-affe-4ef4-ad14-3f9a4ed651b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:11:17 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-d4d06ce1-7012-4757-b7ad-49eabe891e23 tempest-VolumesTestJSON-1223388473 None] Created volume successfully. Aug 05 06:11:19 devstack cinder-volume[88695]: DEBUG cinder.volume.flows.manager.create_volume [None req-d31b42fa-60d4-4309-8d95-6ed3f01cd772 tempest-VolumesTestJSON-1223388473 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88695) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 06:11:19 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-d31b42fa-60d4-4309-8d95-6ed3f01cd772 tempest-VolumesTestJSON-1223388473 None] Flow 'volume_create_manager' (f0b86396-a34a-4aae-861c-f40d22f747bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:11:19 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-d31b42fa-60d4-4309-8d95-6ed3f01cd772 tempest-VolumesTestJSON-1223388473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e7ed5d6-6007-4fee-b941-cfb86549ade0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:11:19 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-d31b42fa-60d4-4309-8d95-6ed3f01cd772 tempest-VolumesTestJSON-1223388473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e7ed5d6-6007-4fee-b941-cfb86549ade0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:11:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-301344886',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eeb7b7cc-fed6-42bc-81f3-9a115af9f16d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='53e9d06a6aa74644b68a26e92bab181d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:11:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:11:19Z,use_quota=True,user_id='dc5ff01ced2441da84a1e6d9c093de24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:11:19 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-d31b42fa-60d4-4309-8d95-6ed3f01cd772 tempest-VolumesTestJSON-1223388473 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8036c3ee-179a-4e45-9300-200b438d3557) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:11:19 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-d31b42fa-60d4-4309-8d95-6ed3f01cd772 tempest-VolumesTestJSON-1223388473 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8036c3ee-179a-4e45-9300-200b438d3557) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:11:19 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-d31b42fa-60d4-4309-8d95-6ed3f01cd772 tempest-VolumesTestJSON-1223388473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e9cf085-751a-4f18-ab03-ebcc18fe4b28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:11:19 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-d31b42fa-60d4-4309-8d95-6ed3f01cd772 tempest-VolumesTestJSON-1223388473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e9cf085-751a-4f18-ab03-ebcc18fe4b28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eeb7b7cc-fed6-42bc-81f3-9a115af9f16d', 'volume_name': 'volume-eeb7b7cc-fed6-42bc-81f3-9a115af9f16d', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:11:19 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-d31b42fa-60d4-4309-8d95-6ed3f01cd772 tempest-VolumesTestJSON-1223388473 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b28f575a-985d-4f9c-a8be-9904e6b8fbdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:11:19 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-d31b42fa-60d4-4309-8d95-6ed3f01cd772 tempest-VolumesTestJSON-1223388473 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b28f575a-985d-4f9c-a8be-9904e6b8fbdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:11:19 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-d31b42fa-60d4-4309-8d95-6ed3f01cd772 tempest-VolumesTestJSON-1223388473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7aefe4d9-28c9-4944-a5e1-29203e0bcf44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:11:19 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-d31b42fa-60d4-4309-8d95-6ed3f01cd772 tempest-VolumesTestJSON-1223388473 None] Volume eeb7b7cc-fed6-42bc-81f3-9a115af9f16d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eeb7b7cc-fed6-42bc-81f3-9a115af9f16d', 'volume_size': 1} Aug 05 06:11:19 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-d31b42fa-60d4-4309-8d95-6ed3f01cd772 tempest-VolumesTestJSON-1223388473 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:11:19 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-d31b42fa-60d4-4309-8d95-6ed3f01cd772 tempest-VolumesTestJSON-1223388473 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:11:19 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-d31b42fa-60d4-4309-8d95-6ed3f01cd772 tempest-VolumesTestJSON-1223388473 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:11:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-301344886',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eeb7b7cc-fed6-42bc-81f3-9a115af9f16d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='53e9d06a6aa74644b68a26e92bab181d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:11:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:11:19Z,use_quota=True,user_id='dc5ff01ced2441da84a1e6d9c093de24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)}" {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 06:11:19 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-d31b42fa-60d4-4309-8d95-6ed3f01cd772 tempest-VolumesTestJSON-1223388473 None] Creating volume eeb7b7cc-fed6-42bc-81f3-9a115af9f16d {{(pid=88695) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 06:11:19 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-d31b42fa-60d4-4309-8d95-6ed3f01cd772 tempest-VolumesTestJSON-1223388473 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:11:19 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-d31b42fa-60d4-4309-8d95-6ed3f01cd772 tempest-VolumesTestJSON-1223388473 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:11:19 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-d31b42fa-60d4-4309-8d95-6ed3f01cd772 tempest-VolumesTestJSON-1223388473 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:11:19 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-d31b42fa-60d4-4309-8d95-6ed3f01cd772 tempest-VolumesTestJSON-1223388473 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:11:19 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-d31b42fa-60d4-4309-8d95-6ed3f01cd772 tempest-VolumesTestJSON-1223388473 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:11:19 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-d31b42fa-60d4-4309-8d95-6ed3f01cd772 tempest-VolumesTestJSON-1223388473 None] Selected osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 as target Quobyte volume. {{(pid=88695) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 06:11:19 devstack cinder-volume[88695]: INFO cinder.volume.drivers.remotefs [None req-d31b42fa-60d4-4309-8d95-6ed3f01cd772 tempest-VolumesTestJSON-1223388473 None] casted to osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 Aug 05 06:11:19 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-d31b42fa-60d4-4309-8d95-6ed3f01cd772 tempest-VolumesTestJSON-1223388473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-eeb7b7cc-fed6-42bc-81f3-9a115af9f16d 1073741824 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:11:19 devstack sudo[90353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-eeb7b7cc-fed6-42bc-81f3-9a115af9f16d 1073741824 Aug 05 06:11:19 devstack sudo[90353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:11:20 devstack sudo[90353]: pam_unix(sudo:session): session closed for user root Aug 05 06:11:20 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-d31b42fa-60d4-4309-8d95-6ed3f01cd772 tempest-VolumesTestJSON-1223388473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-eeb7b7cc-fed6-42bc-81f3-9a115af9f16d 1073741824" returned: 0 in 0.517s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:11:20 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-d31b42fa-60d4-4309-8d95-6ed3f01cd772 tempest-VolumesTestJSON-1223388473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-eeb7b7cc-fed6-42bc-81f3-9a115af9f16d {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:11:20 devstack sudo[90359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-eeb7b7cc-fed6-42bc-81f3-9a115af9f16d Aug 05 06:11:20 devstack sudo[90359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:11:20 devstack sudo[90359]: pam_unix(sudo:session): session closed for user root Aug 05 06:11:20 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-d31b42fa-60d4-4309-8d95-6ed3f01cd772 tempest-VolumesTestJSON-1223388473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-eeb7b7cc-fed6-42bc-81f3-9a115af9f16d" returned: 0 in 0.283s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:11:20 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-d31b42fa-60d4-4309-8d95-6ed3f01cd772 tempest-VolumesTestJSON-1223388473 None] <== create_volume: return (864ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'} {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 06:11:20 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-d31b42fa-60d4-4309-8d95-6ed3f01cd772 tempest-VolumesTestJSON-1223388473 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.867s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:11:20 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-d31b42fa-60d4-4309-8d95-6ed3f01cd772 tempest-VolumesTestJSON-1223388473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7aefe4d9-28c9-4944-a5e1-29203e0bcf44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eeb7b7cc-fed6-42bc-81f3-9a115af9f16d', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:11:20 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-d31b42fa-60d4-4309-8d95-6ed3f01cd772 tempest-VolumesTestJSON-1223388473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2588f48a-66e8-4fe1-b9e8-27af225a7438) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:11:20 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-d31b42fa-60d4-4309-8d95-6ed3f01cd772 tempest-VolumesTestJSON-1223388473 None] Volume volume-eeb7b7cc-fed6-42bc-81f3-9a115af9f16d (eeb7b7cc-fed6-42bc-81f3-9a115af9f16d): created successfully Aug 05 06:11:20 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-d31b42fa-60d4-4309-8d95-6ed3f01cd772 tempest-VolumesTestJSON-1223388473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2588f48a-66e8-4fe1-b9e8-27af225a7438) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:11:20 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-d31b42fa-60d4-4309-8d95-6ed3f01cd772 tempest-VolumesTestJSON-1223388473 None] Flow 'volume_create_manager' (f0b86396-a34a-4aae-861c-f40d22f747bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:11:20 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-d31b42fa-60d4-4309-8d95-6ed3f01cd772 tempest-VolumesTestJSON-1223388473 None] Created volume successfully. Aug 05 06:11:23 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-62db5094-c80b-417e-943b-d408bdcbd942 tempest-VolumesTestJSON-1223388473 None] Acquiring lock "cinder-eeb7b7cc-fed6-42bc-81f3-9a115af9f16d-delete_volume" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:11:23 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-62db5094-c80b-417e-943b-d408bdcbd942 tempest-VolumesTestJSON-1223388473 None] Lock "cinder-eeb7b7cc-fed6-42bc-81f3-9a115af9f16d-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:11:23 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-62db5094-c80b-417e-943b-d408bdcbd942 tempest-VolumesTestJSON-1223388473 None] Acquiring lock "cinder-quobyte-eeb7b7cc-fed6-42bc-81f3-9a115af9f16d" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:11:23 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-62db5094-c80b-417e-943b-d408bdcbd942 tempest-VolumesTestJSON-1223388473 None] Lock "cinder-quobyte-eeb7b7cc-fed6-42bc-81f3-9a115af9f16d" acquired by "delete_volume" :: waited 0.030s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:11:23 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4cb8099-549b-46fa-9185-ef16ed0fb876]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:11:23 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-62db5094-c80b-417e-943b-d408bdcbd942 tempest-VolumesTestJSON-1223388473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-eeb7b7cc-fed6-42bc-81f3-9a115af9f16d {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:11:23 devstack sudo[90365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-eeb7b7cc-fed6-42bc-81f3-9a115af9f16d Aug 05 06:11:23 devstack sudo[90365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:11:23 devstack sudo[90365]: pam_unix(sudo:session): session closed for user root Aug 05 06:11:23 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-62db5094-c80b-417e-943b-d408bdcbd942 tempest-VolumesTestJSON-1223388473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-eeb7b7cc-fed6-42bc-81f3-9a115af9f16d" returned: 0 in 0.415s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:11:23 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-62db5094-c80b-417e-943b-d408bdcbd942 tempest-VolumesTestJSON-1223388473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-eeb7b7cc-fed6-42bc-81f3-9a115af9f16d {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:11:23 devstack sudo[90370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-eeb7b7cc-fed6-42bc-81f3-9a115af9f16d Aug 05 06:11:23 devstack sudo[90370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:11:24 devstack sudo[90370]: pam_unix(sudo:session): session closed for user root Aug 05 06:11:24 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-62db5094-c80b-417e-943b-d408bdcbd942 tempest-VolumesTestJSON-1223388473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-eeb7b7cc-fed6-42bc-81f3-9a115af9f16d" returned: 0 in 0.395s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:11:24 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-62db5094-c80b-417e-943b-d408bdcbd942 tempest-VolumesTestJSON-1223388473 None] Lock "cinder-quobyte-eeb7b7cc-fed6-42bc-81f3-9a115af9f16d" released by "delete_volume" :: held 0.869s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:11:24 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-62db5094-c80b-417e-943b-d408bdcbd942 tempest-VolumesTestJSON-1223388473 None] Created reservations ['3fba5ad6-d063-4aff-829e-9e625c92332f', '5ef20051-3853-4aee-8261-74a6b3a3cda2', '3762a58c-a765-4d4d-923a-1371af11effa', '7b7fab4a-3615-41b9-836a-abbafc6a8b79'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:11:24 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-62db5094-c80b-417e-943b-d408bdcbd942 tempest-VolumesTestJSON-1223388473 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:11:24 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-62db5094-c80b-417e-943b-d408bdcbd942 tempest-VolumesTestJSON-1223388473 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:11:24 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-62db5094-c80b-417e-943b-d408bdcbd942 tempest-VolumesTestJSON-1223388473 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:11:24 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-62db5094-c80b-417e-943b-d408bdcbd942 tempest-VolumesTestJSON-1223388473 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:11:24 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-62db5094-c80b-417e-943b-d408bdcbd942 tempest-VolumesTestJSON-1223388473 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:11:24 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-62db5094-c80b-417e-943b-d408bdcbd942 tempest-VolumesTestJSON-1223388473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:11:24 devstack sudo[90374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce Aug 05 06:11:24 devstack sudo[90374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:11:24 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-fd7b4bc2-7f3e-4e41-8f8b-8b4d31cb3b26 tempest-VolumesTestJSON-1223388473 None] Acquiring lock "cinder-4ac6ce13-5176-4955-b99b-f2f0a7a26ae0-delete_volume" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:11:24 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-fd7b4bc2-7f3e-4e41-8f8b-8b4d31cb3b26 tempest-VolumesTestJSON-1223388473 None] Lock "cinder-4ac6ce13-5176-4955-b99b-f2f0a7a26ae0-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:11:24 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-fd7b4bc2-7f3e-4e41-8f8b-8b4d31cb3b26 tempest-VolumesTestJSON-1223388473 None] Acquiring lock "cinder-quobyte-4ac6ce13-5176-4955-b99b-f2f0a7a26ae0" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:11:24 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-fd7b4bc2-7f3e-4e41-8f8b-8b4d31cb3b26 tempest-VolumesTestJSON-1223388473 None] Lock "cinder-quobyte-4ac6ce13-5176-4955-b99b-f2f0a7a26ae0" acquired by "delete_volume" :: waited 0.030s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:11:24 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[38ad2ca9-ce05-4b48-8d86-b1d83a52bc9f]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:11:24 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-fd7b4bc2-7f3e-4e41-8f8b-8b4d31cb3b26 tempest-VolumesTestJSON-1223388473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-4ac6ce13-5176-4955-b99b-f2f0a7a26ae0 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:11:24 devstack sudo[90374]: pam_unix(sudo:session): session closed for user root Aug 05 06:11:24 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-62db5094-c80b-417e-943b-d408bdcbd942 tempest-VolumesTestJSON-1223388473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce" returned: 0 in 0.376s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:11:24 devstack cinder-volume[88695]: DEBUG cinder.manager [None req-62db5094-c80b-417e-943b-d408bdcbd942 tempest-VolumesTestJSON-1223388473 None] Notifying Schedulers of capabilities ... {{(pid=88695) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 06:11:24 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-62db5094-c80b-417e-943b-d408bdcbd942 tempest-VolumesTestJSON-1223388473 None] Deleted volume successfully. Aug 05 06:11:24 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-62db5094-c80b-417e-943b-d408bdcbd942 tempest-VolumesTestJSON-1223388473 None] Lock "cinder-eeb7b7cc-fed6-42bc-81f3-9a115af9f16d-delete_volume" released by "delete_volume" :: held 1.579s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:11:24 devstack sudo[90377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-4ac6ce13-5176-4955-b99b-f2f0a7a26ae0 Aug 05 06:11:24 devstack sudo[90377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:11:25 devstack sudo[90377]: pam_unix(sudo:session): session closed for user root Aug 05 06:11:25 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-fd7b4bc2-7f3e-4e41-8f8b-8b4d31cb3b26 tempest-VolumesTestJSON-1223388473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-4ac6ce13-5176-4955-b99b-f2f0a7a26ae0" returned: 0 in 0.561s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:11:25 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-fd7b4bc2-7f3e-4e41-8f8b-8b4d31cb3b26 tempest-VolumesTestJSON-1223388473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-4ac6ce13-5176-4955-b99b-f2f0a7a26ae0 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:11:25 devstack sudo[90384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-4ac6ce13-5176-4955-b99b-f2f0a7a26ae0 Aug 05 06:11:25 devstack sudo[90384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:11:25 devstack sudo[90384]: pam_unix(sudo:session): session closed for user root Aug 05 06:11:25 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-fd7b4bc2-7f3e-4e41-8f8b-8b4d31cb3b26 tempest-VolumesTestJSON-1223388473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-4ac6ce13-5176-4955-b99b-f2f0a7a26ae0" returned: 0 in 0.288s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:11:25 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-fd7b4bc2-7f3e-4e41-8f8b-8b4d31cb3b26 tempest-VolumesTestJSON-1223388473 None] Lock "cinder-quobyte-4ac6ce13-5176-4955-b99b-f2f0a7a26ae0" released by "delete_volume" :: held 0.906s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:11:25 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-fd7b4bc2-7f3e-4e41-8f8b-8b4d31cb3b26 tempest-VolumesTestJSON-1223388473 None] Created reservations ['e35b732b-8a37-4d3a-a227-d208537572e3', '7a2ac16f-c681-48e9-8a6d-9e456f8a62d7', 'a94ca2c8-b4ad-462e-b376-3528e1b51a0a', 'eef916b3-3993-49f7-a48d-45ce82967c23'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:11:25 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-fd7b4bc2-7f3e-4e41-8f8b-8b4d31cb3b26 tempest-VolumesTestJSON-1223388473 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:11:25 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-fd7b4bc2-7f3e-4e41-8f8b-8b4d31cb3b26 tempest-VolumesTestJSON-1223388473 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:11:25 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-fd7b4bc2-7f3e-4e41-8f8b-8b4d31cb3b26 tempest-VolumesTestJSON-1223388473 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:11:25 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-fd7b4bc2-7f3e-4e41-8f8b-8b4d31cb3b26 tempest-VolumesTestJSON-1223388473 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:11:25 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-fd7b4bc2-7f3e-4e41-8f8b-8b4d31cb3b26 tempest-VolumesTestJSON-1223388473 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:11:25 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-fd7b4bc2-7f3e-4e41-8f8b-8b4d31cb3b26 tempest-VolumesTestJSON-1223388473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:11:25 devstack sudo[90387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce Aug 05 06:11:25 devstack sudo[90387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:11:25 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-93f6d19f-e679-4a6e-96c7-431bbf4915e1 tempest-VolumesTestJSON-1223388473 None] Acquiring lock "cinder-54874d3f-c040-4ef7-8266-e3fd91a1553d-delete_volume" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:11:25 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-93f6d19f-e679-4a6e-96c7-431bbf4915e1 tempest-VolumesTestJSON-1223388473 None] Lock "cinder-54874d3f-c040-4ef7-8266-e3fd91a1553d-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:11:25 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-93f6d19f-e679-4a6e-96c7-431bbf4915e1 tempest-VolumesTestJSON-1223388473 None] Acquiring lock "cinder-quobyte-54874d3f-c040-4ef7-8266-e3fd91a1553d" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:11:25 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-93f6d19f-e679-4a6e-96c7-431bbf4915e1 tempest-VolumesTestJSON-1223388473 None] Lock "cinder-quobyte-54874d3f-c040-4ef7-8266-e3fd91a1553d" acquired by "delete_volume" :: waited 0.045s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:11:25 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[9550c817-2c08-4a4a-8968-d5face72d694]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:11:25 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-93f6d19f-e679-4a6e-96c7-431bbf4915e1 tempest-VolumesTestJSON-1223388473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-54874d3f-c040-4ef7-8266-e3fd91a1553d {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:11:25 devstack sudo[90387]: pam_unix(sudo:session): session closed for user root Aug 05 06:11:25 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-fd7b4bc2-7f3e-4e41-8f8b-8b4d31cb3b26 tempest-VolumesTestJSON-1223388473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce" returned: 0 in 0.331s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:11:25 devstack cinder-volume[88695]: DEBUG cinder.manager [None req-fd7b4bc2-7f3e-4e41-8f8b-8b4d31cb3b26 tempest-VolumesTestJSON-1223388473 None] Notifying Schedulers of capabilities ... {{(pid=88695) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 06:11:25 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-fd7b4bc2-7f3e-4e41-8f8b-8b4d31cb3b26 tempest-VolumesTestJSON-1223388473 None] Deleted volume successfully. Aug 05 06:11:25 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-fd7b4bc2-7f3e-4e41-8f8b-8b4d31cb3b26 tempest-VolumesTestJSON-1223388473 None] Lock "cinder-4ac6ce13-5176-4955-b99b-f2f0a7a26ae0-delete_volume" released by "delete_volume" :: held 1.553s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:11:25 devstack sudo[90389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-54874d3f-c040-4ef7-8266-e3fd91a1553d Aug 05 06:11:25 devstack sudo[90389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:11:26 devstack sudo[90389]: pam_unix(sudo:session): session closed for user root Aug 05 06:11:26 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-93f6d19f-e679-4a6e-96c7-431bbf4915e1 tempest-VolumesTestJSON-1223388473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-54874d3f-c040-4ef7-8266-e3fd91a1553d" returned: 0 in 0.476s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:11:26 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-93f6d19f-e679-4a6e-96c7-431bbf4915e1 tempest-VolumesTestJSON-1223388473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-54874d3f-c040-4ef7-8266-e3fd91a1553d {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:11:26 devstack sudo[90395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-54874d3f-c040-4ef7-8266-e3fd91a1553d Aug 05 06:11:26 devstack sudo[90395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:11:26 devstack sudo[90395]: pam_unix(sudo:session): session closed for user root Aug 05 06:11:26 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-93f6d19f-e679-4a6e-96c7-431bbf4915e1 tempest-VolumesTestJSON-1223388473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-54874d3f-c040-4ef7-8266-e3fd91a1553d" returned: 0 in 0.295s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:11:26 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-93f6d19f-e679-4a6e-96c7-431bbf4915e1 tempest-VolumesTestJSON-1223388473 None] Lock "cinder-quobyte-54874d3f-c040-4ef7-8266-e3fd91a1553d" released by "delete_volume" :: held 0.831s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:11:26 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-93f6d19f-e679-4a6e-96c7-431bbf4915e1 tempest-VolumesTestJSON-1223388473 None] Created reservations ['15c54fb5-23af-4021-8fca-4353a3272e39', '75a5e252-b50f-40c0-ad96-c4b7cf668b6b', 'de85297e-f27a-43df-9013-b6d1810eb8fc', '9eadd608-c4a2-44c4-aea6-945e164a9b5f'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:11:26 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-93f6d19f-e679-4a6e-96c7-431bbf4915e1 tempest-VolumesTestJSON-1223388473 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:11:26 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-93f6d19f-e679-4a6e-96c7-431bbf4915e1 tempest-VolumesTestJSON-1223388473 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:11:26 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-93f6d19f-e679-4a6e-96c7-431bbf4915e1 tempest-VolumesTestJSON-1223388473 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:11:26 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-93f6d19f-e679-4a6e-96c7-431bbf4915e1 tempest-VolumesTestJSON-1223388473 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:11:26 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-93f6d19f-e679-4a6e-96c7-431bbf4915e1 tempest-VolumesTestJSON-1223388473 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:11:26 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-93f6d19f-e679-4a6e-96c7-431bbf4915e1 tempest-VolumesTestJSON-1223388473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:11:26 devstack sudo[90412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce Aug 05 06:11:26 devstack sudo[90412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:11:27 devstack sudo[90412]: pam_unix(sudo:session): session closed for user root Aug 05 06:11:27 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-93f6d19f-e679-4a6e-96c7-431bbf4915e1 tempest-VolumesTestJSON-1223388473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce" returned: 0 in 0.297s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:11:27 devstack cinder-volume[88695]: DEBUG cinder.manager [None req-93f6d19f-e679-4a6e-96c7-431bbf4915e1 tempest-VolumesTestJSON-1223388473 None] Notifying Schedulers of capabilities ... {{(pid=88695) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 06:11:27 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-93f6d19f-e679-4a6e-96c7-431bbf4915e1 tempest-VolumesTestJSON-1223388473 None] Deleted volume successfully. Aug 05 06:11:27 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-93f6d19f-e679-4a6e-96c7-431bbf4915e1 tempest-VolumesTestJSON-1223388473 None] Lock "cinder-54874d3f-c040-4ef7-8266-e3fd91a1553d-delete_volume" released by "delete_volume" :: held 1.412s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:11:30 devstack cinder-volume[88695]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b522872-9756-43e0-860a-bbf14ee8b325 tempest-VolumeTypesAccessTest-2113171189 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88695) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 06:11:30 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-9b522872-9756-43e0-860a-bbf14ee8b325 tempest-VolumeTypesAccessTest-2113171189 None] Flow 'volume_create_manager' (c0efb0a5-740c-4a9c-9aff-0efcd0c8e170) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:11:30 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-9b522872-9756-43e0-860a-bbf14ee8b325 tempest-VolumeTypesAccessTest-2113171189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf2af433-20ea-47cf-8aad-cf74fde97a37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:11:30 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-9b522872-9756-43e0-860a-bbf14ee8b325 tempest-VolumeTypesAccessTest-2113171189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf2af433-20ea-47cf-8aad-cf74fde97a37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:11:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-190799294',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c20b9860-dce0-480a-b567-988a47750a00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b776f4e53b546da8edc8e7d4aadf35e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:11:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:11:30Z,use_quota=True,user_id='4603741090d14ceea34d0f603ad3bfd7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9fb550b1-8a0e-41b6-8c34-7ed8b64e5df4),volume_type_id=9fb550b1-8a0e-41b6-8c34-7ed8b64e5df4)' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:11:30 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-9b522872-9756-43e0-860a-bbf14ee8b325 tempest-VolumeTypesAccessTest-2113171189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4378136a-7093-49eb-a8fc-449961a01296) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:11:30 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-9b522872-9756-43e0-860a-bbf14ee8b325 tempest-VolumeTypesAccessTest-2113171189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4378136a-7093-49eb-a8fc-449961a01296) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:11:30 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-9b522872-9756-43e0-860a-bbf14ee8b325 tempest-VolumeTypesAccessTest-2113171189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9d7d77f-dabd-46d8-922c-9a7e192dde40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:11:30 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-9b522872-9756-43e0-860a-bbf14ee8b325 tempest-VolumeTypesAccessTest-2113171189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9d7d77f-dabd-46d8-922c-9a7e192dde40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c20b9860-dce0-480a-b567-988a47750a00', 'volume_name': 'volume-c20b9860-dce0-480a-b567-988a47750a00', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:11:30 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-9b522872-9756-43e0-860a-bbf14ee8b325 tempest-VolumeTypesAccessTest-2113171189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8af46036-4e12-4f90-b103-4aee4b9aaa8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:11:30 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-9b522872-9756-43e0-860a-bbf14ee8b325 tempest-VolumeTypesAccessTest-2113171189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8af46036-4e12-4f90-b103-4aee4b9aaa8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:11:30 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-9b522872-9756-43e0-860a-bbf14ee8b325 tempest-VolumeTypesAccessTest-2113171189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ee82e0c-3ecd-48ee-acbe-c46b66174018) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:11:30 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-9b522872-9756-43e0-860a-bbf14ee8b325 tempest-VolumeTypesAccessTest-2113171189 None] Volume c20b9860-dce0-480a-b567-988a47750a00: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c20b9860-dce0-480a-b567-988a47750a00', 'volume_size': 1} Aug 05 06:11:30 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-9b522872-9756-43e0-860a-bbf14ee8b325 tempest-VolumeTypesAccessTest-2113171189 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:11:30 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-9b522872-9756-43e0-860a-bbf14ee8b325 tempest-VolumeTypesAccessTest-2113171189 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:11:30 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-9b522872-9756-43e0-860a-bbf14ee8b325 tempest-VolumeTypesAccessTest-2113171189 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:11:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-190799294',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c20b9860-dce0-480a-b567-988a47750a00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b776f4e53b546da8edc8e7d4aadf35e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:11:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:11:30Z,use_quota=True,user_id='4603741090d14ceea34d0f603ad3bfd7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9fb550b1-8a0e-41b6-8c34-7ed8b64e5df4),volume_type_id=9fb550b1-8a0e-41b6-8c34-7ed8b64e5df4)}" {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 06:11:30 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-9b522872-9756-43e0-860a-bbf14ee8b325 tempest-VolumeTypesAccessTest-2113171189 None] Creating volume c20b9860-dce0-480a-b567-988a47750a00 {{(pid=88695) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 06:11:30 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-9b522872-9756-43e0-860a-bbf14ee8b325 tempest-VolumeTypesAccessTest-2113171189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:11:30 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-9b522872-9756-43e0-860a-bbf14ee8b325 tempest-VolumeTypesAccessTest-2113171189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:11:30 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-9b522872-9756-43e0-860a-bbf14ee8b325 tempest-VolumeTypesAccessTest-2113171189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:11:30 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-9b522872-9756-43e0-860a-bbf14ee8b325 tempest-VolumeTypesAccessTest-2113171189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:11:30 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-9b522872-9756-43e0-860a-bbf14ee8b325 tempest-VolumeTypesAccessTest-2113171189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:11:30 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-9b522872-9756-43e0-860a-bbf14ee8b325 tempest-VolumeTypesAccessTest-2113171189 None] Selected osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 as target Quobyte volume. {{(pid=88695) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 06:11:30 devstack cinder-volume[88695]: INFO cinder.volume.drivers.remotefs [None req-9b522872-9756-43e0-860a-bbf14ee8b325 tempest-VolumeTypesAccessTest-2113171189 None] casted to osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 Aug 05 06:11:30 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-9b522872-9756-43e0-860a-bbf14ee8b325 tempest-VolumeTypesAccessTest-2113171189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-c20b9860-dce0-480a-b567-988a47750a00 1073741824 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:11:30 devstack sudo[90444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-c20b9860-dce0-480a-b567-988a47750a00 1073741824 Aug 05 06:11:30 devstack sudo[90444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:11:31 devstack sudo[90444]: pam_unix(sudo:session): session closed for user root Aug 05 06:11:31 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-9b522872-9756-43e0-860a-bbf14ee8b325 tempest-VolumeTypesAccessTest-2113171189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-c20b9860-dce0-480a-b567-988a47750a00 1073741824" returned: 0 in 0.667s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:11:31 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-9b522872-9756-43e0-860a-bbf14ee8b325 tempest-VolumeTypesAccessTest-2113171189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-c20b9860-dce0-480a-b567-988a47750a00 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:11:31 devstack sudo[90451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-c20b9860-dce0-480a-b567-988a47750a00 Aug 05 06:11:31 devstack sudo[90451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:11:31 devstack sudo[90451]: pam_unix(sudo:session): session closed for user root Aug 05 06:11:31 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-9b522872-9756-43e0-860a-bbf14ee8b325 tempest-VolumeTypesAccessTest-2113171189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-c20b9860-dce0-480a-b567-988a47750a00" returned: 0 in 0.309s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:11:31 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-9b522872-9756-43e0-860a-bbf14ee8b325 tempest-VolumeTypesAccessTest-2113171189 None] <== create_volume: return (1067ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'} {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 06:11:31 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-9b522872-9756-43e0-860a-bbf14ee8b325 tempest-VolumeTypesAccessTest-2113171189 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.070s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:11:31 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-9b522872-9756-43e0-860a-bbf14ee8b325 tempest-VolumeTypesAccessTest-2113171189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ee82e0c-3ecd-48ee-acbe-c46b66174018) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c20b9860-dce0-480a-b567-988a47750a00', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:11:31 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-9b522872-9756-43e0-860a-bbf14ee8b325 tempest-VolumeTypesAccessTest-2113171189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77ad9d4f-af63-41ef-81a9-2e93555ecbf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:11:31 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-9b522872-9756-43e0-860a-bbf14ee8b325 tempest-VolumeTypesAccessTest-2113171189 None] Volume volume-c20b9860-dce0-480a-b567-988a47750a00 (c20b9860-dce0-480a-b567-988a47750a00): created successfully Aug 05 06:11:31 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-9b522872-9756-43e0-860a-bbf14ee8b325 tempest-VolumeTypesAccessTest-2113171189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77ad9d4f-af63-41ef-81a9-2e93555ecbf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:11:31 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-9b522872-9756-43e0-860a-bbf14ee8b325 tempest-VolumeTypesAccessTest-2113171189 None] Flow 'volume_create_manager' (c0efb0a5-740c-4a9c-9aff-0efcd0c8e170) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:11:31 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-9b522872-9756-43e0-860a-bbf14ee8b325 tempest-VolumeTypesAccessTest-2113171189 None] Created volume successfully. Aug 05 06:11:32 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-316bf815-f26d-426d-b9c2-3fabd0013d82 tempest-VolumeTypesAccessTest-2113171189 None] Acquiring lock "cinder-c20b9860-dce0-480a-b567-988a47750a00-delete_volume" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:11:32 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-316bf815-f26d-426d-b9c2-3fabd0013d82 tempest-VolumeTypesAccessTest-2113171189 None] Lock "cinder-c20b9860-dce0-480a-b567-988a47750a00-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:11:32 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-316bf815-f26d-426d-b9c2-3fabd0013d82 tempest-VolumeTypesAccessTest-2113171189 None] Acquiring lock "cinder-quobyte-c20b9860-dce0-480a-b567-988a47750a00" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:11:32 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-316bf815-f26d-426d-b9c2-3fabd0013d82 tempest-VolumeTypesAccessTest-2113171189 None] Lock "cinder-quobyte-c20b9860-dce0-480a-b567-988a47750a00" acquired by "delete_volume" :: waited 0.051s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:11:32 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[13f1a4e9-84ce-4503-b329-76ad1e45e89f]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:11:32 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-316bf815-f26d-426d-b9c2-3fabd0013d82 tempest-VolumeTypesAccessTest-2113171189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-c20b9860-dce0-480a-b567-988a47750a00 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:11:33 devstack sudo[90471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-c20b9860-dce0-480a-b567-988a47750a00 Aug 05 06:11:33 devstack sudo[90471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:11:33 devstack sudo[90471]: pam_unix(sudo:session): session closed for user root Aug 05 06:11:33 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-316bf815-f26d-426d-b9c2-3fabd0013d82 tempest-VolumeTypesAccessTest-2113171189 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-c20b9860-dce0-480a-b567-988a47750a00" returned: 0 in 0.542s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:11:33 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-316bf815-f26d-426d-b9c2-3fabd0013d82 tempest-VolumeTypesAccessTest-2113171189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-c20b9860-dce0-480a-b567-988a47750a00 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:11:33 devstack sudo[90476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-c20b9860-dce0-480a-b567-988a47750a00 Aug 05 06:11:33 devstack sudo[90476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:11:33 devstack sudo[90476]: pam_unix(sudo:session): session closed for user root Aug 05 06:11:33 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-316bf815-f26d-426d-b9c2-3fabd0013d82 tempest-VolumeTypesAccessTest-2113171189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-c20b9860-dce0-480a-b567-988a47750a00" returned: 0 in 0.351s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:11:33 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-316bf815-f26d-426d-b9c2-3fabd0013d82 tempest-VolumeTypesAccessTest-2113171189 None] Lock "cinder-quobyte-c20b9860-dce0-480a-b567-988a47750a00" released by "delete_volume" :: held 0.965s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:11:33 devstack cinder-volume[88695]: WARNING cinder.quota [None req-316bf815-f26d-426d-b9c2-3fabd0013d82 tempest-VolumeTypesAccessTest-2113171189 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1233630967 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1233630967, it is now deprecated. Please use the default quota class for default quota. Aug 05 06:11:33 devstack cinder-volume[88695]: WARNING cinder.quota [None req-316bf815-f26d-426d-b9c2-3fabd0013d82 tempest-VolumeTypesAccessTest-2113171189 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1233630967 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1233630967, it is now deprecated. Please use the default quota class for default quota. Aug 05 06:11:33 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-316bf815-f26d-426d-b9c2-3fabd0013d82 tempest-VolumeTypesAccessTest-2113171189 None] Created reservations ['24345a9d-dab8-444c-bbd2-4400bda74980', 'c2d08103-3bce-49ce-913a-70c4d6df13d2', '59a7af7a-140a-414a-aa4c-1557964a9067', '29fe917f-3646-49a9-857e-ed0544197611'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:11:34 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-316bf815-f26d-426d-b9c2-3fabd0013d82 tempest-VolumeTypesAccessTest-2113171189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:11:34 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-316bf815-f26d-426d-b9c2-3fabd0013d82 tempest-VolumeTypesAccessTest-2113171189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:11:34 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-316bf815-f26d-426d-b9c2-3fabd0013d82 tempest-VolumeTypesAccessTest-2113171189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:11:34 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-316bf815-f26d-426d-b9c2-3fabd0013d82 tempest-VolumeTypesAccessTest-2113171189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:11:34 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-316bf815-f26d-426d-b9c2-3fabd0013d82 tempest-VolumeTypesAccessTest-2113171189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:11:34 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-316bf815-f26d-426d-b9c2-3fabd0013d82 tempest-VolumeTypesAccessTest-2113171189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:11:34 devstack sudo[90479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce Aug 05 06:11:34 devstack sudo[90479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:11:34 devstack sudo[90479]: pam_unix(sudo:session): session closed for user root Aug 05 06:11:34 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-316bf815-f26d-426d-b9c2-3fabd0013d82 tempest-VolumeTypesAccessTest-2113171189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce" returned: 0 in 0.336s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:11:34 devstack cinder-volume[88695]: DEBUG cinder.manager [None req-316bf815-f26d-426d-b9c2-3fabd0013d82 tempest-VolumeTypesAccessTest-2113171189 None] Notifying Schedulers of capabilities ... {{(pid=88695) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 06:11:34 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-316bf815-f26d-426d-b9c2-3fabd0013d82 tempest-VolumeTypesAccessTest-2113171189 None] Deleted volume successfully. Aug 05 06:11:34 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-316bf815-f26d-426d-b9c2-3fabd0013d82 tempest-VolumeTypesAccessTest-2113171189 None] Lock "cinder-c20b9860-dce0-480a-b567-988a47750a00-delete_volume" released by "delete_volume" :: held 1.716s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:11:44 devstack cinder-volume[88695]: DEBUG dbcounter [-] [88695] Writing DB stats cinder:SELECT=55,cinder:UPDATE=96,cinder:INSERT=22,cinder:DELETE=5 {{(pid=88695) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 06:11:44 devstack cinder-volume[88695]: DEBUG dbcounter [-] [88695] Writing DB stats cinder:UPDATE=83,cinder:SELECT=72,cinder:DELETE=11,cinder:INSERT=18 {{(pid=88695) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 06:11:48 devstack cinder-volume[88695]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8ce946b-f7bf-44a9-9b1d-e485f457e300 tempest-VolumesImageMetadata-989187375 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88695) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 06:11:48 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-c8ce946b-f7bf-44a9-9b1d-e485f457e300 tempest-VolumesImageMetadata-989187375 None] Flow 'volume_create_manager' (9244727c-9791-4752-88d4-f7289fb2830f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:11:48 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-c8ce946b-f7bf-44a9-9b1d-e485f457e300 tempest-VolumesImageMetadata-989187375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (543c6f5b-54c1-4a30-81eb-017ac7a38e92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:11:48 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-c8ce946b-f7bf-44a9-9b1d-e485f457e300 tempest-VolumesImageMetadata-989187375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (543c6f5b-54c1-4a30-81eb-017ac7a38e92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:11:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1102164563',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fcb3db1-977c-4094-b813-a3910585e861,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e349b2ba1baf49929dc128e5a03f3afc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:11:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:11:48Z,use_quota=True,user_id='a2b1de5a099542888e9f132e07c8d7fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:11:48 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-c8ce946b-f7bf-44a9-9b1d-e485f457e300 tempest-VolumesImageMetadata-989187375 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0214211-c244-4798-9087-42011347a0da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:11:48 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-c8ce946b-f7bf-44a9-9b1d-e485f457e300 tempest-VolumesImageMetadata-989187375 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0214211-c244-4798-9087-42011347a0da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:11:48 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-c8ce946b-f7bf-44a9-9b1d-e485f457e300 tempest-VolumesImageMetadata-989187375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90c437e1-77d4-4a97-af28-c7640f13c109) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:11:48 devstack cinder-volume[88695]: DEBUG cinder.image.glance [None req-c8ce946b-f7bf-44a9-9b1d-e485f457e300 tempest-VolumesImageMetadata-989187375 None] Creating Keystone auth plugin from conf {{(pid=88695) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 05 06:11:49 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-c8ce946b-f7bf-44a9-9b1d-e485f457e300 tempest-VolumesImageMetadata-989187375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90c437e1-77d4-4a97-af28-c7640f13c109) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '5fcb3db1-977c-4094-b813-a3910585e861', 'volume_name': 'volume-5fcb3db1-977c-4094-b813-a3910585e861', 'volume_size': 1, 'image_id': '02d74946-ca9b-46cd-a590-fddaad1baed9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/02d74946-ca9b-46cd-a590-fddaad1baed9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '45a6d5bbcac24d598455fe1cd77a6beb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '02d74946-ca9b-46cd-a590-fddaad1baed9', 'created_at': datetime.datetime(2026, 8, 5, 4, 5, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 5, 4, 5, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/02d74946-ca9b-46cd-a590-fddaad1baed9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:11:49 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-c8ce946b-f7bf-44a9-9b1d-e485f457e300 tempest-VolumesImageMetadata-989187375 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd8d23d1-1909-4ce6-b57f-a09b60bc34e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:11:49 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-c8ce946b-f7bf-44a9-9b1d-e485f457e300 tempest-VolumesImageMetadata-989187375 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd8d23d1-1909-4ce6-b57f-a09b60bc34e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:11:49 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-c8ce946b-f7bf-44a9-9b1d-e485f457e300 tempest-VolumesImageMetadata-989187375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab68443d-5e57-47e3-b064-8cab0a3b3d6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:11:49 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-c8ce946b-f7bf-44a9-9b1d-e485f457e300 tempest-VolumesImageMetadata-989187375 None] Volume 5fcb3db1-977c-4094-b813-a3910585e861: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-5fcb3db1-977c-4094-b813-a3910585e861', 'volume_size': 1, 'image_id': '02d74946-ca9b-46cd-a590-fddaad1baed9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/02d74946-ca9b-46cd-a590-fddaad1baed9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '45a6d5bbcac24d598455fe1cd77a6beb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '02d74946-ca9b-46cd-a590-fddaad1baed9', 'created_at': datetime.datetime(2026, 8, 5, 4, 5, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 5, 4, 5, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/02d74946-ca9b-46cd-a590-fddaad1baed9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Aug 05 06:11:49 devstack cinder-volume[88695]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8ce946b-f7bf-44a9-9b1d-e485f457e300 tempest-VolumesImageMetadata-989187375 None] Trying to clone 5fcb3db1-977c-4094-b813-a3910585e861 from image 02d74946-ca9b-46cd-a590-fddaad1baed9 at location (None, [{'url': 'file:///opt/stack/data/glance/images/02d74946-ca9b-46cd-a590-fddaad1baed9', 'metadata': {}}]). {{(pid=88695) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 05 06:11:50 devstack cinder-volume[88695]: DEBUG cinder.image.image_utils [None req-c8ce946b-f7bf-44a9-9b1d-e485f457e300 tempest-VolumesImageMetadata-989187375 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_02d74946-ca9b-46cd-a590-fddaad1baed9_rt7x2kchdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=88695) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 05 06:11:50 devstack cinder-volume[88695]: INFO cinder.image.image_utils [None req-c8ce946b-f7bf-44a9-9b1d-e485f457e300 tempest-VolumesImageMetadata-989187375 None] Image download 20.69 MB at 20.69 MB/s Aug 05 06:11:50 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d6415e0-5049-437a-b64b-c03c2beef87e]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:11:50 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-c8ce946b-f7bf-44a9-9b1d-e485f457e300 tempest-VolumesImageMetadata-989187375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_02d74946-ca9b-46cd-a590-fddaad1baed9_rt7x2kchdevstack@QuobyteHD {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:11:50 devstack sudo[90638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_02d74946-ca9b-46cd-a590-fddaad1baed9_rt7x2kchdevstack@QuobyteHD Aug 05 06:11:50 devstack sudo[90638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:11:50 devstack sudo[90638]: pam_unix(sudo:session): session closed for user root Aug 05 06:11:50 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-c8ce946b-f7bf-44a9-9b1d-e485f457e300 tempest-VolumesImageMetadata-989187375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_02d74946-ca9b-46cd-a590-fddaad1baed9_rt7x2kchdevstack@QuobyteHD" returned: 0 in 0.471s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:11:50 devstack cinder-volume[88695]: DEBUG cinder.image.image_utils [None req-c8ce946b-f7bf-44a9-9b1d-e485f457e300 tempest-VolumesImageMetadata-989187375 None] Temporary image 02d74946-ca9b-46cd-a590-fddaad1baed9 is fetched for user a2b1de5a099542888e9f132e07c8d7fd. {{(pid=88695) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 05 06:11:50 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[d483e033-df93-4a9f-a70d-04ccfd855c8f]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:11:50 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-c8ce946b-f7bf-44a9-9b1d-e485f457e300 tempest-VolumesImageMetadata-989187375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_02d74946-ca9b-46cd-a590-fddaad1baed9_rt7x2kchdevstack@QuobyteHD {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:11:50 devstack sudo[90643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_02d74946-ca9b-46cd-a590-fddaad1baed9_rt7x2kchdevstack@QuobyteHD Aug 05 06:11:50 devstack sudo[90643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:11:51 devstack sudo[90643]: pam_unix(sudo:session): session closed for user root Aug 05 06:11:51 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-c8ce946b-f7bf-44a9-9b1d-e485f457e300 tempest-VolumesImageMetadata-989187375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_02d74946-ca9b-46cd-a590-fddaad1baed9_rt7x2kchdevstack@QuobyteHD" returned: 0 in 0.439s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:11:51 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-c8ce946b-f7bf-44a9-9b1d-e485f457e300 tempest-VolumesImageMetadata-989187375 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:11:51 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-c8ce946b-f7bf-44a9-9b1d-e485f457e300 tempest-VolumesImageMetadata-989187375 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:11:51 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-c8ce946b-f7bf-44a9-9b1d-e485f457e300 tempest-VolumesImageMetadata-989187375 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:11:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1102164563',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fcb3db1-977c-4094-b813-a3910585e861,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e349b2ba1baf49929dc128e5a03f3afc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:11:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:11:48Z,use_quota=True,user_id='a2b1de5a099542888e9f132e07c8d7fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)}" {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 06:11:51 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-c8ce946b-f7bf-44a9-9b1d-e485f457e300 tempest-VolumesImageMetadata-989187375 None] Creating volume 5fcb3db1-977c-4094-b813-a3910585e861 {{(pid=88695) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 06:11:51 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-c8ce946b-f7bf-44a9-9b1d-e485f457e300 tempest-VolumesImageMetadata-989187375 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:11:51 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-c8ce946b-f7bf-44a9-9b1d-e485f457e300 tempest-VolumesImageMetadata-989187375 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:11:51 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-c8ce946b-f7bf-44a9-9b1d-e485f457e300 tempest-VolumesImageMetadata-989187375 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:11:51 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-c8ce946b-f7bf-44a9-9b1d-e485f457e300 tempest-VolumesImageMetadata-989187375 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:11:51 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-c8ce946b-f7bf-44a9-9b1d-e485f457e300 tempest-VolumesImageMetadata-989187375 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:11:51 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-c8ce946b-f7bf-44a9-9b1d-e485f457e300 tempest-VolumesImageMetadata-989187375 None] Selected osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 as target Quobyte volume. {{(pid=88695) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 06:11:51 devstack cinder-volume[88695]: INFO cinder.volume.drivers.remotefs [None req-c8ce946b-f7bf-44a9-9b1d-e485f457e300 tempest-VolumesImageMetadata-989187375 None] casted to osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 Aug 05 06:11:51 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-c8ce946b-f7bf-44a9-9b1d-e485f457e300 tempest-VolumesImageMetadata-989187375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-5fcb3db1-977c-4094-b813-a3910585e861 1073741824 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:11:51 devstack sudo[90648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-5fcb3db1-977c-4094-b813-a3910585e861 1073741824 Aug 05 06:11:51 devstack sudo[90648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:11:51 devstack sudo[90648]: pam_unix(sudo:session): session closed for user root Aug 05 06:11:51 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-c8ce946b-f7bf-44a9-9b1d-e485f457e300 tempest-VolumesImageMetadata-989187375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-5fcb3db1-977c-4094-b813-a3910585e861 1073741824" returned: 0 in 0.554s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:11:51 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-c8ce946b-f7bf-44a9-9b1d-e485f457e300 tempest-VolumesImageMetadata-989187375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-5fcb3db1-977c-4094-b813-a3910585e861 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:11:51 devstack sudo[90654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-5fcb3db1-977c-4094-b813-a3910585e861 Aug 05 06:11:51 devstack sudo[90654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:11:52 devstack sudo[90654]: pam_unix(sudo:session): session closed for user root Aug 05 06:11:52 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-c8ce946b-f7bf-44a9-9b1d-e485f457e300 tempest-VolumesImageMetadata-989187375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-5fcb3db1-977c-4094-b813-a3910585e861" returned: 0 in 0.294s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:11:52 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-c8ce946b-f7bf-44a9-9b1d-e485f457e300 tempest-VolumesImageMetadata-989187375 None] <== create_volume: return (934ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'} {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 06:11:52 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-c8ce946b-f7bf-44a9-9b1d-e485f457e300 tempest-VolumesImageMetadata-989187375 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.939s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:11:52 devstack cinder-volume[88695]: DEBUG cinder.volume.volume_utils [None req-c8ce946b-f7bf-44a9-9b1d-e485f457e300 tempest-VolumesImageMetadata-989187375 None] Attempting download of 02d74946-ca9b-46cd-a590-fddaad1baed9 ((None, [{'url': 'file:///opt/stack/data/glance/images/02d74946-ca9b-46cd-a590-fddaad1baed9', 'metadata': {}}])) to volume 5fcb3db1-977c-4094-b813-a3910585e861. {{(pid=88695) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 05 06:11:52 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab18032f-7179-46e8-a296-b19f5b4f8c43]: (4, 'raw') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:11:52 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-c8ce946b-f7bf-44a9-9b1d-e485f457e300 tempest-VolumesImageMetadata-989187375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_02d74946-ca9b-46cd-a590-fddaad1baed9_gl9elkbw {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:11:52 devstack sudo[90657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_02d74946-ca9b-46cd-a590-fddaad1baed9_gl9elkbw Aug 05 06:11:52 devstack sudo[90657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:11:52 devstack sudo[90657]: pam_unix(sudo:session): session closed for user root Aug 05 06:11:52 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-c8ce946b-f7bf-44a9-9b1d-e485f457e300 tempest-VolumesImageMetadata-989187375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_02d74946-ca9b-46cd-a590-fddaad1baed9_gl9elkbw" returned: 0 in 0.373s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:11:52 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-c8ce946b-f7bf-44a9-9b1d-e485f457e300 tempest-VolumesImageMetadata-989187375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_02d74946-ca9b-46cd-a590-fddaad1baed9_gl9elkbw {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:11:52 devstack sudo[90661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_02d74946-ca9b-46cd-a590-fddaad1baed9_gl9elkbw Aug 05 06:11:52 devstack sudo[90661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:11:53 devstack sudo[90661]: pam_unix(sudo:session): session closed for user root Aug 05 06:11:53 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-c8ce946b-f7bf-44a9-9b1d-e485f457e300 tempest-VolumesImageMetadata-989187375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_02d74946-ca9b-46cd-a590-fddaad1baed9_gl9elkbw" returned: 1 in 0.358s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:11:53 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-c8ce946b-f7bf-44a9-9b1d-e485f457e300 tempest-VolumesImageMetadata-989187375 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_02d74946-ca9b-46cd-a590-fddaad1baed9_gl9elkbw' failed. Not Retrying. {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 05 06:11:53 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[21ecc898-c691-4cc3-a722-ffbdd6aaee72]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:11:53 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-c8ce946b-f7bf-44a9-9b1d-e485f457e300 tempest-VolumesImageMetadata-989187375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_02d74946-ca9b-46cd-a590-fddaad1baed9_rt7x2kchdevstack@QuobyteHD {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:11:53 devstack sudo[90665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_02d74946-ca9b-46cd-a590-fddaad1baed9_rt7x2kchdevstack@QuobyteHD Aug 05 06:11:53 devstack sudo[90665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:11:53 devstack sudo[90665]: pam_unix(sudo:session): session closed for user root Aug 05 06:11:53 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-c8ce946b-f7bf-44a9-9b1d-e485f457e300 tempest-VolumesImageMetadata-989187375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_02d74946-ca9b-46cd-a590-fddaad1baed9_rt7x2kchdevstack@QuobyteHD" returned: 0 in 0.344s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:11:53 devstack cinder-volume[88695]: DEBUG cinder.image.image_utils [None req-c8ce946b-f7bf-44a9-9b1d-e485f457e300 tempest-VolumesImageMetadata-989187375 None] 02d74946-ca9b-46cd-a590-fddaad1baed9 was qcow2, converting to qcow2 {{(pid=88695) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 05 06:11:53 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-c8ce946b-f7bf-44a9-9b1d-e485f457e300 tempest-VolumesImageMetadata-989187375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_02d74946-ca9b-46cd-a590-fddaad1baed9_rt7x2kchdevstack@QuobyteHD /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-5fcb3db1-977c-4094-b813-a3910585e861 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:11:53 devstack sudo[90670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_02d74946-ca9b-46cd-a590-fddaad1baed9_rt7x2kchdevstack@QuobyteHD /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-5fcb3db1-977c-4094-b813-a3910585e861 Aug 05 06:11:53 devstack sudo[90670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:11:55 devstack sudo[90670]: pam_unix(sudo:session): session closed for user root Aug 05 06:11:55 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-c8ce946b-f7bf-44a9-9b1d-e485f457e300 tempest-VolumesImageMetadata-989187375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_02d74946-ca9b-46cd-a590-fddaad1baed9_rt7x2kchdevstack@QuobyteHD /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-5fcb3db1-977c-4094-b813-a3910585e861" returned: 0 in 2.008s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:11:55 devstack cinder-volume[88695]: DEBUG cinder.image.image_utils [None req-c8ce946b-f7bf-44a9-9b1d-e485f457e300 tempest-VolumesImageMetadata-989187375 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_02d74946-ca9b-46cd-a590-fddaad1baed9_rt7x2kchdevstack@QuobyteHD, size 112.00 MB, duration 2.01 sec, destination /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-5fcb3db1-977c-4094-b813-a3910585e861 {{(pid=88695) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 05 06:11:55 devstack cinder-volume[88695]: INFO cinder.image.image_utils [None req-c8ce946b-f7bf-44a9-9b1d-e485f457e300 tempest-VolumesImageMetadata-989187375 None] Converted 112.00 MB image at 55.74 MB/s Aug 05 06:11:55 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-c8ce946b-f7bf-44a9-9b1d-e485f457e300 tempest-VolumesImageMetadata-989187375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-5fcb3db1-977c-4094-b813-a3910585e861 1G {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:11:55 devstack sudo[90678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-5fcb3db1-977c-4094-b813-a3910585e861 1G Aug 05 06:11:55 devstack sudo[90678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:11:55 devstack sudo[90678]: pam_unix(sudo:session): session closed for user root Aug 05 06:11:55 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-c8ce946b-f7bf-44a9-9b1d-e485f457e300 tempest-VolumesImageMetadata-989187375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-5fcb3db1-977c-4094-b813-a3910585e861 1G" returned: 0 in 0.523s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:11:55 devstack cinder-volume[88695]: DEBUG cinder.volume.volume_utils [None req-c8ce946b-f7bf-44a9-9b1d-e485f457e300 tempest-VolumesImageMetadata-989187375 None] Downloaded image 02d74946-ca9b-46cd-a590-fddaad1baed9 ((None, [{'url': 'file:///opt/stack/data/glance/images/02d74946-ca9b-46cd-a590-fddaad1baed9', 'metadata': {}}])) to volume 5fcb3db1-977c-4094-b813-a3910585e861 successfully. {{(pid=88695) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 05 06:11:55 devstack cinder-volume[88695]: DEBUG cinder.image.image_utils [None req-c8ce946b-f7bf-44a9-9b1d-e485f457e300 tempest-VolumesImageMetadata-989187375 None] Temporary image 02d74946-ca9b-46cd-a590-fddaad1baed9 for user a2b1de5a099542888e9f132e07c8d7fd is deleted. {{(pid=88695) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 05 06:11:55 devstack cinder-volume[88695]: DEBUG cinder.volume.volume_utils [None req-c8ce946b-f7bf-44a9-9b1d-e485f457e300 tempest-VolumesImageMetadata-989187375 None] Marking volume 5fcb3db1-977c-4094-b813-a3910585e861 as bootable. {{(pid=88695) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 05 06:11:55 devstack cinder-volume[88695]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8ce946b-f7bf-44a9-9b1d-e485f457e300 tempest-VolumesImageMetadata-989187375 None] Copying metadata from image 02d74946-ca9b-46cd-a590-fddaad1baed9 to 5fcb3db1-977c-4094-b813-a3910585e861. {{(pid=88695) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 05 06:11:55 devstack cinder-volume[88695]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8ce946b-f7bf-44a9-9b1d-e485f457e300 tempest-VolumesImageMetadata-989187375 None] Creating volume glance metadata for volume 5fcb3db1-977c-4094-b813-a3910585e861 backed by image 02d74946-ca9b-46cd-a590-fddaad1baed9 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '02d74946-ca9b-46cd-a590-fddaad1baed9', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88695) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 05 06:11:56 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-c8ce946b-f7bf-44a9-9b1d-e485f457e300 tempest-VolumesImageMetadata-989187375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab68443d-5e57-47e3-b064-8cab0a3b3d6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5fcb3db1-977c-4094-b813-a3910585e861', 'volume_size': 1, 'image_id': '02d74946-ca9b-46cd-a590-fddaad1baed9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/02d74946-ca9b-46cd-a590-fddaad1baed9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '45a6d5bbcac24d598455fe1cd77a6beb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '02d74946-ca9b-46cd-a590-fddaad1baed9', 'created_at': datetime.datetime(2026, 8, 5, 4, 5, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 5, 4, 5, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/02d74946-ca9b-46cd-a590-fddaad1baed9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:11:56 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-c8ce946b-f7bf-44a9-9b1d-e485f457e300 tempest-VolumesImageMetadata-989187375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a2290a3-6493-4038-938f-5599bb7113d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:11:56 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-c8ce946b-f7bf-44a9-9b1d-e485f457e300 tempest-VolumesImageMetadata-989187375 None] Volume volume-5fcb3db1-977c-4094-b813-a3910585e861 (5fcb3db1-977c-4094-b813-a3910585e861): created successfully Aug 05 06:11:56 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-c8ce946b-f7bf-44a9-9b1d-e485f457e300 tempest-VolumesImageMetadata-989187375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a2290a3-6493-4038-938f-5599bb7113d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:11:56 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-c8ce946b-f7bf-44a9-9b1d-e485f457e300 tempest-VolumesImageMetadata-989187375 None] Flow 'volume_create_manager' (9244727c-9791-4752-88d4-f7289fb2830f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:11:56 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-c8ce946b-f7bf-44a9-9b1d-e485f457e300 tempest-VolumesImageMetadata-989187375 None] Created volume successfully. Aug 05 06:11:57 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-d318d00f-3a1b-4f7f-ac8d-1cefb562f411 tempest-VolumesImageMetadata-989187375 None] Acquiring lock "cinder-5fcb3db1-977c-4094-b813-a3910585e861-delete_volume" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:11:57 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-d318d00f-3a1b-4f7f-ac8d-1cefb562f411 tempest-VolumesImageMetadata-989187375 None] Lock "cinder-5fcb3db1-977c-4094-b813-a3910585e861-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:11:57 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-d318d00f-3a1b-4f7f-ac8d-1cefb562f411 tempest-VolumesImageMetadata-989187375 None] Acquiring lock "cinder-quobyte-5fcb3db1-977c-4094-b813-a3910585e861" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:11:57 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-d318d00f-3a1b-4f7f-ac8d-1cefb562f411 tempest-VolumesImageMetadata-989187375 None] Lock "cinder-quobyte-5fcb3db1-977c-4094-b813-a3910585e861" acquired by "delete_volume" :: waited 0.021s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:11:57 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[565d471f-4f31-4ad2-92cb-ca8ff10b5d22]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:11:57 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-d318d00f-3a1b-4f7f-ac8d-1cefb562f411 tempest-VolumesImageMetadata-989187375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-5fcb3db1-977c-4094-b813-a3910585e861 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:11:57 devstack sudo[90684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-5fcb3db1-977c-4094-b813-a3910585e861 Aug 05 06:11:57 devstack sudo[90684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:11:57 devstack sudo[90684]: pam_unix(sudo:session): session closed for user root Aug 05 06:11:58 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-d318d00f-3a1b-4f7f-ac8d-1cefb562f411 tempest-VolumesImageMetadata-989187375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-5fcb3db1-977c-4094-b813-a3910585e861" returned: 0 in 0.475s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:11:58 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-d318d00f-3a1b-4f7f-ac8d-1cefb562f411 tempest-VolumesImageMetadata-989187375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-5fcb3db1-977c-4094-b813-a3910585e861 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:11:58 devstack sudo[90690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-5fcb3db1-977c-4094-b813-a3910585e861 Aug 05 06:11:58 devstack sudo[90690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:11:58 devstack sudo[90690]: pam_unix(sudo:session): session closed for user root Aug 05 06:11:58 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-d318d00f-3a1b-4f7f-ac8d-1cefb562f411 tempest-VolumesImageMetadata-989187375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-5fcb3db1-977c-4094-b813-a3910585e861" returned: 0 in 0.338s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:11:58 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-d318d00f-3a1b-4f7f-ac8d-1cefb562f411 tempest-VolumesImageMetadata-989187375 None] Lock "cinder-quobyte-5fcb3db1-977c-4094-b813-a3910585e861" released by "delete_volume" :: held 0.864s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:11:58 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-d318d00f-3a1b-4f7f-ac8d-1cefb562f411 tempest-VolumesImageMetadata-989187375 None] Created reservations ['dc1f6fe2-db77-464d-84ae-01f823557350', 'f5bd34b5-0453-4548-b7b0-588624158049', '219ce339-b20e-4fe2-acfb-9426e5ef157e', '1c4d19f8-0ea8-4ac3-a611-f746ef0ef0c0'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:11:58 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-d318d00f-3a1b-4f7f-ac8d-1cefb562f411 tempest-VolumesImageMetadata-989187375 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:11:58 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-d318d00f-3a1b-4f7f-ac8d-1cefb562f411 tempest-VolumesImageMetadata-989187375 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:11:58 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-d318d00f-3a1b-4f7f-ac8d-1cefb562f411 tempest-VolumesImageMetadata-989187375 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:11:58 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-d318d00f-3a1b-4f7f-ac8d-1cefb562f411 tempest-VolumesImageMetadata-989187375 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:11:58 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-d318d00f-3a1b-4f7f-ac8d-1cefb562f411 tempest-VolumesImageMetadata-989187375 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:11:58 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-d318d00f-3a1b-4f7f-ac8d-1cefb562f411 tempest-VolumesImageMetadata-989187375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:11:58 devstack sudo[90694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce Aug 05 06:11:58 devstack sudo[90694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:11:58 devstack sudo[90694]: pam_unix(sudo:session): session closed for user root Aug 05 06:11:58 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-d318d00f-3a1b-4f7f-ac8d-1cefb562f411 tempest-VolumesImageMetadata-989187375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce" returned: 0 in 0.380s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:11:58 devstack cinder-volume[88695]: DEBUG cinder.manager [None req-d318d00f-3a1b-4f7f-ac8d-1cefb562f411 tempest-VolumesImageMetadata-989187375 None] Notifying Schedulers of capabilities ... {{(pid=88695) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 06:11:58 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-d318d00f-3a1b-4f7f-ac8d-1cefb562f411 tempest-VolumesImageMetadata-989187375 None] Deleted volume successfully. Aug 05 06:11:58 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-d318d00f-3a1b-4f7f-ac8d-1cefb562f411 tempest-VolumesImageMetadata-989187375 None] Lock "cinder-5fcb3db1-977c-4094-b813-a3910585e861-delete_volume" released by "delete_volume" :: held 1.572s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:12:00 devstack cinder-volume[88695]: DEBUG cinder.volume.flows.manager.create_volume [None req-db2b6694-fd48-47ce-adfc-2f22f4f88303 tempest-VolumeRetypeWithoutMigrationTest-1017594154 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88695) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 06:12:00 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-db2b6694-fd48-47ce-adfc-2f22f4f88303 tempest-VolumeRetypeWithoutMigrationTest-1017594154 None] Flow 'volume_create_manager' (c0f545b9-8cc1-4d25-8290-e166ed2fd3a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:12:00 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-db2b6694-fd48-47ce-adfc-2f22f4f88303 tempest-VolumeRetypeWithoutMigrationTest-1017594154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9775f478-eaa8-4633-ba2b-c39bd914b60c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:12:00 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-db2b6694-fd48-47ce-adfc-2f22f4f88303 tempest-VolumeRetypeWithoutMigrationTest-1017594154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9775f478-eaa8-4633-ba2b-c39bd914b60c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:12:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1658327562',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33af3261-1307-489b-972d-6eba62111386,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e04626dfaf0c473daff4617729fb3c9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:12:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:12:00Z,use_quota=True,user_id='0525009bb8494f4186f0c6afff65dfec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cf43b47e-8011-4418-b114-383dafc19b7d),volume_type_id=cf43b47e-8011-4418-b114-383dafc19b7d)' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:12:00 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-db2b6694-fd48-47ce-adfc-2f22f4f88303 tempest-VolumeRetypeWithoutMigrationTest-1017594154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6091800c-db9f-44ae-ac24-6aea8333673d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:12:00 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-db2b6694-fd48-47ce-adfc-2f22f4f88303 tempest-VolumeRetypeWithoutMigrationTest-1017594154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6091800c-db9f-44ae-ac24-6aea8333673d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:12:00 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-db2b6694-fd48-47ce-adfc-2f22f4f88303 tempest-VolumeRetypeWithoutMigrationTest-1017594154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d77addc-d07a-4574-ba50-d9d55180c791) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:12:00 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-db2b6694-fd48-47ce-adfc-2f22f4f88303 tempest-VolumeRetypeWithoutMigrationTest-1017594154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d77addc-d07a-4574-ba50-d9d55180c791) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '33af3261-1307-489b-972d-6eba62111386', 'volume_name': 'volume-33af3261-1307-489b-972d-6eba62111386', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:12:00 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-db2b6694-fd48-47ce-adfc-2f22f4f88303 tempest-VolumeRetypeWithoutMigrationTest-1017594154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f6db37a-c52f-46eb-b303-e20988cf8b35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:12:00 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-db2b6694-fd48-47ce-adfc-2f22f4f88303 tempest-VolumeRetypeWithoutMigrationTest-1017594154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f6db37a-c52f-46eb-b303-e20988cf8b35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:12:00 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-db2b6694-fd48-47ce-adfc-2f22f4f88303 tempest-VolumeRetypeWithoutMigrationTest-1017594154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef089075-c7f5-4d82-bb5b-7058e494627b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:12:00 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-db2b6694-fd48-47ce-adfc-2f22f4f88303 tempest-VolumeRetypeWithoutMigrationTest-1017594154 None] Volume 33af3261-1307-489b-972d-6eba62111386: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-33af3261-1307-489b-972d-6eba62111386', 'volume_size': 1} Aug 05 06:12:00 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-db2b6694-fd48-47ce-adfc-2f22f4f88303 tempest-VolumeRetypeWithoutMigrationTest-1017594154 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:12:00 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-db2b6694-fd48-47ce-adfc-2f22f4f88303 tempest-VolumeRetypeWithoutMigrationTest-1017594154 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:12:00 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-db2b6694-fd48-47ce-adfc-2f22f4f88303 tempest-VolumeRetypeWithoutMigrationTest-1017594154 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:12:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1658327562',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33af3261-1307-489b-972d-6eba62111386,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e04626dfaf0c473daff4617729fb3c9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:12:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:12:00Z,use_quota=True,user_id='0525009bb8494f4186f0c6afff65dfec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cf43b47e-8011-4418-b114-383dafc19b7d),volume_type_id=cf43b47e-8011-4418-b114-383dafc19b7d)}" {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 06:12:00 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-db2b6694-fd48-47ce-adfc-2f22f4f88303 tempest-VolumeRetypeWithoutMigrationTest-1017594154 None] Creating volume 33af3261-1307-489b-972d-6eba62111386 {{(pid=88695) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 06:12:00 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-db2b6694-fd48-47ce-adfc-2f22f4f88303 tempest-VolumeRetypeWithoutMigrationTest-1017594154 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:12:00 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-db2b6694-fd48-47ce-adfc-2f22f4f88303 tempest-VolumeRetypeWithoutMigrationTest-1017594154 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:12:00 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-db2b6694-fd48-47ce-adfc-2f22f4f88303 tempest-VolumeRetypeWithoutMigrationTest-1017594154 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:12:00 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-db2b6694-fd48-47ce-adfc-2f22f4f88303 tempest-VolumeRetypeWithoutMigrationTest-1017594154 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:12:00 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-db2b6694-fd48-47ce-adfc-2f22f4f88303 tempest-VolumeRetypeWithoutMigrationTest-1017594154 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:12:00 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-db2b6694-fd48-47ce-adfc-2f22f4f88303 tempest-VolumeRetypeWithoutMigrationTest-1017594154 None] Selected osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 as target Quobyte volume. {{(pid=88695) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 06:12:00 devstack cinder-volume[88695]: INFO cinder.volume.drivers.remotefs [None req-db2b6694-fd48-47ce-adfc-2f22f4f88303 tempest-VolumeRetypeWithoutMigrationTest-1017594154 None] casted to osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 Aug 05 06:12:00 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-db2b6694-fd48-47ce-adfc-2f22f4f88303 tempest-VolumeRetypeWithoutMigrationTest-1017594154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-33af3261-1307-489b-972d-6eba62111386 1073741824 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:12:00 devstack cinder-volume[88695]: DEBUG oslo_service.periodic_task [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88695) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 06:12:00 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:12:00 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:12:00 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:12:00 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:12:00 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:12:00 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:12:00 devstack sudo[90697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-33af3261-1307-489b-972d-6eba62111386 1073741824 Aug 05 06:12:00 devstack sudo[90697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:12:00 devstack sudo[90698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce Aug 05 06:12:00 devstack sudo[90698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:12:00 devstack sudo[90698]: pam_unix(sudo:session): session closed for user root Aug 05 06:12:00 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce" returned: 0 in 0.353s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:12:00 devstack cinder-volume[88695]: DEBUG cinder.manager [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] Notifying Schedulers of capabilities ... {{(pid=88695) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 06:12:01 devstack sudo[90697]: pam_unix(sudo:session): session closed for user root Aug 05 06:12:01 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-db2b6694-fd48-47ce-adfc-2f22f4f88303 tempest-VolumeRetypeWithoutMigrationTest-1017594154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-33af3261-1307-489b-972d-6eba62111386 1073741824" returned: 0 in 0.697s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:12:01 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-db2b6694-fd48-47ce-adfc-2f22f4f88303 tempest-VolumeRetypeWithoutMigrationTest-1017594154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-33af3261-1307-489b-972d-6eba62111386 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:12:01 devstack sudo[90706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-33af3261-1307-489b-972d-6eba62111386 Aug 05 06:12:01 devstack sudo[90706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:12:01 devstack sudo[90706]: pam_unix(sudo:session): session closed for user root Aug 05 06:12:01 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-db2b6694-fd48-47ce-adfc-2f22f4f88303 tempest-VolumeRetypeWithoutMigrationTest-1017594154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-33af3261-1307-489b-972d-6eba62111386" returned: 0 in 0.361s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:12:01 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-db2b6694-fd48-47ce-adfc-2f22f4f88303 tempest-VolumeRetypeWithoutMigrationTest-1017594154 None] <== create_volume: return (1115ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'} {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 06:12:01 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-db2b6694-fd48-47ce-adfc-2f22f4f88303 tempest-VolumeRetypeWithoutMigrationTest-1017594154 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.119s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:12:01 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-db2b6694-fd48-47ce-adfc-2f22f4f88303 tempest-VolumeRetypeWithoutMigrationTest-1017594154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef089075-c7f5-4d82-bb5b-7058e494627b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-33af3261-1307-489b-972d-6eba62111386', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:12:01 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-db2b6694-fd48-47ce-adfc-2f22f4f88303 tempest-VolumeRetypeWithoutMigrationTest-1017594154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (485765ee-1f4e-4c79-adc1-d2e7748f6684) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:12:01 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-db2b6694-fd48-47ce-adfc-2f22f4f88303 tempest-VolumeRetypeWithoutMigrationTest-1017594154 None] Volume volume-33af3261-1307-489b-972d-6eba62111386 (33af3261-1307-489b-972d-6eba62111386): created successfully Aug 05 06:12:01 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-db2b6694-fd48-47ce-adfc-2f22f4f88303 tempest-VolumeRetypeWithoutMigrationTest-1017594154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (485765ee-1f4e-4c79-adc1-d2e7748f6684) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:12:01 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-db2b6694-fd48-47ce-adfc-2f22f4f88303 tempest-VolumeRetypeWithoutMigrationTest-1017594154 None] Flow 'volume_create_manager' (c0f545b9-8cc1-4d25-8290-e166ed2fd3a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:12:01 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-db2b6694-fd48-47ce-adfc-2f22f4f88303 tempest-VolumeRetypeWithoutMigrationTest-1017594154 None] Created volume successfully. Aug 05 06:12:02 devstack cinder-volume[88695]: DEBUG cinder.volume.flows.manager.create_volume [None req-04a66eae-8a77-43af-8eea-cb348b66aa3d tempest-SnapshotMetadataTestJSON-1175963975 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88695) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 06:12:02 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-04a66eae-8a77-43af-8eea-cb348b66aa3d tempest-SnapshotMetadataTestJSON-1175963975 None] Flow 'volume_create_manager' (ff2986b2-9460-49a4-b825-284cf0cd6544) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:12:02 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-04a66eae-8a77-43af-8eea-cb348b66aa3d tempest-SnapshotMetadataTestJSON-1175963975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74a452b4-ee83-435e-9123-964e45121467) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:12:02 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-04a66eae-8a77-43af-8eea-cb348b66aa3d tempest-SnapshotMetadataTestJSON-1175963975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74a452b4-ee83-435e-9123-964e45121467) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:12:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-632247514',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd1e6f1b-423d-4d26-a45c-e45791f2bf36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cbfc674d8ae43568cef9d87156ccfb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:12:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:12:03Z,use_quota=True,user_id='930deb18632f41abb4d1a1a6160e49ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:12:02 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-04a66eae-8a77-43af-8eea-cb348b66aa3d tempest-SnapshotMetadataTestJSON-1175963975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (899e9dbd-273d-4712-8843-bb63934ce2e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:12:02 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-04a66eae-8a77-43af-8eea-cb348b66aa3d tempest-SnapshotMetadataTestJSON-1175963975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (899e9dbd-273d-4712-8843-bb63934ce2e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:12:02 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-04a66eae-8a77-43af-8eea-cb348b66aa3d tempest-SnapshotMetadataTestJSON-1175963975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7b2a909-6127-41a8-899a-069eb9ce1ec2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:12:02 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-04a66eae-8a77-43af-8eea-cb348b66aa3d tempest-SnapshotMetadataTestJSON-1175963975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7b2a909-6127-41a8-899a-069eb9ce1ec2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd1e6f1b-423d-4d26-a45c-e45791f2bf36', 'volume_name': 'volume-cd1e6f1b-423d-4d26-a45c-e45791f2bf36', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:12:02 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-04a66eae-8a77-43af-8eea-cb348b66aa3d tempest-SnapshotMetadataTestJSON-1175963975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (145552a7-cbb6-4bae-95dd-15b8aebf8edc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:12:02 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-04a66eae-8a77-43af-8eea-cb348b66aa3d tempest-SnapshotMetadataTestJSON-1175963975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (145552a7-cbb6-4bae-95dd-15b8aebf8edc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:12:02 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-04a66eae-8a77-43af-8eea-cb348b66aa3d tempest-SnapshotMetadataTestJSON-1175963975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (552e6ad3-fc17-4323-be2c-7b229544dbd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:12:02 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-04a66eae-8a77-43af-8eea-cb348b66aa3d tempest-SnapshotMetadataTestJSON-1175963975 None] Volume cd1e6f1b-423d-4d26-a45c-e45791f2bf36: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd1e6f1b-423d-4d26-a45c-e45791f2bf36', 'volume_size': 1} Aug 05 06:12:02 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-04a66eae-8a77-43af-8eea-cb348b66aa3d tempest-SnapshotMetadataTestJSON-1175963975 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:12:02 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-04a66eae-8a77-43af-8eea-cb348b66aa3d tempest-SnapshotMetadataTestJSON-1175963975 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:12:02 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-04a66eae-8a77-43af-8eea-cb348b66aa3d tempest-SnapshotMetadataTestJSON-1175963975 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:12:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-632247514',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd1e6f1b-423d-4d26-a45c-e45791f2bf36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cbfc674d8ae43568cef9d87156ccfb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:12:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:12:03Z,use_quota=True,user_id='930deb18632f41abb4d1a1a6160e49ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)}" {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 06:12:02 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-04a66eae-8a77-43af-8eea-cb348b66aa3d tempest-SnapshotMetadataTestJSON-1175963975 None] Creating volume cd1e6f1b-423d-4d26-a45c-e45791f2bf36 {{(pid=88695) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 06:12:02 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-04a66eae-8a77-43af-8eea-cb348b66aa3d tempest-SnapshotMetadataTestJSON-1175963975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:12:02 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-04a66eae-8a77-43af-8eea-cb348b66aa3d tempest-SnapshotMetadataTestJSON-1175963975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:12:02 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-04a66eae-8a77-43af-8eea-cb348b66aa3d tempest-SnapshotMetadataTestJSON-1175963975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:12:02 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-04a66eae-8a77-43af-8eea-cb348b66aa3d tempest-SnapshotMetadataTestJSON-1175963975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:12:02 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-04a66eae-8a77-43af-8eea-cb348b66aa3d tempest-SnapshotMetadataTestJSON-1175963975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:12:02 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-04a66eae-8a77-43af-8eea-cb348b66aa3d tempest-SnapshotMetadataTestJSON-1175963975 None] Selected osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 as target Quobyte volume. {{(pid=88695) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 06:12:02 devstack cinder-volume[88695]: INFO cinder.volume.drivers.remotefs [None req-04a66eae-8a77-43af-8eea-cb348b66aa3d tempest-SnapshotMetadataTestJSON-1175963975 None] casted to osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 Aug 05 06:12:02 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-04a66eae-8a77-43af-8eea-cb348b66aa3d tempest-SnapshotMetadataTestJSON-1175963975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-cd1e6f1b-423d-4d26-a45c-e45791f2bf36 1073741824 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:12:02 devstack sudo[90709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-cd1e6f1b-423d-4d26-a45c-e45791f2bf36 1073741824 Aug 05 06:12:02 devstack sudo[90709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:12:03 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-984a3dc6-0bb2-46f8-8a7a-e0fad0abc62c tempest-VolumeRetypeWithoutMigrationTest-1017594154 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:12:03 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-984a3dc6-0bb2-46f8-8a7a-e0fad0abc62c tempest-VolumeRetypeWithoutMigrationTest-1017594154 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:12:03 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-984a3dc6-0bb2-46f8-8a7a-e0fad0abc62c tempest-VolumeRetypeWithoutMigrationTest-1017594154 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:12:03 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-984a3dc6-0bb2-46f8-8a7a-e0fad0abc62c tempest-VolumeRetypeWithoutMigrationTest-1017594154 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:12:03 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-984a3dc6-0bb2-46f8-8a7a-e0fad0abc62c tempest-VolumeRetypeWithoutMigrationTest-1017594154 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:12:03 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-984a3dc6-0bb2-46f8-8a7a-e0fad0abc62c tempest-VolumeRetypeWithoutMigrationTest-1017594154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:12:03 devstack sudo[90711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce Aug 05 06:12:03 devstack sudo[90711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:12:03 devstack sudo[90709]: pam_unix(sudo:session): session closed for user root Aug 05 06:12:03 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-04a66eae-8a77-43af-8eea-cb348b66aa3d tempest-SnapshotMetadataTestJSON-1175963975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-cd1e6f1b-423d-4d26-a45c-e45791f2bf36 1073741824" returned: 0 in 0.631s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:12:03 devstack sudo[90711]: pam_unix(sudo:session): session closed for user root Aug 05 06:12:03 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-984a3dc6-0bb2-46f8-8a7a-e0fad0abc62c tempest-VolumeRetypeWithoutMigrationTest-1017594154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce" returned: 0 in 0.494s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:12:03 devstack cinder-volume[88695]: DEBUG cinder.manager [None req-984a3dc6-0bb2-46f8-8a7a-e0fad0abc62c tempest-VolumeRetypeWithoutMigrationTest-1017594154 None] Notifying Schedulers of capabilities ... {{(pid=88695) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 06:12:03 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-984a3dc6-0bb2-46f8-8a7a-e0fad0abc62c tempest-VolumeRetypeWithoutMigrationTest-1017594154 None] Retype volume completed successfully. Aug 05 06:12:03 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-04a66eae-8a77-43af-8eea-cb348b66aa3d tempest-SnapshotMetadataTestJSON-1175963975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-cd1e6f1b-423d-4d26-a45c-e45791f2bf36 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:12:03 devstack sudo[90718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-cd1e6f1b-423d-4d26-a45c-e45791f2bf36 Aug 05 06:12:03 devstack sudo[90718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:12:03 devstack sudo[90718]: pam_unix(sudo:session): session closed for user root Aug 05 06:12:03 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-04a66eae-8a77-43af-8eea-cb348b66aa3d tempest-SnapshotMetadataTestJSON-1175963975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-cd1e6f1b-423d-4d26-a45c-e45791f2bf36" returned: 0 in 0.330s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:12:03 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-04a66eae-8a77-43af-8eea-cb348b66aa3d tempest-SnapshotMetadataTestJSON-1175963975 None] <== create_volume: return (1020ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'} {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 06:12:03 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-04a66eae-8a77-43af-8eea-cb348b66aa3d tempest-SnapshotMetadataTestJSON-1175963975 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.025s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:12:04 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-04a66eae-8a77-43af-8eea-cb348b66aa3d tempest-SnapshotMetadataTestJSON-1175963975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (552e6ad3-fc17-4323-be2c-7b229544dbd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd1e6f1b-423d-4d26-a45c-e45791f2bf36', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:12:04 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-04a66eae-8a77-43af-8eea-cb348b66aa3d tempest-SnapshotMetadataTestJSON-1175963975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8aaa28b-8b39-4153-bce9-ebceee5303ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:12:04 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-04a66eae-8a77-43af-8eea-cb348b66aa3d tempest-SnapshotMetadataTestJSON-1175963975 None] Volume volume-cd1e6f1b-423d-4d26-a45c-e45791f2bf36 (cd1e6f1b-423d-4d26-a45c-e45791f2bf36): created successfully Aug 05 06:12:04 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-04a66eae-8a77-43af-8eea-cb348b66aa3d tempest-SnapshotMetadataTestJSON-1175963975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8aaa28b-8b39-4153-bce9-ebceee5303ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:12:04 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-04a66eae-8a77-43af-8eea-cb348b66aa3d tempest-SnapshotMetadataTestJSON-1175963975 None] Flow 'volume_create_manager' (ff2986b2-9460-49a4-b825-284cf0cd6544) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:12:04 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-04a66eae-8a77-43af-8eea-cb348b66aa3d tempest-SnapshotMetadataTestJSON-1175963975 None] Created volume successfully. Aug 05 06:12:04 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-719e983b-67f7-4c97-a9ee-55e7b08ba104 tempest-VolumeRetypeWithoutMigrationTest-1017594154 None] Acquiring lock "cinder-33af3261-1307-489b-972d-6eba62111386-delete_volume" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:12:04 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-719e983b-67f7-4c97-a9ee-55e7b08ba104 tempest-VolumeRetypeWithoutMigrationTest-1017594154 None] Lock "cinder-33af3261-1307-489b-972d-6eba62111386-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:12:04 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-719e983b-67f7-4c97-a9ee-55e7b08ba104 tempest-VolumeRetypeWithoutMigrationTest-1017594154 None] Acquiring lock "cinder-quobyte-33af3261-1307-489b-972d-6eba62111386" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:12:04 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-719e983b-67f7-4c97-a9ee-55e7b08ba104 tempest-VolumeRetypeWithoutMigrationTest-1017594154 None] Lock "cinder-quobyte-33af3261-1307-489b-972d-6eba62111386" acquired by "delete_volume" :: waited 0.020s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:12:04 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef6f5f80-110f-43de-bcf4-fdfe09a30d4a]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:12:04 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-719e983b-67f7-4c97-a9ee-55e7b08ba104 tempest-VolumeRetypeWithoutMigrationTest-1017594154 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-33af3261-1307-489b-972d-6eba62111386 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:12:04 devstack sudo[90723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-33af3261-1307-489b-972d-6eba62111386 Aug 05 06:12:04 devstack sudo[90723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:12:04 devstack sudo[90723]: pam_unix(sudo:session): session closed for user root Aug 05 06:12:04 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-719e983b-67f7-4c97-a9ee-55e7b08ba104 tempest-VolumeRetypeWithoutMigrationTest-1017594154 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-33af3261-1307-489b-972d-6eba62111386" returned: 0 in 0.485s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:12:04 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-719e983b-67f7-4c97-a9ee-55e7b08ba104 tempest-VolumeRetypeWithoutMigrationTest-1017594154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-33af3261-1307-489b-972d-6eba62111386 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:12:04 devstack cinder-volume[88695]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7c25088-d2ed-4e6a-becd-43689beff136 tempest-ServerActionsTestOtherA-886527270 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88695) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 06:12:04 devstack sudo[90728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-33af3261-1307-489b-972d-6eba62111386 Aug 05 06:12:04 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-d7c25088-d2ed-4e6a-becd-43689beff136 tempest-ServerActionsTestOtherA-886527270 None] Flow 'volume_create_manager' (61b14204-33df-4f44-a6ae-9e3df5cbab26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:12:04 devstack sudo[90728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:12:04 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-d7c25088-d2ed-4e6a-becd-43689beff136 tempest-ServerActionsTestOtherA-886527270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5470b131-d4ed-4ac9-bd3e-8fc48919c3e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:12:04 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-d7c25088-d2ed-4e6a-becd-43689beff136 tempest-ServerActionsTestOtherA-886527270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5470b131-d4ed-4ac9-bd3e-8fc48919c3e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:12:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-297345474',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a625722-72b0-4600-9c45-29b3a07e9e82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48aa670bb92f44baaaf6546ea973001f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:12:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:12:05Z,use_quota=True,user_id='8b6dd2a8909447b5bb2458742b7d5922',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:12:05 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-d7c25088-d2ed-4e6a-becd-43689beff136 tempest-ServerActionsTestOtherA-886527270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0565b2f-7d99-4f0d-b0cc-11d4ead92f6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:12:05 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-d7c25088-d2ed-4e6a-becd-43689beff136 tempest-ServerActionsTestOtherA-886527270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0565b2f-7d99-4f0d-b0cc-11d4ead92f6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:12:05 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-d7c25088-d2ed-4e6a-becd-43689beff136 tempest-ServerActionsTestOtherA-886527270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (120975a7-923c-4a1d-b2b2-476a9b45af76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:12:05 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-d7c25088-d2ed-4e6a-becd-43689beff136 tempest-ServerActionsTestOtherA-886527270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (120975a7-923c-4a1d-b2b2-476a9b45af76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4a625722-72b0-4600-9c45-29b3a07e9e82', 'volume_name': 'volume-4a625722-72b0-4600-9c45-29b3a07e9e82', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:12:05 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-d7c25088-d2ed-4e6a-becd-43689beff136 tempest-ServerActionsTestOtherA-886527270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22c9395d-0340-4ad3-b332-2562331532b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:12:05 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-d7c25088-d2ed-4e6a-becd-43689beff136 tempest-ServerActionsTestOtherA-886527270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22c9395d-0340-4ad3-b332-2562331532b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:12:05 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-d7c25088-d2ed-4e6a-becd-43689beff136 tempest-ServerActionsTestOtherA-886527270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cef0aae9-27c0-4f15-aefd-d105848c1cba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:12:05 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-d7c25088-d2ed-4e6a-becd-43689beff136 tempest-ServerActionsTestOtherA-886527270 None] Volume 4a625722-72b0-4600-9c45-29b3a07e9e82: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4a625722-72b0-4600-9c45-29b3a07e9e82', 'volume_size': 1} Aug 05 06:12:05 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-d7c25088-d2ed-4e6a-becd-43689beff136 tempest-ServerActionsTestOtherA-886527270 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:12:05 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-d7c25088-d2ed-4e6a-becd-43689beff136 tempest-ServerActionsTestOtherA-886527270 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:12:05 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-d7c25088-d2ed-4e6a-becd-43689beff136 tempest-ServerActionsTestOtherA-886527270 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:12:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-297345474',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a625722-72b0-4600-9c45-29b3a07e9e82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48aa670bb92f44baaaf6546ea973001f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:12:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:12:05Z,use_quota=True,user_id='8b6dd2a8909447b5bb2458742b7d5922',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)}" {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 06:12:05 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-d7c25088-d2ed-4e6a-becd-43689beff136 tempest-ServerActionsTestOtherA-886527270 None] Creating volume 4a625722-72b0-4600-9c45-29b3a07e9e82 {{(pid=88695) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 06:12:05 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-d7c25088-d2ed-4e6a-becd-43689beff136 tempest-ServerActionsTestOtherA-886527270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:12:05 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-d7c25088-d2ed-4e6a-becd-43689beff136 tempest-ServerActionsTestOtherA-886527270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:12:05 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-d7c25088-d2ed-4e6a-becd-43689beff136 tempest-ServerActionsTestOtherA-886527270 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:12:05 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-d7c25088-d2ed-4e6a-becd-43689beff136 tempest-ServerActionsTestOtherA-886527270 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:12:05 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-d7c25088-d2ed-4e6a-becd-43689beff136 tempest-ServerActionsTestOtherA-886527270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:12:05 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-d7c25088-d2ed-4e6a-becd-43689beff136 tempest-ServerActionsTestOtherA-886527270 None] Selected osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 as target Quobyte volume. {{(pid=88695) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 06:12:05 devstack cinder-volume[88695]: INFO cinder.volume.drivers.remotefs [None req-d7c25088-d2ed-4e6a-becd-43689beff136 tempest-ServerActionsTestOtherA-886527270 None] casted to osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 Aug 05 06:12:05 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-d7c25088-d2ed-4e6a-becd-43689beff136 tempest-ServerActionsTestOtherA-886527270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-4a625722-72b0-4600-9c45-29b3a07e9e82 1073741824 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:12:05 devstack sudo[90731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-4a625722-72b0-4600-9c45-29b3a07e9e82 1073741824 Aug 05 06:12:05 devstack sudo[90731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:12:05 devstack sudo[90728]: pam_unix(sudo:session): session closed for user root Aug 05 06:12:05 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-719e983b-67f7-4c97-a9ee-55e7b08ba104 tempest-VolumeRetypeWithoutMigrationTest-1017594154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-33af3261-1307-489b-972d-6eba62111386" returned: 0 in 0.323s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:12:05 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-719e983b-67f7-4c97-a9ee-55e7b08ba104 tempest-VolumeRetypeWithoutMigrationTest-1017594154 None] Lock "cinder-quobyte-33af3261-1307-489b-972d-6eba62111386" released by "delete_volume" :: held 0.861s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:12:05 devstack cinder-volume[88695]: WARNING cinder.quota [None req-719e983b-67f7-4c97-a9ee-55e7b08ba104 tempest-VolumeRetypeWithoutMigrationTest-1017594154 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Aug 05 06:12:05 devstack cinder-volume[88695]: WARNING cinder.quota [None req-719e983b-67f7-4c97-a9ee-55e7b08ba104 tempest-VolumeRetypeWithoutMigrationTest-1017594154 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Aug 05 06:12:05 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-719e983b-67f7-4c97-a9ee-55e7b08ba104 tempest-VolumeRetypeWithoutMigrationTest-1017594154 None] Created reservations ['d2467782-34dd-429a-958d-e89bbde14d52', '2bc64c55-4541-4442-9644-ed19316cccd4', '8c6dd48d-55da-4a41-887e-5db2de237000', '6f7761ad-5519-4f19-9e8f-c2f5c3262beb'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:12:05 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-3e9b2968-825c-48fd-9dfa-e6fe88646684 tempest-SnapshotMetadataTestJSON-1175963975 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:12:05 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-719e983b-67f7-4c97-a9ee-55e7b08ba104 tempest-VolumeRetypeWithoutMigrationTest-1017594154 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:12:05 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-719e983b-67f7-4c97-a9ee-55e7b08ba104 tempest-VolumeRetypeWithoutMigrationTest-1017594154 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:12:05 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-719e983b-67f7-4c97-a9ee-55e7b08ba104 tempest-VolumeRetypeWithoutMigrationTest-1017594154 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:12:05 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-719e983b-67f7-4c97-a9ee-55e7b08ba104 tempest-VolumeRetypeWithoutMigrationTest-1017594154 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:12:05 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-719e983b-67f7-4c97-a9ee-55e7b08ba104 tempest-VolumeRetypeWithoutMigrationTest-1017594154 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:12:05 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-719e983b-67f7-4c97-a9ee-55e7b08ba104 tempest-VolumeRetypeWithoutMigrationTest-1017594154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:12:05 devstack sudo[90738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce Aug 05 06:12:05 devstack sudo[90738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:12:05 devstack sudo[90731]: pam_unix(sudo:session): session closed for user root Aug 05 06:12:05 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-d7c25088-d2ed-4e6a-becd-43689beff136 tempest-ServerActionsTestOtherA-886527270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-4a625722-72b0-4600-9c45-29b3a07e9e82 1073741824" returned: 0 in 0.568s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:12:05 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-d7c25088-d2ed-4e6a-becd-43689beff136 tempest-ServerActionsTestOtherA-886527270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-4a625722-72b0-4600-9c45-29b3a07e9e82 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:12:05 devstack sudo[90740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-4a625722-72b0-4600-9c45-29b3a07e9e82 Aug 05 06:12:05 devstack sudo[90740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:12:05 devstack sudo[90738]: pam_unix(sudo:session): session closed for user root Aug 05 06:12:05 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-719e983b-67f7-4c97-a9ee-55e7b08ba104 tempest-VolumeRetypeWithoutMigrationTest-1017594154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce" returned: 0 in 0.396s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:12:05 devstack cinder-volume[88695]: DEBUG cinder.manager [None req-719e983b-67f7-4c97-a9ee-55e7b08ba104 tempest-VolumeRetypeWithoutMigrationTest-1017594154 None] Notifying Schedulers of capabilities ... {{(pid=88695) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 06:12:05 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-719e983b-67f7-4c97-a9ee-55e7b08ba104 tempest-VolumeRetypeWithoutMigrationTest-1017594154 None] Deleted volume successfully. Aug 05 06:12:05 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-719e983b-67f7-4c97-a9ee-55e7b08ba104 tempest-VolumeRetypeWithoutMigrationTest-1017594154 None] Lock "cinder-33af3261-1307-489b-972d-6eba62111386-delete_volume" released by "delete_volume" :: held 1.610s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:12:06 devstack sudo[90740]: pam_unix(sudo:session): session closed for user root Aug 05 06:12:06 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-d7c25088-d2ed-4e6a-becd-43689beff136 tempest-ServerActionsTestOtherA-886527270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-4a625722-72b0-4600-9c45-29b3a07e9e82" returned: 0 in 0.356s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:12:06 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-d7c25088-d2ed-4e6a-becd-43689beff136 tempest-ServerActionsTestOtherA-886527270 None] <== create_volume: return (1026ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'} {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 06:12:06 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-d7c25088-d2ed-4e6a-becd-43689beff136 tempest-ServerActionsTestOtherA-886527270 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.032s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:12:06 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-3e9b2968-825c-48fd-9dfa-e6fe88646684 tempest-SnapshotMetadataTestJSON-1175963975 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.676s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:12:06 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-d7c25088-d2ed-4e6a-becd-43689beff136 tempest-ServerActionsTestOtherA-886527270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cef0aae9-27c0-4f15-aefd-d105848c1cba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a625722-72b0-4600-9c45-29b3a07e9e82', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:12:06 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-d7c25088-d2ed-4e6a-becd-43689beff136 tempest-ServerActionsTestOtherA-886527270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a9937f0-37e8-4068-a414-1e2736d0c2a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:12:06 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-3e9b2968-825c-48fd-9dfa-e6fe88646684 tempest-SnapshotMetadataTestJSON-1175963975 None] Creating offline snapshot 0574656a-b84f-427f-b76c-67a826aa0364 of volume cd1e6f1b-423d-4d26-a45c-e45791f2bf36 {{(pid=88695) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 06:12:06 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-d7c25088-d2ed-4e6a-becd-43689beff136 tempest-ServerActionsTestOtherA-886527270 None] Volume volume-4a625722-72b0-4600-9c45-29b3a07e9e82 (4a625722-72b0-4600-9c45-29b3a07e9e82): created successfully Aug 05 06:12:06 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-d7c25088-d2ed-4e6a-becd-43689beff136 tempest-ServerActionsTestOtherA-886527270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a9937f0-37e8-4068-a414-1e2736d0c2a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:12:06 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-d7c25088-d2ed-4e6a-becd-43689beff136 tempest-ServerActionsTestOtherA-886527270 None] Flow 'volume_create_manager' (61b14204-33df-4f44-a6ae-9e3df5cbab26) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:12:06 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7c979be-fda5-482b-b2ad-e06ae11bffb8]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:12:06 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-3e9b2968-825c-48fd-9dfa-e6fe88646684 tempest-SnapshotMetadataTestJSON-1175963975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-cd1e6f1b-423d-4d26-a45c-e45791f2bf36 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:12:06 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-d7c25088-d2ed-4e6a-becd-43689beff136 tempest-ServerActionsTestOtherA-886527270 None] Created volume successfully. Aug 05 06:12:06 devstack sudo[90744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-cd1e6f1b-423d-4d26-a45c-e45791f2bf36 Aug 05 06:12:06 devstack sudo[90744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:12:06 devstack sudo[90744]: pam_unix(sudo:session): session closed for user root Aug 05 06:12:06 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-3e9b2968-825c-48fd-9dfa-e6fe88646684 tempest-SnapshotMetadataTestJSON-1175963975 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-cd1e6f1b-423d-4d26-a45c-e45791f2bf36" returned: 0 in 0.468s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:12:06 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-3e9b2968-825c-48fd-9dfa-e6fe88646684 tempest-SnapshotMetadataTestJSON-1175963975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-cd1e6f1b-423d-4d26-a45c-e45791f2bf36,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-cd1e6f1b-423d-4d26-a45c-e45791f2bf36.0574656a-b84f-427f-b76c-67a826aa0364 1G {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:12:06 devstack sudo[90750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-cd1e6f1b-423d-4d26-a45c-e45791f2bf36,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-cd1e6f1b-423d-4d26-a45c-e45791f2bf36.0574656a-b84f-427f-b76c-67a826aa0364 1G Aug 05 06:12:06 devstack sudo[90750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:12:07 devstack sudo[90750]: pam_unix(sudo:session): session closed for user root Aug 05 06:12:07 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-3e9b2968-825c-48fd-9dfa-e6fe88646684 tempest-SnapshotMetadataTestJSON-1175963975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-cd1e6f1b-423d-4d26-a45c-e45791f2bf36,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-cd1e6f1b-423d-4d26-a45c-e45791f2bf36.0574656a-b84f-427f-b76c-67a826aa0364 1G" returned: 0 in 0.411s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:12:07 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-3e9b2968-825c-48fd-9dfa-e6fe88646684 tempest-SnapshotMetadataTestJSON-1175963975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd1e6f1b-423d-4d26-a45c-e45791f2bf36 -F qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-cd1e6f1b-423d-4d26-a45c-e45791f2bf36.0574656a-b84f-427f-b76c-67a826aa0364 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:12:07 devstack sudo[90756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd1e6f1b-423d-4d26-a45c-e45791f2bf36 -F qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-cd1e6f1b-423d-4d26-a45c-e45791f2bf36.0574656a-b84f-427f-b76c-67a826aa0364 Aug 05 06:12:07 devstack sudo[90756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:12:07 devstack sudo[90756]: pam_unix(sudo:session): session closed for user root Aug 05 06:12:07 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-3e9b2968-825c-48fd-9dfa-e6fe88646684 tempest-SnapshotMetadataTestJSON-1175963975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd1e6f1b-423d-4d26-a45c-e45791f2bf36 -F qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-cd1e6f1b-423d-4d26-a45c-e45791f2bf36.0574656a-b84f-427f-b76c-67a826aa0364" returned: 0 in 0.339s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:12:07 devstack cinder-volume[88695]: WARNING cinder.volume.drivers.remotefs [None req-3e9b2968-825c-48fd-9dfa-e6fe88646684 tempest-SnapshotMetadataTestJSON-1175963975 None] /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-cd1e6f1b-423d-4d26-a45c-e45791f2bf36.0574656a-b84f-427f-b76c-67a826aa0364 is being set with open permissions: ugo+rw Aug 05 06:12:07 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-3e9b2968-825c-48fd-9dfa-e6fe88646684 tempest-SnapshotMetadataTestJSON-1175963975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-cd1e6f1b-423d-4d26-a45c-e45791f2bf36.0574656a-b84f-427f-b76c-67a826aa0364 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:12:07 devstack sudo[90763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-cd1e6f1b-423d-4d26-a45c-e45791f2bf36.0574656a-b84f-427f-b76c-67a826aa0364 Aug 05 06:12:07 devstack sudo[90763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:12:07 devstack sudo[90763]: pam_unix(sudo:session): session closed for user root Aug 05 06:12:07 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-3e9b2968-825c-48fd-9dfa-e6fe88646684 tempest-SnapshotMetadataTestJSON-1175963975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-cd1e6f1b-423d-4d26-a45c-e45791f2bf36.0574656a-b84f-427f-b76c-67a826aa0364" returned: 0 in 0.304s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:12:07 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-3e9b2968-825c-48fd-9dfa-e6fe88646684 tempest-SnapshotMetadataTestJSON-1175963975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-cd1e6f1b-423d-4d26-a45c-e45791f2bf36.info {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:12:07 devstack sudo[90766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-cd1e6f1b-423d-4d26-a45c-e45791f2bf36.info Aug 05 06:12:07 devstack sudo[90766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:12:08 devstack sudo[90766]: pam_unix(sudo:session): session closed for user root Aug 05 06:12:08 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-3e9b2968-825c-48fd-9dfa-e6fe88646684 tempest-SnapshotMetadataTestJSON-1175963975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-cd1e6f1b-423d-4d26-a45c-e45791f2bf36.info" returned: 0 in 0.306s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:12:08 devstack cinder-volume[88695]: WARNING cinder.volume.drivers.remotefs [None req-3e9b2968-825c-48fd-9dfa-e6fe88646684 tempest-SnapshotMetadataTestJSON-1175963975 None] /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-cd1e6f1b-423d-4d26-a45c-e45791f2bf36.info is being set with open permissions: ugo+rw Aug 05 06:12:08 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-3e9b2968-825c-48fd-9dfa-e6fe88646684 tempest-SnapshotMetadataTestJSON-1175963975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-cd1e6f1b-423d-4d26-a45c-e45791f2bf36.info {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:12:08 devstack cinder-volume[88695]: DEBUG cinder.volume.flows.manager.create_volume [None req-4279690c-3931-4ed0-9269-cfd5dea0d99d tempest-TaggedAttachmentsTest-306183043 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88695) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 06:12:08 devstack sudo[90769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-cd1e6f1b-423d-4d26-a45c-e45791f2bf36.info Aug 05 06:12:08 devstack sudo[90769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:12:08 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-4279690c-3931-4ed0-9269-cfd5dea0d99d tempest-TaggedAttachmentsTest-306183043 None] Flow 'volume_create_manager' (488f302a-3a1a-43b0-a474-2bfebd55a2ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:12:08 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-4279690c-3931-4ed0-9269-cfd5dea0d99d tempest-TaggedAttachmentsTest-306183043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06dfe085-ec66-404e-a616-048e19354fd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:12:08 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-4279690c-3931-4ed0-9269-cfd5dea0d99d tempest-TaggedAttachmentsTest-306183043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06dfe085-ec66-404e-a616-048e19354fd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:12:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1203139351',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aeee006c-089d-4fcb-8275-e80f2bf1d441,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c5015a241aa41ecb6b5e2fb91edbb9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:12:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:12:08Z,use_quota=True,user_id='267df17f842a45ffa622bd24bd16cea5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:12:08 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-4279690c-3931-4ed0-9269-cfd5dea0d99d tempest-TaggedAttachmentsTest-306183043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7aae253-0371-466d-bfc8-a6eecae0eb7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:12:08 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-4279690c-3931-4ed0-9269-cfd5dea0d99d tempest-TaggedAttachmentsTest-306183043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7aae253-0371-466d-bfc8-a6eecae0eb7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:12:08 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-4279690c-3931-4ed0-9269-cfd5dea0d99d tempest-TaggedAttachmentsTest-306183043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01cfb3f4-0e9f-4040-835a-01c09c575bc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:12:08 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-4279690c-3931-4ed0-9269-cfd5dea0d99d tempest-TaggedAttachmentsTest-306183043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01cfb3f4-0e9f-4040-835a-01c09c575bc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aeee006c-089d-4fcb-8275-e80f2bf1d441', 'volume_name': 'volume-aeee006c-089d-4fcb-8275-e80f2bf1d441', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:12:08 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-4279690c-3931-4ed0-9269-cfd5dea0d99d tempest-TaggedAttachmentsTest-306183043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3105ade-b07c-4739-ae79-6e2f51c933f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:12:08 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-4279690c-3931-4ed0-9269-cfd5dea0d99d tempest-TaggedAttachmentsTest-306183043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3105ade-b07c-4739-ae79-6e2f51c933f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:12:08 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-4279690c-3931-4ed0-9269-cfd5dea0d99d tempest-TaggedAttachmentsTest-306183043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5974c6f4-898d-4abf-815a-bb5c11ddc666) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:12:08 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-4279690c-3931-4ed0-9269-cfd5dea0d99d tempest-TaggedAttachmentsTest-306183043 None] Volume aeee006c-089d-4fcb-8275-e80f2bf1d441: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aeee006c-089d-4fcb-8275-e80f2bf1d441', 'volume_size': 1} Aug 05 06:12:08 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-4279690c-3931-4ed0-9269-cfd5dea0d99d tempest-TaggedAttachmentsTest-306183043 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:12:08 devstack sudo[90769]: pam_unix(sudo:session): session closed for user root Aug 05 06:12:08 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-3e9b2968-825c-48fd-9dfa-e6fe88646684 tempest-SnapshotMetadataTestJSON-1175963975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-cd1e6f1b-423d-4d26-a45c-e45791f2bf36.info" returned: 0 in 0.290s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:12:08 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-3e9b2968-825c-48fd-9dfa-e6fe88646684 tempest-SnapshotMetadataTestJSON-1175963975 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.298s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:12:08 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-4279690c-3931-4ed0-9269-cfd5dea0d99d tempest-TaggedAttachmentsTest-306183043 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.207s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:12:08 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-4279690c-3931-4ed0-9269-cfd5dea0d99d tempest-TaggedAttachmentsTest-306183043 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:12:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1203139351',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aeee006c-089d-4fcb-8275-e80f2bf1d441,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c5015a241aa41ecb6b5e2fb91edbb9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:12:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:12:08Z,use_quota=True,user_id='267df17f842a45ffa622bd24bd16cea5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)}" {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 06:12:08 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-4279690c-3931-4ed0-9269-cfd5dea0d99d tempest-TaggedAttachmentsTest-306183043 None] Creating volume aeee006c-089d-4fcb-8275-e80f2bf1d441 {{(pid=88695) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 06:12:08 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-4279690c-3931-4ed0-9269-cfd5dea0d99d tempest-TaggedAttachmentsTest-306183043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:12:08 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-4279690c-3931-4ed0-9269-cfd5dea0d99d tempest-TaggedAttachmentsTest-306183043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:12:08 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-4279690c-3931-4ed0-9269-cfd5dea0d99d tempest-TaggedAttachmentsTest-306183043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:12:08 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-4279690c-3931-4ed0-9269-cfd5dea0d99d tempest-TaggedAttachmentsTest-306183043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:12:08 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-4279690c-3931-4ed0-9269-cfd5dea0d99d tempest-TaggedAttachmentsTest-306183043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:12:08 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-4279690c-3931-4ed0-9269-cfd5dea0d99d tempest-TaggedAttachmentsTest-306183043 None] Selected osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 as target Quobyte volume. {{(pid=88695) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 06:12:08 devstack cinder-volume[88695]: INFO cinder.volume.drivers.remotefs [None req-4279690c-3931-4ed0-9269-cfd5dea0d99d tempest-TaggedAttachmentsTest-306183043 None] casted to osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 Aug 05 06:12:08 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-4279690c-3931-4ed0-9269-cfd5dea0d99d tempest-TaggedAttachmentsTest-306183043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-aeee006c-089d-4fcb-8275-e80f2bf1d441 1073741824 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:12:08 devstack sudo[90772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-aeee006c-089d-4fcb-8275-e80f2bf1d441 1073741824 Aug 05 06:12:08 devstack sudo[90772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:12:08 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-3e9b2968-825c-48fd-9dfa-e6fe88646684 tempest-SnapshotMetadataTestJSON-1175963975 None] Create snapshot completed successfully Aug 05 06:12:08 devstack sudo[90772]: pam_unix(sudo:session): session closed for user root Aug 05 06:12:08 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-4279690c-3931-4ed0-9269-cfd5dea0d99d tempest-TaggedAttachmentsTest-306183043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-aeee006c-089d-4fcb-8275-e80f2bf1d441 1073741824" returned: 0 in 0.587s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:12:09 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-4279690c-3931-4ed0-9269-cfd5dea0d99d tempest-TaggedAttachmentsTest-306183043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-aeee006c-089d-4fcb-8275-e80f2bf1d441 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:12:09 devstack sudo[90783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-aeee006c-089d-4fcb-8275-e80f2bf1d441 Aug 05 06:12:09 devstack sudo[90783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:12:09 devstack sudo[90783]: pam_unix(sudo:session): session closed for user root Aug 05 06:12:09 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-4279690c-3931-4ed0-9269-cfd5dea0d99d tempest-TaggedAttachmentsTest-306183043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-aeee006c-089d-4fcb-8275-e80f2bf1d441" returned: 0 in 0.301s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:12:09 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-4279690c-3931-4ed0-9269-cfd5dea0d99d tempest-TaggedAttachmentsTest-306183043 None] <== create_volume: return (976ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'} {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 06:12:09 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-4279690c-3931-4ed0-9269-cfd5dea0d99d tempest-TaggedAttachmentsTest-306183043 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.979s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:12:09 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-4279690c-3931-4ed0-9269-cfd5dea0d99d tempest-TaggedAttachmentsTest-306183043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5974c6f4-898d-4abf-815a-bb5c11ddc666) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aeee006c-089d-4fcb-8275-e80f2bf1d441', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:12:09 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-4279690c-3931-4ed0-9269-cfd5dea0d99d tempest-TaggedAttachmentsTest-306183043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f4fcbee-0b6b-4f4c-a854-7f3defdc1bac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:12:09 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-4279690c-3931-4ed0-9269-cfd5dea0d99d tempest-TaggedAttachmentsTest-306183043 None] Volume volume-aeee006c-089d-4fcb-8275-e80f2bf1d441 (aeee006c-089d-4fcb-8275-e80f2bf1d441): created successfully Aug 05 06:12:09 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-4279690c-3931-4ed0-9269-cfd5dea0d99d tempest-TaggedAttachmentsTest-306183043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f4fcbee-0b6b-4f4c-a854-7f3defdc1bac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:12:09 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-4279690c-3931-4ed0-9269-cfd5dea0d99d tempest-TaggedAttachmentsTest-306183043 None] Flow 'volume_create_manager' (488f302a-3a1a-43b0-a474-2bfebd55a2ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:12:09 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-4279690c-3931-4ed0-9269-cfd5dea0d99d tempest-TaggedAttachmentsTest-306183043 None] Created volume successfully. Aug 05 06:12:09 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-1075d7b4-302f-45cf-b72b-85534c54b34c tempest-SnapshotMetadataTestJSON-1175963975 None] Acquiring lock "cinder-0574656a-b84f-427f-b76c-67a826aa0364-delete_snapshot" by "delete_snapshot" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:12:09 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-1075d7b4-302f-45cf-b72b-85534c54b34c tempest-SnapshotMetadataTestJSON-1175963975 None] Lock "cinder-0574656a-b84f-427f-b76c-67a826aa0364-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:12:09 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-1075d7b4-302f-45cf-b72b-85534c54b34c tempest-SnapshotMetadataTestJSON-1175963975 None] Acquiring lock "cinder-quobyte-cd1e6f1b-423d-4d26-a45c-e45791f2bf36" by "delete_snapshot" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:12:09 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-1075d7b4-302f-45cf-b72b-85534c54b34c tempest-SnapshotMetadataTestJSON-1175963975 None] Lock "cinder-quobyte-cd1e6f1b-423d-4d26-a45c-e45791f2bf36" acquired by "delete_snapshot" :: waited 0.021s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:12:09 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-1075d7b4-302f-45cf-b72b-85534c54b34c tempest-SnapshotMetadataTestJSON-1175963975 None] Acquiring lock "cinder-quobyte-0574656a-b84f-427f-b76c-67a826aa0364" by "_delete_snapshot" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:12:09 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-1075d7b4-302f-45cf-b72b-85534c54b34c tempest-SnapshotMetadataTestJSON-1175963975 None] Lock "cinder-quobyte-0574656a-b84f-427f-b76c-67a826aa0364" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:12:09 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-1075d7b4-302f-45cf-b72b-85534c54b34c tempest-SnapshotMetadataTestJSON-1175963975 None] Deleting offline snapshot 0574656a-b84f-427f-b76c-67a826aa0364 of volume cd1e6f1b-423d-4d26-a45c-e45791f2bf36 {{(pid=88695) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 06:12:09 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-1075d7b4-302f-45cf-b72b-85534c54b34c tempest-SnapshotMetadataTestJSON-1175963975 None] snapshot_file for this snap is: volume-cd1e6f1b-423d-4d26-a45c-e45791f2bf36.0574656a-b84f-427f-b76c-67a826aa0364 {{(pid=88695) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 06:12:09 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[97537640-9650-4e71-a614-56705cda1b8d]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:12:09 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-1075d7b4-302f-45cf-b72b-85534c54b34c tempest-SnapshotMetadataTestJSON-1175963975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-cd1e6f1b-423d-4d26-a45c-e45791f2bf36.0574656a-b84f-427f-b76c-67a826aa0364 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:12:09 devstack sudo[90789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-cd1e6f1b-423d-4d26-a45c-e45791f2bf36.0574656a-b84f-427f-b76c-67a826aa0364 Aug 05 06:12:09 devstack sudo[90789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:12:10 devstack sudo[90789]: pam_unix(sudo:session): session closed for user root Aug 05 06:12:10 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-1075d7b4-302f-45cf-b72b-85534c54b34c tempest-SnapshotMetadataTestJSON-1175963975 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-cd1e6f1b-423d-4d26-a45c-e45791f2bf36.0574656a-b84f-427f-b76c-67a826aa0364" returned: 0 in 0.460s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:12:10 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-1075d7b4-302f-45cf-b72b-85534c54b34c tempest-SnapshotMetadataTestJSON-1175963975 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cd1e6f1b-423d-4d26-a45c-e45791f2bf36(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88695) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 06:12:10 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[384ba2d2-671c-42c3-a61c-390937848fa7]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:12:10 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-1075d7b4-302f-45cf-b72b-85534c54b34c tempest-SnapshotMetadataTestJSON-1175963975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-cd1e6f1b-423d-4d26-a45c-e45791f2bf36 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:12:10 devstack sudo[90794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-cd1e6f1b-423d-4d26-a45c-e45791f2bf36 Aug 05 06:12:10 devstack sudo[90794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:12:10 devstack sudo[90794]: pam_unix(sudo:session): session closed for user root Aug 05 06:12:10 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-1075d7b4-302f-45cf-b72b-85534c54b34c tempest-SnapshotMetadataTestJSON-1175963975 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-cd1e6f1b-423d-4d26-a45c-e45791f2bf36" returned: 0 in 0.486s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:12:10 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-1075d7b4-302f-45cf-b72b-85534c54b34c tempest-SnapshotMetadataTestJSON-1175963975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-cd1e6f1b-423d-4d26-a45c-e45791f2bf36.0574656a-b84f-427f-b76c-67a826aa0364 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:12:10 devstack sudo[90801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-cd1e6f1b-423d-4d26-a45c-e45791f2bf36.0574656a-b84f-427f-b76c-67a826aa0364 Aug 05 06:12:10 devstack sudo[90801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:12:11 devstack sudo[90801]: pam_unix(sudo:session): session closed for user root Aug 05 06:12:11 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-1075d7b4-302f-45cf-b72b-85534c54b34c tempest-SnapshotMetadataTestJSON-1175963975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-cd1e6f1b-423d-4d26-a45c-e45791f2bf36.0574656a-b84f-427f-b76c-67a826aa0364" returned: 0 in 0.569s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:12:11 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-1075d7b4-302f-45cf-b72b-85534c54b34c tempest-SnapshotMetadataTestJSON-1175963975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-cd1e6f1b-423d-4d26-a45c-e45791f2bf36.0574656a-b84f-427f-b76c-67a826aa0364 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:12:11 devstack sudo[90811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-cd1e6f1b-423d-4d26-a45c-e45791f2bf36.0574656a-b84f-427f-b76c-67a826aa0364 Aug 05 06:12:11 devstack sudo[90811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:12:11 devstack sudo[90811]: pam_unix(sudo:session): session closed for user root Aug 05 06:12:11 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-1075d7b4-302f-45cf-b72b-85534c54b34c tempest-SnapshotMetadataTestJSON-1175963975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-cd1e6f1b-423d-4d26-a45c-e45791f2bf36.0574656a-b84f-427f-b76c-67a826aa0364" returned: 0 in 0.443s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:12:11 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-1075d7b4-302f-45cf-b72b-85534c54b34c tempest-SnapshotMetadataTestJSON-1175963975 None] Lock "cinder-quobyte-0574656a-b84f-427f-b76c-67a826aa0364" released by "_delete_snapshot" :: held 2.119s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:12:11 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-1075d7b4-302f-45cf-b72b-85534c54b34c tempest-SnapshotMetadataTestJSON-1175963975 None] Lock "cinder-quobyte-cd1e6f1b-423d-4d26-a45c-e45791f2bf36" released by "delete_snapshot" :: held 2.153s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:12:11 devstack cinder-volume[88695]: WARNING cinder.quota [None req-1075d7b4-302f-45cf-b72b-85534c54b34c tempest-SnapshotMetadataTestJSON-1175963975 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Aug 05 06:12:11 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-1075d7b4-302f-45cf-b72b-85534c54b34c tempest-SnapshotMetadataTestJSON-1175963975 None] Created reservations ['b5a82acc-aad0-4b94-bc48-7fe646e55655', '463929d6-f132-4017-a89c-14144d2df097', 'bc5ef609-b14f-42b4-8981-04b0d2f2f2a0', '00661add-bea4-4a44-a420-a1f401a1e73e'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:12:11 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-1075d7b4-302f-45cf-b72b-85534c54b34c tempest-SnapshotMetadataTestJSON-1175963975 None] Delete snapshot completed successfully. Aug 05 06:12:11 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-1075d7b4-302f-45cf-b72b-85534c54b34c tempest-SnapshotMetadataTestJSON-1175963975 None] Lock "cinder-0574656a-b84f-427f-b76c-67a826aa0364-delete_snapshot" released by "delete_snapshot" :: held 2.397s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:12:12 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-8518240d-4076-4339-acfa-9b77c319dd2e tempest-SnapshotMetadataTestJSON-1175963975 None] Acquiring lock "cinder-cd1e6f1b-423d-4d26-a45c-e45791f2bf36-delete_volume" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:12:12 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-8518240d-4076-4339-acfa-9b77c319dd2e tempest-SnapshotMetadataTestJSON-1175963975 None] Lock "cinder-cd1e6f1b-423d-4d26-a45c-e45791f2bf36-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:12:12 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-8518240d-4076-4339-acfa-9b77c319dd2e tempest-SnapshotMetadataTestJSON-1175963975 None] Acquiring lock "cinder-quobyte-cd1e6f1b-423d-4d26-a45c-e45791f2bf36" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:12:13 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-8518240d-4076-4339-acfa-9b77c319dd2e tempest-SnapshotMetadataTestJSON-1175963975 None] Lock "cinder-quobyte-cd1e6f1b-423d-4d26-a45c-e45791f2bf36" acquired by "delete_volume" :: waited 0.022s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:12:13 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce9467a4-9f50-4cc7-903c-a1c41bb19128]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:12:13 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-8518240d-4076-4339-acfa-9b77c319dd2e tempest-SnapshotMetadataTestJSON-1175963975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-cd1e6f1b-423d-4d26-a45c-e45791f2bf36 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:12:13 devstack sudo[90827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-cd1e6f1b-423d-4d26-a45c-e45791f2bf36 Aug 05 06:12:13 devstack sudo[90827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:12:13 devstack sudo[90827]: pam_unix(sudo:session): session closed for user root Aug 05 06:12:13 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-8518240d-4076-4339-acfa-9b77c319dd2e tempest-SnapshotMetadataTestJSON-1175963975 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-cd1e6f1b-423d-4d26-a45c-e45791f2bf36" returned: 0 in 0.511s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:12:13 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-8518240d-4076-4339-acfa-9b77c319dd2e tempest-SnapshotMetadataTestJSON-1175963975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-cd1e6f1b-423d-4d26-a45c-e45791f2bf36 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:12:13 devstack sudo[90833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-cd1e6f1b-423d-4d26-a45c-e45791f2bf36 Aug 05 06:12:13 devstack sudo[90833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:12:13 devstack cinder-volume[88695]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0174e7c-3e49-4288-acb3-874c0e403e52 tempest-VolumesServicesTestJSON-850909990 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88695) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 06:12:13 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-e0174e7c-3e49-4288-acb3-874c0e403e52 tempest-VolumesServicesTestJSON-850909990 None] Flow 'volume_create_manager' (827bc173-2c4a-4133-842c-113cf91c534e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:12:13 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-e0174e7c-3e49-4288-acb3-874c0e403e52 tempest-VolumesServicesTestJSON-850909990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70b0f210-60b7-484d-bd10-94dd16091cc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:12:13 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-e0174e7c-3e49-4288-acb3-874c0e403e52 tempest-VolumesServicesTestJSON-850909990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70b0f210-60b7-484d-bd10-94dd16091cc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:12:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1670588217',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=760d8387-3ea9-4064-b40d-d03e06f0775d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a38e10b03354565bb230ad8437d5102',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:12:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:12:14Z,use_quota=True,user_id='897919032a10402694137e79fcd54100',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:12:13 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-e0174e7c-3e49-4288-acb3-874c0e403e52 tempest-VolumesServicesTestJSON-850909990 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b924f4a-be70-49b7-b61e-a4093431aa60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:12:13 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-e0174e7c-3e49-4288-acb3-874c0e403e52 tempest-VolumesServicesTestJSON-850909990 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b924f4a-be70-49b7-b61e-a4093431aa60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:12:13 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-e0174e7c-3e49-4288-acb3-874c0e403e52 tempest-VolumesServicesTestJSON-850909990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfc8d30f-3324-42a0-befa-7cce50afe51a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:12:13 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-e0174e7c-3e49-4288-acb3-874c0e403e52 tempest-VolumesServicesTestJSON-850909990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfc8d30f-3324-42a0-befa-7cce50afe51a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '760d8387-3ea9-4064-b40d-d03e06f0775d', 'volume_name': 'volume-760d8387-3ea9-4064-b40d-d03e06f0775d', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:12:13 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-e0174e7c-3e49-4288-acb3-874c0e403e52 tempest-VolumesServicesTestJSON-850909990 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd504fb9-f2c0-430c-9481-96b4dda3a44c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:12:13 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-e0174e7c-3e49-4288-acb3-874c0e403e52 tempest-VolumesServicesTestJSON-850909990 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd504fb9-f2c0-430c-9481-96b4dda3a44c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:12:13 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-e0174e7c-3e49-4288-acb3-874c0e403e52 tempest-VolumesServicesTestJSON-850909990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e1af636-1ea7-497e-8bac-0069271dff09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:12:13 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-e0174e7c-3e49-4288-acb3-874c0e403e52 tempest-VolumesServicesTestJSON-850909990 None] Volume 760d8387-3ea9-4064-b40d-d03e06f0775d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-760d8387-3ea9-4064-b40d-d03e06f0775d', 'volume_size': 1} Aug 05 06:12:13 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-e0174e7c-3e49-4288-acb3-874c0e403e52 tempest-VolumesServicesTestJSON-850909990 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:12:13 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-e0174e7c-3e49-4288-acb3-874c0e403e52 tempest-VolumesServicesTestJSON-850909990 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:12:13 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-e0174e7c-3e49-4288-acb3-874c0e403e52 tempest-VolumesServicesTestJSON-850909990 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:12:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1670588217',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=760d8387-3ea9-4064-b40d-d03e06f0775d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a38e10b03354565bb230ad8437d5102',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:12:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:12:14Z,use_quota=True,user_id='897919032a10402694137e79fcd54100',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)}" {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 06:12:13 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-e0174e7c-3e49-4288-acb3-874c0e403e52 tempest-VolumesServicesTestJSON-850909990 None] Creating volume 760d8387-3ea9-4064-b40d-d03e06f0775d {{(pid=88695) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 06:12:13 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-e0174e7c-3e49-4288-acb3-874c0e403e52 tempest-VolumesServicesTestJSON-850909990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:12:13 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-e0174e7c-3e49-4288-acb3-874c0e403e52 tempest-VolumesServicesTestJSON-850909990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:12:13 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-e0174e7c-3e49-4288-acb3-874c0e403e52 tempest-VolumesServicesTestJSON-850909990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:12:13 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-e0174e7c-3e49-4288-acb3-874c0e403e52 tempest-VolumesServicesTestJSON-850909990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:12:13 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-e0174e7c-3e49-4288-acb3-874c0e403e52 tempest-VolumesServicesTestJSON-850909990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:12:13 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-e0174e7c-3e49-4288-acb3-874c0e403e52 tempest-VolumesServicesTestJSON-850909990 None] Selected osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 as target Quobyte volume. {{(pid=88695) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 06:12:13 devstack cinder-volume[88695]: INFO cinder.volume.drivers.remotefs [None req-e0174e7c-3e49-4288-acb3-874c0e403e52 tempest-VolumesServicesTestJSON-850909990 None] casted to osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 Aug 05 06:12:13 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-e0174e7c-3e49-4288-acb3-874c0e403e52 tempest-VolumesServicesTestJSON-850909990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-760d8387-3ea9-4064-b40d-d03e06f0775d 1073741824 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:12:13 devstack sudo[90845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-760d8387-3ea9-4064-b40d-d03e06f0775d 1073741824 Aug 05 06:12:13 devstack sudo[90845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:12:14 devstack sudo[90833]: pam_unix(sudo:session): session closed for user root Aug 05 06:12:14 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-8518240d-4076-4339-acfa-9b77c319dd2e tempest-SnapshotMetadataTestJSON-1175963975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-cd1e6f1b-423d-4d26-a45c-e45791f2bf36" returned: 0 in 0.548s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:12:14 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-8518240d-4076-4339-acfa-9b77c319dd2e tempest-SnapshotMetadataTestJSON-1175963975 None] Lock "cinder-quobyte-cd1e6f1b-423d-4d26-a45c-e45791f2bf36" released by "delete_volume" :: held 1.188s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:12:14 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-8518240d-4076-4339-acfa-9b77c319dd2e tempest-SnapshotMetadataTestJSON-1175963975 None] Created reservations ['faabe465-a352-4689-b65f-69b781720a02', '09d44701-90bb-4f54-8cb9-3dfacbefede6', '7f7d4583-27f9-4826-aa18-095dc4c77d9e', '4245a805-c7ed-4e63-99df-2b70934e7f96'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:12:14 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-8518240d-4076-4339-acfa-9b77c319dd2e tempest-SnapshotMetadataTestJSON-1175963975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:12:14 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-8518240d-4076-4339-acfa-9b77c319dd2e tempest-SnapshotMetadataTestJSON-1175963975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:12:14 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-8518240d-4076-4339-acfa-9b77c319dd2e tempest-SnapshotMetadataTestJSON-1175963975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:12:14 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-8518240d-4076-4339-acfa-9b77c319dd2e tempest-SnapshotMetadataTestJSON-1175963975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:12:14 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-8518240d-4076-4339-acfa-9b77c319dd2e tempest-SnapshotMetadataTestJSON-1175963975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:12:14 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-8518240d-4076-4339-acfa-9b77c319dd2e tempest-SnapshotMetadataTestJSON-1175963975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:12:14 devstack sudo[90871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce Aug 05 06:12:14 devstack sudo[90871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:12:14 devstack sudo[90845]: pam_unix(sudo:session): session closed for user root Aug 05 06:12:14 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-e0174e7c-3e49-4288-acb3-874c0e403e52 tempest-VolumesServicesTestJSON-850909990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-760d8387-3ea9-4064-b40d-d03e06f0775d 1073741824" returned: 0 in 0.809s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:12:14 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-e0174e7c-3e49-4288-acb3-874c0e403e52 tempest-VolumesServicesTestJSON-850909990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-760d8387-3ea9-4064-b40d-d03e06f0775d {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:12:14 devstack sudo[90878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-760d8387-3ea9-4064-b40d-d03e06f0775d Aug 05 06:12:14 devstack sudo[90878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:12:14 devstack sudo[90871]: pam_unix(sudo:session): session closed for user root Aug 05 06:12:14 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-8518240d-4076-4339-acfa-9b77c319dd2e tempest-SnapshotMetadataTestJSON-1175963975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce" returned: 0 in 0.441s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:12:14 devstack cinder-volume[88695]: DEBUG cinder.manager [None req-8518240d-4076-4339-acfa-9b77c319dd2e tempest-SnapshotMetadataTestJSON-1175963975 None] Notifying Schedulers of capabilities ... {{(pid=88695) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 06:12:15 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-8518240d-4076-4339-acfa-9b77c319dd2e tempest-SnapshotMetadataTestJSON-1175963975 None] Deleted volume successfully. Aug 05 06:12:15 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-8518240d-4076-4339-acfa-9b77c319dd2e tempest-SnapshotMetadataTestJSON-1175963975 None] Lock "cinder-cd1e6f1b-423d-4d26-a45c-e45791f2bf36-delete_volume" released by "delete_volume" :: held 2.126s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:12:15 devstack sudo[90878]: pam_unix(sudo:session): session closed for user root Aug 05 06:12:15 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-e0174e7c-3e49-4288-acb3-874c0e403e52 tempest-VolumesServicesTestJSON-850909990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-760d8387-3ea9-4064-b40d-d03e06f0775d" returned: 0 in 0.545s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:12:15 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-e0174e7c-3e49-4288-acb3-874c0e403e52 tempest-VolumesServicesTestJSON-850909990 None] <== create_volume: return (1440ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'} {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 06:12:15 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-e0174e7c-3e49-4288-acb3-874c0e403e52 tempest-VolumesServicesTestJSON-850909990 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.442s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:12:15 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-e0174e7c-3e49-4288-acb3-874c0e403e52 tempest-VolumesServicesTestJSON-850909990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e1af636-1ea7-497e-8bac-0069271dff09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-760d8387-3ea9-4064-b40d-d03e06f0775d', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:12:15 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-e0174e7c-3e49-4288-acb3-874c0e403e52 tempest-VolumesServicesTestJSON-850909990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afdd8d94-7c24-41cb-8da3-3e308bbe560e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:12:15 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-e0174e7c-3e49-4288-acb3-874c0e403e52 tempest-VolumesServicesTestJSON-850909990 None] Volume volume-760d8387-3ea9-4064-b40d-d03e06f0775d (760d8387-3ea9-4064-b40d-d03e06f0775d): created successfully Aug 05 06:12:15 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-e0174e7c-3e49-4288-acb3-874c0e403e52 tempest-VolumesServicesTestJSON-850909990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afdd8d94-7c24-41cb-8da3-3e308bbe560e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:12:15 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-e0174e7c-3e49-4288-acb3-874c0e403e52 tempest-VolumesServicesTestJSON-850909990 None] Flow 'volume_create_manager' (827bc173-2c4a-4133-842c-113cf91c534e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:12:15 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-e0174e7c-3e49-4288-acb3-874c0e403e52 tempest-VolumesServicesTestJSON-850909990 None] Created volume successfully. Aug 05 06:12:16 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-5ae4cdc3-0b83-454e-b959-2aab1db0b59f tempest-VolumesServicesTestJSON-850909990 None] Acquiring lock "cinder-760d8387-3ea9-4064-b40d-d03e06f0775d-delete_volume" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:12:16 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-5ae4cdc3-0b83-454e-b959-2aab1db0b59f tempest-VolumesServicesTestJSON-850909990 None] Lock "cinder-760d8387-3ea9-4064-b40d-d03e06f0775d-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:12:16 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-5ae4cdc3-0b83-454e-b959-2aab1db0b59f tempest-VolumesServicesTestJSON-850909990 None] Acquiring lock "cinder-quobyte-760d8387-3ea9-4064-b40d-d03e06f0775d" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:12:16 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-5ae4cdc3-0b83-454e-b959-2aab1db0b59f tempest-VolumesServicesTestJSON-850909990 None] Lock "cinder-quobyte-760d8387-3ea9-4064-b40d-d03e06f0775d" acquired by "delete_volume" :: waited 0.022s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:12:16 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[edb85a01-bf98-45b3-8cf6-b444fbf467a3]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:12:16 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-5ae4cdc3-0b83-454e-b959-2aab1db0b59f tempest-VolumesServicesTestJSON-850909990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-760d8387-3ea9-4064-b40d-d03e06f0775d {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:12:16 devstack sudo[90911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-760d8387-3ea9-4064-b40d-d03e06f0775d Aug 05 06:12:16 devstack sudo[90911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:12:17 devstack sudo[90911]: pam_unix(sudo:session): session closed for user root Aug 05 06:12:17 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-5ae4cdc3-0b83-454e-b959-2aab1db0b59f tempest-VolumesServicesTestJSON-850909990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-760d8387-3ea9-4064-b40d-d03e06f0775d" returned: 0 in 0.897s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:12:17 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-5ae4cdc3-0b83-454e-b959-2aab1db0b59f tempest-VolumesServicesTestJSON-850909990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-760d8387-3ea9-4064-b40d-d03e06f0775d {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:12:17 devstack sudo[90923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-760d8387-3ea9-4064-b40d-d03e06f0775d Aug 05 06:12:17 devstack sudo[90923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:12:17 devstack sudo[90923]: pam_unix(sudo:session): session closed for user root Aug 05 06:12:17 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-5ae4cdc3-0b83-454e-b959-2aab1db0b59f tempest-VolumesServicesTestJSON-850909990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-760d8387-3ea9-4064-b40d-d03e06f0775d" returned: 0 in 0.624s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:12:17 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-5ae4cdc3-0b83-454e-b959-2aab1db0b59f tempest-VolumesServicesTestJSON-850909990 None] Lock "cinder-quobyte-760d8387-3ea9-4064-b40d-d03e06f0775d" released by "delete_volume" :: held 1.634s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:12:18 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-5ae4cdc3-0b83-454e-b959-2aab1db0b59f tempest-VolumesServicesTestJSON-850909990 None] Created reservations ['eb939548-963d-4620-9cf5-5abd46c8a47e', 'b2e6a02c-df58-43d3-8c6d-5ebe50e4f7cb', 'f1a20cd3-8ff0-4395-a42a-cad47016b0c4', '76e20380-c16e-4b4f-8af8-01567e2fd931'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:12:18 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-5ae4cdc3-0b83-454e-b959-2aab1db0b59f tempest-VolumesServicesTestJSON-850909990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:12:18 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-5ae4cdc3-0b83-454e-b959-2aab1db0b59f tempest-VolumesServicesTestJSON-850909990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:12:18 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-5ae4cdc3-0b83-454e-b959-2aab1db0b59f tempest-VolumesServicesTestJSON-850909990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:12:18 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-5ae4cdc3-0b83-454e-b959-2aab1db0b59f tempest-VolumesServicesTestJSON-850909990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:12:18 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-5ae4cdc3-0b83-454e-b959-2aab1db0b59f tempest-VolumesServicesTestJSON-850909990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:12:18 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-5ae4cdc3-0b83-454e-b959-2aab1db0b59f tempest-VolumesServicesTestJSON-850909990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:12:18 devstack sudo[90937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce Aug 05 06:12:18 devstack sudo[90937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:12:18 devstack sudo[90937]: pam_unix(sudo:session): session closed for user root Aug 05 06:12:18 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-5ae4cdc3-0b83-454e-b959-2aab1db0b59f tempest-VolumesServicesTestJSON-850909990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce" returned: 0 in 0.450s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:12:18 devstack cinder-volume[88695]: DEBUG cinder.manager [None req-5ae4cdc3-0b83-454e-b959-2aab1db0b59f tempest-VolumesServicesTestJSON-850909990 None] Notifying Schedulers of capabilities ... {{(pid=88695) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 06:12:18 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-5ae4cdc3-0b83-454e-b959-2aab1db0b59f tempest-VolumesServicesTestJSON-850909990 None] Deleted volume successfully. Aug 05 06:12:18 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-5ae4cdc3-0b83-454e-b959-2aab1db0b59f tempest-VolumesServicesTestJSON-850909990 None] Lock "cinder-760d8387-3ea9-4064-b40d-d03e06f0775d-delete_volume" released by "delete_volume" :: held 2.478s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:12:27 devstack cinder-volume[88695]: DEBUG cinder.volume.flows.manager.create_volume [None req-505ebef0-cb14-4f7b-b62c-f4c7d0547303 tempest-AbsoluteLimitsTests-1098996243 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88695) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 06:12:27 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-505ebef0-cb14-4f7b-b62c-f4c7d0547303 tempest-AbsoluteLimitsTests-1098996243 None] Flow 'volume_create_manager' (77cad00b-3268-4e27-9d65-739f187fff71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:12:27 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-505ebef0-cb14-4f7b-b62c-f4c7d0547303 tempest-AbsoluteLimitsTests-1098996243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a868aa68-ecdb-45f7-ac24-657986221ec4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:12:27 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-505ebef0-cb14-4f7b-b62c-f4c7d0547303 tempest-AbsoluteLimitsTests-1098996243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a868aa68-ecdb-45f7-ac24-657986221ec4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:12:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1786718705',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcbd9441-30c2-452c-be0a-e0628fce5b07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='689f1a59c39f49838181ad955e45bcd5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:12:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:12:27Z,use_quota=True,user_id='29986744f2ac4909bfe531360ee81a2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:12:27 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-505ebef0-cb14-4f7b-b62c-f4c7d0547303 tempest-AbsoluteLimitsTests-1098996243 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abec9a63-9d6e-4552-bc43-bcc4dd550626) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:12:27 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-505ebef0-cb14-4f7b-b62c-f4c7d0547303 tempest-AbsoluteLimitsTests-1098996243 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abec9a63-9d6e-4552-bc43-bcc4dd550626) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:12:27 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-505ebef0-cb14-4f7b-b62c-f4c7d0547303 tempest-AbsoluteLimitsTests-1098996243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c087ebab-9ede-4236-9583-23b30488b168) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:12:27 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-505ebef0-cb14-4f7b-b62c-f4c7d0547303 tempest-AbsoluteLimitsTests-1098996243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c087ebab-9ede-4236-9583-23b30488b168) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bcbd9441-30c2-452c-be0a-e0628fce5b07', 'volume_name': 'volume-bcbd9441-30c2-452c-be0a-e0628fce5b07', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:12:27 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-505ebef0-cb14-4f7b-b62c-f4c7d0547303 tempest-AbsoluteLimitsTests-1098996243 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c50338a2-8727-4011-9a40-8ab89c8cdbda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:12:27 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-505ebef0-cb14-4f7b-b62c-f4c7d0547303 tempest-AbsoluteLimitsTests-1098996243 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c50338a2-8727-4011-9a40-8ab89c8cdbda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:12:27 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-505ebef0-cb14-4f7b-b62c-f4c7d0547303 tempest-AbsoluteLimitsTests-1098996243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e90e398-7654-4647-b45e-5f318e45b9b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:12:27 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-505ebef0-cb14-4f7b-b62c-f4c7d0547303 tempest-AbsoluteLimitsTests-1098996243 None] Volume bcbd9441-30c2-452c-be0a-e0628fce5b07: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bcbd9441-30c2-452c-be0a-e0628fce5b07', 'volume_size': 1} Aug 05 06:12:27 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-505ebef0-cb14-4f7b-b62c-f4c7d0547303 tempest-AbsoluteLimitsTests-1098996243 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:12:27 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-505ebef0-cb14-4f7b-b62c-f4c7d0547303 tempest-AbsoluteLimitsTests-1098996243 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:12:27 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-505ebef0-cb14-4f7b-b62c-f4c7d0547303 tempest-AbsoluteLimitsTests-1098996243 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:12:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1786718705',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcbd9441-30c2-452c-be0a-e0628fce5b07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='689f1a59c39f49838181ad955e45bcd5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:12:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:12:27Z,use_quota=True,user_id='29986744f2ac4909bfe531360ee81a2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)}" {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 06:12:27 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-505ebef0-cb14-4f7b-b62c-f4c7d0547303 tempest-AbsoluteLimitsTests-1098996243 None] Creating volume bcbd9441-30c2-452c-be0a-e0628fce5b07 {{(pid=88695) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 06:12:27 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-505ebef0-cb14-4f7b-b62c-f4c7d0547303 tempest-AbsoluteLimitsTests-1098996243 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:12:27 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-505ebef0-cb14-4f7b-b62c-f4c7d0547303 tempest-AbsoluteLimitsTests-1098996243 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:12:27 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-505ebef0-cb14-4f7b-b62c-f4c7d0547303 tempest-AbsoluteLimitsTests-1098996243 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:12:27 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-505ebef0-cb14-4f7b-b62c-f4c7d0547303 tempest-AbsoluteLimitsTests-1098996243 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:12:27 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-505ebef0-cb14-4f7b-b62c-f4c7d0547303 tempest-AbsoluteLimitsTests-1098996243 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:12:27 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-505ebef0-cb14-4f7b-b62c-f4c7d0547303 tempest-AbsoluteLimitsTests-1098996243 None] Selected osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 as target Quobyte volume. {{(pid=88695) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 06:12:27 devstack cinder-volume[88695]: INFO cinder.volume.drivers.remotefs [None req-505ebef0-cb14-4f7b-b62c-f4c7d0547303 tempest-AbsoluteLimitsTests-1098996243 None] casted to osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 Aug 05 06:12:27 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-505ebef0-cb14-4f7b-b62c-f4c7d0547303 tempest-AbsoluteLimitsTests-1098996243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-bcbd9441-30c2-452c-be0a-e0628fce5b07 1073741824 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:12:27 devstack sudo[91045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-bcbd9441-30c2-452c-be0a-e0628fce5b07 1073741824 Aug 05 06:12:27 devstack sudo[91045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:12:28 devstack sudo[91045]: pam_unix(sudo:session): session closed for user root Aug 05 06:12:28 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-505ebef0-cb14-4f7b-b62c-f4c7d0547303 tempest-AbsoluteLimitsTests-1098996243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-bcbd9441-30c2-452c-be0a-e0628fce5b07 1073741824" returned: 0 in 0.830s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:12:28 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-505ebef0-cb14-4f7b-b62c-f4c7d0547303 tempest-AbsoluteLimitsTests-1098996243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-bcbd9441-30c2-452c-be0a-e0628fce5b07 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:12:28 devstack sudo[91074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-bcbd9441-30c2-452c-be0a-e0628fce5b07 Aug 05 06:12:28 devstack sudo[91074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:12:29 devstack sudo[91074]: pam_unix(sudo:session): session closed for user root Aug 05 06:12:29 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-505ebef0-cb14-4f7b-b62c-f4c7d0547303 tempest-AbsoluteLimitsTests-1098996243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-bcbd9441-30c2-452c-be0a-e0628fce5b07" returned: 0 in 0.682s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:12:29 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-505ebef0-cb14-4f7b-b62c-f4c7d0547303 tempest-AbsoluteLimitsTests-1098996243 None] <== create_volume: return (1611ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'} {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 06:12:29 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-505ebef0-cb14-4f7b-b62c-f4c7d0547303 tempest-AbsoluteLimitsTests-1098996243 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.615s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:12:29 devstack cinder-volume[88695]: DEBUG cinder.volume.flows.manager.create_volume [None req-d749e481-d644-4eaf-a3b5-512aafd66380 tempest-VolumeSnapshotQuotasNegativeTestJSON-1885056327 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88695) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 06:12:29 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-d749e481-d644-4eaf-a3b5-512aafd66380 tempest-VolumeSnapshotQuotasNegativeTestJSON-1885056327 None] Flow 'volume_create_manager' (30a7ac25-c2a9-477a-9398-65fb37747e8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:12:29 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-d749e481-d644-4eaf-a3b5-512aafd66380 tempest-VolumeSnapshotQuotasNegativeTestJSON-1885056327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d75978b7-cc14-4924-a465-7940268806b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:12:29 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-505ebef0-cb14-4f7b-b62c-f4c7d0547303 tempest-AbsoluteLimitsTests-1098996243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e90e398-7654-4647-b45e-5f318e45b9b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bcbd9441-30c2-452c-be0a-e0628fce5b07', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:12:29 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-505ebef0-cb14-4f7b-b62c-f4c7d0547303 tempest-AbsoluteLimitsTests-1098996243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0faa78c4-d4d8-433f-b7f9-1ffe3a9a96b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:12:29 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-505ebef0-cb14-4f7b-b62c-f4c7d0547303 tempest-AbsoluteLimitsTests-1098996243 None] Volume volume-bcbd9441-30c2-452c-be0a-e0628fce5b07 (bcbd9441-30c2-452c-be0a-e0628fce5b07): created successfully Aug 05 06:12:29 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-505ebef0-cb14-4f7b-b62c-f4c7d0547303 tempest-AbsoluteLimitsTests-1098996243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0faa78c4-d4d8-433f-b7f9-1ffe3a9a96b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:12:29 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-505ebef0-cb14-4f7b-b62c-f4c7d0547303 tempest-AbsoluteLimitsTests-1098996243 None] Flow 'volume_create_manager' (77cad00b-3268-4e27-9d65-739f187fff71) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:12:29 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-d749e481-d644-4eaf-a3b5-512aafd66380 tempest-VolumeSnapshotQuotasNegativeTestJSON-1885056327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d75978b7-cc14-4924-a465-7940268806b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:12:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-668560421',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71a19fb2-2e1f-47b9-8b26-ef1f876e65da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da8ca7b92d5d46dca630688844a47231',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:12:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:12:29Z,use_quota=True,user_id='24406d2ed56447769ce35305b01ed6e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:12:29 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-d749e481-d644-4eaf-a3b5-512aafd66380 tempest-VolumeSnapshotQuotasNegativeTestJSON-1885056327 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e93a37e-cbce-421c-9a94-6dd3fc19553e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:12:29 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-d749e481-d644-4eaf-a3b5-512aafd66380 tempest-VolumeSnapshotQuotasNegativeTestJSON-1885056327 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e93a37e-cbce-421c-9a94-6dd3fc19553e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:12:29 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-d749e481-d644-4eaf-a3b5-512aafd66380 tempest-VolumeSnapshotQuotasNegativeTestJSON-1885056327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0410af1-977d-4281-a193-9680d9d3495c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:12:29 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-d749e481-d644-4eaf-a3b5-512aafd66380 tempest-VolumeSnapshotQuotasNegativeTestJSON-1885056327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0410af1-977d-4281-a193-9680d9d3495c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '71a19fb2-2e1f-47b9-8b26-ef1f876e65da', 'volume_name': 'volume-71a19fb2-2e1f-47b9-8b26-ef1f876e65da', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:12:29 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-d749e481-d644-4eaf-a3b5-512aafd66380 tempest-VolumeSnapshotQuotasNegativeTestJSON-1885056327 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cca509fd-6190-47d0-aa05-18ebe76c112c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:12:29 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-d749e481-d644-4eaf-a3b5-512aafd66380 tempest-VolumeSnapshotQuotasNegativeTestJSON-1885056327 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cca509fd-6190-47d0-aa05-18ebe76c112c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:12:29 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-d749e481-d644-4eaf-a3b5-512aafd66380 tempest-VolumeSnapshotQuotasNegativeTestJSON-1885056327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ecd1a7e-ec0c-4053-95bb-6c8a216f6389) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:12:29 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-d749e481-d644-4eaf-a3b5-512aafd66380 tempest-VolumeSnapshotQuotasNegativeTestJSON-1885056327 None] Volume 71a19fb2-2e1f-47b9-8b26-ef1f876e65da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-71a19fb2-2e1f-47b9-8b26-ef1f876e65da', 'volume_size': 1} Aug 05 06:12:29 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-d749e481-d644-4eaf-a3b5-512aafd66380 tempest-VolumeSnapshotQuotasNegativeTestJSON-1885056327 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:12:29 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-d749e481-d644-4eaf-a3b5-512aafd66380 tempest-VolumeSnapshotQuotasNegativeTestJSON-1885056327 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:12:29 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-d749e481-d644-4eaf-a3b5-512aafd66380 tempest-VolumeSnapshotQuotasNegativeTestJSON-1885056327 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:12:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-668560421',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71a19fb2-2e1f-47b9-8b26-ef1f876e65da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da8ca7b92d5d46dca630688844a47231',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:12:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:12:29Z,use_quota=True,user_id='24406d2ed56447769ce35305b01ed6e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)}" {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 06:12:29 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-d749e481-d644-4eaf-a3b5-512aafd66380 tempest-VolumeSnapshotQuotasNegativeTestJSON-1885056327 None] Creating volume 71a19fb2-2e1f-47b9-8b26-ef1f876e65da {{(pid=88695) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 06:12:29 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-d749e481-d644-4eaf-a3b5-512aafd66380 tempest-VolumeSnapshotQuotasNegativeTestJSON-1885056327 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:12:29 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-d749e481-d644-4eaf-a3b5-512aafd66380 tempest-VolumeSnapshotQuotasNegativeTestJSON-1885056327 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:12:29 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-d749e481-d644-4eaf-a3b5-512aafd66380 tempest-VolumeSnapshotQuotasNegativeTestJSON-1885056327 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:12:29 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-d749e481-d644-4eaf-a3b5-512aafd66380 tempest-VolumeSnapshotQuotasNegativeTestJSON-1885056327 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:12:29 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-d749e481-d644-4eaf-a3b5-512aafd66380 tempest-VolumeSnapshotQuotasNegativeTestJSON-1885056327 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:12:29 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-d749e481-d644-4eaf-a3b5-512aafd66380 tempest-VolumeSnapshotQuotasNegativeTestJSON-1885056327 None] Selected osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 as target Quobyte volume. {{(pid=88695) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 06:12:29 devstack cinder-volume[88695]: INFO cinder.volume.drivers.remotefs [None req-d749e481-d644-4eaf-a3b5-512aafd66380 tempest-VolumeSnapshotQuotasNegativeTestJSON-1885056327 None] casted to osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 Aug 05 06:12:29 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-d749e481-d644-4eaf-a3b5-512aafd66380 tempest-VolumeSnapshotQuotasNegativeTestJSON-1885056327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-71a19fb2-2e1f-47b9-8b26-ef1f876e65da 1073741824 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:12:29 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-505ebef0-cb14-4f7b-b62c-f4c7d0547303 tempest-AbsoluteLimitsTests-1098996243 None] Created volume successfully. Aug 05 06:12:29 devstack sudo[91079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-71a19fb2-2e1f-47b9-8b26-ef1f876e65da 1073741824 Aug 05 06:12:29 devstack sudo[91079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:12:29 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-bc3cba66-ab57-462e-884c-e51d97fa14a1 tempest-AbsoluteLimitsTests-1098996243 None] Acquiring lock "cinder-bcbd9441-30c2-452c-be0a-e0628fce5b07-delete_volume" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:12:29 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-bc3cba66-ab57-462e-884c-e51d97fa14a1 tempest-AbsoluteLimitsTests-1098996243 None] Lock "cinder-bcbd9441-30c2-452c-be0a-e0628fce5b07-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:12:30 devstack sudo[91079]: pam_unix(sudo:session): session closed for user root Aug 05 06:12:30 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-d749e481-d644-4eaf-a3b5-512aafd66380 tempest-VolumeSnapshotQuotasNegativeTestJSON-1885056327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-71a19fb2-2e1f-47b9-8b26-ef1f876e65da 1073741824" returned: 0 in 0.729s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:12:30 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-bc3cba66-ab57-462e-884c-e51d97fa14a1 tempest-AbsoluteLimitsTests-1098996243 None] Acquiring lock "cinder-quobyte-bcbd9441-30c2-452c-be0a-e0628fce5b07" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:12:30 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-d749e481-d644-4eaf-a3b5-512aafd66380 tempest-VolumeSnapshotQuotasNegativeTestJSON-1885056327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-71a19fb2-2e1f-47b9-8b26-ef1f876e65da {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:12:30 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-bc3cba66-ab57-462e-884c-e51d97fa14a1 tempest-AbsoluteLimitsTests-1098996243 None] Lock "cinder-quobyte-bcbd9441-30c2-452c-be0a-e0628fce5b07" acquired by "delete_volume" :: waited 0.061s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:12:30 devstack sudo[91093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-71a19fb2-2e1f-47b9-8b26-ef1f876e65da Aug 05 06:12:30 devstack sudo[91093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:12:30 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[874ae505-fa11-4f5d-be88-650fcf4dd653]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:12:30 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-bc3cba66-ab57-462e-884c-e51d97fa14a1 tempest-AbsoluteLimitsTests-1098996243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-bcbd9441-30c2-452c-be0a-e0628fce5b07 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:12:30 devstack sudo[91112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-bcbd9441-30c2-452c-be0a-e0628fce5b07 Aug 05 06:12:30 devstack sudo[91112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:12:30 devstack sudo[91093]: pam_unix(sudo:session): session closed for user root Aug 05 06:12:30 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-d749e481-d644-4eaf-a3b5-512aafd66380 tempest-VolumeSnapshotQuotasNegativeTestJSON-1885056327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-71a19fb2-2e1f-47b9-8b26-ef1f876e65da" returned: 0 in 0.494s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:12:30 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-d749e481-d644-4eaf-a3b5-512aafd66380 tempest-VolumeSnapshotQuotasNegativeTestJSON-1885056327 None] <== create_volume: return (1307ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'} {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 06:12:30 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-d749e481-d644-4eaf-a3b5-512aafd66380 tempest-VolumeSnapshotQuotasNegativeTestJSON-1885056327 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.309s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:12:30 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-d749e481-d644-4eaf-a3b5-512aafd66380 tempest-VolumeSnapshotQuotasNegativeTestJSON-1885056327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ecd1a7e-ec0c-4053-95bb-6c8a216f6389) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-71a19fb2-2e1f-47b9-8b26-ef1f876e65da', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:12:30 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-d749e481-d644-4eaf-a3b5-512aafd66380 tempest-VolumeSnapshotQuotasNegativeTestJSON-1885056327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3011dbc-aa96-4b56-85b6-b86ed5878928) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:12:30 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-d749e481-d644-4eaf-a3b5-512aafd66380 tempest-VolumeSnapshotQuotasNegativeTestJSON-1885056327 None] Volume volume-71a19fb2-2e1f-47b9-8b26-ef1f876e65da (71a19fb2-2e1f-47b9-8b26-ef1f876e65da): created successfully Aug 05 06:12:30 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-d749e481-d644-4eaf-a3b5-512aafd66380 tempest-VolumeSnapshotQuotasNegativeTestJSON-1885056327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3011dbc-aa96-4b56-85b6-b86ed5878928) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:12:30 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-d749e481-d644-4eaf-a3b5-512aafd66380 tempest-VolumeSnapshotQuotasNegativeTestJSON-1885056327 None] Flow 'volume_create_manager' (30a7ac25-c2a9-477a-9398-65fb37747e8b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:12:30 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-d749e481-d644-4eaf-a3b5-512aafd66380 tempest-VolumeSnapshotQuotasNegativeTestJSON-1885056327 None] Created volume successfully. Aug 05 06:12:30 devstack sudo[91112]: pam_unix(sudo:session): session closed for user root Aug 05 06:12:30 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-bc3cba66-ab57-462e-884c-e51d97fa14a1 tempest-AbsoluteLimitsTests-1098996243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-bcbd9441-30c2-452c-be0a-e0628fce5b07" returned: 0 in 0.577s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:12:30 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-bc3cba66-ab57-462e-884c-e51d97fa14a1 tempest-AbsoluteLimitsTests-1098996243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-bcbd9441-30c2-452c-be0a-e0628fce5b07 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:12:30 devstack sudo[91122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-bcbd9441-30c2-452c-be0a-e0628fce5b07 Aug 05 06:12:30 devstack sudo[91122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:12:31 devstack sudo[91122]: pam_unix(sudo:session): session closed for user root Aug 05 06:12:31 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-bc3cba66-ab57-462e-884c-e51d97fa14a1 tempest-AbsoluteLimitsTests-1098996243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-bcbd9441-30c2-452c-be0a-e0628fce5b07" returned: 0 in 0.393s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:12:31 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-bc3cba66-ab57-462e-884c-e51d97fa14a1 tempest-AbsoluteLimitsTests-1098996243 None] Lock "cinder-quobyte-bcbd9441-30c2-452c-be0a-e0628fce5b07" released by "delete_volume" :: held 1.072s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:12:31 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-bc3cba66-ab57-462e-884c-e51d97fa14a1 tempest-AbsoluteLimitsTests-1098996243 None] Created reservations ['80e97216-bfcd-4a65-a95d-4737e7afcaf9', 'db5c7c2b-44d5-49f9-ab78-1f96d6c6d5f1', 'e42853d8-6cf7-4447-859a-afefc9894a73', '07450987-1942-42ba-8cc3-6f419cd1c8ef'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:12:31 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-bb090b8e-927f-410a-8305-d701b35415c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1885056327 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:12:31 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-bb090b8e-927f-410a-8305-d701b35415c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1885056327 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:12:31 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-bb090b8e-927f-410a-8305-d701b35415c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1885056327 None] Creating offline snapshot 6f885bd4-333a-4622-b908-ed065a68695d of volume 71a19fb2-2e1f-47b9-8b26-ef1f876e65da {{(pid=88695) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 06:12:31 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6272b43-2008-4585-81ac-e30a500c948b]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:12:31 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-bb090b8e-927f-410a-8305-d701b35415c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1885056327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-71a19fb2-2e1f-47b9-8b26-ef1f876e65da {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:12:31 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-bc3cba66-ab57-462e-884c-e51d97fa14a1 tempest-AbsoluteLimitsTests-1098996243 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:12:31 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-bc3cba66-ab57-462e-884c-e51d97fa14a1 tempest-AbsoluteLimitsTests-1098996243 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:12:31 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-bc3cba66-ab57-462e-884c-e51d97fa14a1 tempest-AbsoluteLimitsTests-1098996243 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:12:31 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-bc3cba66-ab57-462e-884c-e51d97fa14a1 tempest-AbsoluteLimitsTests-1098996243 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:12:31 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-bc3cba66-ab57-462e-884c-e51d97fa14a1 tempest-AbsoluteLimitsTests-1098996243 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:12:31 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-bc3cba66-ab57-462e-884c-e51d97fa14a1 tempest-AbsoluteLimitsTests-1098996243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:12:31 devstack sudo[91126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce Aug 05 06:12:31 devstack sudo[91126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:12:31 devstack sudo[91125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-71a19fb2-2e1f-47b9-8b26-ef1f876e65da Aug 05 06:12:31 devstack sudo[91125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:12:31 devstack sudo[91126]: pam_unix(sudo:session): session closed for user root Aug 05 06:12:31 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-bc3cba66-ab57-462e-884c-e51d97fa14a1 tempest-AbsoluteLimitsTests-1098996243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce" returned: 0 in 0.268s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:12:31 devstack cinder-volume[88695]: DEBUG cinder.manager [None req-bc3cba66-ab57-462e-884c-e51d97fa14a1 tempest-AbsoluteLimitsTests-1098996243 None] Notifying Schedulers of capabilities ... {{(pid=88695) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 06:12:31 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-bc3cba66-ab57-462e-884c-e51d97fa14a1 tempest-AbsoluteLimitsTests-1098996243 None] Deleted volume successfully. Aug 05 06:12:31 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-bc3cba66-ab57-462e-884c-e51d97fa14a1 tempest-AbsoluteLimitsTests-1098996243 None] Lock "cinder-bcbd9441-30c2-452c-be0a-e0628fce5b07-delete_volume" released by "delete_volume" :: held 1.734s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:12:31 devstack sudo[91125]: pam_unix(sudo:session): session closed for user root Aug 05 06:12:31 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-bb090b8e-927f-410a-8305-d701b35415c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1885056327 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-71a19fb2-2e1f-47b9-8b26-ef1f876e65da" returned: 0 in 0.420s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:12:31 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-bb090b8e-927f-410a-8305-d701b35415c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1885056327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-71a19fb2-2e1f-47b9-8b26-ef1f876e65da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-71a19fb2-2e1f-47b9-8b26-ef1f876e65da.6f885bd4-333a-4622-b908-ed065a68695d 1G {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:12:31 devstack sudo[91133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-71a19fb2-2e1f-47b9-8b26-ef1f876e65da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-71a19fb2-2e1f-47b9-8b26-ef1f876e65da.6f885bd4-333a-4622-b908-ed065a68695d 1G Aug 05 06:12:31 devstack sudo[91133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:12:32 devstack sudo[91133]: pam_unix(sudo:session): session closed for user root Aug 05 06:12:32 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-bb090b8e-927f-410a-8305-d701b35415c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1885056327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-71a19fb2-2e1f-47b9-8b26-ef1f876e65da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-71a19fb2-2e1f-47b9-8b26-ef1f876e65da.6f885bd4-333a-4622-b908-ed065a68695d 1G" returned: 0 in 0.396s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:12:32 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-bb090b8e-927f-410a-8305-d701b35415c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1885056327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-71a19fb2-2e1f-47b9-8b26-ef1f876e65da -F qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-71a19fb2-2e1f-47b9-8b26-ef1f876e65da.6f885bd4-333a-4622-b908-ed065a68695d {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:12:32 devstack sudo[91138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-71a19fb2-2e1f-47b9-8b26-ef1f876e65da -F qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-71a19fb2-2e1f-47b9-8b26-ef1f876e65da.6f885bd4-333a-4622-b908-ed065a68695d Aug 05 06:12:32 devstack sudo[91138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:12:32 devstack sudo[91138]: pam_unix(sudo:session): session closed for user root Aug 05 06:12:32 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-bb090b8e-927f-410a-8305-d701b35415c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1885056327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-71a19fb2-2e1f-47b9-8b26-ef1f876e65da -F qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-71a19fb2-2e1f-47b9-8b26-ef1f876e65da.6f885bd4-333a-4622-b908-ed065a68695d" returned: 0 in 0.317s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:12:32 devstack cinder-volume[88695]: WARNING cinder.volume.drivers.remotefs [None req-bb090b8e-927f-410a-8305-d701b35415c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1885056327 None] /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-71a19fb2-2e1f-47b9-8b26-ef1f876e65da.6f885bd4-333a-4622-b908-ed065a68695d is being set with open permissions: ugo+rw Aug 05 06:12:32 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-bb090b8e-927f-410a-8305-d701b35415c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1885056327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-71a19fb2-2e1f-47b9-8b26-ef1f876e65da.6f885bd4-333a-4622-b908-ed065a68695d {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:12:32 devstack sudo[91143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-71a19fb2-2e1f-47b9-8b26-ef1f876e65da.6f885bd4-333a-4622-b908-ed065a68695d Aug 05 06:12:32 devstack sudo[91143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:12:32 devstack sudo[91143]: pam_unix(sudo:session): session closed for user root Aug 05 06:12:32 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-bb090b8e-927f-410a-8305-d701b35415c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1885056327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-71a19fb2-2e1f-47b9-8b26-ef1f876e65da.6f885bd4-333a-4622-b908-ed065a68695d" returned: 0 in 0.275s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:12:32 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-bb090b8e-927f-410a-8305-d701b35415c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1885056327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-71a19fb2-2e1f-47b9-8b26-ef1f876e65da.info {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:12:32 devstack sudo[91146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-71a19fb2-2e1f-47b9-8b26-ef1f876e65da.info Aug 05 06:12:32 devstack sudo[91146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:12:33 devstack sudo[91146]: pam_unix(sudo:session): session closed for user root Aug 05 06:12:33 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-bb090b8e-927f-410a-8305-d701b35415c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1885056327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-71a19fb2-2e1f-47b9-8b26-ef1f876e65da.info" returned: 0 in 0.262s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:12:33 devstack cinder-volume[88695]: WARNING cinder.volume.drivers.remotefs [None req-bb090b8e-927f-410a-8305-d701b35415c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1885056327 None] /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-71a19fb2-2e1f-47b9-8b26-ef1f876e65da.info is being set with open permissions: ugo+rw Aug 05 06:12:33 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-bb090b8e-927f-410a-8305-d701b35415c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1885056327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-71a19fb2-2e1f-47b9-8b26-ef1f876e65da.info {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:12:33 devstack sudo[91149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-71a19fb2-2e1f-47b9-8b26-ef1f876e65da.info Aug 05 06:12:33 devstack sudo[91149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:12:33 devstack sudo[91149]: pam_unix(sudo:session): session closed for user root Aug 05 06:12:33 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-bb090b8e-927f-410a-8305-d701b35415c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1885056327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-71a19fb2-2e1f-47b9-8b26-ef1f876e65da.info" returned: 0 in 0.287s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:12:33 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-bb090b8e-927f-410a-8305-d701b35415c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1885056327 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.060s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:12:33 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-bb090b8e-927f-410a-8305-d701b35415c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1885056327 None] Create snapshot completed successfully Aug 05 06:12:34 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-89cb3c62-0adb-440f-85b7-704a3ad8b4a7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1885056327 None] Acquiring lock "cinder-6f885bd4-333a-4622-b908-ed065a68695d-delete_snapshot" by "delete_snapshot" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:12:34 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-89cb3c62-0adb-440f-85b7-704a3ad8b4a7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1885056327 None] Lock "cinder-6f885bd4-333a-4622-b908-ed065a68695d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:12:34 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-89cb3c62-0adb-440f-85b7-704a3ad8b4a7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1885056327 None] Acquiring lock "cinder-quobyte-71a19fb2-2e1f-47b9-8b26-ef1f876e65da" by "delete_snapshot" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:12:34 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-89cb3c62-0adb-440f-85b7-704a3ad8b4a7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1885056327 None] Lock "cinder-quobyte-71a19fb2-2e1f-47b9-8b26-ef1f876e65da" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:12:34 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-89cb3c62-0adb-440f-85b7-704a3ad8b4a7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1885056327 None] Acquiring lock "cinder-quobyte-6f885bd4-333a-4622-b908-ed065a68695d" by "_delete_snapshot" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:12:34 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-89cb3c62-0adb-440f-85b7-704a3ad8b4a7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1885056327 None] Lock "cinder-quobyte-6f885bd4-333a-4622-b908-ed065a68695d" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:12:34 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-89cb3c62-0adb-440f-85b7-704a3ad8b4a7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1885056327 None] Deleting offline snapshot 6f885bd4-333a-4622-b908-ed065a68695d of volume 71a19fb2-2e1f-47b9-8b26-ef1f876e65da {{(pid=88695) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 06:12:35 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-89cb3c62-0adb-440f-85b7-704a3ad8b4a7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1885056327 None] snapshot_file for this snap is: volume-71a19fb2-2e1f-47b9-8b26-ef1f876e65da.6f885bd4-333a-4622-b908-ed065a68695d {{(pid=88695) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 06:12:35 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[b45c32e5-6a9a-4680-b9f8-635b7f4e2782]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:12:35 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-89cb3c62-0adb-440f-85b7-704a3ad8b4a7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1885056327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-71a19fb2-2e1f-47b9-8b26-ef1f876e65da.6f885bd4-333a-4622-b908-ed065a68695d {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:12:35 devstack sudo[91152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-71a19fb2-2e1f-47b9-8b26-ef1f876e65da.6f885bd4-333a-4622-b908-ed065a68695d Aug 05 06:12:35 devstack sudo[91152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:12:35 devstack sudo[91152]: pam_unix(sudo:session): session closed for user root Aug 05 06:12:35 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-89cb3c62-0adb-440f-85b7-704a3ad8b4a7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1885056327 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-71a19fb2-2e1f-47b9-8b26-ef1f876e65da.6f885bd4-333a-4622-b908-ed065a68695d" returned: 0 in 0.374s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:12:35 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-89cb3c62-0adb-440f-85b7-704a3ad8b4a7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1885056327 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-71a19fb2-2e1f-47b9-8b26-ef1f876e65da(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88695) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 06:12:35 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[38a014a3-d298-40f0-81e0-3b7e4a1308a8]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:12:35 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-89cb3c62-0adb-440f-85b7-704a3ad8b4a7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1885056327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-71a19fb2-2e1f-47b9-8b26-ef1f876e65da {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:12:35 devstack sudo[91158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-71a19fb2-2e1f-47b9-8b26-ef1f876e65da Aug 05 06:12:35 devstack sudo[91158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:12:35 devstack sudo[91158]: pam_unix(sudo:session): session closed for user root Aug 05 06:12:35 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-89cb3c62-0adb-440f-85b7-704a3ad8b4a7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1885056327 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-71a19fb2-2e1f-47b9-8b26-ef1f876e65da" returned: 0 in 0.401s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:12:35 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-89cb3c62-0adb-440f-85b7-704a3ad8b4a7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1885056327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-71a19fb2-2e1f-47b9-8b26-ef1f876e65da.6f885bd4-333a-4622-b908-ed065a68695d {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:12:35 devstack sudo[91164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-71a19fb2-2e1f-47b9-8b26-ef1f876e65da.6f885bd4-333a-4622-b908-ed065a68695d Aug 05 06:12:35 devstack sudo[91164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:12:36 devstack sudo[91164]: pam_unix(sudo:session): session closed for user root Aug 05 06:12:36 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-89cb3c62-0adb-440f-85b7-704a3ad8b4a7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1885056327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-71a19fb2-2e1f-47b9-8b26-ef1f876e65da.6f885bd4-333a-4622-b908-ed065a68695d" returned: 0 in 0.376s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:12:36 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-89cb3c62-0adb-440f-85b7-704a3ad8b4a7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1885056327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-71a19fb2-2e1f-47b9-8b26-ef1f876e65da.6f885bd4-333a-4622-b908-ed065a68695d {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:12:36 devstack sudo[91169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-71a19fb2-2e1f-47b9-8b26-ef1f876e65da.6f885bd4-333a-4622-b908-ed065a68695d Aug 05 06:12:36 devstack sudo[91169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:12:36 devstack sudo[91169]: pam_unix(sudo:session): session closed for user root Aug 05 06:12:36 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-89cb3c62-0adb-440f-85b7-704a3ad8b4a7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1885056327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-71a19fb2-2e1f-47b9-8b26-ef1f876e65da.6f885bd4-333a-4622-b908-ed065a68695d" returned: 0 in 0.277s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:12:36 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-89cb3c62-0adb-440f-85b7-704a3ad8b4a7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1885056327 None] Lock "cinder-quobyte-6f885bd4-333a-4622-b908-ed065a68695d" released by "_delete_snapshot" :: held 1.555s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:12:36 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-89cb3c62-0adb-440f-85b7-704a3ad8b4a7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1885056327 None] Lock "cinder-quobyte-71a19fb2-2e1f-47b9-8b26-ef1f876e65da" released by "delete_snapshot" :: held 1.583s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:12:36 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-89cb3c62-0adb-440f-85b7-704a3ad8b4a7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1885056327 None] Created reservations ['c6103b9d-f413-49e2-be04-22acfa2cc88e', '28133641-069a-43be-b95c-8c82dd4947f0', '3bb07358-bd91-471f-a1df-490e6e9c606b', '4ec7a1d1-fe68-4133-815a-6a1ddd6813f1'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:12:36 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-89cb3c62-0adb-440f-85b7-704a3ad8b4a7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1885056327 None] Delete snapshot completed successfully. Aug 05 06:12:36 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-89cb3c62-0adb-440f-85b7-704a3ad8b4a7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1885056327 None] Lock "cinder-6f885bd4-333a-4622-b908-ed065a68695d-delete_snapshot" released by "delete_snapshot" :: held 1.747s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:12:37 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-32758157-93c7-4926-9f9b-64fd7434a3e3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1885056327 None] Acquiring lock "cinder-71a19fb2-2e1f-47b9-8b26-ef1f876e65da-delete_volume" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:12:37 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-32758157-93c7-4926-9f9b-64fd7434a3e3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1885056327 None] Lock "cinder-71a19fb2-2e1f-47b9-8b26-ef1f876e65da-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:12:37 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-32758157-93c7-4926-9f9b-64fd7434a3e3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1885056327 None] Acquiring lock "cinder-quobyte-71a19fb2-2e1f-47b9-8b26-ef1f876e65da" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:12:37 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-32758157-93c7-4926-9f9b-64fd7434a3e3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1885056327 None] Lock "cinder-quobyte-71a19fb2-2e1f-47b9-8b26-ef1f876e65da" acquired by "delete_volume" :: waited 0.021s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:12:37 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9317914-0ed5-445c-a349-67b1b173df58]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:12:37 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-32758157-93c7-4926-9f9b-64fd7434a3e3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1885056327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-71a19fb2-2e1f-47b9-8b26-ef1f876e65da {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:12:37 devstack sudo[91173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-71a19fb2-2e1f-47b9-8b26-ef1f876e65da Aug 05 06:12:37 devstack sudo[91173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:12:37 devstack sudo[91173]: pam_unix(sudo:session): session closed for user root Aug 05 06:12:37 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-32758157-93c7-4926-9f9b-64fd7434a3e3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1885056327 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-71a19fb2-2e1f-47b9-8b26-ef1f876e65da" returned: 0 in 0.562s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:12:37 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-32758157-93c7-4926-9f9b-64fd7434a3e3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1885056327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-71a19fb2-2e1f-47b9-8b26-ef1f876e65da {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:12:37 devstack sudo[91179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-71a19fb2-2e1f-47b9-8b26-ef1f876e65da Aug 05 06:12:37 devstack sudo[91179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:12:38 devstack sudo[91179]: pam_unix(sudo:session): session closed for user root Aug 05 06:12:38 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-32758157-93c7-4926-9f9b-64fd7434a3e3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1885056327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-71a19fb2-2e1f-47b9-8b26-ef1f876e65da" returned: 0 in 0.270s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:12:38 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-32758157-93c7-4926-9f9b-64fd7434a3e3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1885056327 None] Lock "cinder-quobyte-71a19fb2-2e1f-47b9-8b26-ef1f876e65da" released by "delete_volume" :: held 0.904s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:12:38 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-32758157-93c7-4926-9f9b-64fd7434a3e3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1885056327 None] Created reservations ['1a90ed8b-82d9-437e-bbd7-da4e2daea07d', '2be5fbd0-66b3-4a6f-998c-28f73c98ac96', 'c2bbc88b-edd2-49de-a31c-ec3a020bd67f', '4c26fe08-f588-4a0d-a2f9-dcac9dd5f9b2'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:12:38 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-32758157-93c7-4926-9f9b-64fd7434a3e3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1885056327 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:12:38 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-32758157-93c7-4926-9f9b-64fd7434a3e3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1885056327 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:12:38 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-32758157-93c7-4926-9f9b-64fd7434a3e3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1885056327 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:12:38 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-32758157-93c7-4926-9f9b-64fd7434a3e3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1885056327 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:12:38 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-32758157-93c7-4926-9f9b-64fd7434a3e3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1885056327 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:12:38 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-32758157-93c7-4926-9f9b-64fd7434a3e3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1885056327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:12:38 devstack sudo[91182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce Aug 05 06:12:38 devstack sudo[91182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:12:38 devstack cinder-volume[88695]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f255dd7-1d5a-46d0-8a22-2b1bd9a03547 tempest-VolumesTransfersV355Test-260632662 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88695) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 06:12:38 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-0f255dd7-1d5a-46d0-8a22-2b1bd9a03547 tempest-VolumesTransfersV355Test-260632662 None] Flow 'volume_create_manager' (c23740e5-0253-4a5d-8da1-f8d7a7ae2079) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:12:38 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-0f255dd7-1d5a-46d0-8a22-2b1bd9a03547 tempest-VolumesTransfersV355Test-260632662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5512f867-4b9e-4075-822e-9b6676710259) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:12:38 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-0f255dd7-1d5a-46d0-8a22-2b1bd9a03547 tempest-VolumesTransfersV355Test-260632662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5512f867-4b9e-4075-822e-9b6676710259) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:12:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1961281221',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42ff5ea7-4a94-4809-beea-e4ed04e594d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='763df9fc861b4a38aad3d0607393599a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:12:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:12:39Z,use_quota=True,user_id='e4d3707a0fc0430094ded6a9a07d59f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:12:38 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-0f255dd7-1d5a-46d0-8a22-2b1bd9a03547 tempest-VolumesTransfersV355Test-260632662 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49921c82-6470-4980-a336-9f15a6f51155) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:12:38 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-0f255dd7-1d5a-46d0-8a22-2b1bd9a03547 tempest-VolumesTransfersV355Test-260632662 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49921c82-6470-4980-a336-9f15a6f51155) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:12:38 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-0f255dd7-1d5a-46d0-8a22-2b1bd9a03547 tempest-VolumesTransfersV355Test-260632662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f745473-b386-43de-9451-2af5193f0447) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:12:38 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-0f255dd7-1d5a-46d0-8a22-2b1bd9a03547 tempest-VolumesTransfersV355Test-260632662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f745473-b386-43de-9451-2af5193f0447) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '42ff5ea7-4a94-4809-beea-e4ed04e594d1', 'volume_name': 'volume-42ff5ea7-4a94-4809-beea-e4ed04e594d1', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:12:38 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-0f255dd7-1d5a-46d0-8a22-2b1bd9a03547 tempest-VolumesTransfersV355Test-260632662 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80eeeb80-8b9e-4ed8-8fcc-f946c6337751) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:12:38 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-0f255dd7-1d5a-46d0-8a22-2b1bd9a03547 tempest-VolumesTransfersV355Test-260632662 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80eeeb80-8b9e-4ed8-8fcc-f946c6337751) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:12:38 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-0f255dd7-1d5a-46d0-8a22-2b1bd9a03547 tempest-VolumesTransfersV355Test-260632662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6cd05bb-a312-49d9-a67b-66093f8c1e42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:12:38 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-0f255dd7-1d5a-46d0-8a22-2b1bd9a03547 tempest-VolumesTransfersV355Test-260632662 None] Volume 42ff5ea7-4a94-4809-beea-e4ed04e594d1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-42ff5ea7-4a94-4809-beea-e4ed04e594d1', 'volume_size': 1} Aug 05 06:12:38 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-0f255dd7-1d5a-46d0-8a22-2b1bd9a03547 tempest-VolumesTransfersV355Test-260632662 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:12:38 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-0f255dd7-1d5a-46d0-8a22-2b1bd9a03547 tempest-VolumesTransfersV355Test-260632662 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:12:38 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-0f255dd7-1d5a-46d0-8a22-2b1bd9a03547 tempest-VolumesTransfersV355Test-260632662 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:12:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1961281221',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42ff5ea7-4a94-4809-beea-e4ed04e594d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='763df9fc861b4a38aad3d0607393599a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:12:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:12:39Z,use_quota=True,user_id='e4d3707a0fc0430094ded6a9a07d59f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)}" {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 06:12:38 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-0f255dd7-1d5a-46d0-8a22-2b1bd9a03547 tempest-VolumesTransfersV355Test-260632662 None] Creating volume 42ff5ea7-4a94-4809-beea-e4ed04e594d1 {{(pid=88695) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 06:12:38 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-0f255dd7-1d5a-46d0-8a22-2b1bd9a03547 tempest-VolumesTransfersV355Test-260632662 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:12:38 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-0f255dd7-1d5a-46d0-8a22-2b1bd9a03547 tempest-VolumesTransfersV355Test-260632662 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:12:38 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-0f255dd7-1d5a-46d0-8a22-2b1bd9a03547 tempest-VolumesTransfersV355Test-260632662 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:12:38 devstack sudo[91182]: pam_unix(sudo:session): session closed for user root Aug 05 06:12:38 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-0f255dd7-1d5a-46d0-8a22-2b1bd9a03547 tempest-VolumesTransfersV355Test-260632662 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:12:38 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-0f255dd7-1d5a-46d0-8a22-2b1bd9a03547 tempest-VolumesTransfersV355Test-260632662 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:12:38 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-0f255dd7-1d5a-46d0-8a22-2b1bd9a03547 tempest-VolumesTransfersV355Test-260632662 None] Selected osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 as target Quobyte volume. {{(pid=88695) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 06:12:38 devstack cinder-volume[88695]: INFO cinder.volume.drivers.remotefs [None req-0f255dd7-1d5a-46d0-8a22-2b1bd9a03547 tempest-VolumesTransfersV355Test-260632662 None] casted to osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 Aug 05 06:12:38 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-0f255dd7-1d5a-46d0-8a22-2b1bd9a03547 tempest-VolumesTransfersV355Test-260632662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-42ff5ea7-4a94-4809-beea-e4ed04e594d1 1073741824 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:12:38 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-32758157-93c7-4926-9f9b-64fd7434a3e3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1885056327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce" returned: 0 in 0.366s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:12:38 devstack cinder-volume[88695]: DEBUG cinder.manager [None req-32758157-93c7-4926-9f9b-64fd7434a3e3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1885056327 None] Notifying Schedulers of capabilities ... {{(pid=88695) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 06:12:38 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-32758157-93c7-4926-9f9b-64fd7434a3e3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1885056327 None] Deleted volume successfully. Aug 05 06:12:38 devstack sudo[91185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-42ff5ea7-4a94-4809-beea-e4ed04e594d1 1073741824 Aug 05 06:12:38 devstack sudo[91185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:12:38 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-32758157-93c7-4926-9f9b-64fd7434a3e3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1885056327 None] Lock "cinder-71a19fb2-2e1f-47b9-8b26-ef1f876e65da-delete_volume" released by "delete_volume" :: held 1.613s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:12:39 devstack sudo[91185]: pam_unix(sudo:session): session closed for user root Aug 05 06:12:39 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-0f255dd7-1d5a-46d0-8a22-2b1bd9a03547 tempest-VolumesTransfersV355Test-260632662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-42ff5ea7-4a94-4809-beea-e4ed04e594d1 1073741824" returned: 0 in 0.556s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:12:39 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-0f255dd7-1d5a-46d0-8a22-2b1bd9a03547 tempest-VolumesTransfersV355Test-260632662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-42ff5ea7-4a94-4809-beea-e4ed04e594d1 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:12:39 devstack sudo[91192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-42ff5ea7-4a94-4809-beea-e4ed04e594d1 Aug 05 06:12:39 devstack sudo[91192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:12:39 devstack sudo[91192]: pam_unix(sudo:session): session closed for user root Aug 05 06:12:39 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-0f255dd7-1d5a-46d0-8a22-2b1bd9a03547 tempest-VolumesTransfersV355Test-260632662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-42ff5ea7-4a94-4809-beea-e4ed04e594d1" returned: 0 in 0.278s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:12:39 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-0f255dd7-1d5a-46d0-8a22-2b1bd9a03547 tempest-VolumesTransfersV355Test-260632662 None] <== create_volume: return (888ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'} {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 06:12:39 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-0f255dd7-1d5a-46d0-8a22-2b1bd9a03547 tempest-VolumesTransfersV355Test-260632662 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.892s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:12:39 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-0f255dd7-1d5a-46d0-8a22-2b1bd9a03547 tempest-VolumesTransfersV355Test-260632662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6cd05bb-a312-49d9-a67b-66093f8c1e42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-42ff5ea7-4a94-4809-beea-e4ed04e594d1', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:12:39 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-0f255dd7-1d5a-46d0-8a22-2b1bd9a03547 tempest-VolumesTransfersV355Test-260632662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (793aeadf-dbfe-4785-aec9-cf184135ab07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:12:39 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-0f255dd7-1d5a-46d0-8a22-2b1bd9a03547 tempest-VolumesTransfersV355Test-260632662 None] Volume volume-42ff5ea7-4a94-4809-beea-e4ed04e594d1 (42ff5ea7-4a94-4809-beea-e4ed04e594d1): created successfully Aug 05 06:12:39 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-0f255dd7-1d5a-46d0-8a22-2b1bd9a03547 tempest-VolumesTransfersV355Test-260632662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (793aeadf-dbfe-4785-aec9-cf184135ab07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:12:39 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-0f255dd7-1d5a-46d0-8a22-2b1bd9a03547 tempest-VolumesTransfersV355Test-260632662 None] Flow 'volume_create_manager' (c23740e5-0253-4a5d-8da1-f8d7a7ae2079) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:12:39 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-0f255dd7-1d5a-46d0-8a22-2b1bd9a03547 tempest-VolumesTransfersV355Test-260632662 None] Created volume successfully. Aug 05 06:12:41 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-30173b42-238f-42bf-8551-9e44bbb8585b tempest-VolumesTransfersV355Test-50845594 None] Transfer volume completed successfully. Aug 05 06:12:42 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-92e66fb0-0138-4847-a7b6-2cd00c6052ea tempest-VolumesTransfersV355Test-55205240 None] Acquiring lock "cinder-42ff5ea7-4a94-4809-beea-e4ed04e594d1-delete_volume" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:12:42 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-92e66fb0-0138-4847-a7b6-2cd00c6052ea tempest-VolumesTransfersV355Test-55205240 None] Lock "cinder-42ff5ea7-4a94-4809-beea-e4ed04e594d1-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:12:42 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-92e66fb0-0138-4847-a7b6-2cd00c6052ea tempest-VolumesTransfersV355Test-55205240 None] Acquiring lock "cinder-quobyte-42ff5ea7-4a94-4809-beea-e4ed04e594d1" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:12:42 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-92e66fb0-0138-4847-a7b6-2cd00c6052ea tempest-VolumesTransfersV355Test-55205240 None] Lock "cinder-quobyte-42ff5ea7-4a94-4809-beea-e4ed04e594d1" acquired by "delete_volume" :: waited 0.017s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:12:42 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[efb9cffb-a4f4-409d-aa59-4d465e1d7fdd]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:12:42 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-92e66fb0-0138-4847-a7b6-2cd00c6052ea tempest-VolumesTransfersV355Test-55205240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-42ff5ea7-4a94-4809-beea-e4ed04e594d1 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:12:42 devstack sudo[91233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-42ff5ea7-4a94-4809-beea-e4ed04e594d1 Aug 05 06:12:42 devstack sudo[91233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:12:42 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [req-488f30b8-e3da-43f5-bacb-d2489c8f28dd req-79415efb-02e0-4c6a-8b52-370b7dd2ad73 tempest-ServerActionsTestOtherA-886527270 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:12:42 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [req-488f30b8-e3da-43f5-bacb-d2489c8f28dd req-79415efb-02e0-4c6a-8b52-370b7dd2ad73 tempest-ServerActionsTestOtherA-886527270 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:12:42 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [req-488f30b8-e3da-43f5-bacb-d2489c8f28dd req-79415efb-02e0-4c6a-8b52-370b7dd2ad73 tempest-ServerActionsTestOtherA-886527270 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:12:42 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [req-488f30b8-e3da-43f5-bacb-d2489c8f28dd req-79415efb-02e0-4c6a-8b52-370b7dd2ad73 tempest-ServerActionsTestOtherA-886527270 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087', 'name': 'volume-4a625722-72b0-4600-9c45-29b3a07e9e82', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ffbb803b-5ad9-4656-b5d0-dc6d41cca6df', 'enforce_multipath': True} {{(pid=88695) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 05 06:12:42 devstack cinder-volume[88695]: INFO cinder.volume.manager [req-488f30b8-e3da-43f5-bacb-d2489c8f28dd req-79415efb-02e0-4c6a-8b52-370b7dd2ad73 tempest-ServerActionsTestOtherA-886527270 None] attachment_update completed successfully. Aug 05 06:12:43 devstack sudo[91233]: pam_unix(sudo:session): session closed for user root Aug 05 06:12:43 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-92e66fb0-0138-4847-a7b6-2cd00c6052ea tempest-VolumesTransfersV355Test-55205240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-42ff5ea7-4a94-4809-beea-e4ed04e594d1" returned: 0 in 0.428s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:12:43 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-92e66fb0-0138-4847-a7b6-2cd00c6052ea tempest-VolumesTransfersV355Test-55205240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-42ff5ea7-4a94-4809-beea-e4ed04e594d1 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:12:43 devstack sudo[91266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-42ff5ea7-4a94-4809-beea-e4ed04e594d1 Aug 05 06:12:43 devstack sudo[91266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:12:43 devstack sudo[91266]: pam_unix(sudo:session): session closed for user root Aug 05 06:12:43 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-92e66fb0-0138-4847-a7b6-2cd00c6052ea tempest-VolumesTransfersV355Test-55205240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-42ff5ea7-4a94-4809-beea-e4ed04e594d1" returned: 0 in 0.313s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:12:43 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-92e66fb0-0138-4847-a7b6-2cd00c6052ea tempest-VolumesTransfersV355Test-55205240 None] Lock "cinder-quobyte-42ff5ea7-4a94-4809-beea-e4ed04e594d1" released by "delete_volume" :: held 0.796s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:12:43 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-92e66fb0-0138-4847-a7b6-2cd00c6052ea tempest-VolumesTransfersV355Test-55205240 None] Created reservations ['d25920c0-c41d-405e-8df5-0d5110696ad0', 'a2c69c32-7673-4c71-9622-12ee9acce22b', '66ecd59c-9471-4fa4-a856-69aca6d418d1', '890ceb15-af11-45d8-87d8-d7d20b68eebe'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:12:43 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-92e66fb0-0138-4847-a7b6-2cd00c6052ea tempest-VolumesTransfersV355Test-55205240 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:12:43 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-92e66fb0-0138-4847-a7b6-2cd00c6052ea tempest-VolumesTransfersV355Test-55205240 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:12:43 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-92e66fb0-0138-4847-a7b6-2cd00c6052ea tempest-VolumesTransfersV355Test-55205240 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:12:43 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-92e66fb0-0138-4847-a7b6-2cd00c6052ea tempest-VolumesTransfersV355Test-55205240 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:12:43 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-92e66fb0-0138-4847-a7b6-2cd00c6052ea tempest-VolumesTransfersV355Test-55205240 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:12:43 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-92e66fb0-0138-4847-a7b6-2cd00c6052ea tempest-VolumesTransfersV355Test-55205240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:12:43 devstack sudo[91627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce Aug 05 06:12:43 devstack sudo[91627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:12:43 devstack sudo[91627]: pam_unix(sudo:session): session closed for user root Aug 05 06:12:43 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-92e66fb0-0138-4847-a7b6-2cd00c6052ea tempest-VolumesTransfersV355Test-55205240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce" returned: 0 in 0.326s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:12:43 devstack cinder-volume[88695]: DEBUG cinder.manager [None req-92e66fb0-0138-4847-a7b6-2cd00c6052ea tempest-VolumesTransfersV355Test-55205240 None] Notifying Schedulers of capabilities ... {{(pid=88695) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 06:12:43 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-92e66fb0-0138-4847-a7b6-2cd00c6052ea tempest-VolumesTransfersV355Test-55205240 None] Deleted volume successfully. Aug 05 06:12:43 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-92e66fb0-0138-4847-a7b6-2cd00c6052ea tempest-VolumesTransfersV355Test-55205240 None] Lock "cinder-42ff5ea7-4a94-4809-beea-e4ed04e594d1-delete_volume" released by "delete_volume" :: held 1.368s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:12:44 devstack cinder-volume[88695]: DEBUG dbcounter [-] [88695] Writing DB stats cinder:UPDATE=104,cinder:SELECT=81,cinder:INSERT=30,cinder:DELETE=11 {{(pid=88695) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 06:12:44 devstack cinder-volume[88695]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ca144aa-cab5-43f0-8273-83511ccf3132 tempest-VolumesTransfersV355Test-260632662 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88695) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 06:12:44 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-7ca144aa-cab5-43f0-8273-83511ccf3132 tempest-VolumesTransfersV355Test-260632662 None] Flow 'volume_create_manager' (56e77897-9497-43d4-9127-f76c06de042d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:12:44 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-7ca144aa-cab5-43f0-8273-83511ccf3132 tempest-VolumesTransfersV355Test-260632662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b9f82e8-ee7a-4898-95e8-1c394d20a8f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:12:44 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-7ca144aa-cab5-43f0-8273-83511ccf3132 tempest-VolumesTransfersV355Test-260632662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b9f82e8-ee7a-4898-95e8-1c394d20a8f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:12:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1713765970',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d20090c-691f-4218-a144-511ebb881e86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='763df9fc861b4a38aad3d0607393599a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:12:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:12:44Z,use_quota=True,user_id='e4d3707a0fc0430094ded6a9a07d59f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:12:44 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-7ca144aa-cab5-43f0-8273-83511ccf3132 tempest-VolumesTransfersV355Test-260632662 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd13e93f-5331-4d65-b7bf-10ca800b6012) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:12:44 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-7ca144aa-cab5-43f0-8273-83511ccf3132 tempest-VolumesTransfersV355Test-260632662 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd13e93f-5331-4d65-b7bf-10ca800b6012) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:12:44 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-7ca144aa-cab5-43f0-8273-83511ccf3132 tempest-VolumesTransfersV355Test-260632662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41110e9c-f8f8-4295-ba40-33d74159bc42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:12:44 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-7ca144aa-cab5-43f0-8273-83511ccf3132 tempest-VolumesTransfersV355Test-260632662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41110e9c-f8f8-4295-ba40-33d74159bc42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d20090c-691f-4218-a144-511ebb881e86', 'volume_name': 'volume-3d20090c-691f-4218-a144-511ebb881e86', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:12:44 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-7ca144aa-cab5-43f0-8273-83511ccf3132 tempest-VolumesTransfersV355Test-260632662 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4606078c-ef34-44d7-b8ac-29d3b0dca16c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:12:44 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-7ca144aa-cab5-43f0-8273-83511ccf3132 tempest-VolumesTransfersV355Test-260632662 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4606078c-ef34-44d7-b8ac-29d3b0dca16c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:12:44 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-7ca144aa-cab5-43f0-8273-83511ccf3132 tempest-VolumesTransfersV355Test-260632662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d9c6e0a-6ad8-49c0-9b19-501967be112a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:12:44 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-7ca144aa-cab5-43f0-8273-83511ccf3132 tempest-VolumesTransfersV355Test-260632662 None] Volume 3d20090c-691f-4218-a144-511ebb881e86: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d20090c-691f-4218-a144-511ebb881e86', 'volume_size': 1} Aug 05 06:12:44 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-7ca144aa-cab5-43f0-8273-83511ccf3132 tempest-VolumesTransfersV355Test-260632662 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:12:44 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-7ca144aa-cab5-43f0-8273-83511ccf3132 tempest-VolumesTransfersV355Test-260632662 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:12:44 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-7ca144aa-cab5-43f0-8273-83511ccf3132 tempest-VolumesTransfersV355Test-260632662 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:12:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1713765970',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d20090c-691f-4218-a144-511ebb881e86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='763df9fc861b4a38aad3d0607393599a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:12:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:12:44Z,use_quota=True,user_id='e4d3707a0fc0430094ded6a9a07d59f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)}" {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 06:12:44 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-7ca144aa-cab5-43f0-8273-83511ccf3132 tempest-VolumesTransfersV355Test-260632662 None] Creating volume 3d20090c-691f-4218-a144-511ebb881e86 {{(pid=88695) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 06:12:44 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-7ca144aa-cab5-43f0-8273-83511ccf3132 tempest-VolumesTransfersV355Test-260632662 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:12:44 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-7ca144aa-cab5-43f0-8273-83511ccf3132 tempest-VolumesTransfersV355Test-260632662 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:12:44 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-7ca144aa-cab5-43f0-8273-83511ccf3132 tempest-VolumesTransfersV355Test-260632662 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:12:44 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-7ca144aa-cab5-43f0-8273-83511ccf3132 tempest-VolumesTransfersV355Test-260632662 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:12:44 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-7ca144aa-cab5-43f0-8273-83511ccf3132 tempest-VolumesTransfersV355Test-260632662 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:12:44 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-7ca144aa-cab5-43f0-8273-83511ccf3132 tempest-VolumesTransfersV355Test-260632662 None] Selected osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 as target Quobyte volume. {{(pid=88695) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 06:12:44 devstack cinder-volume[88695]: INFO cinder.volume.drivers.remotefs [None req-7ca144aa-cab5-43f0-8273-83511ccf3132 tempest-VolumesTransfersV355Test-260632662 None] casted to osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 Aug 05 06:12:44 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-7ca144aa-cab5-43f0-8273-83511ccf3132 tempest-VolumesTransfersV355Test-260632662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-3d20090c-691f-4218-a144-511ebb881e86 1073741824 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:12:44 devstack sudo[91630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-3d20090c-691f-4218-a144-511ebb881e86 1073741824 Aug 05 06:12:44 devstack sudo[91630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:12:44 devstack sudo[91630]: pam_unix(sudo:session): session closed for user root Aug 05 06:12:44 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-7ca144aa-cab5-43f0-8273-83511ccf3132 tempest-VolumesTransfersV355Test-260632662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-3d20090c-691f-4218-a144-511ebb881e86 1073741824" returned: 0 in 0.468s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:12:44 devstack cinder-volume[88695]: DEBUG dbcounter [-] [88695] Writing DB stats cinder:SELECT=108,cinder:INSERT=30,cinder:UPDATE=107,cinder:DELETE=7 {{(pid=88695) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 06:12:44 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-7ca144aa-cab5-43f0-8273-83511ccf3132 tempest-VolumesTransfersV355Test-260632662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-3d20090c-691f-4218-a144-511ebb881e86 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:12:44 devstack sudo[91636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-3d20090c-691f-4218-a144-511ebb881e86 Aug 05 06:12:44 devstack sudo[91636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:12:45 devstack sudo[91636]: pam_unix(sudo:session): session closed for user root Aug 05 06:12:45 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-7ca144aa-cab5-43f0-8273-83511ccf3132 tempest-VolumesTransfersV355Test-260632662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-3d20090c-691f-4218-a144-511ebb881e86" returned: 0 in 0.279s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:12:45 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-7ca144aa-cab5-43f0-8273-83511ccf3132 tempest-VolumesTransfersV355Test-260632662 None] <== create_volume: return (802ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'} {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 06:12:45 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-7ca144aa-cab5-43f0-8273-83511ccf3132 tempest-VolumesTransfersV355Test-260632662 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.804s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:12:45 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-7ca144aa-cab5-43f0-8273-83511ccf3132 tempest-VolumesTransfersV355Test-260632662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d9c6e0a-6ad8-49c0-9b19-501967be112a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d20090c-691f-4218-a144-511ebb881e86', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:12:45 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-7ca144aa-cab5-43f0-8273-83511ccf3132 tempest-VolumesTransfersV355Test-260632662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8f7d572-ec8e-4e07-ab24-e85d08fc4222) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:12:45 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-7ca144aa-cab5-43f0-8273-83511ccf3132 tempest-VolumesTransfersV355Test-260632662 None] Volume volume-3d20090c-691f-4218-a144-511ebb881e86 (3d20090c-691f-4218-a144-511ebb881e86): created successfully Aug 05 06:12:45 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-7ca144aa-cab5-43f0-8273-83511ccf3132 tempest-VolumesTransfersV355Test-260632662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8f7d572-ec8e-4e07-ab24-e85d08fc4222) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:12:45 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-7ca144aa-cab5-43f0-8273-83511ccf3132 tempest-VolumesTransfersV355Test-260632662 None] Flow 'volume_create_manager' (56e77897-9497-43d4-9127-f76c06de042d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:12:45 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-7ca144aa-cab5-43f0-8273-83511ccf3132 tempest-VolumesTransfersV355Test-260632662 None] Created volume successfully. Aug 05 06:12:46 devstack cinder-volume[88695]: INFO cinder.volume.manager [req-13bf7b6a-c52b-4ed6-92ad-75bed537621b req-d032342e-ad01-4b5f-92d4-b15ae32b4572 tempest-ServerActionsTestOtherA-886527270 None] Terminate volume connection completed successfully. Aug 05 06:12:46 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [req-13bf7b6a-c52b-4ed6-92ad-75bed537621b req-d032342e-ad01-4b5f-92d4-b15ae32b4572 tempest-ServerActionsTestOtherA-886527270 None] Deleting attachment ffbb803b-5ad9-4656-b5d0-dc6d41cca6df. {{(pid=88695) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 05 06:12:46 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-74f4afe5-5900-404f-ad6d-60aed9963eef tempest-VolumesTransfersV355Test-55205240 None] Acquiring lock "cinder-3d20090c-691f-4218-a144-511ebb881e86-delete_volume" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:12:46 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-74f4afe5-5900-404f-ad6d-60aed9963eef tempest-VolumesTransfersV355Test-55205240 None] Lock "cinder-3d20090c-691f-4218-a144-511ebb881e86-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:12:46 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-74f4afe5-5900-404f-ad6d-60aed9963eef tempest-VolumesTransfersV355Test-55205240 None] Acquiring lock "cinder-quobyte-3d20090c-691f-4218-a144-511ebb881e86" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:12:47 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-74f4afe5-5900-404f-ad6d-60aed9963eef tempest-VolumesTransfersV355Test-55205240 None] Lock "cinder-quobyte-3d20090c-691f-4218-a144-511ebb881e86" acquired by "delete_volume" :: waited 0.042s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:12:47 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b994aa2-4958-43ca-8d4a-34704a0effca]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:12:47 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-74f4afe5-5900-404f-ad6d-60aed9963eef tempest-VolumesTransfersV355Test-55205240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-3d20090c-691f-4218-a144-511ebb881e86 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:12:47 devstack sudo[91677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-3d20090c-691f-4218-a144-511ebb881e86 Aug 05 06:12:47 devstack sudo[91677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:12:47 devstack sudo[91677]: pam_unix(sudo:session): session closed for user root Aug 05 06:12:47 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-74f4afe5-5900-404f-ad6d-60aed9963eef tempest-VolumesTransfersV355Test-55205240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-3d20090c-691f-4218-a144-511ebb881e86" returned: 0 in 0.801s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:12:47 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-74f4afe5-5900-404f-ad6d-60aed9963eef tempest-VolumesTransfersV355Test-55205240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-3d20090c-691f-4218-a144-511ebb881e86 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:12:47 devstack sudo[91725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-3d20090c-691f-4218-a144-511ebb881e86 Aug 05 06:12:47 devstack sudo[91725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:12:48 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [req-13bf7b6a-c52b-4ed6-92ad-75bed537621b req-e4cfa01f-64d2-47fd-9a38-692b65f61ca7 tempest-ServerActionsTestOtherA-886527270 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:12:48 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [req-13bf7b6a-c52b-4ed6-92ad-75bed537621b req-e4cfa01f-64d2-47fd-9a38-692b65f61ca7 tempest-ServerActionsTestOtherA-886527270 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:12:48 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [req-13bf7b6a-c52b-4ed6-92ad-75bed537621b req-e4cfa01f-64d2-47fd-9a38-692b65f61ca7 tempest-ServerActionsTestOtherA-886527270 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.025s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:12:48 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [req-13bf7b6a-c52b-4ed6-92ad-75bed537621b req-e4cfa01f-64d2-47fd-9a38-692b65f61ca7 tempest-ServerActionsTestOtherA-886527270 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087', 'name': 'volume-4a625722-72b0-4600-9c45-29b3a07e9e82', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2df40583-88a7-4033-a744-a76eaaaba07d', 'enforce_multipath': True} {{(pid=88695) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 05 06:12:48 devstack cinder-volume[88695]: INFO cinder.volume.manager [req-13bf7b6a-c52b-4ed6-92ad-75bed537621b req-e4cfa01f-64d2-47fd-9a38-692b65f61ca7 tempest-ServerActionsTestOtherA-886527270 None] attachment_update completed successfully. Aug 05 06:12:48 devstack sudo[91725]: pam_unix(sudo:session): session closed for user root Aug 05 06:12:48 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-74f4afe5-5900-404f-ad6d-60aed9963eef tempest-VolumesTransfersV355Test-55205240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-3d20090c-691f-4218-a144-511ebb881e86" returned: 0 in 0.433s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:12:48 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-74f4afe5-5900-404f-ad6d-60aed9963eef tempest-VolumesTransfersV355Test-55205240 None] Lock "cinder-quobyte-3d20090c-691f-4218-a144-511ebb881e86" released by "delete_volume" :: held 1.308s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:12:48 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-74f4afe5-5900-404f-ad6d-60aed9963eef tempest-VolumesTransfersV355Test-55205240 None] Created reservations ['5b219949-d0aa-4873-9a5b-927066443a1d', 'f1b27e75-bc70-430c-91a5-6432ae5e1df8', '0db55f01-65d2-4f16-b4d7-e434bb1b88b1', '898c5423-0916-4775-bc79-12a5ce795c68'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:12:48 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-74f4afe5-5900-404f-ad6d-60aed9963eef tempest-VolumesTransfersV355Test-55205240 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:12:48 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-74f4afe5-5900-404f-ad6d-60aed9963eef tempest-VolumesTransfersV355Test-55205240 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:12:48 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-74f4afe5-5900-404f-ad6d-60aed9963eef tempest-VolumesTransfersV355Test-55205240 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:12:48 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-74f4afe5-5900-404f-ad6d-60aed9963eef tempest-VolumesTransfersV355Test-55205240 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:12:48 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-74f4afe5-5900-404f-ad6d-60aed9963eef tempest-VolumesTransfersV355Test-55205240 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:12:48 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-74f4afe5-5900-404f-ad6d-60aed9963eef tempest-VolumesTransfersV355Test-55205240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:12:48 devstack sudo[91730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce Aug 05 06:12:48 devstack sudo[91730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:12:48 devstack sudo[91730]: pam_unix(sudo:session): session closed for user root Aug 05 06:12:48 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-74f4afe5-5900-404f-ad6d-60aed9963eef tempest-VolumesTransfersV355Test-55205240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce" returned: 0 in 0.313s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:12:48 devstack cinder-volume[88695]: DEBUG cinder.manager [None req-74f4afe5-5900-404f-ad6d-60aed9963eef tempest-VolumesTransfersV355Test-55205240 None] Notifying Schedulers of capabilities ... {{(pid=88695) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 06:12:48 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-74f4afe5-5900-404f-ad6d-60aed9963eef tempest-VolumesTransfersV355Test-55205240 None] Deleted volume successfully. Aug 05 06:12:48 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-74f4afe5-5900-404f-ad6d-60aed9963eef tempest-VolumesTransfersV355Test-55205240 None] Lock "cinder-3d20090c-691f-4218-a144-511ebb881e86-delete_volume" released by "delete_volume" :: held 1.998s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:12:57 devstack cinder-volume[88695]: DEBUG cinder.volume.flows.manager.create_volume [None req-71eac24e-de9f-4407-b0a1-a1650a7e9d44 tempest-VolumesTransfersTest-170828364 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88695) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 06:12:57 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-71eac24e-de9f-4407-b0a1-a1650a7e9d44 tempest-VolumesTransfersTest-170828364 None] Flow 'volume_create_manager' (3c277829-81ad-48dd-a052-287f6860a867) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:12:57 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-71eac24e-de9f-4407-b0a1-a1650a7e9d44 tempest-VolumesTransfersTest-170828364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d52544c2-c59a-4633-91de-2d61c67fdfe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:12:57 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-71eac24e-de9f-4407-b0a1-a1650a7e9d44 tempest-VolumesTransfersTest-170828364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d52544c2-c59a-4633-91de-2d61c67fdfe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:12:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1139123145',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb41593d-2645-4a37-8919-f6142773e1ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0705e3809f844464b280b15a6b730702',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:12:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:12:57Z,use_quota=True,user_id='5ab07b78eea04c6bb436ed09b08fcc2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:12:57 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-71eac24e-de9f-4407-b0a1-a1650a7e9d44 tempest-VolumesTransfersTest-170828364 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e01acf5-f9d1-4886-97ce-f7d95a93b01b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:12:57 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-71eac24e-de9f-4407-b0a1-a1650a7e9d44 tempest-VolumesTransfersTest-170828364 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e01acf5-f9d1-4886-97ce-f7d95a93b01b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:12:57 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-71eac24e-de9f-4407-b0a1-a1650a7e9d44 tempest-VolumesTransfersTest-170828364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d054e5da-0905-4b95-a67a-c2c426845366) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:12:57 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-71eac24e-de9f-4407-b0a1-a1650a7e9d44 tempest-VolumesTransfersTest-170828364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d054e5da-0905-4b95-a67a-c2c426845366) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb41593d-2645-4a37-8919-f6142773e1ff', 'volume_name': 'volume-eb41593d-2645-4a37-8919-f6142773e1ff', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:12:57 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-71eac24e-de9f-4407-b0a1-a1650a7e9d44 tempest-VolumesTransfersTest-170828364 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89413bf5-57c6-4843-b7ca-bbc064bfb739) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:12:57 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-71eac24e-de9f-4407-b0a1-a1650a7e9d44 tempest-VolumesTransfersTest-170828364 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89413bf5-57c6-4843-b7ca-bbc064bfb739) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:12:57 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-71eac24e-de9f-4407-b0a1-a1650a7e9d44 tempest-VolumesTransfersTest-170828364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6dd85d6-742e-47c7-891f-35560a45c899) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:12:57 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-71eac24e-de9f-4407-b0a1-a1650a7e9d44 tempest-VolumesTransfersTest-170828364 None] Volume eb41593d-2645-4a37-8919-f6142773e1ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb41593d-2645-4a37-8919-f6142773e1ff', 'volume_size': 1} Aug 05 06:12:57 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-71eac24e-de9f-4407-b0a1-a1650a7e9d44 tempest-VolumesTransfersTest-170828364 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:12:57 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-71eac24e-de9f-4407-b0a1-a1650a7e9d44 tempest-VolumesTransfersTest-170828364 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:12:57 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-71eac24e-de9f-4407-b0a1-a1650a7e9d44 tempest-VolumesTransfersTest-170828364 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:12:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1139123145',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb41593d-2645-4a37-8919-f6142773e1ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0705e3809f844464b280b15a6b730702',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:12:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:12:57Z,use_quota=True,user_id='5ab07b78eea04c6bb436ed09b08fcc2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)}" {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 06:12:57 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-71eac24e-de9f-4407-b0a1-a1650a7e9d44 tempest-VolumesTransfersTest-170828364 None] Creating volume eb41593d-2645-4a37-8919-f6142773e1ff {{(pid=88695) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 06:12:57 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-71eac24e-de9f-4407-b0a1-a1650a7e9d44 tempest-VolumesTransfersTest-170828364 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:12:57 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-71eac24e-de9f-4407-b0a1-a1650a7e9d44 tempest-VolumesTransfersTest-170828364 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:12:57 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-71eac24e-de9f-4407-b0a1-a1650a7e9d44 tempest-VolumesTransfersTest-170828364 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:12:57 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-71eac24e-de9f-4407-b0a1-a1650a7e9d44 tempest-VolumesTransfersTest-170828364 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:12:57 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-71eac24e-de9f-4407-b0a1-a1650a7e9d44 tempest-VolumesTransfersTest-170828364 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:12:57 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-71eac24e-de9f-4407-b0a1-a1650a7e9d44 tempest-VolumesTransfersTest-170828364 None] Selected osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 as target Quobyte volume. {{(pid=88695) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 06:12:57 devstack cinder-volume[88695]: INFO cinder.volume.drivers.remotefs [None req-71eac24e-de9f-4407-b0a1-a1650a7e9d44 tempest-VolumesTransfersTest-170828364 None] casted to osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 Aug 05 06:12:57 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-71eac24e-de9f-4407-b0a1-a1650a7e9d44 tempest-VolumesTransfersTest-170828364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-eb41593d-2645-4a37-8919-f6142773e1ff 1073741824 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:12:57 devstack sudo[92202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-eb41593d-2645-4a37-8919-f6142773e1ff 1073741824 Aug 05 06:12:57 devstack sudo[92202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:12:58 devstack sudo[92202]: pam_unix(sudo:session): session closed for user root Aug 05 06:12:58 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-71eac24e-de9f-4407-b0a1-a1650a7e9d44 tempest-VolumesTransfersTest-170828364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-eb41593d-2645-4a37-8919-f6142773e1ff 1073741824" returned: 0 in 0.670s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:12:58 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-71eac24e-de9f-4407-b0a1-a1650a7e9d44 tempest-VolumesTransfersTest-170828364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-eb41593d-2645-4a37-8919-f6142773e1ff {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:12:58 devstack sudo[92208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-eb41593d-2645-4a37-8919-f6142773e1ff Aug 05 06:12:58 devstack sudo[92208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:12:58 devstack sudo[92208]: pam_unix(sudo:session): session closed for user root Aug 05 06:12:58 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-71eac24e-de9f-4407-b0a1-a1650a7e9d44 tempest-VolumesTransfersTest-170828364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-eb41593d-2645-4a37-8919-f6142773e1ff" returned: 0 in 0.416s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:12:58 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-71eac24e-de9f-4407-b0a1-a1650a7e9d44 tempest-VolumesTransfersTest-170828364 None] <== create_volume: return (1168ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'} {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 06:12:58 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-71eac24e-de9f-4407-b0a1-a1650a7e9d44 tempest-VolumesTransfersTest-170828364 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.182s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:12:58 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-71eac24e-de9f-4407-b0a1-a1650a7e9d44 tempest-VolumesTransfersTest-170828364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6dd85d6-742e-47c7-891f-35560a45c899) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb41593d-2645-4a37-8919-f6142773e1ff', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:12:58 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-71eac24e-de9f-4407-b0a1-a1650a7e9d44 tempest-VolumesTransfersTest-170828364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0dfa8519-f2b0-455c-835d-3268fc6bb24a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:12:58 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-71eac24e-de9f-4407-b0a1-a1650a7e9d44 tempest-VolumesTransfersTest-170828364 None] Volume volume-eb41593d-2645-4a37-8919-f6142773e1ff (eb41593d-2645-4a37-8919-f6142773e1ff): created successfully Aug 05 06:12:58 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-71eac24e-de9f-4407-b0a1-a1650a7e9d44 tempest-VolumesTransfersTest-170828364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0dfa8519-f2b0-455c-835d-3268fc6bb24a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:12:58 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-71eac24e-de9f-4407-b0a1-a1650a7e9d44 tempest-VolumesTransfersTest-170828364 None] Flow 'volume_create_manager' (3c277829-81ad-48dd-a052-287f6860a867) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:12:58 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-71eac24e-de9f-4407-b0a1-a1650a7e9d44 tempest-VolumesTransfersTest-170828364 None] Created volume successfully. Aug 05 06:13:00 devstack cinder-volume[88695]: DEBUG oslo_service.periodic_task [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88695) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 06:13:00 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:13:00 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:13:00 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:13:00 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:13:00 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:13:00 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:13:00 devstack sudo[92266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce Aug 05 06:13:00 devstack sudo[92266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:13:00 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-a739c54e-a2b5-4ebf-a493-de00c2acacb0 tempest-VolumesTransfersTest-1065653514 None] Transfer volume completed successfully. Aug 05 06:13:00 devstack sudo[92266]: pam_unix(sudo:session): session closed for user root Aug 05 06:13:00 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce" returned: 0 in 0.471s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:13:00 devstack cinder-volume[88695]: DEBUG cinder.manager [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] Notifying Schedulers of capabilities ... {{(pid=88695) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 06:13:00 devstack cinder-volume[88695]: DEBUG oslo_service.periodic_task [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] Running periodic task VolumeManager._thread_info {{(pid=88695) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 06:13:00 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] thread count: 28 {{(pid=88695) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 05 06:13:00 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] thread info: [<_MainThread(MainThread, started 134469211893888)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88695) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 05 06:13:01 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [req-c9bc3785-0699-4d3c-ab93-ff7f91fad23d req-f127fe44-d3a7-4d22-99f9-72aa441b2e6f tempest-TaggedAttachmentsTest-306183043 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:13:01 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [req-c9bc3785-0699-4d3c-ab93-ff7f91fad23d req-f127fe44-d3a7-4d22-99f9-72aa441b2e6f tempest-TaggedAttachmentsTest-306183043 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:13:01 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [req-c9bc3785-0699-4d3c-ab93-ff7f91fad23d req-f127fe44-d3a7-4d22-99f9-72aa441b2e6f tempest-TaggedAttachmentsTest-306183043 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:13:01 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-9bebfa21-f9ff-4069-8fdf-ff10e9d265c5 tempest-VolumesTransfersTest-1480389806 None] Acquiring lock "cinder-eb41593d-2645-4a37-8919-f6142773e1ff-delete_volume" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:13:01 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-9bebfa21-f9ff-4069-8fdf-ff10e9d265c5 tempest-VolumesTransfersTest-1480389806 None] Lock "cinder-eb41593d-2645-4a37-8919-f6142773e1ff-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:13:01 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [req-c9bc3785-0699-4d3c-ab93-ff7f91fad23d req-f127fe44-d3a7-4d22-99f9-72aa441b2e6f tempest-TaggedAttachmentsTest-306183043 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087', 'name': 'volume-aeee006c-089d-4fcb-8275-e80f2bf1d441', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a397e274-029e-4918-90e0-2f456a7643cd', 'enforce_multipath': True} {{(pid=88695) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 05 06:13:01 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-9bebfa21-f9ff-4069-8fdf-ff10e9d265c5 tempest-VolumesTransfersTest-1480389806 None] Acquiring lock "cinder-quobyte-eb41593d-2645-4a37-8919-f6142773e1ff" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:13:01 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-9bebfa21-f9ff-4069-8fdf-ff10e9d265c5 tempest-VolumesTransfersTest-1480389806 None] Lock "cinder-quobyte-eb41593d-2645-4a37-8919-f6142773e1ff" acquired by "delete_volume" :: waited 0.027s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:13:01 devstack cinder-volume[88695]: INFO cinder.volume.manager [req-c9bc3785-0699-4d3c-ab93-ff7f91fad23d req-f127fe44-d3a7-4d22-99f9-72aa441b2e6f tempest-TaggedAttachmentsTest-306183043 None] attachment_update completed successfully. Aug 05 06:13:01 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[320fba7a-a38a-4b40-91e5-706f95a2a6e0]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:13:01 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-9bebfa21-f9ff-4069-8fdf-ff10e9d265c5 tempest-VolumesTransfersTest-1480389806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-eb41593d-2645-4a37-8919-f6142773e1ff {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:13:01 devstack sudo[92282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-eb41593d-2645-4a37-8919-f6142773e1ff Aug 05 06:13:01 devstack sudo[92282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:13:02 devstack sudo[92282]: pam_unix(sudo:session): session closed for user root Aug 05 06:13:02 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-9bebfa21-f9ff-4069-8fdf-ff10e9d265c5 tempest-VolumesTransfersTest-1480389806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-eb41593d-2645-4a37-8919-f6142773e1ff" returned: 0 in 0.625s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:13:02 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-9bebfa21-f9ff-4069-8fdf-ff10e9d265c5 tempest-VolumesTransfersTest-1480389806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-eb41593d-2645-4a37-8919-f6142773e1ff {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:13:02 devstack sudo[92293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-eb41593d-2645-4a37-8919-f6142773e1ff Aug 05 06:13:02 devstack sudo[92293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:13:02 devstack sudo[92293]: pam_unix(sudo:session): session closed for user root Aug 05 06:13:02 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-9bebfa21-f9ff-4069-8fdf-ff10e9d265c5 tempest-VolumesTransfersTest-1480389806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-eb41593d-2645-4a37-8919-f6142773e1ff" returned: 0 in 0.335s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:13:02 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-9bebfa21-f9ff-4069-8fdf-ff10e9d265c5 tempest-VolumesTransfersTest-1480389806 None] Lock "cinder-quobyte-eb41593d-2645-4a37-8919-f6142773e1ff" released by "delete_volume" :: held 1.033s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:13:02 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-9bebfa21-f9ff-4069-8fdf-ff10e9d265c5 tempest-VolumesTransfersTest-1480389806 None] Created reservations ['fef20368-9a22-44c7-a89e-af8fe7fb2755', '0d116452-92cb-4efd-95d0-5a1defee0da2', 'c88b6519-877b-4782-a431-f4611c2f542d', '1da15c97-def9-4b4c-b596-e0453357da74'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:13:02 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-9bebfa21-f9ff-4069-8fdf-ff10e9d265c5 tempest-VolumesTransfersTest-1480389806 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:13:02 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-9bebfa21-f9ff-4069-8fdf-ff10e9d265c5 tempest-VolumesTransfersTest-1480389806 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:13:02 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-9bebfa21-f9ff-4069-8fdf-ff10e9d265c5 tempest-VolumesTransfersTest-1480389806 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:13:02 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-9bebfa21-f9ff-4069-8fdf-ff10e9d265c5 tempest-VolumesTransfersTest-1480389806 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:13:02 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-9bebfa21-f9ff-4069-8fdf-ff10e9d265c5 tempest-VolumesTransfersTest-1480389806 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:13:02 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-9bebfa21-f9ff-4069-8fdf-ff10e9d265c5 tempest-VolumesTransfersTest-1480389806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:13:02 devstack sudo[92296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce Aug 05 06:13:02 devstack sudo[92296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:13:03 devstack sudo[92296]: pam_unix(sudo:session): session closed for user root Aug 05 06:13:03 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-9bebfa21-f9ff-4069-8fdf-ff10e9d265c5 tempest-VolumesTransfersTest-1480389806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce" returned: 0 in 0.259s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:13:03 devstack cinder-volume[88695]: DEBUG cinder.manager [None req-9bebfa21-f9ff-4069-8fdf-ff10e9d265c5 tempest-VolumesTransfersTest-1480389806 None] Notifying Schedulers of capabilities ... {{(pid=88695) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 06:13:03 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-9bebfa21-f9ff-4069-8fdf-ff10e9d265c5 tempest-VolumesTransfersTest-1480389806 None] Deleted volume successfully. Aug 05 06:13:03 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-9bebfa21-f9ff-4069-8fdf-ff10e9d265c5 tempest-VolumesTransfersTest-1480389806 None] Lock "cinder-eb41593d-2645-4a37-8919-f6142773e1ff-delete_volume" released by "delete_volume" :: held 1.611s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:13:05 devstack cinder-volume[88695]: DEBUG cinder.volume.flows.manager.create_volume [None req-e728c0bd-5d7f-40a3-aced-ded091e428b9 tempest-VolumesTransfersTest-170828364 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88695) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 06:13:05 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-e728c0bd-5d7f-40a3-aced-ded091e428b9 tempest-VolumesTransfersTest-170828364 None] Flow 'volume_create_manager' (bc8bb156-3c60-4bf9-8f8b-1ebf785812da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:13:05 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-e728c0bd-5d7f-40a3-aced-ded091e428b9 tempest-VolumesTransfersTest-170828364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3f68654-8fa5-4091-ad4d-d4ab1e344b84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:13:05 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-e728c0bd-5d7f-40a3-aced-ded091e428b9 tempest-VolumesTransfersTest-170828364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3f68654-8fa5-4091-ad4d-d4ab1e344b84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:13:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1782068570',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12b46770-5b5b-4f12-b072-1b1c757cda59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0705e3809f844464b280b15a6b730702',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:13:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:13:05Z,use_quota=True,user_id='5ab07b78eea04c6bb436ed09b08fcc2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:13:05 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-e728c0bd-5d7f-40a3-aced-ded091e428b9 tempest-VolumesTransfersTest-170828364 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73d76b90-7710-49b6-8b5e-c7b2b89d33ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:13:05 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-e728c0bd-5d7f-40a3-aced-ded091e428b9 tempest-VolumesTransfersTest-170828364 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73d76b90-7710-49b6-8b5e-c7b2b89d33ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:13:05 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-e728c0bd-5d7f-40a3-aced-ded091e428b9 tempest-VolumesTransfersTest-170828364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0877af70-ca27-4d91-ace8-cc8e1b1ad7e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:13:05 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-e728c0bd-5d7f-40a3-aced-ded091e428b9 tempest-VolumesTransfersTest-170828364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0877af70-ca27-4d91-ace8-cc8e1b1ad7e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '12b46770-5b5b-4f12-b072-1b1c757cda59', 'volume_name': 'volume-12b46770-5b5b-4f12-b072-1b1c757cda59', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:13:05 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-e728c0bd-5d7f-40a3-aced-ded091e428b9 tempest-VolumesTransfersTest-170828364 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3775c3dd-50b5-4c89-b633-45177777b2a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:13:05 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-e728c0bd-5d7f-40a3-aced-ded091e428b9 tempest-VolumesTransfersTest-170828364 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3775c3dd-50b5-4c89-b633-45177777b2a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:13:05 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-e728c0bd-5d7f-40a3-aced-ded091e428b9 tempest-VolumesTransfersTest-170828364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e34e267e-ec7f-4828-bb9f-288d5b35fdc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:13:05 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-e728c0bd-5d7f-40a3-aced-ded091e428b9 tempest-VolumesTransfersTest-170828364 None] Volume 12b46770-5b5b-4f12-b072-1b1c757cda59: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-12b46770-5b5b-4f12-b072-1b1c757cda59', 'volume_size': 1} Aug 05 06:13:05 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-e728c0bd-5d7f-40a3-aced-ded091e428b9 tempest-VolumesTransfersTest-170828364 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:13:05 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-e728c0bd-5d7f-40a3-aced-ded091e428b9 tempest-VolumesTransfersTest-170828364 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:13:05 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-e728c0bd-5d7f-40a3-aced-ded091e428b9 tempest-VolumesTransfersTest-170828364 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:13:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1782068570',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12b46770-5b5b-4f12-b072-1b1c757cda59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0705e3809f844464b280b15a6b730702',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:13:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:13:05Z,use_quota=True,user_id='5ab07b78eea04c6bb436ed09b08fcc2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)}" {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 06:13:05 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-e728c0bd-5d7f-40a3-aced-ded091e428b9 tempest-VolumesTransfersTest-170828364 None] Creating volume 12b46770-5b5b-4f12-b072-1b1c757cda59 {{(pid=88695) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 06:13:05 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-e728c0bd-5d7f-40a3-aced-ded091e428b9 tempest-VolumesTransfersTest-170828364 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:13:05 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-e728c0bd-5d7f-40a3-aced-ded091e428b9 tempest-VolumesTransfersTest-170828364 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:13:05 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-e728c0bd-5d7f-40a3-aced-ded091e428b9 tempest-VolumesTransfersTest-170828364 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:13:05 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-e728c0bd-5d7f-40a3-aced-ded091e428b9 tempest-VolumesTransfersTest-170828364 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:13:05 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-e728c0bd-5d7f-40a3-aced-ded091e428b9 tempest-VolumesTransfersTest-170828364 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:13:05 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-e728c0bd-5d7f-40a3-aced-ded091e428b9 tempest-VolumesTransfersTest-170828364 None] Selected osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 as target Quobyte volume. {{(pid=88695) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 06:13:05 devstack cinder-volume[88695]: INFO cinder.volume.drivers.remotefs [None req-e728c0bd-5d7f-40a3-aced-ded091e428b9 tempest-VolumesTransfersTest-170828364 None] casted to osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 Aug 05 06:13:05 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-e728c0bd-5d7f-40a3-aced-ded091e428b9 tempest-VolumesTransfersTest-170828364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-12b46770-5b5b-4f12-b072-1b1c757cda59 1073741824 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:13:05 devstack sudo[92318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-12b46770-5b5b-4f12-b072-1b1c757cda59 1073741824 Aug 05 06:13:05 devstack sudo[92318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:13:05 devstack cinder-volume[88695]: INFO cinder.volume.manager [req-fe4df294-1a63-483b-94be-fe61d405737b req-10babee6-0396-4c3a-a2b4-029ef595162f tempest-TaggedAttachmentsTest-306183043 None] Terminate volume connection completed successfully. Aug 05 06:13:05 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [req-fe4df294-1a63-483b-94be-fe61d405737b req-10babee6-0396-4c3a-a2b4-029ef595162f tempest-TaggedAttachmentsTest-306183043 None] Deleting attachment a397e274-029e-4918-90e0-2f456a7643cd. {{(pid=88695) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 05 06:13:05 devstack sudo[92318]: pam_unix(sudo:session): session closed for user root Aug 05 06:13:05 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-e728c0bd-5d7f-40a3-aced-ded091e428b9 tempest-VolumesTransfersTest-170828364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-12b46770-5b5b-4f12-b072-1b1c757cda59 1073741824" returned: 0 in 0.732s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:13:05 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-e728c0bd-5d7f-40a3-aced-ded091e428b9 tempest-VolumesTransfersTest-170828364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-12b46770-5b5b-4f12-b072-1b1c757cda59 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:13:05 devstack sudo[92369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-12b46770-5b5b-4f12-b072-1b1c757cda59 Aug 05 06:13:05 devstack sudo[92369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:13:06 devstack sudo[92369]: pam_unix(sudo:session): session closed for user root Aug 05 06:13:06 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-e728c0bd-5d7f-40a3-aced-ded091e428b9 tempest-VolumesTransfersTest-170828364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-12b46770-5b5b-4f12-b072-1b1c757cda59" returned: 0 in 0.603s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:13:06 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-e728c0bd-5d7f-40a3-aced-ded091e428b9 tempest-VolumesTransfersTest-170828364 None] <== create_volume: return (1429ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'} {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 06:13:06 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-e728c0bd-5d7f-40a3-aced-ded091e428b9 tempest-VolumesTransfersTest-170828364 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.446s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:13:06 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-e728c0bd-5d7f-40a3-aced-ded091e428b9 tempest-VolumesTransfersTest-170828364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e34e267e-ec7f-4828-bb9f-288d5b35fdc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12b46770-5b5b-4f12-b072-1b1c757cda59', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:13:06 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-e728c0bd-5d7f-40a3-aced-ded091e428b9 tempest-VolumesTransfersTest-170828364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1143685-7c06-4495-b8d5-3e94ae2ae1d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:13:06 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-e728c0bd-5d7f-40a3-aced-ded091e428b9 tempest-VolumesTransfersTest-170828364 None] Volume volume-12b46770-5b5b-4f12-b072-1b1c757cda59 (12b46770-5b5b-4f12-b072-1b1c757cda59): created successfully Aug 05 06:13:06 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-e728c0bd-5d7f-40a3-aced-ded091e428b9 tempest-VolumesTransfersTest-170828364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1143685-7c06-4495-b8d5-3e94ae2ae1d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:13:06 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-e728c0bd-5d7f-40a3-aced-ded091e428b9 tempest-VolumesTransfersTest-170828364 None] Flow 'volume_create_manager' (bc8bb156-3c60-4bf9-8f8b-1ebf785812da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:13:06 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-e728c0bd-5d7f-40a3-aced-ded091e428b9 tempest-VolumesTransfersTest-170828364 None] Created volume successfully. Aug 05 06:13:07 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-3a48304f-13ca-4c65-b4fd-2f4c09f2c4b0 tempest-VolumesTransfersTest-1480389806 None] Acquiring lock "cinder-12b46770-5b5b-4f12-b072-1b1c757cda59-delete_volume" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:13:07 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-3a48304f-13ca-4c65-b4fd-2f4c09f2c4b0 tempest-VolumesTransfersTest-1480389806 None] Lock "cinder-12b46770-5b5b-4f12-b072-1b1c757cda59-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:13:07 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-3a48304f-13ca-4c65-b4fd-2f4c09f2c4b0 tempest-VolumesTransfersTest-1480389806 None] Acquiring lock "cinder-quobyte-12b46770-5b5b-4f12-b072-1b1c757cda59" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:13:07 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-3a48304f-13ca-4c65-b4fd-2f4c09f2c4b0 tempest-VolumesTransfersTest-1480389806 None] Lock "cinder-quobyte-12b46770-5b5b-4f12-b072-1b1c757cda59" acquired by "delete_volume" :: waited 0.023s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:13:07 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[b43f9fc1-86ef-482a-b08e-583f5860360a]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:13:07 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-3a48304f-13ca-4c65-b4fd-2f4c09f2c4b0 tempest-VolumesTransfersTest-1480389806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-12b46770-5b5b-4f12-b072-1b1c757cda59 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:13:07 devstack sudo[92393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-12b46770-5b5b-4f12-b072-1b1c757cda59 Aug 05 06:13:07 devstack sudo[92393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:13:08 devstack sudo[92393]: pam_unix(sudo:session): session closed for user root Aug 05 06:13:08 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-3a48304f-13ca-4c65-b4fd-2f4c09f2c4b0 tempest-VolumesTransfersTest-1480389806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-12b46770-5b5b-4f12-b072-1b1c757cda59" returned: 0 in 0.549s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:13:08 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-3a48304f-13ca-4c65-b4fd-2f4c09f2c4b0 tempest-VolumesTransfersTest-1480389806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-12b46770-5b5b-4f12-b072-1b1c757cda59 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:13:08 devstack sudo[92400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-12b46770-5b5b-4f12-b072-1b1c757cda59 Aug 05 06:13:08 devstack sudo[92400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:13:08 devstack sudo[92400]: pam_unix(sudo:session): session closed for user root Aug 05 06:13:08 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-3a48304f-13ca-4c65-b4fd-2f4c09f2c4b0 tempest-VolumesTransfersTest-1480389806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-12b46770-5b5b-4f12-b072-1b1c757cda59" returned: 0 in 0.328s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:13:08 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-3a48304f-13ca-4c65-b4fd-2f4c09f2c4b0 tempest-VolumesTransfersTest-1480389806 None] Lock "cinder-quobyte-12b46770-5b5b-4f12-b072-1b1c757cda59" released by "delete_volume" :: held 0.924s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:13:08 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-3a48304f-13ca-4c65-b4fd-2f4c09f2c4b0 tempest-VolumesTransfersTest-1480389806 None] Created reservations ['24a28599-da3a-4b09-a398-83ccf19ef463', 'ad26ddad-a679-4428-bab7-e603368848de', 'e16a3569-2091-4b9e-8e86-7f1702cd9635', 'fd619f25-66c3-48d3-825a-1c9f100db7de'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:13:08 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-3a48304f-13ca-4c65-b4fd-2f4c09f2c4b0 tempest-VolumesTransfersTest-1480389806 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:13:08 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-3a48304f-13ca-4c65-b4fd-2f4c09f2c4b0 tempest-VolumesTransfersTest-1480389806 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:13:08 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-3a48304f-13ca-4c65-b4fd-2f4c09f2c4b0 tempest-VolumesTransfersTest-1480389806 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:13:08 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-3a48304f-13ca-4c65-b4fd-2f4c09f2c4b0 tempest-VolumesTransfersTest-1480389806 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:13:08 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-3a48304f-13ca-4c65-b4fd-2f4c09f2c4b0 tempest-VolumesTransfersTest-1480389806 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:13:08 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-3a48304f-13ca-4c65-b4fd-2f4c09f2c4b0 tempest-VolumesTransfersTest-1480389806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:13:08 devstack sudo[92404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce Aug 05 06:13:08 devstack sudo[92404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:13:08 devstack sudo[92404]: pam_unix(sudo:session): session closed for user root Aug 05 06:13:08 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-3a48304f-13ca-4c65-b4fd-2f4c09f2c4b0 tempest-VolumesTransfersTest-1480389806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce" returned: 0 in 0.255s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:13:08 devstack cinder-volume[88695]: DEBUG cinder.manager [None req-3a48304f-13ca-4c65-b4fd-2f4c09f2c4b0 tempest-VolumesTransfersTest-1480389806 None] Notifying Schedulers of capabilities ... {{(pid=88695) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 06:13:08 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-3a48304f-13ca-4c65-b4fd-2f4c09f2c4b0 tempest-VolumesTransfersTest-1480389806 None] Deleted volume successfully. Aug 05 06:13:08 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-3a48304f-13ca-4c65-b4fd-2f4c09f2c4b0 tempest-VolumesTransfersTest-1480389806 None] Lock "cinder-12b46770-5b5b-4f12-b072-1b1c757cda59-delete_volume" released by "delete_volume" :: held 1.456s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:13:11 devstack cinder-volume[88695]: DEBUG cinder.volume.flows.manager.create_volume [None req-fba4bdb7-50c2-4803-babb-44215ecffc69 tempest-VolumesActionsTest-545848188 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88695) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 06:13:11 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-fba4bdb7-50c2-4803-babb-44215ecffc69 tempest-VolumesActionsTest-545848188 None] Flow 'volume_create_manager' (7969876d-3a3a-4f6a-9bc0-b01e6c6a2e6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:13:11 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-fba4bdb7-50c2-4803-babb-44215ecffc69 tempest-VolumesActionsTest-545848188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9de846e5-8b9c-4d4b-b2e1-835dcf724496) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:13:11 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-fba4bdb7-50c2-4803-babb-44215ecffc69 tempest-VolumesActionsTest-545848188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9de846e5-8b9c-4d4b-b2e1-835dcf724496) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:13:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1098117675',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f853167c-debe-4f36-9d16-8fa376c5004d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68b0a1df657f4b0690c301044355740f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:13:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:13:12Z,use_quota=True,user_id='77edfcf72ae74a52ad25d45f132ab81d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:13:11 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-fba4bdb7-50c2-4803-babb-44215ecffc69 tempest-VolumesActionsTest-545848188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c21ec0b-df52-4139-a01c-553def10fa5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:13:11 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-fba4bdb7-50c2-4803-babb-44215ecffc69 tempest-VolumesActionsTest-545848188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c21ec0b-df52-4139-a01c-553def10fa5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:13:11 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-fba4bdb7-50c2-4803-babb-44215ecffc69 tempest-VolumesActionsTest-545848188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03577e99-50ef-4543-844f-a19e29304be7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:13:11 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-fba4bdb7-50c2-4803-babb-44215ecffc69 tempest-VolumesActionsTest-545848188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03577e99-50ef-4543-844f-a19e29304be7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f853167c-debe-4f36-9d16-8fa376c5004d', 'volume_name': 'volume-f853167c-debe-4f36-9d16-8fa376c5004d', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:13:11 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-fba4bdb7-50c2-4803-babb-44215ecffc69 tempest-VolumesActionsTest-545848188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6761e3d2-4a69-42af-82de-5fa55b9c1396) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:13:11 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-fba4bdb7-50c2-4803-babb-44215ecffc69 tempest-VolumesActionsTest-545848188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6761e3d2-4a69-42af-82de-5fa55b9c1396) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:13:11 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-fba4bdb7-50c2-4803-babb-44215ecffc69 tempest-VolumesActionsTest-545848188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28990763-5fb9-46c0-a87b-2e4cb2440c77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:13:11 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-fba4bdb7-50c2-4803-babb-44215ecffc69 tempest-VolumesActionsTest-545848188 None] Volume f853167c-debe-4f36-9d16-8fa376c5004d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f853167c-debe-4f36-9d16-8fa376c5004d', 'volume_size': 1} Aug 05 06:13:11 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-fba4bdb7-50c2-4803-babb-44215ecffc69 tempest-VolumesActionsTest-545848188 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:13:11 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-fba4bdb7-50c2-4803-babb-44215ecffc69 tempest-VolumesActionsTest-545848188 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:13:11 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-fba4bdb7-50c2-4803-babb-44215ecffc69 tempest-VolumesActionsTest-545848188 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:13:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1098117675',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f853167c-debe-4f36-9d16-8fa376c5004d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68b0a1df657f4b0690c301044355740f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:13:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:13:12Z,use_quota=True,user_id='77edfcf72ae74a52ad25d45f132ab81d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)}" {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 06:13:11 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-fba4bdb7-50c2-4803-babb-44215ecffc69 tempest-VolumesActionsTest-545848188 None] Creating volume f853167c-debe-4f36-9d16-8fa376c5004d {{(pid=88695) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 06:13:11 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-fba4bdb7-50c2-4803-babb-44215ecffc69 tempest-VolumesActionsTest-545848188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:13:11 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-fba4bdb7-50c2-4803-babb-44215ecffc69 tempest-VolumesActionsTest-545848188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:13:11 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-fba4bdb7-50c2-4803-babb-44215ecffc69 tempest-VolumesActionsTest-545848188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:13:11 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-fba4bdb7-50c2-4803-babb-44215ecffc69 tempest-VolumesActionsTest-545848188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:13:11 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-fba4bdb7-50c2-4803-babb-44215ecffc69 tempest-VolumesActionsTest-545848188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:13:11 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-fba4bdb7-50c2-4803-babb-44215ecffc69 tempest-VolumesActionsTest-545848188 None] Selected osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 as target Quobyte volume. {{(pid=88695) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 06:13:11 devstack cinder-volume[88695]: INFO cinder.volume.drivers.remotefs [None req-fba4bdb7-50c2-4803-babb-44215ecffc69 tempest-VolumesActionsTest-545848188 None] casted to osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 Aug 05 06:13:11 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-fba4bdb7-50c2-4803-babb-44215ecffc69 tempest-VolumesActionsTest-545848188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-f853167c-debe-4f36-9d16-8fa376c5004d 1073741824 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:13:12 devstack sudo[92460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-f853167c-debe-4f36-9d16-8fa376c5004d 1073741824 Aug 05 06:13:12 devstack sudo[92460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:13:12 devstack sudo[92460]: pam_unix(sudo:session): session closed for user root Aug 05 06:13:12 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-fba4bdb7-50c2-4803-babb-44215ecffc69 tempest-VolumesActionsTest-545848188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-f853167c-debe-4f36-9d16-8fa376c5004d 1073741824" returned: 0 in 0.496s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:13:12 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-fba4bdb7-50c2-4803-babb-44215ecffc69 tempest-VolumesActionsTest-545848188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-f853167c-debe-4f36-9d16-8fa376c5004d {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:13:12 devstack sudo[92466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-f853167c-debe-4f36-9d16-8fa376c5004d Aug 05 06:13:12 devstack sudo[92466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:13:12 devstack sudo[92466]: pam_unix(sudo:session): session closed for user root Aug 05 06:13:12 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-fba4bdb7-50c2-4803-babb-44215ecffc69 tempest-VolumesActionsTest-545848188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-f853167c-debe-4f36-9d16-8fa376c5004d" returned: 0 in 0.285s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:13:12 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-fba4bdb7-50c2-4803-babb-44215ecffc69 tempest-VolumesActionsTest-545848188 None] <== create_volume: return (826ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'} {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 06:13:12 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-fba4bdb7-50c2-4803-babb-44215ecffc69 tempest-VolumesActionsTest-545848188 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.829s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:13:12 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-fba4bdb7-50c2-4803-babb-44215ecffc69 tempest-VolumesActionsTest-545848188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28990763-5fb9-46c0-a87b-2e4cb2440c77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f853167c-debe-4f36-9d16-8fa376c5004d', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:13:12 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-fba4bdb7-50c2-4803-babb-44215ecffc69 tempest-VolumesActionsTest-545848188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (547d7787-b72a-4b99-a3a5-06e6a6baadba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:13:12 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-fba4bdb7-50c2-4803-babb-44215ecffc69 tempest-VolumesActionsTest-545848188 None] Volume volume-f853167c-debe-4f36-9d16-8fa376c5004d (f853167c-debe-4f36-9d16-8fa376c5004d): created successfully Aug 05 06:13:12 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-fba4bdb7-50c2-4803-babb-44215ecffc69 tempest-VolumesActionsTest-545848188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (547d7787-b72a-4b99-a3a5-06e6a6baadba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:13:12 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-fba4bdb7-50c2-4803-babb-44215ecffc69 tempest-VolumesActionsTest-545848188 None] Flow 'volume_create_manager' (7969876d-3a3a-4f6a-9bc0-b01e6c6a2e6f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:13:12 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-fba4bdb7-50c2-4803-babb-44215ecffc69 tempest-VolumesActionsTest-545848188 None] Created volume successfully. Aug 05 06:13:14 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-a39cd2e4-9d83-4e87-86fe-82484fab067f tempest-TaggedAttachmentsTest-306183043 None] Acquiring lock "cinder-aeee006c-089d-4fcb-8275-e80f2bf1d441-delete_volume" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:13:14 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-a39cd2e4-9d83-4e87-86fe-82484fab067f tempest-TaggedAttachmentsTest-306183043 None] Lock "cinder-aeee006c-089d-4fcb-8275-e80f2bf1d441-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:13:15 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-a39cd2e4-9d83-4e87-86fe-82484fab067f tempest-TaggedAttachmentsTest-306183043 None] Acquiring lock "cinder-quobyte-aeee006c-089d-4fcb-8275-e80f2bf1d441" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:13:15 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-a39cd2e4-9d83-4e87-86fe-82484fab067f tempest-TaggedAttachmentsTest-306183043 None] Lock "cinder-quobyte-aeee006c-089d-4fcb-8275-e80f2bf1d441" acquired by "delete_volume" :: waited 0.025s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:13:15 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[04fcd2b3-da04-4c38-9ff2-37cb180f5a3c]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:13:15 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-a39cd2e4-9d83-4e87-86fe-82484fab067f tempest-TaggedAttachmentsTest-306183043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-aeee006c-089d-4fcb-8275-e80f2bf1d441 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:13:15 devstack sudo[92470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-aeee006c-089d-4fcb-8275-e80f2bf1d441 Aug 05 06:13:15 devstack sudo[92470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:13:15 devstack sudo[92470]: pam_unix(sudo:session): session closed for user root Aug 05 06:13:15 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-a39cd2e4-9d83-4e87-86fe-82484fab067f tempest-TaggedAttachmentsTest-306183043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-aeee006c-089d-4fcb-8275-e80f2bf1d441" returned: 0 in 0.470s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:13:15 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-a39cd2e4-9d83-4e87-86fe-82484fab067f tempest-TaggedAttachmentsTest-306183043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-aeee006c-089d-4fcb-8275-e80f2bf1d441 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:13:15 devstack sudo[92476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-aeee006c-089d-4fcb-8275-e80f2bf1d441 Aug 05 06:13:15 devstack sudo[92476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:13:15 devstack sudo[92476]: pam_unix(sudo:session): session closed for user root Aug 05 06:13:15 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-a39cd2e4-9d83-4e87-86fe-82484fab067f tempest-TaggedAttachmentsTest-306183043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-aeee006c-089d-4fcb-8275-e80f2bf1d441" returned: 0 in 0.420s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:13:16 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-a39cd2e4-9d83-4e87-86fe-82484fab067f tempest-TaggedAttachmentsTest-306183043 None] Lock "cinder-quobyte-aeee006c-089d-4fcb-8275-e80f2bf1d441" released by "delete_volume" :: held 0.964s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:13:16 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-a39cd2e4-9d83-4e87-86fe-82484fab067f tempest-TaggedAttachmentsTest-306183043 None] Created reservations ['ecddfb8c-8bb2-4552-87c4-3d4e6f9b1877', '67a7010a-16d9-439a-ad8f-637138d62b58', '35ae1260-c599-4a17-9158-97aa098c1e6f', '02275a17-616a-4b3e-ad92-a8048ecca376'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:13:16 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-a39cd2e4-9d83-4e87-86fe-82484fab067f tempest-TaggedAttachmentsTest-306183043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:13:16 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-a39cd2e4-9d83-4e87-86fe-82484fab067f tempest-TaggedAttachmentsTest-306183043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:13:16 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-a39cd2e4-9d83-4e87-86fe-82484fab067f tempest-TaggedAttachmentsTest-306183043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:13:16 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-a39cd2e4-9d83-4e87-86fe-82484fab067f tempest-TaggedAttachmentsTest-306183043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:13:16 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-a39cd2e4-9d83-4e87-86fe-82484fab067f tempest-TaggedAttachmentsTest-306183043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:13:16 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-a39cd2e4-9d83-4e87-86fe-82484fab067f tempest-TaggedAttachmentsTest-306183043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:13:16 devstack sudo[92482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce Aug 05 06:13:16 devstack sudo[92482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:13:16 devstack sudo[92482]: pam_unix(sudo:session): session closed for user root Aug 05 06:13:16 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-a39cd2e4-9d83-4e87-86fe-82484fab067f tempest-TaggedAttachmentsTest-306183043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce" returned: 0 in 0.364s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:13:16 devstack cinder-volume[88695]: DEBUG cinder.manager [None req-a39cd2e4-9d83-4e87-86fe-82484fab067f tempest-TaggedAttachmentsTest-306183043 None] Notifying Schedulers of capabilities ... {{(pid=88695) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 06:13:16 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-a39cd2e4-9d83-4e87-86fe-82484fab067f tempest-TaggedAttachmentsTest-306183043 None] Deleted volume successfully. Aug 05 06:13:16 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-a39cd2e4-9d83-4e87-86fe-82484fab067f tempest-TaggedAttachmentsTest-306183043 None] Lock "cinder-aeee006c-089d-4fcb-8275-e80f2bf1d441-delete_volume" released by "delete_volume" :: held 1.780s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:13:18 devstack cinder-volume[88695]: DEBUG cinder.volume.flows.manager.create_volume [None req-de195194-5182-4527-8656-9e0a5ce38508 tempest-VolumesCloneNegativeTest-1514272687 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88695) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 06:13:18 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-de195194-5182-4527-8656-9e0a5ce38508 tempest-VolumesCloneNegativeTest-1514272687 None] Flow 'volume_create_manager' (193ebe64-9523-477f-aa8a-d5d7f71825e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:13:18 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-de195194-5182-4527-8656-9e0a5ce38508 tempest-VolumesCloneNegativeTest-1514272687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51edd94f-9040-4d7a-9484-8031be78be58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:13:18 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-de195194-5182-4527-8656-9e0a5ce38508 tempest-VolumesCloneNegativeTest-1514272687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51edd94f-9040-4d7a-9484-8031be78be58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:13:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1639566509',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b087fa0-2880-4394-a537-ad9340fc5498,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26960788f0034386a3de08676c112483',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:13:18Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:13:18Z,use_quota=True,user_id='0850eccda9434c0795b94fc6aea78ad1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:13:18 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-de195194-5182-4527-8656-9e0a5ce38508 tempest-VolumesCloneNegativeTest-1514272687 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0df3653b-2108-4755-a0c6-2cb5ba5799c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:13:18 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-de195194-5182-4527-8656-9e0a5ce38508 tempest-VolumesCloneNegativeTest-1514272687 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0df3653b-2108-4755-a0c6-2cb5ba5799c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:13:18 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-de195194-5182-4527-8656-9e0a5ce38508 tempest-VolumesCloneNegativeTest-1514272687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c54afa4e-6894-48b5-a0f2-7ee782ee60db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:13:18 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-de195194-5182-4527-8656-9e0a5ce38508 tempest-VolumesCloneNegativeTest-1514272687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c54afa4e-6894-48b5-a0f2-7ee782ee60db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b087fa0-2880-4394-a537-ad9340fc5498', 'volume_name': 'volume-3b087fa0-2880-4394-a537-ad9340fc5498', 'volume_size': 2}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:13:18 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-de195194-5182-4527-8656-9e0a5ce38508 tempest-VolumesCloneNegativeTest-1514272687 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72e1793c-ea6d-44ba-8681-88add40e42ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:13:18 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-de195194-5182-4527-8656-9e0a5ce38508 tempest-VolumesCloneNegativeTest-1514272687 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72e1793c-ea6d-44ba-8681-88add40e42ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:13:18 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-de195194-5182-4527-8656-9e0a5ce38508 tempest-VolumesCloneNegativeTest-1514272687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (938d9f1e-67d2-4b5a-868f-b78f2ac41692) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:13:18 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-de195194-5182-4527-8656-9e0a5ce38508 tempest-VolumesCloneNegativeTest-1514272687 None] Volume 3b087fa0-2880-4394-a537-ad9340fc5498: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b087fa0-2880-4394-a537-ad9340fc5498', 'volume_size': 2} Aug 05 06:13:18 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-de195194-5182-4527-8656-9e0a5ce38508 tempest-VolumesCloneNegativeTest-1514272687 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:13:18 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-de195194-5182-4527-8656-9e0a5ce38508 tempest-VolumesCloneNegativeTest-1514272687 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:13:18 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-de195194-5182-4527-8656-9e0a5ce38508 tempest-VolumesCloneNegativeTest-1514272687 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:13:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1639566509',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b087fa0-2880-4394-a537-ad9340fc5498,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26960788f0034386a3de08676c112483',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:13:18Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:13:18Z,use_quota=True,user_id='0850eccda9434c0795b94fc6aea78ad1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)}" {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 06:13:18 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-de195194-5182-4527-8656-9e0a5ce38508 tempest-VolumesCloneNegativeTest-1514272687 None] Creating volume 3b087fa0-2880-4394-a537-ad9340fc5498 {{(pid=88695) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 06:13:18 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-de195194-5182-4527-8656-9e0a5ce38508 tempest-VolumesCloneNegativeTest-1514272687 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:13:18 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-de195194-5182-4527-8656-9e0a5ce38508 tempest-VolumesCloneNegativeTest-1514272687 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:13:18 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-de195194-5182-4527-8656-9e0a5ce38508 tempest-VolumesCloneNegativeTest-1514272687 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:13:18 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-de195194-5182-4527-8656-9e0a5ce38508 tempest-VolumesCloneNegativeTest-1514272687 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:13:18 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-de195194-5182-4527-8656-9e0a5ce38508 tempest-VolumesCloneNegativeTest-1514272687 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:13:18 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-de195194-5182-4527-8656-9e0a5ce38508 tempest-VolumesCloneNegativeTest-1514272687 None] Selected osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 as target Quobyte volume. {{(pid=88695) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 06:13:18 devstack cinder-volume[88695]: INFO cinder.volume.drivers.remotefs [None req-de195194-5182-4527-8656-9e0a5ce38508 tempest-VolumesCloneNegativeTest-1514272687 None] casted to osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 Aug 05 06:13:18 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-de195194-5182-4527-8656-9e0a5ce38508 tempest-VolumesCloneNegativeTest-1514272687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-3b087fa0-2880-4394-a537-ad9340fc5498 2147483648 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:13:18 devstack sudo[92507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-3b087fa0-2880-4394-a537-ad9340fc5498 2147483648 Aug 05 06:13:18 devstack sudo[92507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:13:19 devstack sudo[92507]: pam_unix(sudo:session): session closed for user root Aug 05 06:13:19 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-de195194-5182-4527-8656-9e0a5ce38508 tempest-VolumesCloneNegativeTest-1514272687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-3b087fa0-2880-4394-a537-ad9340fc5498 2147483648" returned: 0 in 0.655s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:13:19 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-de195194-5182-4527-8656-9e0a5ce38508 tempest-VolumesCloneNegativeTest-1514272687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-3b087fa0-2880-4394-a537-ad9340fc5498 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:13:19 devstack sudo[92513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-3b087fa0-2880-4394-a537-ad9340fc5498 Aug 05 06:13:19 devstack sudo[92513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:13:19 devstack sudo[92513]: pam_unix(sudo:session): session closed for user root Aug 05 06:13:19 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-de195194-5182-4527-8656-9e0a5ce38508 tempest-VolumesCloneNegativeTest-1514272687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-3b087fa0-2880-4394-a537-ad9340fc5498" returned: 0 in 0.306s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:13:19 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-de195194-5182-4527-8656-9e0a5ce38508 tempest-VolumesCloneNegativeTest-1514272687 None] <== create_volume: return (1020ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'} {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 06:13:19 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-de195194-5182-4527-8656-9e0a5ce38508 tempest-VolumesCloneNegativeTest-1514272687 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.023s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:13:19 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-de195194-5182-4527-8656-9e0a5ce38508 tempest-VolumesCloneNegativeTest-1514272687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (938d9f1e-67d2-4b5a-868f-b78f2ac41692) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b087fa0-2880-4394-a537-ad9340fc5498', 'volume_size': 2}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:13:19 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-de195194-5182-4527-8656-9e0a5ce38508 tempest-VolumesCloneNegativeTest-1514272687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (112e25a4-ab58-485f-94d2-afd02233d1e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:13:19 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-de195194-5182-4527-8656-9e0a5ce38508 tempest-VolumesCloneNegativeTest-1514272687 None] Volume volume-3b087fa0-2880-4394-a537-ad9340fc5498 (3b087fa0-2880-4394-a537-ad9340fc5498): created successfully Aug 05 06:13:19 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-de195194-5182-4527-8656-9e0a5ce38508 tempest-VolumesCloneNegativeTest-1514272687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (112e25a4-ab58-485f-94d2-afd02233d1e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:13:19 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-de195194-5182-4527-8656-9e0a5ce38508 tempest-VolumesCloneNegativeTest-1514272687 None] Flow 'volume_create_manager' (193ebe64-9523-477f-aa8a-d5d7f71825e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:13:19 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-de195194-5182-4527-8656-9e0a5ce38508 tempest-VolumesCloneNegativeTest-1514272687 None] Created volume successfully. Aug 05 06:13:20 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-0eb250f9-a27b-4c05-a589-712542b10e8d tempest-VolumesCloneNegativeTest-1514272687 None] Acquiring lock "cinder-3b087fa0-2880-4394-a537-ad9340fc5498-delete_volume" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:13:20 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-0eb250f9-a27b-4c05-a589-712542b10e8d tempest-VolumesCloneNegativeTest-1514272687 None] Lock "cinder-3b087fa0-2880-4394-a537-ad9340fc5498-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:13:20 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-0eb250f9-a27b-4c05-a589-712542b10e8d tempest-VolumesCloneNegativeTest-1514272687 None] Acquiring lock "cinder-quobyte-3b087fa0-2880-4394-a537-ad9340fc5498" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:13:20 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-0eb250f9-a27b-4c05-a589-712542b10e8d tempest-VolumesCloneNegativeTest-1514272687 None] Lock "cinder-quobyte-3b087fa0-2880-4394-a537-ad9340fc5498" acquired by "delete_volume" :: waited 0.019s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:13:20 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[30b7b431-7245-478e-a5ec-d98951e56fc4]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:13:20 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-0eb250f9-a27b-4c05-a589-712542b10e8d tempest-VolumesCloneNegativeTest-1514272687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-3b087fa0-2880-4394-a537-ad9340fc5498 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:13:21 devstack cinder-volume[88695]: INFO cinder.volume.manager [req-0ddd7023-7d7e-4a04-bc75-90c0eb14fd62 req-1da29a90-246f-4646-88db-79bc273dcd96 tempest-ServerActionsTestOtherA-886527270 None] Terminate volume connection completed successfully. Aug 05 06:13:21 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [req-0ddd7023-7d7e-4a04-bc75-90c0eb14fd62 req-1da29a90-246f-4646-88db-79bc273dcd96 tempest-ServerActionsTestOtherA-886527270 None] Deleting attachment 2df40583-88a7-4033-a744-a76eaaaba07d. {{(pid=88695) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 05 06:13:21 devstack sudo[92526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-3b087fa0-2880-4394-a537-ad9340fc5498 Aug 05 06:13:21 devstack sudo[92526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:13:21 devstack sudo[92526]: pam_unix(sudo:session): session closed for user root Aug 05 06:13:21 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-0eb250f9-a27b-4c05-a589-712542b10e8d tempest-VolumesCloneNegativeTest-1514272687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-3b087fa0-2880-4394-a537-ad9340fc5498" returned: 0 in 0.555s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:13:21 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-0eb250f9-a27b-4c05-a589-712542b10e8d tempest-VolumesCloneNegativeTest-1514272687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-3b087fa0-2880-4394-a537-ad9340fc5498 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:13:21 devstack sudo[92532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-3b087fa0-2880-4394-a537-ad9340fc5498 Aug 05 06:13:21 devstack sudo[92532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:13:21 devstack sudo[92532]: pam_unix(sudo:session): session closed for user root Aug 05 06:13:21 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-0eb250f9-a27b-4c05-a589-712542b10e8d tempest-VolumesCloneNegativeTest-1514272687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-3b087fa0-2880-4394-a537-ad9340fc5498" returned: 0 in 0.528s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:13:22 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-0eb250f9-a27b-4c05-a589-712542b10e8d tempest-VolumesCloneNegativeTest-1514272687 None] Lock "cinder-quobyte-3b087fa0-2880-4394-a537-ad9340fc5498" released by "delete_volume" :: held 1.160s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:13:22 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-0eb250f9-a27b-4c05-a589-712542b10e8d tempest-VolumesCloneNegativeTest-1514272687 None] Created reservations ['cf6e1b01-f661-40d8-a46d-e4e1d4a3fe82', '1c884874-a924-48a8-a873-f7b268d970f2', '2134d072-97bc-4a38-afcd-0c32fda37462', 'f0e36eec-0231-4634-888f-d77360450a3e'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:13:22 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-0eb250f9-a27b-4c05-a589-712542b10e8d tempest-VolumesCloneNegativeTest-1514272687 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:13:22 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-0eb250f9-a27b-4c05-a589-712542b10e8d tempest-VolumesCloneNegativeTest-1514272687 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:13:22 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-0eb250f9-a27b-4c05-a589-712542b10e8d tempest-VolumesCloneNegativeTest-1514272687 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:13:22 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-0eb250f9-a27b-4c05-a589-712542b10e8d tempest-VolumesCloneNegativeTest-1514272687 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:13:22 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-0eb250f9-a27b-4c05-a589-712542b10e8d tempest-VolumesCloneNegativeTest-1514272687 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:13:22 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-0eb250f9-a27b-4c05-a589-712542b10e8d tempest-VolumesCloneNegativeTest-1514272687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:13:22 devstack sudo[92578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce Aug 05 06:13:22 devstack sudo[92578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:13:22 devstack sudo[92578]: pam_unix(sudo:session): session closed for user root Aug 05 06:13:22 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-0eb250f9-a27b-4c05-a589-712542b10e8d tempest-VolumesCloneNegativeTest-1514272687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce" returned: 0 in 0.388s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:13:22 devstack cinder-volume[88695]: DEBUG cinder.manager [None req-0eb250f9-a27b-4c05-a589-712542b10e8d tempest-VolumesCloneNegativeTest-1514272687 None] Notifying Schedulers of capabilities ... {{(pid=88695) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 06:13:22 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-0eb250f9-a27b-4c05-a589-712542b10e8d tempest-VolumesCloneNegativeTest-1514272687 None] Deleted volume successfully. Aug 05 06:13:22 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-0eb250f9-a27b-4c05-a589-712542b10e8d tempest-VolumesCloneNegativeTest-1514272687 None] Lock "cinder-3b087fa0-2880-4394-a537-ad9340fc5498-delete_volume" released by "delete_volume" :: held 2.003s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:13:28 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-bd9f5e7c-7ec5-45ba-aac8-71f88da86642 tempest-VolumesActionsTest-545848188 None] Acquiring lock "cinder-f853167c-debe-4f36-9d16-8fa376c5004d" by "attach_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:13:28 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-bd9f5e7c-7ec5-45ba-aac8-71f88da86642 tempest-VolumesActionsTest-545848188 None] Lock "cinder-f853167c-debe-4f36-9d16-8fa376c5004d" acquired by "attach_volume" :: waited 0.031s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:13:28 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-bd9f5e7c-7ec5-45ba-aac8-71f88da86642 tempest-VolumesActionsTest-545848188 None] Attaching volume f853167c-debe-4f36-9d16-8fa376c5004d to instance a2316810-64d7-4966-8484-7fdbad51e70b at mountpoint /dev/vdb on host None. Aug 05 06:13:28 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-bd9f5e7c-7ec5-45ba-aac8-71f88da86642 tempest-VolumesActionsTest-545848188 None] Attach volume completed successfully. Aug 05 06:13:28 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-bd9f5e7c-7ec5-45ba-aac8-71f88da86642 tempest-VolumesActionsTest-545848188 None] Lock "cinder-f853167c-debe-4f36-9d16-8fa376c5004d" released by "attach_volume" :: held 0.143s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:13:28 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-f669c21f-2d2e-40a6-90a5-37ce77f0aba5 tempest-VolumesActionsTest-545848188 None] Acquiring lock "cinder-f853167c-debe-4f36-9d16-8fa376c5004d-detach_volume" by "detach_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:13:28 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-f669c21f-2d2e-40a6-90a5-37ce77f0aba5 tempest-VolumesActionsTest-545848188 None] Lock "cinder-f853167c-debe-4f36-9d16-8fa376c5004d-detach_volume" acquired by "detach_volume" :: waited 0.025s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:13:28 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-f669c21f-2d2e-40a6-90a5-37ce77f0aba5 tempest-VolumesActionsTest-545848188 None] Detaching volume f853167c-debe-4f36-9d16-8fa376c5004d from instance a2316810-64d7-4966-8484-7fdbad51e70b. Aug 05 06:13:28 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-f669c21f-2d2e-40a6-90a5-37ce77f0aba5 tempest-VolumesActionsTest-545848188 None] Detach volume completed successfully. Aug 05 06:13:28 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-f669c21f-2d2e-40a6-90a5-37ce77f0aba5 tempest-VolumesActionsTest-545848188 None] Lock "cinder-f853167c-debe-4f36-9d16-8fa376c5004d-detach_volume" released by "detach_volume" :: held 0.087s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:13:31 devstack cinder-volume[88695]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ffa8ccc-37f7-4c40-bbf2-21941b5ca598 tempest-ServerActionsTestOtherA-886527270 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88695) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 06:13:31 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-2ffa8ccc-37f7-4c40-bbf2-21941b5ca598 tempest-ServerActionsTestOtherA-886527270 None] Flow 'volume_create_manager' (6bd8c8e6-f41c-453a-934d-e44b67456869) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:13:31 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-2ffa8ccc-37f7-4c40-bbf2-21941b5ca598 tempest-ServerActionsTestOtherA-886527270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5b8fffd-a163-4071-b7c5-5bcb10a6cf17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:13:31 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-2ffa8ccc-37f7-4c40-bbf2-21941b5ca598 tempest-ServerActionsTestOtherA-886527270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5b8fffd-a163-4071-b7c5-5bcb10a6cf17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:13:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1472154243',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36d2290d-861b-4b93-95e6-e660ba0e5f20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48aa670bb92f44baaaf6546ea973001f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:13:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:13:31Z,use_quota=True,user_id='8b6dd2a8909447b5bb2458742b7d5922',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:13:31 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-2ffa8ccc-37f7-4c40-bbf2-21941b5ca598 tempest-ServerActionsTestOtherA-886527270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (734eb9fe-97c3-4f37-b0c1-20f96e71e3d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:13:31 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-2ffa8ccc-37f7-4c40-bbf2-21941b5ca598 tempest-ServerActionsTestOtherA-886527270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (734eb9fe-97c3-4f37-b0c1-20f96e71e3d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:13:31 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-2ffa8ccc-37f7-4c40-bbf2-21941b5ca598 tempest-ServerActionsTestOtherA-886527270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c87e80b0-5981-4ca0-93aa-c132d9cef1b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:13:31 devstack cinder-volume[88695]: DEBUG cinder.image.glance [None req-2ffa8ccc-37f7-4c40-bbf2-21941b5ca598 tempest-ServerActionsTestOtherA-886527270 None] Creating Keystone auth plugin from conf {{(pid=88695) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 05 06:13:32 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-2ffa8ccc-37f7-4c40-bbf2-21941b5ca598 tempest-ServerActionsTestOtherA-886527270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c87e80b0-5981-4ca0-93aa-c132d9cef1b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '36d2290d-861b-4b93-95e6-e660ba0e5f20', 'volume_name': 'volume-36d2290d-861b-4b93-95e6-e660ba0e5f20', 'volume_size': 1, 'image_id': '02d74946-ca9b-46cd-a590-fddaad1baed9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/02d74946-ca9b-46cd-a590-fddaad1baed9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '45a6d5bbcac24d598455fe1cd77a6beb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '02d74946-ca9b-46cd-a590-fddaad1baed9', 'created_at': datetime.datetime(2026, 8, 5, 4, 5, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 5, 4, 5, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/02d74946-ca9b-46cd-a590-fddaad1baed9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:13:32 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-2ffa8ccc-37f7-4c40-bbf2-21941b5ca598 tempest-ServerActionsTestOtherA-886527270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a66c314-f234-43e9-b030-f515656f5846) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:13:32 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-2ffa8ccc-37f7-4c40-bbf2-21941b5ca598 tempest-ServerActionsTestOtherA-886527270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a66c314-f234-43e9-b030-f515656f5846) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:13:32 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-2ffa8ccc-37f7-4c40-bbf2-21941b5ca598 tempest-ServerActionsTestOtherA-886527270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (056635c4-5039-4e6c-9342-baef542a000f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:13:32 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-2ffa8ccc-37f7-4c40-bbf2-21941b5ca598 tempest-ServerActionsTestOtherA-886527270 None] Volume 36d2290d-861b-4b93-95e6-e660ba0e5f20: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-36d2290d-861b-4b93-95e6-e660ba0e5f20', 'volume_size': 1, 'image_id': '02d74946-ca9b-46cd-a590-fddaad1baed9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/02d74946-ca9b-46cd-a590-fddaad1baed9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '45a6d5bbcac24d598455fe1cd77a6beb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '02d74946-ca9b-46cd-a590-fddaad1baed9', 'created_at': datetime.datetime(2026, 8, 5, 4, 5, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 5, 4, 5, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/02d74946-ca9b-46cd-a590-fddaad1baed9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Aug 05 06:13:32 devstack cinder-volume[88695]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ffa8ccc-37f7-4c40-bbf2-21941b5ca598 tempest-ServerActionsTestOtherA-886527270 None] Trying to clone 36d2290d-861b-4b93-95e6-e660ba0e5f20 from image 02d74946-ca9b-46cd-a590-fddaad1baed9 at location (None, [{'url': 'file:///opt/stack/data/glance/images/02d74946-ca9b-46cd-a590-fddaad1baed9', 'metadata': {}}]). {{(pid=88695) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 05 06:13:32 devstack cinder-volume[88695]: DEBUG cinder.image.image_utils [None req-2ffa8ccc-37f7-4c40-bbf2-21941b5ca598 tempest-ServerActionsTestOtherA-886527270 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_02d74946-ca9b-46cd-a590-fddaad1baed9_q0i7532vdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=88695) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 05 06:13:32 devstack cinder-volume[88695]: INFO cinder.image.image_utils [None req-2ffa8ccc-37f7-4c40-bbf2-21941b5ca598 tempest-ServerActionsTestOtherA-886527270 None] Image download 20.69 MB at 20.69 MB/s Aug 05 06:13:32 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[84b95d81-c4ef-446d-b392-cee6dfaae349]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:13:32 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-2ffa8ccc-37f7-4c40-bbf2-21941b5ca598 tempest-ServerActionsTestOtherA-886527270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_02d74946-ca9b-46cd-a590-fddaad1baed9_q0i7532vdevstack@QuobyteHD {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:13:32 devstack sudo[92724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_02d74946-ca9b-46cd-a590-fddaad1baed9_q0i7532vdevstack@QuobyteHD Aug 05 06:13:32 devstack sudo[92724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:13:33 devstack sudo[92724]: pam_unix(sudo:session): session closed for user root Aug 05 06:13:33 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-2ffa8ccc-37f7-4c40-bbf2-21941b5ca598 tempest-ServerActionsTestOtherA-886527270 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_02d74946-ca9b-46cd-a590-fddaad1baed9_q0i7532vdevstack@QuobyteHD" returned: 0 in 0.380s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:13:33 devstack cinder-volume[88695]: DEBUG cinder.image.image_utils [None req-2ffa8ccc-37f7-4c40-bbf2-21941b5ca598 tempest-ServerActionsTestOtherA-886527270 None] Temporary image 02d74946-ca9b-46cd-a590-fddaad1baed9 is fetched for user 8b6dd2a8909447b5bb2458742b7d5922. {{(pid=88695) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 05 06:13:33 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[32973108-c372-4716-914b-a89ffb3387ac]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:13:33 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-2ffa8ccc-37f7-4c40-bbf2-21941b5ca598 tempest-ServerActionsTestOtherA-886527270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_02d74946-ca9b-46cd-a590-fddaad1baed9_q0i7532vdevstack@QuobyteHD {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:13:33 devstack sudo[92729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_02d74946-ca9b-46cd-a590-fddaad1baed9_q0i7532vdevstack@QuobyteHD Aug 05 06:13:33 devstack sudo[92729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:13:33 devstack sudo[92729]: pam_unix(sudo:session): session closed for user root Aug 05 06:13:33 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-2ffa8ccc-37f7-4c40-bbf2-21941b5ca598 tempest-ServerActionsTestOtherA-886527270 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_02d74946-ca9b-46cd-a590-fddaad1baed9_q0i7532vdevstack@QuobyteHD" returned: 0 in 0.461s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:13:33 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-2ffa8ccc-37f7-4c40-bbf2-21941b5ca598 tempest-ServerActionsTestOtherA-886527270 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:13:33 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-2ffa8ccc-37f7-4c40-bbf2-21941b5ca598 tempest-ServerActionsTestOtherA-886527270 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:13:33 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-2ffa8ccc-37f7-4c40-bbf2-21941b5ca598 tempest-ServerActionsTestOtherA-886527270 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:13:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1472154243',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36d2290d-861b-4b93-95e6-e660ba0e5f20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48aa670bb92f44baaaf6546ea973001f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:13:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:13:31Z,use_quota=True,user_id='8b6dd2a8909447b5bb2458742b7d5922',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)}" {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 06:13:33 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-2ffa8ccc-37f7-4c40-bbf2-21941b5ca598 tempest-ServerActionsTestOtherA-886527270 None] Creating volume 36d2290d-861b-4b93-95e6-e660ba0e5f20 {{(pid=88695) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 06:13:33 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-2ffa8ccc-37f7-4c40-bbf2-21941b5ca598 tempest-ServerActionsTestOtherA-886527270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:13:33 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-2ffa8ccc-37f7-4c40-bbf2-21941b5ca598 tempest-ServerActionsTestOtherA-886527270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:13:33 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-2ffa8ccc-37f7-4c40-bbf2-21941b5ca598 tempest-ServerActionsTestOtherA-886527270 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:13:33 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-2ffa8ccc-37f7-4c40-bbf2-21941b5ca598 tempest-ServerActionsTestOtherA-886527270 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:13:33 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-2ffa8ccc-37f7-4c40-bbf2-21941b5ca598 tempest-ServerActionsTestOtherA-886527270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:13:33 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-2ffa8ccc-37f7-4c40-bbf2-21941b5ca598 tempest-ServerActionsTestOtherA-886527270 None] Selected osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 as target Quobyte volume. {{(pid=88695) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 06:13:33 devstack cinder-volume[88695]: INFO cinder.volume.drivers.remotefs [None req-2ffa8ccc-37f7-4c40-bbf2-21941b5ca598 tempest-ServerActionsTestOtherA-886527270 None] casted to osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 Aug 05 06:13:33 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-2ffa8ccc-37f7-4c40-bbf2-21941b5ca598 tempest-ServerActionsTestOtherA-886527270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-36d2290d-861b-4b93-95e6-e660ba0e5f20 1073741824 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:13:33 devstack sudo[92738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-36d2290d-861b-4b93-95e6-e660ba0e5f20 1073741824 Aug 05 06:13:33 devstack sudo[92738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:13:34 devstack sudo[92738]: pam_unix(sudo:session): session closed for user root Aug 05 06:13:34 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-2ffa8ccc-37f7-4c40-bbf2-21941b5ca598 tempest-ServerActionsTestOtherA-886527270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-36d2290d-861b-4b93-95e6-e660ba0e5f20 1073741824" returned: 0 in 0.553s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:13:34 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-2ffa8ccc-37f7-4c40-bbf2-21941b5ca598 tempest-ServerActionsTestOtherA-886527270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-36d2290d-861b-4b93-95e6-e660ba0e5f20 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:13:34 devstack sudo[92746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-36d2290d-861b-4b93-95e6-e660ba0e5f20 Aug 05 06:13:34 devstack sudo[92746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:13:34 devstack sudo[92746]: pam_unix(sudo:session): session closed for user root Aug 05 06:13:34 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-2ffa8ccc-37f7-4c40-bbf2-21941b5ca598 tempest-ServerActionsTestOtherA-886527270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-36d2290d-861b-4b93-95e6-e660ba0e5f20" returned: 0 in 0.314s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:13:34 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-2ffa8ccc-37f7-4c40-bbf2-21941b5ca598 tempest-ServerActionsTestOtherA-886527270 None] <== create_volume: return (922ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'} {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 06:13:34 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-2ffa8ccc-37f7-4c40-bbf2-21941b5ca598 tempest-ServerActionsTestOtherA-886527270 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.927s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:13:34 devstack cinder-volume[88695]: DEBUG cinder.volume.volume_utils [None req-2ffa8ccc-37f7-4c40-bbf2-21941b5ca598 tempest-ServerActionsTestOtherA-886527270 None] Attempting download of 02d74946-ca9b-46cd-a590-fddaad1baed9 ((None, [{'url': 'file:///opt/stack/data/glance/images/02d74946-ca9b-46cd-a590-fddaad1baed9', 'metadata': {}}])) to volume 36d2290d-861b-4b93-95e6-e660ba0e5f20. {{(pid=88695) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 05 06:13:34 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5803949-381d-4017-a1ce-dbb8961ce201]: (4, 'raw') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:13:34 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-2ffa8ccc-37f7-4c40-bbf2-21941b5ca598 tempest-ServerActionsTestOtherA-886527270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_02d74946-ca9b-46cd-a590-fddaad1baed9_d3leplok {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:13:34 devstack sudo[92749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_02d74946-ca9b-46cd-a590-fddaad1baed9_d3leplok Aug 05 06:13:34 devstack sudo[92749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:13:35 devstack sudo[92749]: pam_unix(sudo:session): session closed for user root Aug 05 06:13:35 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-2ffa8ccc-37f7-4c40-bbf2-21941b5ca598 tempest-ServerActionsTestOtherA-886527270 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_02d74946-ca9b-46cd-a590-fddaad1baed9_d3leplok" returned: 0 in 0.475s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:13:35 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-2ffa8ccc-37f7-4c40-bbf2-21941b5ca598 tempest-ServerActionsTestOtherA-886527270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_02d74946-ca9b-46cd-a590-fddaad1baed9_d3leplok {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:13:35 devstack sudo[92753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_02d74946-ca9b-46cd-a590-fddaad1baed9_d3leplok Aug 05 06:13:35 devstack sudo[92753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:13:35 devstack sudo[92753]: pam_unix(sudo:session): session closed for user root Aug 05 06:13:35 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-2ffa8ccc-37f7-4c40-bbf2-21941b5ca598 tempest-ServerActionsTestOtherA-886527270 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_02d74946-ca9b-46cd-a590-fddaad1baed9_d3leplok" returned: 1 in 0.451s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:13:35 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-2ffa8ccc-37f7-4c40-bbf2-21941b5ca598 tempest-ServerActionsTestOtherA-886527270 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_02d74946-ca9b-46cd-a590-fddaad1baed9_d3leplok' failed. Not Retrying. {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 05 06:13:35 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[614cd307-1d49-487c-990e-37ff52952436]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:13:35 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-2ffa8ccc-37f7-4c40-bbf2-21941b5ca598 tempest-ServerActionsTestOtherA-886527270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_02d74946-ca9b-46cd-a590-fddaad1baed9_q0i7532vdevstack@QuobyteHD {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:13:35 devstack sudo[92763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_02d74946-ca9b-46cd-a590-fddaad1baed9_q0i7532vdevstack@QuobyteHD Aug 05 06:13:35 devstack sudo[92763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:13:35 devstack sudo[92763]: pam_unix(sudo:session): session closed for user root Aug 05 06:13:35 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-2ffa8ccc-37f7-4c40-bbf2-21941b5ca598 tempest-ServerActionsTestOtherA-886527270 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_02d74946-ca9b-46cd-a590-fddaad1baed9_q0i7532vdevstack@QuobyteHD" returned: 0 in 0.408s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:13:36 devstack cinder-volume[88695]: DEBUG cinder.image.image_utils [None req-2ffa8ccc-37f7-4c40-bbf2-21941b5ca598 tempest-ServerActionsTestOtherA-886527270 None] 02d74946-ca9b-46cd-a590-fddaad1baed9 was qcow2, converting to qcow2 {{(pid=88695) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 05 06:13:36 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-2ffa8ccc-37f7-4c40-bbf2-21941b5ca598 tempest-ServerActionsTestOtherA-886527270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_02d74946-ca9b-46cd-a590-fddaad1baed9_q0i7532vdevstack@QuobyteHD /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-36d2290d-861b-4b93-95e6-e660ba0e5f20 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:13:36 devstack sudo[92779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_02d74946-ca9b-46cd-a590-fddaad1baed9_q0i7532vdevstack@QuobyteHD /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-36d2290d-861b-4b93-95e6-e660ba0e5f20 Aug 05 06:13:36 devstack sudo[92779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:13:38 devstack sudo[92779]: pam_unix(sudo:session): session closed for user root Aug 05 06:13:38 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-2ffa8ccc-37f7-4c40-bbf2-21941b5ca598 tempest-ServerActionsTestOtherA-886527270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_02d74946-ca9b-46cd-a590-fddaad1baed9_q0i7532vdevstack@QuobyteHD /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-36d2290d-861b-4b93-95e6-e660ba0e5f20" returned: 0 in 2.119s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:13:38 devstack cinder-volume[88695]: DEBUG cinder.image.image_utils [None req-2ffa8ccc-37f7-4c40-bbf2-21941b5ca598 tempest-ServerActionsTestOtherA-886527270 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_02d74946-ca9b-46cd-a590-fddaad1baed9_q0i7532vdevstack@QuobyteHD, size 112.00 MB, duration 2.12 sec, destination /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-36d2290d-861b-4b93-95e6-e660ba0e5f20 {{(pid=88695) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 05 06:13:38 devstack cinder-volume[88695]: INFO cinder.image.image_utils [None req-2ffa8ccc-37f7-4c40-bbf2-21941b5ca598 tempest-ServerActionsTestOtherA-886527270 None] Converted 112.00 MB image at 52.83 MB/s Aug 05 06:13:38 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-2ffa8ccc-37f7-4c40-bbf2-21941b5ca598 tempest-ServerActionsTestOtherA-886527270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-36d2290d-861b-4b93-95e6-e660ba0e5f20 1G {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:13:38 devstack sudo[92789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-36d2290d-861b-4b93-95e6-e660ba0e5f20 1G Aug 05 06:13:38 devstack sudo[92789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:13:38 devstack sudo[92789]: pam_unix(sudo:session): session closed for user root Aug 05 06:13:38 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-2ffa8ccc-37f7-4c40-bbf2-21941b5ca598 tempest-ServerActionsTestOtherA-886527270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-36d2290d-861b-4b93-95e6-e660ba0e5f20 1G" returned: 0 in 0.386s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:13:38 devstack cinder-volume[88695]: DEBUG cinder.volume.volume_utils [None req-2ffa8ccc-37f7-4c40-bbf2-21941b5ca598 tempest-ServerActionsTestOtherA-886527270 None] Downloaded image 02d74946-ca9b-46cd-a590-fddaad1baed9 ((None, [{'url': 'file:///opt/stack/data/glance/images/02d74946-ca9b-46cd-a590-fddaad1baed9', 'metadata': {}}])) to volume 36d2290d-861b-4b93-95e6-e660ba0e5f20 successfully. {{(pid=88695) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 05 06:13:38 devstack cinder-volume[88695]: DEBUG cinder.image.image_utils [None req-2ffa8ccc-37f7-4c40-bbf2-21941b5ca598 tempest-ServerActionsTestOtherA-886527270 None] Temporary image 02d74946-ca9b-46cd-a590-fddaad1baed9 for user 8b6dd2a8909447b5bb2458742b7d5922 is deleted. {{(pid=88695) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 05 06:13:38 devstack cinder-volume[88695]: DEBUG cinder.volume.volume_utils [None req-2ffa8ccc-37f7-4c40-bbf2-21941b5ca598 tempest-ServerActionsTestOtherA-886527270 None] Marking volume 36d2290d-861b-4b93-95e6-e660ba0e5f20 as bootable. {{(pid=88695) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 05 06:13:38 devstack cinder-volume[88695]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ffa8ccc-37f7-4c40-bbf2-21941b5ca598 tempest-ServerActionsTestOtherA-886527270 None] Copying metadata from image 02d74946-ca9b-46cd-a590-fddaad1baed9 to 36d2290d-861b-4b93-95e6-e660ba0e5f20. {{(pid=88695) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 05 06:13:38 devstack cinder-volume[88695]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ffa8ccc-37f7-4c40-bbf2-21941b5ca598 tempest-ServerActionsTestOtherA-886527270 None] Creating volume glance metadata for volume 36d2290d-861b-4b93-95e6-e660ba0e5f20 backed by image 02d74946-ca9b-46cd-a590-fddaad1baed9 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '02d74946-ca9b-46cd-a590-fddaad1baed9', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88695) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 05 06:13:38 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-2ffa8ccc-37f7-4c40-bbf2-21941b5ca598 tempest-ServerActionsTestOtherA-886527270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (056635c4-5039-4e6c-9342-baef542a000f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36d2290d-861b-4b93-95e6-e660ba0e5f20', 'volume_size': 1, 'image_id': '02d74946-ca9b-46cd-a590-fddaad1baed9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/02d74946-ca9b-46cd-a590-fddaad1baed9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '45a6d5bbcac24d598455fe1cd77a6beb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '02d74946-ca9b-46cd-a590-fddaad1baed9', 'created_at': datetime.datetime(2026, 8, 5, 4, 5, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 5, 4, 5, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/02d74946-ca9b-46cd-a590-fddaad1baed9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:13:38 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-2ffa8ccc-37f7-4c40-bbf2-21941b5ca598 tempest-ServerActionsTestOtherA-886527270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (896a4c88-cacf-48fc-bdf1-7886f87318c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:13:38 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-2ffa8ccc-37f7-4c40-bbf2-21941b5ca598 tempest-ServerActionsTestOtherA-886527270 None] Volume volume-36d2290d-861b-4b93-95e6-e660ba0e5f20 (36d2290d-861b-4b93-95e6-e660ba0e5f20): created successfully Aug 05 06:13:38 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-2ffa8ccc-37f7-4c40-bbf2-21941b5ca598 tempest-ServerActionsTestOtherA-886527270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (896a4c88-cacf-48fc-bdf1-7886f87318c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:13:38 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-2ffa8ccc-37f7-4c40-bbf2-21941b5ca598 tempest-ServerActionsTestOtherA-886527270 None] Flow 'volume_create_manager' (6bd8c8e6-f41c-453a-934d-e44b67456869) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:13:38 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-2ffa8ccc-37f7-4c40-bbf2-21941b5ca598 tempest-ServerActionsTestOtherA-886527270 None] Created volume successfully. Aug 05 06:13:48 devstack cinder-volume[88695]: DEBUG dbcounter [-] [88695] Writing DB stats cinder:UPDATE=60,cinder:DELETE=6,cinder:SELECT=63,cinder:INSERT=24 {{(pid=88695) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 06:13:48 devstack cinder-volume[88695]: DEBUG dbcounter [-] [88695] Writing DB stats cinder:UPDATE=70,cinder:SELECT=69,cinder:INSERT=17,cinder:DELETE=5 {{(pid=88695) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 06:13:49 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [req-09ae7d8d-ddb2-458b-b00f-29ed41de6ec8 req-7498ac78-3c01-4353-931a-ce0616cbb98e tempest-ServerActionsTestOtherA-886527270 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:13:49 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [req-09ae7d8d-ddb2-458b-b00f-29ed41de6ec8 req-7498ac78-3c01-4353-931a-ce0616cbb98e tempest-ServerActionsTestOtherA-886527270 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:13:49 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [req-09ae7d8d-ddb2-458b-b00f-29ed41de6ec8 req-7498ac78-3c01-4353-931a-ce0616cbb98e tempest-ServerActionsTestOtherA-886527270 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.025s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:13:49 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [req-09ae7d8d-ddb2-458b-b00f-29ed41de6ec8 req-7498ac78-3c01-4353-931a-ce0616cbb98e tempest-ServerActionsTestOtherA-886527270 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087', 'name': 'volume-36d2290d-861b-4b93-95e6-e660ba0e5f20', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '07049af0-017a-4341-99d3-7b12eeb960c6', 'enforce_multipath': True} {{(pid=88695) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 05 06:13:50 devstack cinder-volume[88695]: INFO cinder.volume.manager [req-09ae7d8d-ddb2-458b-b00f-29ed41de6ec8 req-7498ac78-3c01-4353-931a-ce0616cbb98e tempest-ServerActionsTestOtherA-886527270 None] attachment_update completed successfully. Aug 05 06:13:54 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-310a4ff1-11b3-4dec-9961-cb91f403453a tempest-VolumesActionsTest-545848188 None] Acquiring lock "cinder-f853167c-debe-4f36-9d16-8fa376c5004d" by "attach_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:13:54 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-310a4ff1-11b3-4dec-9961-cb91f403453a tempest-VolumesActionsTest-545848188 None] Lock "cinder-f853167c-debe-4f36-9d16-8fa376c5004d" acquired by "attach_volume" :: waited 0.021s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:13:54 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-310a4ff1-11b3-4dec-9961-cb91f403453a tempest-VolumesActionsTest-545848188 None] Attaching volume f853167c-debe-4f36-9d16-8fa376c5004d to instance 3e17da0a-fbee-47fc-87b6-f0b11d95bc89 at mountpoint /dev/vdb on host None. Aug 05 06:13:54 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-310a4ff1-11b3-4dec-9961-cb91f403453a tempest-VolumesActionsTest-545848188 None] Attach volume completed successfully. Aug 05 06:13:54 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-310a4ff1-11b3-4dec-9961-cb91f403453a tempest-VolumesActionsTest-545848188 None] Lock "cinder-f853167c-debe-4f36-9d16-8fa376c5004d" released by "attach_volume" :: held 0.120s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:13:55 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-21a92593-ed92-4975-a5d2-2a9a6050c052 tempest-VolumesActionsTest-545848188 None] Acquiring lock "cinder-f853167c-debe-4f36-9d16-8fa376c5004d-detach_volume" by "detach_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:13:55 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-21a92593-ed92-4975-a5d2-2a9a6050c052 tempest-VolumesActionsTest-545848188 None] Lock "cinder-f853167c-debe-4f36-9d16-8fa376c5004d-detach_volume" acquired by "detach_volume" :: waited 0.022s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:13:55 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-21a92593-ed92-4975-a5d2-2a9a6050c052 tempest-VolumesActionsTest-545848188 None] Detaching volume f853167c-debe-4f36-9d16-8fa376c5004d from instance 3e17da0a-fbee-47fc-87b6-f0b11d95bc89. Aug 05 06:13:55 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-21a92593-ed92-4975-a5d2-2a9a6050c052 tempest-VolumesActionsTest-545848188 None] Detach volume completed successfully. Aug 05 06:13:55 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-21a92593-ed92-4975-a5d2-2a9a6050c052 tempest-VolumesActionsTest-545848188 None] Lock "cinder-f853167c-debe-4f36-9d16-8fa376c5004d-detach_volume" released by "detach_volume" :: held 0.080s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:14:00 devstack cinder-volume[88695]: DEBUG oslo_service.periodic_task [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88695) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 06:14:00 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:14:00 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:14:00 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:14:00 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:14:00 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:14:00 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:14:00 devstack sudo[93487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce Aug 05 06:14:00 devstack sudo[93487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:14:00 devstack sudo[93487]: pam_unix(sudo:session): session closed for user root Aug 05 06:14:00 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce" returned: 0 in 0.411s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:14:00 devstack cinder-volume[88695]: DEBUG cinder.manager [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] Notifying Schedulers of capabilities ... {{(pid=88695) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 06:14:00 devstack cinder-volume[88695]: DEBUG oslo_service.periodic_task [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] Running periodic task VolumeManager._thread_info {{(pid=88695) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 06:14:00 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] thread count: 28 {{(pid=88695) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 05 06:14:00 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] thread info: [<_MainThread(MainThread, started 134469211893888)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88695) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 05 06:14:05 devstack cinder-volume[88695]: DEBUG dbcounter [-] [88695] Writing DB stats cinder:SELECT=12,cinder:UPDATE=6,cinder:INSERT=1 {{(pid=88695) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 06:14:05 devstack cinder-volume[88695]: DEBUG dbcounter [-] [88695] Writing DB stats cinder:SELECT=15,cinder:UPDATE=4,cinder:INSERT=1 {{(pid=88695) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 06:14:06 devstack cinder-volume[88695]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d5375ea-d605-4368-b2cb-6e8c592084bc tempest-TestServerVolumeAttachmentScenario-1990739042 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88695) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 06:14:06 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-2d5375ea-d605-4368-b2cb-6e8c592084bc tempest-TestServerVolumeAttachmentScenario-1990739042 None] Flow 'volume_create_manager' (5150fdaf-c9fb-400f-ba75-d10154b8b7c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:14:06 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-2d5375ea-d605-4368-b2cb-6e8c592084bc tempest-TestServerVolumeAttachmentScenario-1990739042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29a04a4a-9799-448b-bb52-e374e41cd1e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:14:06 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-2d5375ea-d605-4368-b2cb-6e8c592084bc tempest-TestServerVolumeAttachmentScenario-1990739042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29a04a4a-9799-448b-bb52-e374e41cd1e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:14:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-197298020',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ca7847e-4c2c-4412-ab30-455f5e3215c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46f1919bed3c49f8b3c8704c0b642723',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:14:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:14:06Z,use_quota=True,user_id='f2f95514bc7841d29b6a8b5b4d0f809b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:14:06 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-2d5375ea-d605-4368-b2cb-6e8c592084bc tempest-TestServerVolumeAttachmentScenario-1990739042 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac9a594e-54b1-43c9-8ea7-06cc8f597906) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:14:06 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-2d5375ea-d605-4368-b2cb-6e8c592084bc tempest-TestServerVolumeAttachmentScenario-1990739042 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac9a594e-54b1-43c9-8ea7-06cc8f597906) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:14:06 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-2d5375ea-d605-4368-b2cb-6e8c592084bc tempest-TestServerVolumeAttachmentScenario-1990739042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4dcfe30e-53cd-47c6-aad2-8d895ef23f86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:14:06 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-2d5375ea-d605-4368-b2cb-6e8c592084bc tempest-TestServerVolumeAttachmentScenario-1990739042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4dcfe30e-53cd-47c6-aad2-8d895ef23f86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ca7847e-4c2c-4412-ab30-455f5e3215c4', 'volume_name': 'volume-4ca7847e-4c2c-4412-ab30-455f5e3215c4', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:14:06 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-2d5375ea-d605-4368-b2cb-6e8c592084bc tempest-TestServerVolumeAttachmentScenario-1990739042 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80124457-bca9-4e8b-9f96-3ca1577ec00a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:14:06 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-2d5375ea-d605-4368-b2cb-6e8c592084bc tempest-TestServerVolumeAttachmentScenario-1990739042 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80124457-bca9-4e8b-9f96-3ca1577ec00a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:14:06 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-2d5375ea-d605-4368-b2cb-6e8c592084bc tempest-TestServerVolumeAttachmentScenario-1990739042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a2393db-d8ad-46ed-aed0-5303151ae572) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:14:06 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-2d5375ea-d605-4368-b2cb-6e8c592084bc tempest-TestServerVolumeAttachmentScenario-1990739042 None] Volume 4ca7847e-4c2c-4412-ab30-455f5e3215c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ca7847e-4c2c-4412-ab30-455f5e3215c4', 'volume_size': 1} Aug 05 06:14:06 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-2d5375ea-d605-4368-b2cb-6e8c592084bc tempest-TestServerVolumeAttachmentScenario-1990739042 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:14:06 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-2d5375ea-d605-4368-b2cb-6e8c592084bc tempest-TestServerVolumeAttachmentScenario-1990739042 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:14:06 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-2d5375ea-d605-4368-b2cb-6e8c592084bc tempest-TestServerVolumeAttachmentScenario-1990739042 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:14:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-197298020',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ca7847e-4c2c-4412-ab30-455f5e3215c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46f1919bed3c49f8b3c8704c0b642723',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:14:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:14:06Z,use_quota=True,user_id='f2f95514bc7841d29b6a8b5b4d0f809b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)}" {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 06:14:06 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-2d5375ea-d605-4368-b2cb-6e8c592084bc tempest-TestServerVolumeAttachmentScenario-1990739042 None] Creating volume 4ca7847e-4c2c-4412-ab30-455f5e3215c4 {{(pid=88695) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 06:14:06 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-2d5375ea-d605-4368-b2cb-6e8c592084bc tempest-TestServerVolumeAttachmentScenario-1990739042 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:14:06 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-2d5375ea-d605-4368-b2cb-6e8c592084bc tempest-TestServerVolumeAttachmentScenario-1990739042 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:14:06 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-2d5375ea-d605-4368-b2cb-6e8c592084bc tempest-TestServerVolumeAttachmentScenario-1990739042 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:14:06 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-2d5375ea-d605-4368-b2cb-6e8c592084bc tempest-TestServerVolumeAttachmentScenario-1990739042 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:14:06 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-2d5375ea-d605-4368-b2cb-6e8c592084bc tempest-TestServerVolumeAttachmentScenario-1990739042 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.046s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:14:06 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-2d5375ea-d605-4368-b2cb-6e8c592084bc tempest-TestServerVolumeAttachmentScenario-1990739042 None] Selected osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 as target Quobyte volume. {{(pid=88695) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 06:14:06 devstack cinder-volume[88695]: INFO cinder.volume.drivers.remotefs [None req-2d5375ea-d605-4368-b2cb-6e8c592084bc tempest-TestServerVolumeAttachmentScenario-1990739042 None] casted to osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 Aug 05 06:14:06 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-2d5375ea-d605-4368-b2cb-6e8c592084bc tempest-TestServerVolumeAttachmentScenario-1990739042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-4ca7847e-4c2c-4412-ab30-455f5e3215c4 1073741824 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:14:06 devstack sudo[93500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-4ca7847e-4c2c-4412-ab30-455f5e3215c4 1073741824 Aug 05 06:14:06 devstack sudo[93500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:14:06 devstack cinder-volume[88695]: DEBUG cinder.volume.flows.manager.create_volume [None req-d32a891b-686c-40c5-9e49-287b1bc5eb88 tempest-TestServerVolumeAttachmentScenario-1990739042 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88695) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 06:14:06 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-d32a891b-686c-40c5-9e49-287b1bc5eb88 tempest-TestServerVolumeAttachmentScenario-1990739042 None] Flow 'volume_create_manager' (fac0b243-027b-45b4-9f3a-ae04a3decc92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:14:07 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-d32a891b-686c-40c5-9e49-287b1bc5eb88 tempest-TestServerVolumeAttachmentScenario-1990739042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fbe9ff2-2006-49c7-9e4c-ce2fb6046c2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:14:07 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-d32a891b-686c-40c5-9e49-287b1bc5eb88 tempest-TestServerVolumeAttachmentScenario-1990739042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fbe9ff2-2006-49c7-9e4c-ce2fb6046c2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:14:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-917678417',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3651087-27df-4417-a10a-1b97a46efaeb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46f1919bed3c49f8b3c8704c0b642723',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:14:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:14:07Z,use_quota=True,user_id='f2f95514bc7841d29b6a8b5b4d0f809b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:14:07 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-d32a891b-686c-40c5-9e49-287b1bc5eb88 tempest-TestServerVolumeAttachmentScenario-1990739042 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4fd0804-39f2-4a9e-b3c4-02f9cfaa5351) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:14:07 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-d32a891b-686c-40c5-9e49-287b1bc5eb88 tempest-TestServerVolumeAttachmentScenario-1990739042 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4fd0804-39f2-4a9e-b3c4-02f9cfaa5351) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:14:07 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-d32a891b-686c-40c5-9e49-287b1bc5eb88 tempest-TestServerVolumeAttachmentScenario-1990739042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c42b821-a327-4fe6-9c68-7fb47fe7c5ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:14:07 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-d32a891b-686c-40c5-9e49-287b1bc5eb88 tempest-TestServerVolumeAttachmentScenario-1990739042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c42b821-a327-4fe6-9c68-7fb47fe7c5ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e3651087-27df-4417-a10a-1b97a46efaeb', 'volume_name': 'volume-e3651087-27df-4417-a10a-1b97a46efaeb', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:14:07 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-d32a891b-686c-40c5-9e49-287b1bc5eb88 tempest-TestServerVolumeAttachmentScenario-1990739042 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea7151fb-f1f0-463d-b4b8-baa377d476ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:14:07 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-d32a891b-686c-40c5-9e49-287b1bc5eb88 tempest-TestServerVolumeAttachmentScenario-1990739042 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea7151fb-f1f0-463d-b4b8-baa377d476ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:14:07 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-d32a891b-686c-40c5-9e49-287b1bc5eb88 tempest-TestServerVolumeAttachmentScenario-1990739042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edf5f043-1613-45ad-ae44-cc570c9bd11f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:14:07 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-d32a891b-686c-40c5-9e49-287b1bc5eb88 tempest-TestServerVolumeAttachmentScenario-1990739042 None] Volume e3651087-27df-4417-a10a-1b97a46efaeb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e3651087-27df-4417-a10a-1b97a46efaeb', 'volume_size': 1} Aug 05 06:14:07 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-d32a891b-686c-40c5-9e49-287b1bc5eb88 tempest-TestServerVolumeAttachmentScenario-1990739042 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:14:07 devstack sudo[93500]: pam_unix(sudo:session): session closed for user root Aug 05 06:14:07 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-2d5375ea-d605-4368-b2cb-6e8c592084bc tempest-TestServerVolumeAttachmentScenario-1990739042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-4ca7847e-4c2c-4412-ab30-455f5e3215c4 1073741824" returned: 0 in 1.425s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:14:07 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-2d5375ea-d605-4368-b2cb-6e8c592084bc tempest-TestServerVolumeAttachmentScenario-1990739042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-4ca7847e-4c2c-4412-ab30-455f5e3215c4 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:14:07 devstack sudo[93508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-4ca7847e-4c2c-4412-ab30-455f5e3215c4 Aug 05 06:14:07 devstack sudo[93508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:14:08 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-1cd719b7-bfc4-4d61-9981-96412f2f31d4 tempest-VolumesActionsTest-545848188 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:14:08 devstack sudo[93508]: pam_unix(sudo:session): session closed for user root Aug 05 06:14:08 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-2d5375ea-d605-4368-b2cb-6e8c592084bc tempest-TestServerVolumeAttachmentScenario-1990739042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-4ca7847e-4c2c-4412-ab30-455f5e3215c4" returned: 0 in 0.397s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:14:08 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-2d5375ea-d605-4368-b2cb-6e8c592084bc tempest-TestServerVolumeAttachmentScenario-1990739042 None] <== create_volume: return (1949ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'} {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 06:14:08 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-2d5375ea-d605-4368-b2cb-6e8c592084bc tempest-TestServerVolumeAttachmentScenario-1990739042 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.969s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:14:08 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-d32a891b-686c-40c5-9e49-287b1bc5eb88 tempest-TestServerVolumeAttachmentScenario-1990739042 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.944s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:14:08 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-d32a891b-686c-40c5-9e49-287b1bc5eb88 tempest-TestServerVolumeAttachmentScenario-1990739042 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:14:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-917678417',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3651087-27df-4417-a10a-1b97a46efaeb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46f1919bed3c49f8b3c8704c0b642723',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:14:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:14:07Z,use_quota=True,user_id='f2f95514bc7841d29b6a8b5b4d0f809b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)}" {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 06:14:08 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-d32a891b-686c-40c5-9e49-287b1bc5eb88 tempest-TestServerVolumeAttachmentScenario-1990739042 None] Creating volume e3651087-27df-4417-a10a-1b97a46efaeb {{(pid=88695) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 06:14:08 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-d32a891b-686c-40c5-9e49-287b1bc5eb88 tempest-TestServerVolumeAttachmentScenario-1990739042 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:14:08 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-d32a891b-686c-40c5-9e49-287b1bc5eb88 tempest-TestServerVolumeAttachmentScenario-1990739042 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:14:08 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-d32a891b-686c-40c5-9e49-287b1bc5eb88 tempest-TestServerVolumeAttachmentScenario-1990739042 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:14:08 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-d32a891b-686c-40c5-9e49-287b1bc5eb88 tempest-TestServerVolumeAttachmentScenario-1990739042 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:14:08 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-d32a891b-686c-40c5-9e49-287b1bc5eb88 tempest-TestServerVolumeAttachmentScenario-1990739042 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:14:08 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-d32a891b-686c-40c5-9e49-287b1bc5eb88 tempest-TestServerVolumeAttachmentScenario-1990739042 None] Selected osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 as target Quobyte volume. {{(pid=88695) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 06:14:08 devstack cinder-volume[88695]: INFO cinder.volume.drivers.remotefs [None req-d32a891b-686c-40c5-9e49-287b1bc5eb88 tempest-TestServerVolumeAttachmentScenario-1990739042 None] casted to osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 Aug 05 06:14:08 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-d32a891b-686c-40c5-9e49-287b1bc5eb88 tempest-TestServerVolumeAttachmentScenario-1990739042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-e3651087-27df-4417-a10a-1b97a46efaeb 1073741824 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:14:08 devstack sudo[93513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-e3651087-27df-4417-a10a-1b97a46efaeb 1073741824 Aug 05 06:14:08 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-2d5375ea-d605-4368-b2cb-6e8c592084bc tempest-TestServerVolumeAttachmentScenario-1990739042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a2393db-d8ad-46ed-aed0-5303151ae572) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ca7847e-4c2c-4412-ab30-455f5e3215c4', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:14:08 devstack sudo[93513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:14:08 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-2d5375ea-d605-4368-b2cb-6e8c592084bc tempest-TestServerVolumeAttachmentScenario-1990739042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e34b0c6d-d11e-4b6c-a2c1-900ba52840d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:14:08 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-2d5375ea-d605-4368-b2cb-6e8c592084bc tempest-TestServerVolumeAttachmentScenario-1990739042 None] Volume volume-4ca7847e-4c2c-4412-ab30-455f5e3215c4 (4ca7847e-4c2c-4412-ab30-455f5e3215c4): created successfully Aug 05 06:14:08 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-2d5375ea-d605-4368-b2cb-6e8c592084bc tempest-TestServerVolumeAttachmentScenario-1990739042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e34b0c6d-d11e-4b6c-a2c1-900ba52840d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:14:08 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-2d5375ea-d605-4368-b2cb-6e8c592084bc tempest-TestServerVolumeAttachmentScenario-1990739042 None] Flow 'volume_create_manager' (5150fdaf-c9fb-400f-ba75-d10154b8b7c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:14:08 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-2d5375ea-d605-4368-b2cb-6e8c592084bc tempest-TestServerVolumeAttachmentScenario-1990739042 None] Created volume successfully. Aug 05 06:14:09 devstack sudo[93513]: pam_unix(sudo:session): session closed for user root Aug 05 06:14:09 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-d32a891b-686c-40c5-9e49-287b1bc5eb88 tempest-TestServerVolumeAttachmentScenario-1990739042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-e3651087-27df-4417-a10a-1b97a46efaeb 1073741824" returned: 0 in 0.993s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:14:09 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-d32a891b-686c-40c5-9e49-287b1bc5eb88 tempest-TestServerVolumeAttachmentScenario-1990739042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-e3651087-27df-4417-a10a-1b97a46efaeb {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:14:09 devstack sudo[93522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-e3651087-27df-4417-a10a-1b97a46efaeb Aug 05 06:14:09 devstack sudo[93522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:14:09 devstack sudo[93522]: pam_unix(sudo:session): session closed for user root Aug 05 06:14:09 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-d32a891b-686c-40c5-9e49-287b1bc5eb88 tempest-TestServerVolumeAttachmentScenario-1990739042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-e3651087-27df-4417-a10a-1b97a46efaeb" returned: 0 in 0.546s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:14:09 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-d32a891b-686c-40c5-9e49-287b1bc5eb88 tempest-TestServerVolumeAttachmentScenario-1990739042 None] <== create_volume: return (1622ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'} {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 06:14:09 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-d32a891b-686c-40c5-9e49-287b1bc5eb88 tempest-TestServerVolumeAttachmentScenario-1990739042 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.631s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:14:09 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-1cd719b7-bfc4-4d61-9981-96412f2f31d4 tempest-VolumesActionsTest-545848188 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 1.772s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:14:09 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-d32a891b-686c-40c5-9e49-287b1bc5eb88 tempest-TestServerVolumeAttachmentScenario-1990739042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edf5f043-1613-45ad-ae44-cc570c9bd11f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3651087-27df-4417-a10a-1b97a46efaeb', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:14:09 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-d32a891b-686c-40c5-9e49-287b1bc5eb88 tempest-TestServerVolumeAttachmentScenario-1990739042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47fb4639-d0ff-4b1c-993e-38720e5456a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:14:09 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[45442451-b1dd-445e-99fc-a11b7bf8125d]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:14:09 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-1cd719b7-bfc4-4d61-9981-96412f2f31d4 tempest-VolumesActionsTest-545848188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-f853167c-debe-4f36-9d16-8fa376c5004d {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:14:09 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-d32a891b-686c-40c5-9e49-287b1bc5eb88 tempest-TestServerVolumeAttachmentScenario-1990739042 None] Volume volume-e3651087-27df-4417-a10a-1b97a46efaeb (e3651087-27df-4417-a10a-1b97a46efaeb): created successfully Aug 05 06:14:09 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-d32a891b-686c-40c5-9e49-287b1bc5eb88 tempest-TestServerVolumeAttachmentScenario-1990739042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47fb4639-d0ff-4b1c-993e-38720e5456a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:14:09 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-d32a891b-686c-40c5-9e49-287b1bc5eb88 tempest-TestServerVolumeAttachmentScenario-1990739042 None] Flow 'volume_create_manager' (fac0b243-027b-45b4-9f3a-ae04a3decc92) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:14:10 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-d32a891b-686c-40c5-9e49-287b1bc5eb88 tempest-TestServerVolumeAttachmentScenario-1990739042 None] Created volume successfully. Aug 05 06:14:10 devstack sudo[93529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-f853167c-debe-4f36-9d16-8fa376c5004d Aug 05 06:14:10 devstack sudo[93529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:14:10 devstack sudo[93529]: pam_unix(sudo:session): session closed for user root Aug 05 06:14:11 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-1cd719b7-bfc4-4d61-9981-96412f2f31d4 tempest-VolumesActionsTest-545848188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-f853167c-debe-4f36-9d16-8fa376c5004d" returned: 0 in 1.083s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:14:11 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[13f4dbf9-b5f4-4a3e-9af7-77b4e70507ad]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:14:11 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-1cd719b7-bfc4-4d61-9981-96412f2f31d4 tempest-VolumesActionsTest-545848188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-f853167c-debe-4f36-9d16-8fa376c5004d {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:14:11 devstack sudo[93537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-f853167c-debe-4f36-9d16-8fa376c5004d Aug 05 06:14:11 devstack sudo[93537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:14:11 devstack sudo[93537]: pam_unix(sudo:session): session closed for user root Aug 05 06:14:11 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-1cd719b7-bfc4-4d61-9981-96412f2f31d4 tempest-VolumesActionsTest-545848188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-f853167c-debe-4f36-9d16-8fa376c5004d" returned: 0 in 0.641s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:14:11 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-1cd719b7-bfc4-4d61-9981-96412f2f31d4 tempest-VolumesActionsTest-545848188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-f853167c-debe-4f36-9d16-8fa376c5004d /opt/stack/data/cinder/conversion/f853167c-debe-4f36-9d16-8fa376c5004d.temp_image.cc8278e6-ba29-4a6c-8b01-a3cfcfc01d11tms77lmv.img {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:14:11 devstack sudo[93544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-f853167c-debe-4f36-9d16-8fa376c5004d /opt/stack/data/cinder/conversion/f853167c-debe-4f36-9d16-8fa376c5004d.temp_image.cc8278e6-ba29-4a6c-8b01-a3cfcfc01d11tms77lmv.img Aug 05 06:14:11 devstack sudo[93544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:14:19 devstack cinder-volume[88695]: DEBUG dbcounter [-] [88695] Writing DB stats cinder:SELECT=7,cinder:UPDATE=7,cinder:DELETE=1 {{(pid=88695) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 06:14:20 devstack cinder-volume[88695]: DEBUG dbcounter [-] [88695] Writing DB stats cinder:SELECT=2,cinder:UPDATE=5,cinder:INSERT=2,cinder:DELETE=1 {{(pid=88695) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 06:14:21 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-1cd719b7-bfc4-4d61-9981-96412f2f31d4 tempest-VolumesActionsTest-545848188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-f853167c-debe-4f36-9d16-8fa376c5004d /opt/stack/data/cinder/conversion/f853167c-debe-4f36-9d16-8fa376c5004d.temp_image.cc8278e6-ba29-4a6c-8b01-a3cfcfc01d11tms77lmv.img" returned: 0 in 9.503s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:14:21 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd08da04-9f8a-4c87-8c15-d64045fb7905]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:14:21 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-1cd719b7-bfc4-4d61-9981-96412f2f31d4 tempest-VolumesActionsTest-545848188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-f853167c-debe-4f36-9d16-8fa376c5004d {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:14:21 devstack sudo[93658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-f853167c-debe-4f36-9d16-8fa376c5004d Aug 05 06:14:21 devstack sudo[93658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:14:22 devstack sudo[93658]: pam_unix(sudo:session): session closed for user root Aug 05 06:14:22 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-1cd719b7-bfc4-4d61-9981-96412f2f31d4 tempest-VolumesActionsTest-545848188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-f853167c-debe-4f36-9d16-8fa376c5004d" returned: 0 in 0.826s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:14:22 devstack cinder-volume[88695]: DEBUG cinder.image.image_utils [None req-1cd719b7-bfc4-4d61-9981-96412f2f31d4 tempest-VolumesActionsTest-545848188 None] Image conversion details: src /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-f853167c-debe-4f36-9d16-8fa376c5004d, size 1024.00 MB, duration 9.50 sec, destination /opt/stack/data/cinder/conversion/f853167c-debe-4f36-9d16-8fa376c5004d.temp_image.cc8278e6-ba29-4a6c-8b01-a3cfcfc01d11tms77lmv.img {{(pid=88695) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 05 06:14:22 devstack cinder-volume[88695]: INFO cinder.image.image_utils [None req-1cd719b7-bfc4-4d61-9981-96412f2f31d4 tempest-VolumesActionsTest-545848188 None] Converted 1024.00 MB image at 107.74 MB/s Aug 05 06:14:22 devstack cinder-volume[88695]: DEBUG cinder.image.image_utils [None req-1cd719b7-bfc4-4d61-9981-96412f2f31d4 tempest-VolumesActionsTest-545848188 None] cc8278e6-ba29-4a6c-8b01-a3cfcfc01d11 was raw, no need to convert to raw {{(pid=88695) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Aug 05 06:14:24 devstack cinder-volume[88695]: INFO cinder.volume.manager [req-68761242-f377-4fc8-8a48-952b90f2afe6 req-5e1e6e25-d5a5-45e9-ad57-cd447cd09492 tempest-ServerActionsTestOtherA-886527270 None] Terminate volume connection completed successfully. Aug 05 06:14:24 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [req-68761242-f377-4fc8-8a48-952b90f2afe6 req-5e1e6e25-d5a5-45e9-ad57-cd447cd09492 tempest-ServerActionsTestOtherA-886527270 None] Deleting attachment 07049af0-017a-4341-99d3-7b12eeb960c6. {{(pid=88695) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 05 06:14:30 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [req-68761242-f377-4fc8-8a48-952b90f2afe6 req-687ce826-25bc-42df-a523-4655f77f416f tempest-ServerActionsTestOtherA-886527270 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:14:34 devstack cinder-volume[88695]: DEBUG cinder.volume.flows.manager.create_volume [None req-c19b18f4-b7be-42e2-90ff-97331d8d3c6a tempest-ServersNegativeTestJSON-1675891323 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88695) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 06:14:34 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-c19b18f4-b7be-42e2-90ff-97331d8d3c6a tempest-ServersNegativeTestJSON-1675891323 None] Flow 'volume_create_manager' (5bfac3ee-4707-4bc9-a7c1-6a1d0ea628c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:14:34 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-c19b18f4-b7be-42e2-90ff-97331d8d3c6a tempest-ServersNegativeTestJSON-1675891323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e4bf41b-ff65-46a9-908c-05612c22056d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:14:34 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-c19b18f4-b7be-42e2-90ff-97331d8d3c6a tempest-ServersNegativeTestJSON-1675891323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e4bf41b-ff65-46a9-908c-05612c22056d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:14:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-364474470',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99aa69e7-c8e7-4424-8a6b-44775d5b3d79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='241d0afd886745aeb8172d9d42894950',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:14:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:14:35Z,use_quota=True,user_id='1cac6d65104b4b79bdb53197e2d21c1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:14:34 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-c19b18f4-b7be-42e2-90ff-97331d8d3c6a tempest-ServersNegativeTestJSON-1675891323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ae7449f-f3cc-4f34-8cc8-fdedbf404520) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:14:34 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-c19b18f4-b7be-42e2-90ff-97331d8d3c6a tempest-ServersNegativeTestJSON-1675891323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ae7449f-f3cc-4f34-8cc8-fdedbf404520) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:14:34 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-c19b18f4-b7be-42e2-90ff-97331d8d3c6a tempest-ServersNegativeTestJSON-1675891323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fc5e765-eef3-4875-a94b-3419cb497a88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:14:34 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-c19b18f4-b7be-42e2-90ff-97331d8d3c6a tempest-ServersNegativeTestJSON-1675891323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fc5e765-eef3-4875-a94b-3419cb497a88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '99aa69e7-c8e7-4424-8a6b-44775d5b3d79', 'volume_name': 'volume-99aa69e7-c8e7-4424-8a6b-44775d5b3d79', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:14:34 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-c19b18f4-b7be-42e2-90ff-97331d8d3c6a tempest-ServersNegativeTestJSON-1675891323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49c2cf19-1e83-424d-a182-22bb55c24809) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:14:34 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-c19b18f4-b7be-42e2-90ff-97331d8d3c6a tempest-ServersNegativeTestJSON-1675891323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49c2cf19-1e83-424d-a182-22bb55c24809) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:14:34 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-c19b18f4-b7be-42e2-90ff-97331d8d3c6a tempest-ServersNegativeTestJSON-1675891323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00a5ffc8-9ba3-4ed2-b172-cd48ba61aee2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:14:34 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-c19b18f4-b7be-42e2-90ff-97331d8d3c6a tempest-ServersNegativeTestJSON-1675891323 None] Volume 99aa69e7-c8e7-4424-8a6b-44775d5b3d79: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-99aa69e7-c8e7-4424-8a6b-44775d5b3d79', 'volume_size': 1} Aug 05 06:14:34 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-c19b18f4-b7be-42e2-90ff-97331d8d3c6a tempest-ServersNegativeTestJSON-1675891323 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:14:44 devstack cinder-volume[88695]: DEBUG dbcounter [-] [88695] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=88695) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 06:14:44 devstack cinder-volume[88695]: DEBUG dbcounter [-] [88695] Writing DB stats cinder:SELECT=5 {{(pid=88695) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 06:14:49 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-1cd719b7-bfc4-4d61-9981-96412f2f31d4 tempest-VolumesActionsTest-545848188 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 39.730s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:14:49 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-1cd719b7-bfc4-4d61-9981-96412f2f31d4 tempest-VolumesActionsTest-545848188 None] Uploaded volume to glance image-id: cc8278e6-ba29-4a6c-8b01-a3cfcfc01d11. {{(pid=88695) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Aug 05 06:14:49 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [req-68761242-f377-4fc8-8a48-952b90f2afe6 req-687ce826-25bc-42df-a523-4655f77f416f tempest-ServerActionsTestOtherA-886527270 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 19.318s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:14:49 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [req-68761242-f377-4fc8-8a48-952b90f2afe6 req-687ce826-25bc-42df-a523-4655f77f416f tempest-ServerActionsTestOtherA-886527270 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.030s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:14:49 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-c19b18f4-b7be-42e2-90ff-97331d8d3c6a tempest-ServersNegativeTestJSON-1675891323 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.808s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:14:49 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-c19b18f4-b7be-42e2-90ff-97331d8d3c6a tempest-ServersNegativeTestJSON-1675891323 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:14:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-364474470',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99aa69e7-c8e7-4424-8a6b-44775d5b3d79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='241d0afd886745aeb8172d9d42894950',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:14:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:14:35Z,use_quota=True,user_id='1cac6d65104b4b79bdb53197e2d21c1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)}" {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 06:14:49 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-c19b18f4-b7be-42e2-90ff-97331d8d3c6a tempest-ServersNegativeTestJSON-1675891323 None] Creating volume 99aa69e7-c8e7-4424-8a6b-44775d5b3d79 {{(pid=88695) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 06:14:49 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-c19b18f4-b7be-42e2-90ff-97331d8d3c6a tempest-ServersNegativeTestJSON-1675891323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:14:49 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-c19b18f4-b7be-42e2-90ff-97331d8d3c6a tempest-ServersNegativeTestJSON-1675891323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:14:49 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-c19b18f4-b7be-42e2-90ff-97331d8d3c6a tempest-ServersNegativeTestJSON-1675891323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:14:49 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-c19b18f4-b7be-42e2-90ff-97331d8d3c6a tempest-ServersNegativeTestJSON-1675891323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:14:49 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-c19b18f4-b7be-42e2-90ff-97331d8d3c6a tempest-ServersNegativeTestJSON-1675891323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:14:49 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-c19b18f4-b7be-42e2-90ff-97331d8d3c6a tempest-ServersNegativeTestJSON-1675891323 None] Selected osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 as target Quobyte volume. {{(pid=88695) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 06:14:49 devstack cinder-volume[88695]: INFO cinder.volume.drivers.remotefs [None req-c19b18f4-b7be-42e2-90ff-97331d8d3c6a tempest-ServersNegativeTestJSON-1675891323 None] casted to osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 Aug 05 06:14:49 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-c19b18f4-b7be-42e2-90ff-97331d8d3c6a tempest-ServersNegativeTestJSON-1675891323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-99aa69e7-c8e7-4424-8a6b-44775d5b3d79 1073741824 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:14:49 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-1cd719b7-bfc4-4d61-9981-96412f2f31d4 tempest-VolumesActionsTest-545848188 None] Copy volume to image completed successfully. Aug 05 06:14:49 devstack sudo[93986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-99aa69e7-c8e7-4424-8a6b-44775d5b3d79 1073741824 Aug 05 06:14:49 devstack sudo[93986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:14:49 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [req-68761242-f377-4fc8-8a48-952b90f2afe6 req-687ce826-25bc-42df-a523-4655f77f416f tempest-ServerActionsTestOtherA-886527270 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087', 'name': 'volume-36d2290d-861b-4b93-95e6-e660ba0e5f20', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '289c353f-e978-4785-aa95-043e1f8f9eff', 'enforce_multipath': True} {{(pid=88695) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 05 06:14:49 devstack cinder-volume[88695]: INFO cinder.volume.manager [req-68761242-f377-4fc8-8a48-952b90f2afe6 req-687ce826-25bc-42df-a523-4655f77f416f tempest-ServerActionsTestOtherA-886527270 None] attachment_update completed successfully. Aug 05 06:14:50 devstack sudo[93986]: pam_unix(sudo:session): session closed for user root Aug 05 06:14:50 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-c19b18f4-b7be-42e2-90ff-97331d8d3c6a tempest-ServersNegativeTestJSON-1675891323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-99aa69e7-c8e7-4424-8a6b-44775d5b3d79 1073741824" returned: 0 in 0.558s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:14:50 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-c19b18f4-b7be-42e2-90ff-97331d8d3c6a tempest-ServersNegativeTestJSON-1675891323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-99aa69e7-c8e7-4424-8a6b-44775d5b3d79 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:14:50 devstack sudo[94023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-99aa69e7-c8e7-4424-8a6b-44775d5b3d79 Aug 05 06:14:50 devstack sudo[94023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:14:50 devstack sudo[94023]: pam_unix(sudo:session): session closed for user root Aug 05 06:14:50 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-c19b18f4-b7be-42e2-90ff-97331d8d3c6a tempest-ServersNegativeTestJSON-1675891323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-99aa69e7-c8e7-4424-8a6b-44775d5b3d79" returned: 0 in 0.355s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:14:50 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-c19b18f4-b7be-42e2-90ff-97331d8d3c6a tempest-ServersNegativeTestJSON-1675891323 None] <== create_volume: return (978ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'} {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 06:14:50 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-c19b18f4-b7be-42e2-90ff-97331d8d3c6a tempest-ServersNegativeTestJSON-1675891323 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.982s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:14:50 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-c19b18f4-b7be-42e2-90ff-97331d8d3c6a tempest-ServersNegativeTestJSON-1675891323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00a5ffc8-9ba3-4ed2-b172-cd48ba61aee2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99aa69e7-c8e7-4424-8a6b-44775d5b3d79', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:14:50 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-c19b18f4-b7be-42e2-90ff-97331d8d3c6a tempest-ServersNegativeTestJSON-1675891323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58b260a7-2e4f-46b9-8b69-1ecf552c2f74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:14:50 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-c19b18f4-b7be-42e2-90ff-97331d8d3c6a tempest-ServersNegativeTestJSON-1675891323 None] Volume volume-99aa69e7-c8e7-4424-8a6b-44775d5b3d79 (99aa69e7-c8e7-4424-8a6b-44775d5b3d79): created successfully Aug 05 06:14:50 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-c19b18f4-b7be-42e2-90ff-97331d8d3c6a tempest-ServersNegativeTestJSON-1675891323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58b260a7-2e4f-46b9-8b69-1ecf552c2f74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:14:50 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-c19b18f4-b7be-42e2-90ff-97331d8d3c6a tempest-ServersNegativeTestJSON-1675891323 None] Flow 'volume_create_manager' (5bfac3ee-4707-4bc9-a7c1-6a1d0ea628c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:14:50 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-c19b18f4-b7be-42e2-90ff-97331d8d3c6a tempest-ServersNegativeTestJSON-1675891323 None] Created volume successfully. Aug 05 06:14:51 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-ce00aab6-df70-42f4-a604-17895894ffca tempest-VolumesActionsTest-545848188 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:14:51 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-ce00aab6-df70-42f4-a604-17895894ffca tempest-VolumesActionsTest-545848188 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:14:51 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c6740fb-a524-4582-91e4-287f9daa2219]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:14:51 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-ce00aab6-df70-42f4-a604-17895894ffca tempest-VolumesActionsTest-545848188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-f853167c-debe-4f36-9d16-8fa376c5004d {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:14:51 devstack sudo[94425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-f853167c-debe-4f36-9d16-8fa376c5004d Aug 05 06:14:51 devstack sudo[94425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:14:52 devstack sudo[94425]: pam_unix(sudo:session): session closed for user root Aug 05 06:14:52 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-ce00aab6-df70-42f4-a604-17895894ffca tempest-VolumesActionsTest-545848188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-f853167c-debe-4f36-9d16-8fa376c5004d" returned: 0 in 0.442s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:14:52 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[6906bed6-dcf8-4838-8ab7-9c75c4f6239f]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:14:52 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-ce00aab6-df70-42f4-a604-17895894ffca tempest-VolumesActionsTest-545848188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-f853167c-debe-4f36-9d16-8fa376c5004d {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:14:52 devstack sudo[94442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-f853167c-debe-4f36-9d16-8fa376c5004d Aug 05 06:14:52 devstack sudo[94442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:14:52 devstack sudo[94442]: pam_unix(sudo:session): session closed for user root Aug 05 06:14:52 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-ce00aab6-df70-42f4-a604-17895894ffca tempest-VolumesActionsTest-545848188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-f853167c-debe-4f36-9d16-8fa376c5004d" returned: 0 in 0.452s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:14:52 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-ce00aab6-df70-42f4-a604-17895894ffca tempest-VolumesActionsTest-545848188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-f853167c-debe-4f36-9d16-8fa376c5004d /opt/stack/data/cinder/conversion/f853167c-debe-4f36-9d16-8fa376c5004d.temp_image.c1bb5a61-2cfa-4df6-bad5-edcea37bf366mh3ig2l4.img {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:14:52 devstack sudo[94463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-f853167c-debe-4f36-9d16-8fa376c5004d /opt/stack/data/cinder/conversion/f853167c-debe-4f36-9d16-8fa376c5004d.temp_image.c1bb5a61-2cfa-4df6-bad5-edcea37bf366mh3ig2l4.img Aug 05 06:14:52 devstack sudo[94463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:14:54 devstack cinder-volume[88695]: DEBUG cinder.volume.flows.manager.create_volume [None req-74118ac5-7937-433a-8cfe-1f625116321b tempest-ServersNegativeTestJSON-1675891323 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88695) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 06:14:54 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-74118ac5-7937-433a-8cfe-1f625116321b tempest-ServersNegativeTestJSON-1675891323 None] Flow 'volume_create_manager' (b3f9953f-272d-4b04-81da-4145608e9382) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:14:54 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-74118ac5-7937-433a-8cfe-1f625116321b tempest-ServersNegativeTestJSON-1675891323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6c0702d-9242-4d41-9f58-a082e4a6d9fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:14:54 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-74118ac5-7937-433a-8cfe-1f625116321b tempest-ServersNegativeTestJSON-1675891323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6c0702d-9242-4d41-9f58-a082e4a6d9fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:14:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1480592449',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2502b099-0276-4f2a-9b15-82d02ae3abac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='241d0afd886745aeb8172d9d42894950',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:14:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:14:54Z,use_quota=True,user_id='1cac6d65104b4b79bdb53197e2d21c1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:14:54 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-74118ac5-7937-433a-8cfe-1f625116321b tempest-ServersNegativeTestJSON-1675891323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53d2d57e-fc81-4aab-a60b-3795664c2683) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:14:54 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-74118ac5-7937-433a-8cfe-1f625116321b tempest-ServersNegativeTestJSON-1675891323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53d2d57e-fc81-4aab-a60b-3795664c2683) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:14:54 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-74118ac5-7937-433a-8cfe-1f625116321b tempest-ServersNegativeTestJSON-1675891323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (816b551c-b187-4e46-a277-fe5077e8b9ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:14:54 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-74118ac5-7937-433a-8cfe-1f625116321b tempest-ServersNegativeTestJSON-1675891323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (816b551c-b187-4e46-a277-fe5077e8b9ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2502b099-0276-4f2a-9b15-82d02ae3abac', 'volume_name': 'volume-2502b099-0276-4f2a-9b15-82d02ae3abac', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:14:54 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-74118ac5-7937-433a-8cfe-1f625116321b tempest-ServersNegativeTestJSON-1675891323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07e348f0-8acb-4fba-987e-bf873ee156ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:14:54 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-74118ac5-7937-433a-8cfe-1f625116321b tempest-ServersNegativeTestJSON-1675891323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07e348f0-8acb-4fba-987e-bf873ee156ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:14:54 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-74118ac5-7937-433a-8cfe-1f625116321b tempest-ServersNegativeTestJSON-1675891323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60a6d965-ad61-4079-a727-ab6e1eb8fd60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:14:54 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-74118ac5-7937-433a-8cfe-1f625116321b tempest-ServersNegativeTestJSON-1675891323 None] Volume 2502b099-0276-4f2a-9b15-82d02ae3abac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2502b099-0276-4f2a-9b15-82d02ae3abac', 'volume_size': 1} Aug 05 06:14:54 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-74118ac5-7937-433a-8cfe-1f625116321b tempest-ServersNegativeTestJSON-1675891323 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:15:00 devstack sudo[94463]: pam_unix(sudo:session): session closed for user root Aug 05 06:15:00 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-ce00aab6-df70-42f4-a604-17895894ffca tempest-VolumesActionsTest-545848188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-f853167c-debe-4f36-9d16-8fa376c5004d /opt/stack/data/cinder/conversion/f853167c-debe-4f36-9d16-8fa376c5004d.temp_image.c1bb5a61-2cfa-4df6-bad5-edcea37bf366mh3ig2l4.img" returned: 0 in 7.540s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:15:00 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[1796e5cc-68ab-46d1-8f12-5f19f0b53ec0]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:15:00 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-ce00aab6-df70-42f4-a604-17895894ffca tempest-VolumesActionsTest-545848188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-f853167c-debe-4f36-9d16-8fa376c5004d {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:15:00 devstack sudo[94484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-f853167c-debe-4f36-9d16-8fa376c5004d Aug 05 06:15:00 devstack sudo[94484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:15:00 devstack cinder-volume[88695]: DEBUG oslo_service.periodic_task [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88695) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 06:15:00 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:15:00 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:15:00 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:15:00 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:15:00 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:15:00 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:15:00 devstack sudo[94486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce Aug 05 06:15:00 devstack sudo[94486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:15:00 devstack sudo[94486]: pam_unix(sudo:session): session closed for user root Aug 05 06:15:00 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce" returned: 0 in 0.446s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:15:00 devstack cinder-volume[88695]: DEBUG cinder.manager [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] Notifying Schedulers of capabilities ... {{(pid=88695) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 06:15:00 devstack cinder-volume[88695]: DEBUG oslo_service.periodic_task [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] Running periodic task VolumeManager._thread_info {{(pid=88695) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 06:15:00 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] thread count: 28 {{(pid=88695) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 05 06:15:00 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] thread info: [<_MainThread(MainThread, started 134469211893888)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88695) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 05 06:15:01 devstack sudo[94484]: pam_unix(sudo:session): session closed for user root Aug 05 06:15:01 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-ce00aab6-df70-42f4-a604-17895894ffca tempest-VolumesActionsTest-545848188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-f853167c-debe-4f36-9d16-8fa376c5004d" returned: 0 in 0.937s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:15:01 devstack cinder-volume[88695]: DEBUG cinder.image.image_utils [None req-ce00aab6-df70-42f4-a604-17895894ffca tempest-VolumesActionsTest-545848188 None] Image conversion details: src /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-f853167c-debe-4f36-9d16-8fa376c5004d, size 1024.00 MB, duration 7.54 sec, destination /opt/stack/data/cinder/conversion/f853167c-debe-4f36-9d16-8fa376c5004d.temp_image.c1bb5a61-2cfa-4df6-bad5-edcea37bf366mh3ig2l4.img {{(pid=88695) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 05 06:15:01 devstack cinder-volume[88695]: INFO cinder.image.image_utils [None req-ce00aab6-df70-42f4-a604-17895894ffca tempest-VolumesActionsTest-545848188 None] Converted 1024.00 MB image at 135.80 MB/s Aug 05 06:15:01 devstack cinder-volume[88695]: DEBUG cinder.image.image_utils [None req-ce00aab6-df70-42f4-a604-17895894ffca tempest-VolumesActionsTest-545848188 None] c1bb5a61-2cfa-4df6-bad5-edcea37bf366 was raw, converting to qcow2 {{(pid=88695) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Aug 05 06:15:01 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[5119ebb1-4e5a-4263-bd9c-99ea633ec165]: (4, 'raw') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:15:01 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-ce00aab6-df70-42f4-a604-17895894ffca tempest-VolumesActionsTest-545848188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/f853167c-debe-4f36-9d16-8fa376c5004d.temp_image.c1bb5a61-2cfa-4df6-bad5-edcea37bf366mh3ig2l4.img {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:15:01 devstack sudo[94493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/f853167c-debe-4f36-9d16-8fa376c5004d.temp_image.c1bb5a61-2cfa-4df6-bad5-edcea37bf366mh3ig2l4.img Aug 05 06:15:01 devstack sudo[94493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:15:01 devstack sudo[94493]: pam_unix(sudo:session): session closed for user root Aug 05 06:15:01 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-ce00aab6-df70-42f4-a604-17895894ffca tempest-VolumesActionsTest-545848188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/f853167c-debe-4f36-9d16-8fa376c5004d.temp_image.c1bb5a61-2cfa-4df6-bad5-edcea37bf366mh3ig2l4.img" returned: 0 in 0.496s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:15:01 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-ce00aab6-df70-42f4-a604-17895894ffca tempest-VolumesActionsTest-545848188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/f853167c-debe-4f36-9d16-8fa376c5004d.temp_image.c1bb5a61-2cfa-4df6-bad5-edcea37bf366mh3ig2l4.img {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:15:01 devstack sudo[94502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/f853167c-debe-4f36-9d16-8fa376c5004d.temp_image.c1bb5a61-2cfa-4df6-bad5-edcea37bf366mh3ig2l4.img Aug 05 06:15:01 devstack sudo[94502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:15:02 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [req-9df29241-c1d2-4685-b164-0f0486d5eec7 req-82fda6c3-f33b-4462-aad6-a5011c393df7 tempest-TestServerVolumeAttachmentScenario-1990739042 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:15:02 devstack sudo[94502]: pam_unix(sudo:session): session closed for user root Aug 05 06:15:02 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-ce00aab6-df70-42f4-a604-17895894ffca tempest-VolumesActionsTest-545848188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/f853167c-debe-4f36-9d16-8fa376c5004d.temp_image.c1bb5a61-2cfa-4df6-bad5-edcea37bf366mh3ig2l4.img" returned: 1 in 0.453s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:15:02 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-ce00aab6-df70-42f4-a604-17895894ffca tempest-VolumesActionsTest-545848188 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/f853167c-debe-4f36-9d16-8fa376c5004d.temp_image.c1bb5a61-2cfa-4df6-bad5-edcea37bf366mh3ig2l4.img' failed. Not Retrying. {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 05 06:15:02 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-ce00aab6-df70-42f4-a604-17895894ffca tempest-VolumesActionsTest-545848188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/f853167c-debe-4f36-9d16-8fa376c5004d.temp_image.c1bb5a61-2cfa-4df6-bad5-edcea37bf366mh3ig2l4.img /opt/stack/data/cinder/conversion/vol_upload_uu6hqk49 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:15:02 devstack sudo[94518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/f853167c-debe-4f36-9d16-8fa376c5004d.temp_image.c1bb5a61-2cfa-4df6-bad5-edcea37bf366mh3ig2l4.img /opt/stack/data/cinder/conversion/vol_upload_uu6hqk49 Aug 05 06:15:02 devstack sudo[94518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:15:02 devstack sudo[94518]: pam_unix(sudo:session): session closed for user root Aug 05 06:15:02 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-ce00aab6-df70-42f4-a604-17895894ffca tempest-VolumesActionsTest-545848188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/f853167c-debe-4f36-9d16-8fa376c5004d.temp_image.c1bb5a61-2cfa-4df6-bad5-edcea37bf366mh3ig2l4.img /opt/stack/data/cinder/conversion/vol_upload_uu6hqk49" returned: 0 in 0.295s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:15:02 devstack cinder-volume[88695]: DEBUG cinder.image.image_utils [None req-ce00aab6-df70-42f4-a604-17895894ffca tempest-VolumesActionsTest-545848188 None] Image conversion details: src /opt/stack/data/cinder/conversion/f853167c-debe-4f36-9d16-8fa376c5004d.temp_image.c1bb5a61-2cfa-4df6-bad5-edcea37bf366mh3ig2l4.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_uu6hqk49 {{(pid=88695) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 05 06:15:02 devstack cinder-volume[88695]: INFO cinder.image.image_utils [None req-ce00aab6-df70-42f4-a604-17895894ffca tempest-VolumesActionsTest-545848188 None] Converted 1024.00 MB image at 1024.00 MB/s Aug 05 06:15:02 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb8d9cd7-661e-4d19-88cf-b1d168d7cfef]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:15:02 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-ce00aab6-df70-42f4-a604-17895894ffca tempest-VolumesActionsTest-545848188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_uu6hqk49 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:15:02 devstack sudo[94526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_uu6hqk49 Aug 05 06:15:02 devstack sudo[94526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:15:02 devstack sudo[94526]: pam_unix(sudo:session): session closed for user root Aug 05 06:15:02 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-ce00aab6-df70-42f4-a604-17895894ffca tempest-VolumesActionsTest-545848188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_uu6hqk49" returned: 0 in 0.371s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:15:04 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-ce00aab6-df70-42f4-a604-17895894ffca tempest-VolumesActionsTest-545848188 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 12.690s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:15:04 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-ce00aab6-df70-42f4-a604-17895894ffca tempest-VolumesActionsTest-545848188 None] Uploaded volume to glance image-id: c1bb5a61-2cfa-4df6-bad5-edcea37bf366. {{(pid=88695) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Aug 05 06:15:04 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-74118ac5-7937-433a-8cfe-1f625116321b tempest-ServersNegativeTestJSON-1675891323 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.544s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:15:04 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-74118ac5-7937-433a-8cfe-1f625116321b tempest-ServersNegativeTestJSON-1675891323 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:14:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1480592449',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2502b099-0276-4f2a-9b15-82d02ae3abac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='241d0afd886745aeb8172d9d42894950',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:14:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:14:54Z,use_quota=True,user_id='1cac6d65104b4b79bdb53197e2d21c1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)}" {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 06:15:04 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-74118ac5-7937-433a-8cfe-1f625116321b tempest-ServersNegativeTestJSON-1675891323 None] Creating volume 2502b099-0276-4f2a-9b15-82d02ae3abac {{(pid=88695) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 06:15:04 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-74118ac5-7937-433a-8cfe-1f625116321b tempest-ServersNegativeTestJSON-1675891323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:15:04 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-74118ac5-7937-433a-8cfe-1f625116321b tempest-ServersNegativeTestJSON-1675891323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:15:04 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-74118ac5-7937-433a-8cfe-1f625116321b tempest-ServersNegativeTestJSON-1675891323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:15:04 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-74118ac5-7937-433a-8cfe-1f625116321b tempest-ServersNegativeTestJSON-1675891323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:15:04 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-74118ac5-7937-433a-8cfe-1f625116321b tempest-ServersNegativeTestJSON-1675891323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:15:04 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-74118ac5-7937-433a-8cfe-1f625116321b tempest-ServersNegativeTestJSON-1675891323 None] Selected osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 as target Quobyte volume. {{(pid=88695) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 06:15:04 devstack cinder-volume[88695]: INFO cinder.volume.drivers.remotefs [None req-74118ac5-7937-433a-8cfe-1f625116321b tempest-ServersNegativeTestJSON-1675891323 None] casted to osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 Aug 05 06:15:04 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-74118ac5-7937-433a-8cfe-1f625116321b tempest-ServersNegativeTestJSON-1675891323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-2502b099-0276-4f2a-9b15-82d02ae3abac 1073741824 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:15:04 devstack sudo[94531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-2502b099-0276-4f2a-9b15-82d02ae3abac 1073741824 Aug 05 06:15:04 devstack sudo[94531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:15:04 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-ce00aab6-df70-42f4-a604-17895894ffca tempest-VolumesActionsTest-545848188 None] Copy volume to image completed successfully. Aug 05 06:15:04 devstack sudo[94531]: pam_unix(sudo:session): session closed for user root Aug 05 06:15:04 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-74118ac5-7937-433a-8cfe-1f625116321b tempest-ServersNegativeTestJSON-1675891323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-2502b099-0276-4f2a-9b15-82d02ae3abac 1073741824" returned: 0 in 0.486s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:15:04 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-74118ac5-7937-433a-8cfe-1f625116321b tempest-ServersNegativeTestJSON-1675891323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-2502b099-0276-4f2a-9b15-82d02ae3abac {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:15:04 devstack sudo[94537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-2502b099-0276-4f2a-9b15-82d02ae3abac Aug 05 06:15:04 devstack sudo[94537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:15:05 devstack sudo[94537]: pam_unix(sudo:session): session closed for user root Aug 05 06:15:05 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-74118ac5-7937-433a-8cfe-1f625116321b tempest-ServersNegativeTestJSON-1675891323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-2502b099-0276-4f2a-9b15-82d02ae3abac" returned: 0 in 0.279s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:15:05 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-74118ac5-7937-433a-8cfe-1f625116321b tempest-ServersNegativeTestJSON-1675891323 None] <== create_volume: return (832ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'} {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 06:15:05 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-74118ac5-7937-433a-8cfe-1f625116321b tempest-ServersNegativeTestJSON-1675891323 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.836s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:15:05 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [req-9df29241-c1d2-4685-b164-0f0486d5eec7 req-82fda6c3-f33b-4462-aad6-a5011c393df7 tempest-TestServerVolumeAttachmentScenario-1990739042 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 3.130s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:15:05 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-74118ac5-7937-433a-8cfe-1f625116321b tempest-ServersNegativeTestJSON-1675891323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60a6d965-ad61-4079-a727-ab6e1eb8fd60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2502b099-0276-4f2a-9b15-82d02ae3abac', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:15:05 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-74118ac5-7937-433a-8cfe-1f625116321b tempest-ServersNegativeTestJSON-1675891323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8e48903-26bd-45a9-a18d-a9961ebe0e62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:15:05 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [req-9df29241-c1d2-4685-b164-0f0486d5eec7 req-82fda6c3-f33b-4462-aad6-a5011c393df7 tempest-TestServerVolumeAttachmentScenario-1990739042 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.033s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:15:05 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-74118ac5-7937-433a-8cfe-1f625116321b tempest-ServersNegativeTestJSON-1675891323 None] Volume volume-2502b099-0276-4f2a-9b15-82d02ae3abac (2502b099-0276-4f2a-9b15-82d02ae3abac): created successfully Aug 05 06:15:05 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-74118ac5-7937-433a-8cfe-1f625116321b tempest-ServersNegativeTestJSON-1675891323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8e48903-26bd-45a9-a18d-a9961ebe0e62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:15:05 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-74118ac5-7937-433a-8cfe-1f625116321b tempest-ServersNegativeTestJSON-1675891323 None] Flow 'volume_create_manager' (b3f9953f-272d-4b04-81da-4145608e9382) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:15:05 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-74118ac5-7937-433a-8cfe-1f625116321b tempest-ServersNegativeTestJSON-1675891323 None] Created volume successfully. Aug 05 06:15:05 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [req-9df29241-c1d2-4685-b164-0f0486d5eec7 req-82fda6c3-f33b-4462-aad6-a5011c393df7 tempest-TestServerVolumeAttachmentScenario-1990739042 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087', 'name': 'volume-4ca7847e-4c2c-4412-ab30-455f5e3215c4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '31dc4486-ef3a-433b-bff1-108b3ca20ada', 'enforce_multipath': True} {{(pid=88695) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 05 06:15:05 devstack cinder-volume[88695]: INFO cinder.volume.manager [req-9df29241-c1d2-4685-b164-0f0486d5eec7 req-82fda6c3-f33b-4462-aad6-a5011c393df7 tempest-TestServerVolumeAttachmentScenario-1990739042 None] attachment_update completed successfully. Aug 05 06:15:05 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-95ac93de-1398-4a49-8bf7-97a819967386 tempest-VolumesActionsTest-545848188 None] Acquiring lock "cinder-f853167c-debe-4f36-9d16-8fa376c5004d-delete_volume" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:15:05 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-95ac93de-1398-4a49-8bf7-97a819967386 tempest-VolumesActionsTest-545848188 None] Lock "cinder-f853167c-debe-4f36-9d16-8fa376c5004d-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:15:05 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-95ac93de-1398-4a49-8bf7-97a819967386 tempest-VolumesActionsTest-545848188 None] Acquiring lock "cinder-quobyte-f853167c-debe-4f36-9d16-8fa376c5004d" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:15:05 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-95ac93de-1398-4a49-8bf7-97a819967386 tempest-VolumesActionsTest-545848188 None] Lock "cinder-quobyte-f853167c-debe-4f36-9d16-8fa376c5004d" acquired by "delete_volume" :: waited 0.035s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:15:05 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b5db73b-738c-48e9-97a4-813b51830232]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:15:05 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-95ac93de-1398-4a49-8bf7-97a819967386 tempest-VolumesActionsTest-545848188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-f853167c-debe-4f36-9d16-8fa376c5004d {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:15:05 devstack sudo[94544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-f853167c-debe-4f36-9d16-8fa376c5004d Aug 05 06:15:05 devstack sudo[94544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:15:06 devstack sudo[94544]: pam_unix(sudo:session): session closed for user root Aug 05 06:15:06 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-95ac93de-1398-4a49-8bf7-97a819967386 tempest-VolumesActionsTest-545848188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-f853167c-debe-4f36-9d16-8fa376c5004d" returned: 0 in 0.527s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:15:06 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-95ac93de-1398-4a49-8bf7-97a819967386 tempest-VolumesActionsTest-545848188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-f853167c-debe-4f36-9d16-8fa376c5004d {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:15:06 devstack sudo[94550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-f853167c-debe-4f36-9d16-8fa376c5004d Aug 05 06:15:06 devstack sudo[94550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:15:06 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-108371e4-1af3-40ac-b0fd-4d1fbcf68369 tempest-ServersNegativeTestJSON-1675891323 None] Acquiring lock "cinder-2502b099-0276-4f2a-9b15-82d02ae3abac-delete_volume" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:15:06 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-108371e4-1af3-40ac-b0fd-4d1fbcf68369 tempest-ServersNegativeTestJSON-1675891323 None] Lock "cinder-2502b099-0276-4f2a-9b15-82d02ae3abac-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:15:06 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-108371e4-1af3-40ac-b0fd-4d1fbcf68369 tempest-ServersNegativeTestJSON-1675891323 None] Acquiring lock "cinder-quobyte-2502b099-0276-4f2a-9b15-82d02ae3abac" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:15:06 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-108371e4-1af3-40ac-b0fd-4d1fbcf68369 tempest-ServersNegativeTestJSON-1675891323 None] Lock "cinder-quobyte-2502b099-0276-4f2a-9b15-82d02ae3abac" acquired by "delete_volume" :: waited 0.017s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:15:06 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb6bc5da-0685-4141-8315-6ed5339a482c]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:15:06 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-108371e4-1af3-40ac-b0fd-4d1fbcf68369 tempest-ServersNegativeTestJSON-1675891323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-2502b099-0276-4f2a-9b15-82d02ae3abac {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:15:06 devstack sudo[94552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-2502b099-0276-4f2a-9b15-82d02ae3abac Aug 05 06:15:06 devstack sudo[94552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:15:06 devstack sudo[94550]: pam_unix(sudo:session): session closed for user root Aug 05 06:15:06 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-95ac93de-1398-4a49-8bf7-97a819967386 tempest-VolumesActionsTest-545848188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-f853167c-debe-4f36-9d16-8fa376c5004d" returned: 0 in 0.374s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:15:06 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-95ac93de-1398-4a49-8bf7-97a819967386 tempest-VolumesActionsTest-545848188 None] Lock "cinder-quobyte-f853167c-debe-4f36-9d16-8fa376c5004d" released by "delete_volume" :: held 0.960s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:15:06 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-95ac93de-1398-4a49-8bf7-97a819967386 tempest-VolumesActionsTest-545848188 None] Created reservations ['94238f4e-6615-42be-b3e6-4c1cf035aa28', 'cf396e08-0f41-4da4-8de0-1629cbba38fd', '83ac27e4-a783-48b2-8fd0-db215c11f384', '0dd1fda5-ff42-46d5-b9b0-937b7704c5b7'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:15:06 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-95ac93de-1398-4a49-8bf7-97a819967386 tempest-VolumesActionsTest-545848188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:15:06 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-95ac93de-1398-4a49-8bf7-97a819967386 tempest-VolumesActionsTest-545848188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:15:06 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-95ac93de-1398-4a49-8bf7-97a819967386 tempest-VolumesActionsTest-545848188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:15:06 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-95ac93de-1398-4a49-8bf7-97a819967386 tempest-VolumesActionsTest-545848188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:15:06 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-95ac93de-1398-4a49-8bf7-97a819967386 tempest-VolumesActionsTest-545848188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:15:06 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-95ac93de-1398-4a49-8bf7-97a819967386 tempest-VolumesActionsTest-545848188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:15:06 devstack sudo[94556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce Aug 05 06:15:06 devstack sudo[94556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:15:06 devstack sudo[94552]: pam_unix(sudo:session): session closed for user root Aug 05 06:15:06 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-108371e4-1af3-40ac-b0fd-4d1fbcf68369 tempest-ServersNegativeTestJSON-1675891323 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-2502b099-0276-4f2a-9b15-82d02ae3abac" returned: 0 in 0.396s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:15:06 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-108371e4-1af3-40ac-b0fd-4d1fbcf68369 tempest-ServersNegativeTestJSON-1675891323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-2502b099-0276-4f2a-9b15-82d02ae3abac {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:15:06 devstack sudo[94560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-2502b099-0276-4f2a-9b15-82d02ae3abac Aug 05 06:15:06 devstack sudo[94560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:15:06 devstack sudo[94556]: pam_unix(sudo:session): session closed for user root Aug 05 06:15:06 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-95ac93de-1398-4a49-8bf7-97a819967386 tempest-VolumesActionsTest-545848188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce" returned: 0 in 0.256s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:15:06 devstack cinder-volume[88695]: DEBUG cinder.manager [None req-95ac93de-1398-4a49-8bf7-97a819967386 tempest-VolumesActionsTest-545848188 None] Notifying Schedulers of capabilities ... {{(pid=88695) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 06:15:06 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-95ac93de-1398-4a49-8bf7-97a819967386 tempest-VolumesActionsTest-545848188 None] Deleted volume successfully. Aug 05 06:15:06 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-95ac93de-1398-4a49-8bf7-97a819967386 tempest-VolumesActionsTest-545848188 None] Lock "cinder-f853167c-debe-4f36-9d16-8fa376c5004d-delete_volume" released by "delete_volume" :: held 1.492s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:15:07 devstack sudo[94560]: pam_unix(sudo:session): session closed for user root Aug 05 06:15:07 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-108371e4-1af3-40ac-b0fd-4d1fbcf68369 tempest-ServersNegativeTestJSON-1675891323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-2502b099-0276-4f2a-9b15-82d02ae3abac" returned: 0 in 0.263s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:15:07 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-108371e4-1af3-40ac-b0fd-4d1fbcf68369 tempest-ServersNegativeTestJSON-1675891323 None] Lock "cinder-quobyte-2502b099-0276-4f2a-9b15-82d02ae3abac" released by "delete_volume" :: held 0.705s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:15:07 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-108371e4-1af3-40ac-b0fd-4d1fbcf68369 tempest-ServersNegativeTestJSON-1675891323 None] Created reservations ['8819ff4a-4a91-4905-8a82-bf227a75ae8c', '30a7d8f1-3ffd-4f2c-ad2b-4d7185c6ff2c', '1b48552e-ef0a-4800-aa87-eea881fff8c8', '37849892-cf53-44d4-99be-14330166f130'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:15:07 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-108371e4-1af3-40ac-b0fd-4d1fbcf68369 tempest-ServersNegativeTestJSON-1675891323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:15:07 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-108371e4-1af3-40ac-b0fd-4d1fbcf68369 tempest-ServersNegativeTestJSON-1675891323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:15:07 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-108371e4-1af3-40ac-b0fd-4d1fbcf68369 tempest-ServersNegativeTestJSON-1675891323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:15:07 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-108371e4-1af3-40ac-b0fd-4d1fbcf68369 tempest-ServersNegativeTestJSON-1675891323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:15:07 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-108371e4-1af3-40ac-b0fd-4d1fbcf68369 tempest-ServersNegativeTestJSON-1675891323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:15:07 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-108371e4-1af3-40ac-b0fd-4d1fbcf68369 tempest-ServersNegativeTestJSON-1675891323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:15:07 devstack sudo[94564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce Aug 05 06:15:07 devstack sudo[94564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:15:07 devstack sudo[94564]: pam_unix(sudo:session): session closed for user root Aug 05 06:15:07 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-108371e4-1af3-40ac-b0fd-4d1fbcf68369 tempest-ServersNegativeTestJSON-1675891323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce" returned: 0 in 0.277s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:15:07 devstack cinder-volume[88695]: DEBUG cinder.manager [None req-108371e4-1af3-40ac-b0fd-4d1fbcf68369 tempest-ServersNegativeTestJSON-1675891323 None] Notifying Schedulers of capabilities ... {{(pid=88695) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 06:15:07 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-0c4fbba1-1014-4941-a499-284c92084ee0 tempest-ServersNegativeTestJSON-1675891323 None] Acquiring lock "cinder-99aa69e7-c8e7-4424-8a6b-44775d5b3d79-delete_volume" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:15:07 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-108371e4-1af3-40ac-b0fd-4d1fbcf68369 tempest-ServersNegativeTestJSON-1675891323 None] Deleted volume successfully. Aug 05 06:15:07 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-0c4fbba1-1014-4941-a499-284c92084ee0 tempest-ServersNegativeTestJSON-1675891323 None] Lock "cinder-99aa69e7-c8e7-4424-8a6b-44775d5b3d79-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:15:07 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-108371e4-1af3-40ac-b0fd-4d1fbcf68369 tempest-ServersNegativeTestJSON-1675891323 None] Lock "cinder-2502b099-0276-4f2a-9b15-82d02ae3abac-delete_volume" released by "delete_volume" :: held 1.296s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:15:07 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-0c4fbba1-1014-4941-a499-284c92084ee0 tempest-ServersNegativeTestJSON-1675891323 None] Acquiring lock "cinder-quobyte-99aa69e7-c8e7-4424-8a6b-44775d5b3d79" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:15:07 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-0c4fbba1-1014-4941-a499-284c92084ee0 tempest-ServersNegativeTestJSON-1675891323 None] Lock "cinder-quobyte-99aa69e7-c8e7-4424-8a6b-44775d5b3d79" acquired by "delete_volume" :: waited 0.015s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:15:07 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fcae2dc-471b-4404-a443-8b679c671e6f]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:15:07 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-0c4fbba1-1014-4941-a499-284c92084ee0 tempest-ServersNegativeTestJSON-1675891323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-99aa69e7-c8e7-4424-8a6b-44775d5b3d79 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:15:07 devstack sudo[94568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-99aa69e7-c8e7-4424-8a6b-44775d5b3d79 Aug 05 06:15:07 devstack sudo[94568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:15:08 devstack sudo[94568]: pam_unix(sudo:session): session closed for user root Aug 05 06:15:08 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-0c4fbba1-1014-4941-a499-284c92084ee0 tempest-ServersNegativeTestJSON-1675891323 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-99aa69e7-c8e7-4424-8a6b-44775d5b3d79" returned: 0 in 0.423s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:15:08 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-0c4fbba1-1014-4941-a499-284c92084ee0 tempest-ServersNegativeTestJSON-1675891323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-99aa69e7-c8e7-4424-8a6b-44775d5b3d79 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:15:08 devstack sudo[94573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-99aa69e7-c8e7-4424-8a6b-44775d5b3d79 Aug 05 06:15:08 devstack sudo[94573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:15:08 devstack sudo[94573]: pam_unix(sudo:session): session closed for user root Aug 05 06:15:08 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-0c4fbba1-1014-4941-a499-284c92084ee0 tempest-ServersNegativeTestJSON-1675891323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-99aa69e7-c8e7-4424-8a6b-44775d5b3d79" returned: 0 in 0.302s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:15:08 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-0c4fbba1-1014-4941-a499-284c92084ee0 tempest-ServersNegativeTestJSON-1675891323 None] Lock "cinder-quobyte-99aa69e7-c8e7-4424-8a6b-44775d5b3d79" released by "delete_volume" :: held 0.796s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:15:08 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-0c4fbba1-1014-4941-a499-284c92084ee0 tempest-ServersNegativeTestJSON-1675891323 None] Created reservations ['9b41505b-2b40-44cc-bf04-8737619d2255', 'c99d920c-e238-4175-97c7-23246d3d1fd4', 'b93e49ad-2f3e-4d35-a60e-a4b46e1f9ad5', '3fa9a109-ef8a-4d00-8db8-bcc3c33a75e6'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:15:08 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-0c4fbba1-1014-4941-a499-284c92084ee0 tempest-ServersNegativeTestJSON-1675891323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:15:08 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-0c4fbba1-1014-4941-a499-284c92084ee0 tempest-ServersNegativeTestJSON-1675891323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:15:08 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-0c4fbba1-1014-4941-a499-284c92084ee0 tempest-ServersNegativeTestJSON-1675891323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:15:08 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-0c4fbba1-1014-4941-a499-284c92084ee0 tempest-ServersNegativeTestJSON-1675891323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:15:08 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-0c4fbba1-1014-4941-a499-284c92084ee0 tempest-ServersNegativeTestJSON-1675891323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.036s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:15:08 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-0c4fbba1-1014-4941-a499-284c92084ee0 tempest-ServersNegativeTestJSON-1675891323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:15:08 devstack sudo[94577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce Aug 05 06:15:08 devstack sudo[94577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:15:09 devstack sudo[94577]: pam_unix(sudo:session): session closed for user root Aug 05 06:15:09 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-0c4fbba1-1014-4941-a499-284c92084ee0 tempest-ServersNegativeTestJSON-1675891323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce" returned: 0 in 0.434s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:15:09 devstack cinder-volume[88695]: DEBUG cinder.manager [None req-0c4fbba1-1014-4941-a499-284c92084ee0 tempest-ServersNegativeTestJSON-1675891323 None] Notifying Schedulers of capabilities ... {{(pid=88695) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 06:15:09 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-0c4fbba1-1014-4941-a499-284c92084ee0 tempest-ServersNegativeTestJSON-1675891323 None] Deleted volume successfully. Aug 05 06:15:09 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-0c4fbba1-1014-4941-a499-284c92084ee0 tempest-ServersNegativeTestJSON-1675891323 None] Lock "cinder-99aa69e7-c8e7-4424-8a6b-44775d5b3d79-delete_volume" released by "delete_volume" :: held 1.728s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:15:12 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [req-9665213d-c700-4940-9fe4-f59fbb5c859d req-78855414-f4a4-4091-ae3d-9f33a38c9d8c tempest-TestServerVolumeAttachmentScenario-1990739042 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:15:12 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [req-9665213d-c700-4940-9fe4-f59fbb5c859d req-78855414-f4a4-4091-ae3d-9f33a38c9d8c tempest-TestServerVolumeAttachmentScenario-1990739042 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:15:12 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [req-9665213d-c700-4940-9fe4-f59fbb5c859d req-78855414-f4a4-4091-ae3d-9f33a38c9d8c tempest-TestServerVolumeAttachmentScenario-1990739042 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:15:12 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [req-9665213d-c700-4940-9fe4-f59fbb5c859d req-78855414-f4a4-4091-ae3d-9f33a38c9d8c tempest-TestServerVolumeAttachmentScenario-1990739042 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087', 'name': 'volume-e3651087-27df-4417-a10a-1b97a46efaeb', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bdb74daf-5a8b-4048-93e9-cf3f95bfea19', 'enforce_multipath': True} {{(pid=88695) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 05 06:15:12 devstack cinder-volume[88695]: INFO cinder.volume.manager [req-9665213d-c700-4940-9fe4-f59fbb5c859d req-78855414-f4a4-4091-ae3d-9f33a38c9d8c tempest-TestServerVolumeAttachmentScenario-1990739042 None] attachment_update completed successfully. Aug 05 06:15:15 devstack cinder-volume[88695]: INFO cinder.volume.manager [req-0276542d-75d9-4a84-b303-1132b7ce28be req-f6979147-70fa-4161-be2d-f363bf28c546 tempest-TestServerVolumeAttachmentScenario-1990739042 None] Terminate volume connection completed successfully. Aug 05 06:15:15 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [req-0276542d-75d9-4a84-b303-1132b7ce28be req-f6979147-70fa-4161-be2d-f363bf28c546 tempest-TestServerVolumeAttachmentScenario-1990739042 None] Deleting attachment bdb74daf-5a8b-4048-93e9-cf3f95bfea19. {{(pid=88695) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 05 06:15:17 devstack cinder-volume[88695]: INFO cinder.volume.manager [req-bda521ad-731e-4a9d-ac2b-0d0f8b1dca91 req-3b0563ce-07b2-4a3b-9834-f15fa2112517 tempest-TestServerVolumeAttachmentScenario-1990739042 None] Terminate volume connection completed successfully. Aug 05 06:15:17 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [req-bda521ad-731e-4a9d-ac2b-0d0f8b1dca91 req-3b0563ce-07b2-4a3b-9834-f15fa2112517 tempest-TestServerVolumeAttachmentScenario-1990739042 None] Deleting attachment 31dc4486-ef3a-433b-bff1-108b3ca20ada. {{(pid=88695) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 05 06:15:17 devstack cinder-volume[88695]: DEBUG cinder.volume.flows.manager.create_volume [None req-8850fe5c-503a-4639-a39b-6ecb3fb2ead6 tempest-VolumesCloneTest-882742693 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88695) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 06:15:17 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-8850fe5c-503a-4639-a39b-6ecb3fb2ead6 tempest-VolumesCloneTest-882742693 None] Flow 'volume_create_manager' (39a9fa5b-d620-4363-b470-194a6e799adb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:15:17 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-8850fe5c-503a-4639-a39b-6ecb3fb2ead6 tempest-VolumesCloneTest-882742693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f652d722-6c72-488b-8bc7-12786907bb6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:15:17 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-8850fe5c-503a-4639-a39b-6ecb3fb2ead6 tempest-VolumesCloneTest-882742693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f652d722-6c72-488b-8bc7-12786907bb6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:15:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1310002827',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a47a9a15-e750-4ac2-a5e1-2a7f4bee29a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13cc88a83e9345538a16d64825caeb5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:15:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:15:17Z,use_quota=True,user_id='3b0b88a090ef496d9af9d2b3cbaeba47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:15:17 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-8850fe5c-503a-4639-a39b-6ecb3fb2ead6 tempest-VolumesCloneTest-882742693 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f70e2e2-e1d1-4b77-8a7f-1c27cbc0b234) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:15:17 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-8850fe5c-503a-4639-a39b-6ecb3fb2ead6 tempest-VolumesCloneTest-882742693 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f70e2e2-e1d1-4b77-8a7f-1c27cbc0b234) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:15:17 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-8850fe5c-503a-4639-a39b-6ecb3fb2ead6 tempest-VolumesCloneTest-882742693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fa937d7-e38b-4cca-bed8-b8a96e274ad1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:15:17 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-8850fe5c-503a-4639-a39b-6ecb3fb2ead6 tempest-VolumesCloneTest-882742693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fa937d7-e38b-4cca-bed8-b8a96e274ad1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a47a9a15-e750-4ac2-a5e1-2a7f4bee29a1', 'volume_name': 'volume-a47a9a15-e750-4ac2-a5e1-2a7f4bee29a1', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:15:17 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-8850fe5c-503a-4639-a39b-6ecb3fb2ead6 tempest-VolumesCloneTest-882742693 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (040474d2-a01e-45a7-8279-b2fa51a28cd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:15:17 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-8850fe5c-503a-4639-a39b-6ecb3fb2ead6 tempest-VolumesCloneTest-882742693 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (040474d2-a01e-45a7-8279-b2fa51a28cd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:15:17 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-8850fe5c-503a-4639-a39b-6ecb3fb2ead6 tempest-VolumesCloneTest-882742693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a18cfc0-d630-40ba-981d-5c957dae00f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:15:17 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-8850fe5c-503a-4639-a39b-6ecb3fb2ead6 tempest-VolumesCloneTest-882742693 None] Volume a47a9a15-e750-4ac2-a5e1-2a7f4bee29a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a47a9a15-e750-4ac2-a5e1-2a7f4bee29a1', 'volume_size': 1} Aug 05 06:15:17 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-8850fe5c-503a-4639-a39b-6ecb3fb2ead6 tempest-VolumesCloneTest-882742693 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:15:17 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-8850fe5c-503a-4639-a39b-6ecb3fb2ead6 tempest-VolumesCloneTest-882742693 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:15:17 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-8850fe5c-503a-4639-a39b-6ecb3fb2ead6 tempest-VolumesCloneTest-882742693 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:15:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1310002827',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a47a9a15-e750-4ac2-a5e1-2a7f4bee29a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13cc88a83e9345538a16d64825caeb5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:15:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:15:17Z,use_quota=True,user_id='3b0b88a090ef496d9af9d2b3cbaeba47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)}" {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 06:15:17 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-8850fe5c-503a-4639-a39b-6ecb3fb2ead6 tempest-VolumesCloneTest-882742693 None] Creating volume a47a9a15-e750-4ac2-a5e1-2a7f4bee29a1 {{(pid=88695) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 06:15:17 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-8850fe5c-503a-4639-a39b-6ecb3fb2ead6 tempest-VolumesCloneTest-882742693 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:15:17 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-8850fe5c-503a-4639-a39b-6ecb3fb2ead6 tempest-VolumesCloneTest-882742693 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:15:17 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-8850fe5c-503a-4639-a39b-6ecb3fb2ead6 tempest-VolumesCloneTest-882742693 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:15:17 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-8850fe5c-503a-4639-a39b-6ecb3fb2ead6 tempest-VolumesCloneTest-882742693 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:15:17 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-8850fe5c-503a-4639-a39b-6ecb3fb2ead6 tempest-VolumesCloneTest-882742693 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:15:17 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-8850fe5c-503a-4639-a39b-6ecb3fb2ead6 tempest-VolumesCloneTest-882742693 None] Selected osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 as target Quobyte volume. {{(pid=88695) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 06:15:17 devstack cinder-volume[88695]: INFO cinder.volume.drivers.remotefs [None req-8850fe5c-503a-4639-a39b-6ecb3fb2ead6 tempest-VolumesCloneTest-882742693 None] casted to osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 Aug 05 06:15:17 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-8850fe5c-503a-4639-a39b-6ecb3fb2ead6 tempest-VolumesCloneTest-882742693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a47a9a15-e750-4ac2-a5e1-2a7f4bee29a1 1073741824 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:15:17 devstack sudo[94673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a47a9a15-e750-4ac2-a5e1-2a7f4bee29a1 1073741824 Aug 05 06:15:17 devstack sudo[94673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:15:17 devstack sudo[94673]: pam_unix(sudo:session): session closed for user root Aug 05 06:15:17 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-8850fe5c-503a-4639-a39b-6ecb3fb2ead6 tempest-VolumesCloneTest-882742693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a47a9a15-e750-4ac2-a5e1-2a7f4bee29a1 1073741824" returned: 0 in 0.570s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:15:17 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-8850fe5c-503a-4639-a39b-6ecb3fb2ead6 tempest-VolumesCloneTest-882742693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a47a9a15-e750-4ac2-a5e1-2a7f4bee29a1 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:15:17 devstack sudo[94683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a47a9a15-e750-4ac2-a5e1-2a7f4bee29a1 Aug 05 06:15:17 devstack sudo[94683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:15:18 devstack sudo[94683]: pam_unix(sudo:session): session closed for user root Aug 05 06:15:18 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-8850fe5c-503a-4639-a39b-6ecb3fb2ead6 tempest-VolumesCloneTest-882742693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a47a9a15-e750-4ac2-a5e1-2a7f4bee29a1" returned: 0 in 0.295s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:15:18 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-8850fe5c-503a-4639-a39b-6ecb3fb2ead6 tempest-VolumesCloneTest-882742693 None] <== create_volume: return (941ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'} {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 06:15:18 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-8850fe5c-503a-4639-a39b-6ecb3fb2ead6 tempest-VolumesCloneTest-882742693 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.943s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:15:18 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-8850fe5c-503a-4639-a39b-6ecb3fb2ead6 tempest-VolumesCloneTest-882742693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a18cfc0-d630-40ba-981d-5c957dae00f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a47a9a15-e750-4ac2-a5e1-2a7f4bee29a1', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:15:18 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-8850fe5c-503a-4639-a39b-6ecb3fb2ead6 tempest-VolumesCloneTest-882742693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e509002-d559-464c-b6ee-d5cd6913fcd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:15:18 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-8850fe5c-503a-4639-a39b-6ecb3fb2ead6 tempest-VolumesCloneTest-882742693 None] Volume volume-a47a9a15-e750-4ac2-a5e1-2a7f4bee29a1 (a47a9a15-e750-4ac2-a5e1-2a7f4bee29a1): created successfully Aug 05 06:15:18 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-8850fe5c-503a-4639-a39b-6ecb3fb2ead6 tempest-VolumesCloneTest-882742693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e509002-d559-464c-b6ee-d5cd6913fcd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:15:18 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-8850fe5c-503a-4639-a39b-6ecb3fb2ead6 tempest-VolumesCloneTest-882742693 None] Flow 'volume_create_manager' (39a9fa5b-d620-4363-b470-194a6e799adb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:15:18 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-8850fe5c-503a-4639-a39b-6ecb3fb2ead6 tempest-VolumesCloneTest-882742693 None] Created volume successfully. Aug 05 06:15:20 devstack cinder-volume[88695]: DEBUG cinder.volume.flows.manager.create_volume [None req-36c208eb-4e98-48f6-81ec-765851a867bf tempest-VolumesCloneTest-882742693 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88695) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 06:15:20 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-36c208eb-4e98-48f6-81ec-765851a867bf tempest-VolumesCloneTest-882742693 None] Flow 'volume_create_manager' (980d8155-a008-4130-b1ef-85fd1e1b8c54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:15:20 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-36c208eb-4e98-48f6-81ec-765851a867bf tempest-VolumesCloneTest-882742693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dede0235-f8af-49e5-98f2-24805315c59e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:15:20 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-36c208eb-4e98-48f6-81ec-765851a867bf tempest-VolumesCloneTest-882742693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dede0235-f8af-49e5-98f2-24805315c59e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:15:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1315831725',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61975dc1-f774-4e6f-81c0-b9ec830220e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13cc88a83e9345538a16d64825caeb5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:15:20Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=a47a9a15-e750-4ac2-a5e1-2a7f4bee29a1,status='creating',terminated_at=None,updated_at=2026-08-05T04:15:20Z,use_quota=True,user_id='3b0b88a090ef496d9af9d2b3cbaeba47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:15:20 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-36c208eb-4e98-48f6-81ec-765851a867bf tempest-VolumesCloneTest-882742693 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6deab8c-76b9-4bcc-a2b6-be2fa6cbcdae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:15:20 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-36c208eb-4e98-48f6-81ec-765851a867bf tempest-VolumesCloneTest-882742693 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6deab8c-76b9-4bcc-a2b6-be2fa6cbcdae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:15:20 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-36c208eb-4e98-48f6-81ec-765851a867bf tempest-VolumesCloneTest-882742693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (559bc379-ab74-4759-b71f-ace1d3e33628) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:15:20 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-36c208eb-4e98-48f6-81ec-765851a867bf tempest-VolumesCloneTest-882742693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (559bc379-ab74-4759-b71f-ace1d3e33628) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '61975dc1-f774-4e6f-81c0-b9ec830220e4', 'volume_name': 'volume-61975dc1-f774-4e6f-81c0-b9ec830220e4', 'volume_size': 2, 'source_volid': 'a47a9a15-e750-4ac2-a5e1-2a7f4bee29a1', 'source_volstatus': 'available'}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:15:20 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-36c208eb-4e98-48f6-81ec-765851a867bf tempest-VolumesCloneTest-882742693 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13233f42-82b7-463d-a72b-80b638b49682) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:15:20 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-36c208eb-4e98-48f6-81ec-765851a867bf tempest-VolumesCloneTest-882742693 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13233f42-82b7-463d-a72b-80b638b49682) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:15:20 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-36c208eb-4e98-48f6-81ec-765851a867bf tempest-VolumesCloneTest-882742693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f9a5936-af7e-4619-9895-001135355c78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:15:20 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-36c208eb-4e98-48f6-81ec-765851a867bf tempest-VolumesCloneTest-882742693 None] Volume 61975dc1-f774-4e6f-81c0-b9ec830220e4: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-61975dc1-f774-4e6f-81c0-b9ec830220e4', 'volume_size': 2, 'source_volid': 'a47a9a15-e750-4ac2-a5e1-2a7f4bee29a1', 'source_volstatus': 'available'} Aug 05 06:15:20 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-36c208eb-4e98-48f6-81ec-765851a867bf tempest-VolumesCloneTest-882742693 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:15:20 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-36c208eb-4e98-48f6-81ec-765851a867bf tempest-VolumesCloneTest-882742693 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:15:20 devstack cinder-volume[88695]: INFO cinder.volume.drivers.remotefs [None req-36c208eb-4e98-48f6-81ec-765851a867bf tempest-VolumesCloneTest-882742693 None] Cloning volume a47a9a15-e750-4ac2-a5e1-2a7f4bee29a1 to volume 61975dc1-f774-4e6f-81c0-b9ec830220e4 Aug 05 06:15:20 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-36c208eb-4e98-48f6-81ec-765851a867bf tempest-VolumesCloneTest-882742693 None] Creating offline snapshot 6de0dbcf-74ed-4a58-a7e9-fbd682932c13 of volume a47a9a15-e750-4ac2-a5e1-2a7f4bee29a1 {{(pid=88695) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 06:15:20 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fbd82af-efd7-4a83-840c-632ed05add0d]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:15:20 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-36c208eb-4e98-48f6-81ec-765851a867bf tempest-VolumesCloneTest-882742693 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a47a9a15-e750-4ac2-a5e1-2a7f4bee29a1 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:15:20 devstack sudo[94712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a47a9a15-e750-4ac2-a5e1-2a7f4bee29a1 Aug 05 06:15:20 devstack sudo[94712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:15:20 devstack sudo[94712]: pam_unix(sudo:session): session closed for user root Aug 05 06:15:20 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-36c208eb-4e98-48f6-81ec-765851a867bf tempest-VolumesCloneTest-882742693 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a47a9a15-e750-4ac2-a5e1-2a7f4bee29a1" returned: 0 in 0.489s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:15:20 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-36c208eb-4e98-48f6-81ec-765851a867bf tempest-VolumesCloneTest-882742693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a47a9a15-e750-4ac2-a5e1-2a7f4bee29a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a47a9a15-e750-4ac2-a5e1-2a7f4bee29a1.6de0dbcf-74ed-4a58-a7e9-fbd682932c13 1G {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:15:20 devstack sudo[94717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a47a9a15-e750-4ac2-a5e1-2a7f4bee29a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a47a9a15-e750-4ac2-a5e1-2a7f4bee29a1.6de0dbcf-74ed-4a58-a7e9-fbd682932c13 1G Aug 05 06:15:20 devstack sudo[94717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:15:21 devstack sudo[94717]: pam_unix(sudo:session): session closed for user root Aug 05 06:15:21 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-36c208eb-4e98-48f6-81ec-765851a867bf tempest-VolumesCloneTest-882742693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a47a9a15-e750-4ac2-a5e1-2a7f4bee29a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a47a9a15-e750-4ac2-a5e1-2a7f4bee29a1.6de0dbcf-74ed-4a58-a7e9-fbd682932c13 1G" returned: 0 in 0.559s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:15:21 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-36c208eb-4e98-48f6-81ec-765851a867bf tempest-VolumesCloneTest-882742693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a47a9a15-e750-4ac2-a5e1-2a7f4bee29a1 -F qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a47a9a15-e750-4ac2-a5e1-2a7f4bee29a1.6de0dbcf-74ed-4a58-a7e9-fbd682932c13 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:15:21 devstack sudo[94722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a47a9a15-e750-4ac2-a5e1-2a7f4bee29a1 -F qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a47a9a15-e750-4ac2-a5e1-2a7f4bee29a1.6de0dbcf-74ed-4a58-a7e9-fbd682932c13 Aug 05 06:15:21 devstack sudo[94722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:15:21 devstack sudo[94722]: pam_unix(sudo:session): session closed for user root Aug 05 06:15:21 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-36c208eb-4e98-48f6-81ec-765851a867bf tempest-VolumesCloneTest-882742693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a47a9a15-e750-4ac2-a5e1-2a7f4bee29a1 -F qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a47a9a15-e750-4ac2-a5e1-2a7f4bee29a1.6de0dbcf-74ed-4a58-a7e9-fbd682932c13" returned: 0 in 0.405s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:15:21 devstack cinder-volume[88695]: WARNING cinder.volume.drivers.remotefs [None req-36c208eb-4e98-48f6-81ec-765851a867bf tempest-VolumesCloneTest-882742693 None] /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a47a9a15-e750-4ac2-a5e1-2a7f4bee29a1.6de0dbcf-74ed-4a58-a7e9-fbd682932c13 is being set with open permissions: ugo+rw Aug 05 06:15:21 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-36c208eb-4e98-48f6-81ec-765851a867bf tempest-VolumesCloneTest-882742693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a47a9a15-e750-4ac2-a5e1-2a7f4bee29a1.6de0dbcf-74ed-4a58-a7e9-fbd682932c13 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:15:21 devstack sudo[94727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a47a9a15-e750-4ac2-a5e1-2a7f4bee29a1.6de0dbcf-74ed-4a58-a7e9-fbd682932c13 Aug 05 06:15:21 devstack sudo[94727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:15:22 devstack sudo[94727]: pam_unix(sudo:session): session closed for user root Aug 05 06:15:22 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-36c208eb-4e98-48f6-81ec-765851a867bf tempest-VolumesCloneTest-882742693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a47a9a15-e750-4ac2-a5e1-2a7f4bee29a1.6de0dbcf-74ed-4a58-a7e9-fbd682932c13" returned: 0 in 0.413s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:15:22 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-1097315a-0751-48e0-a1e6-de68e6776dd3 tempest-TestServerVolumeAttachmentScenario-1990739042 None] Acquiring lock "cinder-e3651087-27df-4417-a10a-1b97a46efaeb-delete_volume" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:15:22 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-1097315a-0751-48e0-a1e6-de68e6776dd3 tempest-TestServerVolumeAttachmentScenario-1990739042 None] Lock "cinder-e3651087-27df-4417-a10a-1b97a46efaeb-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:15:22 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-36c208eb-4e98-48f6-81ec-765851a867bf tempest-VolumesCloneTest-882742693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a47a9a15-e750-4ac2-a5e1-2a7f4bee29a1.info {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:15:22 devstack sudo[94730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a47a9a15-e750-4ac2-a5e1-2a7f4bee29a1.info Aug 05 06:15:22 devstack sudo[94730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:15:22 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-1097315a-0751-48e0-a1e6-de68e6776dd3 tempest-TestServerVolumeAttachmentScenario-1990739042 None] Acquiring lock "cinder-quobyte-e3651087-27df-4417-a10a-1b97a46efaeb" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:15:22 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-1097315a-0751-48e0-a1e6-de68e6776dd3 tempest-TestServerVolumeAttachmentScenario-1990739042 None] Lock "cinder-quobyte-e3651087-27df-4417-a10a-1b97a46efaeb" acquired by "delete_volume" :: waited 0.016s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:15:22 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[844d0465-b7ac-486d-a712-f611be101bed]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:15:22 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-1097315a-0751-48e0-a1e6-de68e6776dd3 tempest-TestServerVolumeAttachmentScenario-1990739042 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-e3651087-27df-4417-a10a-1b97a46efaeb {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:15:22 devstack sudo[94732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-e3651087-27df-4417-a10a-1b97a46efaeb Aug 05 06:15:22 devstack sudo[94732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:15:22 devstack sudo[94730]: pam_unix(sudo:session): session closed for user root Aug 05 06:15:22 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-36c208eb-4e98-48f6-81ec-765851a867bf tempest-VolumesCloneTest-882742693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a47a9a15-e750-4ac2-a5e1-2a7f4bee29a1.info" returned: 0 in 0.308s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:15:22 devstack cinder-volume[88695]: WARNING cinder.volume.drivers.remotefs [None req-36c208eb-4e98-48f6-81ec-765851a867bf tempest-VolumesCloneTest-882742693 None] /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a47a9a15-e750-4ac2-a5e1-2a7f4bee29a1.info is being set with open permissions: ugo+rw Aug 05 06:15:22 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-36c208eb-4e98-48f6-81ec-765851a867bf tempest-VolumesCloneTest-882742693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a47a9a15-e750-4ac2-a5e1-2a7f4bee29a1.info {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:15:22 devstack sudo[94750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a47a9a15-e750-4ac2-a5e1-2a7f4bee29a1.info Aug 05 06:15:22 devstack sudo[94750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:15:22 devstack sudo[94732]: pam_unix(sudo:session): session closed for user root Aug 05 06:15:22 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-1097315a-0751-48e0-a1e6-de68e6776dd3 tempest-TestServerVolumeAttachmentScenario-1990739042 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-e3651087-27df-4417-a10a-1b97a46efaeb" returned: 0 in 0.501s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:15:22 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-1097315a-0751-48e0-a1e6-de68e6776dd3 tempest-TestServerVolumeAttachmentScenario-1990739042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-e3651087-27df-4417-a10a-1b97a46efaeb {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:15:22 devstack sudo[94750]: pam_unix(sudo:session): session closed for user root Aug 05 06:15:22 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-36c208eb-4e98-48f6-81ec-765851a867bf tempest-VolumesCloneTest-882742693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a47a9a15-e750-4ac2-a5e1-2a7f4bee29a1.info" returned: 0 in 0.300s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:15:22 devstack sudo[94756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-e3651087-27df-4417-a10a-1b97a46efaeb Aug 05 06:15:22 devstack sudo[94756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:15:22 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-36c208eb-4e98-48f6-81ec-765851a867bf tempest-VolumesCloneTest-882742693 None] Acquiring lock "cinder-quobyte-61975dc1-f774-4e6f-81c0-b9ec830220e4" by "_copy_volume_from_snapshot" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:15:22 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-36c208eb-4e98-48f6-81ec-765851a867bf tempest-VolumesCloneTest-882742693 None] Lock "cinder-quobyte-61975dc1-f774-4e6f-81c0-b9ec830220e4" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:15:22 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-36c208eb-4e98-48f6-81ec-765851a867bf tempest-VolumesCloneTest-882742693 None] snapshot: 6de0dbcf-74ed-4a58-a7e9-fbd682932c13, volume: 61975dc1-f774-4e6f-81c0-b9ec830220e4, {{(pid=88695) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 05 06:15:22 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-36c208eb-4e98-48f6-81ec-765851a867bf tempest-VolumesCloneTest-882742693 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:15:22 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-36c208eb-4e98-48f6-81ec-765851a867bf tempest-VolumesCloneTest-882742693 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:15:22 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-36c208eb-4e98-48f6-81ec-765851a867bf tempest-VolumesCloneTest-882742693 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:15:22 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-36c208eb-4e98-48f6-81ec-765851a867bf tempest-VolumesCloneTest-882742693 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:15:22 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-36c208eb-4e98-48f6-81ec-765851a867bf tempest-VolumesCloneTest-882742693 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:15:22 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6adf020-96d0-4cb9-bc5b-690eac5702eb]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:15:22 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-36c208eb-4e98-48f6-81ec-765851a867bf tempest-VolumesCloneTest-882742693 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a47a9a15-e750-4ac2-a5e1-2a7f4bee29a1.6de0dbcf-74ed-4a58-a7e9-fbd682932c13 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:15:23 devstack sudo[94758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a47a9a15-e750-4ac2-a5e1-2a7f4bee29a1.6de0dbcf-74ed-4a58-a7e9-fbd682932c13 Aug 05 06:15:23 devstack sudo[94758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:15:23 devstack sudo[94756]: pam_unix(sudo:session): session closed for user root Aug 05 06:15:23 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-1097315a-0751-48e0-a1e6-de68e6776dd3 tempest-TestServerVolumeAttachmentScenario-1990739042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-e3651087-27df-4417-a10a-1b97a46efaeb" returned: 0 in 0.348s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:15:23 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-1097315a-0751-48e0-a1e6-de68e6776dd3 tempest-TestServerVolumeAttachmentScenario-1990739042 None] Lock "cinder-quobyte-e3651087-27df-4417-a10a-1b97a46efaeb" released by "delete_volume" :: held 0.893s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:15:23 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-1097315a-0751-48e0-a1e6-de68e6776dd3 tempest-TestServerVolumeAttachmentScenario-1990739042 None] Created reservations ['4ff4f424-677a-4bf6-837c-3447a1b48448', 'b67c7808-6bf0-4052-8fe4-aebb84c23b2e', 'acaa66f2-5339-4a4f-b8a9-34d06853fb6a', 'db2af2a0-0500-4c62-ae53-0a4ac9b379e1'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:15:23 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-1097315a-0751-48e0-a1e6-de68e6776dd3 tempest-TestServerVolumeAttachmentScenario-1990739042 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:15:23 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-1097315a-0751-48e0-a1e6-de68e6776dd3 tempest-TestServerVolumeAttachmentScenario-1990739042 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:15:23 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-1097315a-0751-48e0-a1e6-de68e6776dd3 tempest-TestServerVolumeAttachmentScenario-1990739042 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:15:23 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-1097315a-0751-48e0-a1e6-de68e6776dd3 tempest-TestServerVolumeAttachmentScenario-1990739042 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:15:23 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-1097315a-0751-48e0-a1e6-de68e6776dd3 tempest-TestServerVolumeAttachmentScenario-1990739042 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:15:23 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-1097315a-0751-48e0-a1e6-de68e6776dd3 tempest-TestServerVolumeAttachmentScenario-1990739042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:15:23 devstack sudo[94765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce Aug 05 06:15:23 devstack sudo[94765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:15:23 devstack sudo[94758]: pam_unix(sudo:session): session closed for user root Aug 05 06:15:23 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-36c208eb-4e98-48f6-81ec-765851a867bf tempest-VolumesCloneTest-882742693 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a47a9a15-e750-4ac2-a5e1-2a7f4bee29a1.6de0dbcf-74ed-4a58-a7e9-fbd682932c13" returned: 0 in 0.552s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:15:23 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-36c208eb-4e98-48f6-81ec-765851a867bf tempest-VolumesCloneTest-882742693 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a47a9a15-e750-4ac2-a5e1-2a7f4bee29a1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88695) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 06:15:23 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-b5e5fcb7-70c8-4fbe-bc49-62db5f0d7806 tempest-TestServerVolumeAttachmentScenario-1990739042 None] Acquiring lock "cinder-4ca7847e-4c2c-4412-ab30-455f5e3215c4-delete_volume" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:15:23 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f3debc3-d5d8-4310-985e-2fbe053768e8]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:15:23 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-36c208eb-4e98-48f6-81ec-765851a867bf tempest-VolumesCloneTest-882742693 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a47a9a15-e750-4ac2-a5e1-2a7f4bee29a1 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:15:23 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-b5e5fcb7-70c8-4fbe-bc49-62db5f0d7806 tempest-TestServerVolumeAttachmentScenario-1990739042 None] Lock "cinder-4ca7847e-4c2c-4412-ab30-455f5e3215c4-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:15:23 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-b5e5fcb7-70c8-4fbe-bc49-62db5f0d7806 tempest-TestServerVolumeAttachmentScenario-1990739042 None] Acquiring lock "cinder-quobyte-4ca7847e-4c2c-4412-ab30-455f5e3215c4" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:15:23 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-b5e5fcb7-70c8-4fbe-bc49-62db5f0d7806 tempest-TestServerVolumeAttachmentScenario-1990739042 None] Lock "cinder-quobyte-4ca7847e-4c2c-4412-ab30-455f5e3215c4" acquired by "delete_volume" :: waited 0.031s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:15:23 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[275dbd80-223e-456d-aa34-9019bb28c2cf]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:15:23 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-b5e5fcb7-70c8-4fbe-bc49-62db5f0d7806 tempest-TestServerVolumeAttachmentScenario-1990739042 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-4ca7847e-4c2c-4412-ab30-455f5e3215c4 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:15:23 devstack sudo[94767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a47a9a15-e750-4ac2-a5e1-2a7f4bee29a1 Aug 05 06:15:23 devstack sudo[94767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:15:23 devstack sudo[94765]: pam_unix(sudo:session): session closed for user root Aug 05 06:15:23 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-1097315a-0751-48e0-a1e6-de68e6776dd3 tempest-TestServerVolumeAttachmentScenario-1990739042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce" returned: 0 in 0.389s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:15:23 devstack cinder-volume[88695]: DEBUG cinder.manager [None req-1097315a-0751-48e0-a1e6-de68e6776dd3 tempest-TestServerVolumeAttachmentScenario-1990739042 None] Notifying Schedulers of capabilities ... {{(pid=88695) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 06:15:23 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-1097315a-0751-48e0-a1e6-de68e6776dd3 tempest-TestServerVolumeAttachmentScenario-1990739042 None] Deleted volume successfully. Aug 05 06:15:23 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-1097315a-0751-48e0-a1e6-de68e6776dd3 tempest-TestServerVolumeAttachmentScenario-1990739042 None] Lock "cinder-e3651087-27df-4417-a10a-1b97a46efaeb-delete_volume" released by "delete_volume" :: held 1.633s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:15:23 devstack sudo[94768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-4ca7847e-4c2c-4412-ab30-455f5e3215c4 Aug 05 06:15:23 devstack sudo[94768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:15:24 devstack sudo[94767]: pam_unix(sudo:session): session closed for user root Aug 05 06:15:24 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-36c208eb-4e98-48f6-81ec-765851a867bf tempest-VolumesCloneTest-882742693 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a47a9a15-e750-4ac2-a5e1-2a7f4bee29a1" returned: 0 in 0.474s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:15:24 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-36c208eb-4e98-48f6-81ec-765851a867bf tempest-VolumesCloneTest-882742693 None] will copy from snapshot at /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a47a9a15-e750-4ac2-a5e1-2a7f4bee29a1 {{(pid=88695) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 05 06:15:24 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-36c208eb-4e98-48f6-81ec-765851a867bf tempest-VolumesCloneTest-882742693 None] Creating direct copy from snapshot {{(pid=88695) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 05 06:15:24 devstack cinder-volume[88695]: DEBUG cinder.utils [None req-36c208eb-4e98-48f6-81ec-765851a867bf tempest-VolumesCloneTest-882742693 None] Path /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-61975dc1-f774-4e6f-81c0-b9ec830220e4 not found in is_blk_device check {{(pid=88695) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 05 06:15:24 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-36c208eb-4e98-48f6-81ec-765851a867bf tempest-VolumesCloneTest-882742693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a47a9a15-e750-4ac2-a5e1-2a7f4bee29a1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-61975dc1-f774-4e6f-81c0-b9ec830220e4 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:15:24 devstack sudo[94775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a47a9a15-e750-4ac2-a5e1-2a7f4bee29a1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-61975dc1-f774-4e6f-81c0-b9ec830220e4 Aug 05 06:15:24 devstack sudo[94775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:15:24 devstack sudo[94768]: pam_unix(sudo:session): session closed for user root Aug 05 06:15:24 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-b5e5fcb7-70c8-4fbe-bc49-62db5f0d7806 tempest-TestServerVolumeAttachmentScenario-1990739042 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-4ca7847e-4c2c-4412-ab30-455f5e3215c4" returned: 0 in 0.470s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:15:24 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-b5e5fcb7-70c8-4fbe-bc49-62db5f0d7806 tempest-TestServerVolumeAttachmentScenario-1990739042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-4ca7847e-4c2c-4412-ab30-455f5e3215c4 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:15:24 devstack sudo[94780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-4ca7847e-4c2c-4412-ab30-455f5e3215c4 Aug 05 06:15:24 devstack sudo[94780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:15:24 devstack sudo[94780]: pam_unix(sudo:session): session closed for user root Aug 05 06:15:24 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-b5e5fcb7-70c8-4fbe-bc49-62db5f0d7806 tempest-TestServerVolumeAttachmentScenario-1990739042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-4ca7847e-4c2c-4412-ab30-455f5e3215c4" returned: 0 in 0.263s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:15:24 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-b5e5fcb7-70c8-4fbe-bc49-62db5f0d7806 tempest-TestServerVolumeAttachmentScenario-1990739042 None] Lock "cinder-quobyte-4ca7847e-4c2c-4412-ab30-455f5e3215c4" released by "delete_volume" :: held 0.790s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:15:24 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-b5e5fcb7-70c8-4fbe-bc49-62db5f0d7806 tempest-TestServerVolumeAttachmentScenario-1990739042 None] Created reservations ['54ae7ac0-80b8-45d7-afd7-8b8f5440f9f9', '15491fd8-3046-4a36-b45c-02a87554947e', '85da8433-324c-4192-af04-b401596b7a45', '6a88afb6-4b3d-4646-a5f6-b9d7c35cf12d'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:15:24 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-b5e5fcb7-70c8-4fbe-bc49-62db5f0d7806 tempest-TestServerVolumeAttachmentScenario-1990739042 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:15:24 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-b5e5fcb7-70c8-4fbe-bc49-62db5f0d7806 tempest-TestServerVolumeAttachmentScenario-1990739042 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:15:24 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-b5e5fcb7-70c8-4fbe-bc49-62db5f0d7806 tempest-TestServerVolumeAttachmentScenario-1990739042 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:15:24 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-b5e5fcb7-70c8-4fbe-bc49-62db5f0d7806 tempest-TestServerVolumeAttachmentScenario-1990739042 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:15:24 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-b5e5fcb7-70c8-4fbe-bc49-62db5f0d7806 tempest-TestServerVolumeAttachmentScenario-1990739042 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:15:24 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-b5e5fcb7-70c8-4fbe-bc49-62db5f0d7806 tempest-TestServerVolumeAttachmentScenario-1990739042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:15:24 devstack sudo[94795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce Aug 05 06:15:24 devstack sudo[94795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:15:25 devstack sudo[94795]: pam_unix(sudo:session): session closed for user root Aug 05 06:15:25 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-b5e5fcb7-70c8-4fbe-bc49-62db5f0d7806 tempest-TestServerVolumeAttachmentScenario-1990739042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce" returned: 0 in 0.623s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:15:25 devstack cinder-volume[88695]: DEBUG cinder.manager [None req-b5e5fcb7-70c8-4fbe-bc49-62db5f0d7806 tempest-TestServerVolumeAttachmentScenario-1990739042 None] Notifying Schedulers of capabilities ... {{(pid=88695) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 06:15:25 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-b5e5fcb7-70c8-4fbe-bc49-62db5f0d7806 tempest-TestServerVolumeAttachmentScenario-1990739042 None] Deleted volume successfully. Aug 05 06:15:25 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-b5e5fcb7-70c8-4fbe-bc49-62db5f0d7806 tempest-TestServerVolumeAttachmentScenario-1990739042 None] Lock "cinder-4ca7847e-4c2c-4412-ab30-455f5e3215c4-delete_volume" released by "delete_volume" :: held 1.936s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:15:29 devstack sudo[94775]: pam_unix(sudo:session): session closed for user root Aug 05 06:15:29 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-36c208eb-4e98-48f6-81ec-765851a867bf tempest-VolumesCloneTest-882742693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a47a9a15-e750-4ac2-a5e1-2a7f4bee29a1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-61975dc1-f774-4e6f-81c0-b9ec830220e4" returned: 0 in 5.414s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:15:29 devstack cinder-volume[88695]: DEBUG cinder.image.image_utils [None req-36c208eb-4e98-48f6-81ec-765851a867bf tempest-VolumesCloneTest-882742693 None] Image conversion details: src /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a47a9a15-e750-4ac2-a5e1-2a7f4bee29a1, size 1024.00 MB, duration 5.42 sec, destination /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-61975dc1-f774-4e6f-81c0-b9ec830220e4 {{(pid=88695) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 05 06:15:29 devstack cinder-volume[88695]: INFO cinder.image.image_utils [None req-36c208eb-4e98-48f6-81ec-765851a867bf tempest-VolumesCloneTest-882742693 None] Converted 1024.00 MB image at 189.10 MB/s Aug 05 06:15:29 devstack cinder-volume[88695]: WARNING cinder.volume.drivers.remotefs [None req-36c208eb-4e98-48f6-81ec-765851a867bf tempest-VolumesCloneTest-882742693 None] /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-61975dc1-f774-4e6f-81c0-b9ec830220e4 is being set with open permissions: ugo+rw Aug 05 06:15:29 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-36c208eb-4e98-48f6-81ec-765851a867bf tempest-VolumesCloneTest-882742693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-61975dc1-f774-4e6f-81c0-b9ec830220e4 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:15:29 devstack sudo[94801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-61975dc1-f774-4e6f-81c0-b9ec830220e4 Aug 05 06:15:29 devstack sudo[94801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:15:29 devstack sudo[94801]: pam_unix(sudo:session): session closed for user root Aug 05 06:15:29 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-36c208eb-4e98-48f6-81ec-765851a867bf tempest-VolumesCloneTest-882742693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-61975dc1-f774-4e6f-81c0-b9ec830220e4" returned: 0 in 0.342s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:15:29 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-36c208eb-4e98-48f6-81ec-765851a867bf tempest-VolumesCloneTest-882742693 None] Lock "cinder-quobyte-61975dc1-f774-4e6f-81c0-b9ec830220e4" released by "_copy_volume_from_snapshot" :: held 6.888s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:15:29 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-36c208eb-4e98-48f6-81ec-765851a867bf tempest-VolumesCloneTest-882742693 None] Acquiring lock "cinder-quobyte-6de0dbcf-74ed-4a58-a7e9-fbd682932c13" by "_delete_snapshot" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:15:29 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-36c208eb-4e98-48f6-81ec-765851a867bf tempest-VolumesCloneTest-882742693 None] Lock "cinder-quobyte-6de0dbcf-74ed-4a58-a7e9-fbd682932c13" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:15:29 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-36c208eb-4e98-48f6-81ec-765851a867bf tempest-VolumesCloneTest-882742693 None] Deleting offline snapshot 6de0dbcf-74ed-4a58-a7e9-fbd682932c13 of volume a47a9a15-e750-4ac2-a5e1-2a7f4bee29a1 {{(pid=88695) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 06:15:30 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-36c208eb-4e98-48f6-81ec-765851a867bf tempest-VolumesCloneTest-882742693 None] snapshot_file for this snap is: volume-a47a9a15-e750-4ac2-a5e1-2a7f4bee29a1.6de0dbcf-74ed-4a58-a7e9-fbd682932c13 {{(pid=88695) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 06:15:30 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0f42665-d298-4633-a7e3-2ce80b4fbb47]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:15:30 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-36c208eb-4e98-48f6-81ec-765851a867bf tempest-VolumesCloneTest-882742693 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a47a9a15-e750-4ac2-a5e1-2a7f4bee29a1.6de0dbcf-74ed-4a58-a7e9-fbd682932c13 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:15:30 devstack sudo[94810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a47a9a15-e750-4ac2-a5e1-2a7f4bee29a1.6de0dbcf-74ed-4a58-a7e9-fbd682932c13 Aug 05 06:15:30 devstack sudo[94810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:15:30 devstack sudo[94810]: pam_unix(sudo:session): session closed for user root Aug 05 06:15:30 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-36c208eb-4e98-48f6-81ec-765851a867bf tempest-VolumesCloneTest-882742693 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a47a9a15-e750-4ac2-a5e1-2a7f4bee29a1.6de0dbcf-74ed-4a58-a7e9-fbd682932c13" returned: 0 in 0.583s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:15:30 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-36c208eb-4e98-48f6-81ec-765851a867bf tempest-VolumesCloneTest-882742693 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a47a9a15-e750-4ac2-a5e1-2a7f4bee29a1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88695) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 06:15:30 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0e0a365-bee3-4d13-b280-cf239bb19f9c]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:15:30 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-36c208eb-4e98-48f6-81ec-765851a867bf tempest-VolumesCloneTest-882742693 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a47a9a15-e750-4ac2-a5e1-2a7f4bee29a1 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:15:30 devstack sudo[94836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a47a9a15-e750-4ac2-a5e1-2a7f4bee29a1 Aug 05 06:15:30 devstack sudo[94836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:15:31 devstack sudo[94836]: pam_unix(sudo:session): session closed for user root Aug 05 06:15:31 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-36c208eb-4e98-48f6-81ec-765851a867bf tempest-VolumesCloneTest-882742693 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a47a9a15-e750-4ac2-a5e1-2a7f4bee29a1" returned: 0 in 0.566s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:15:31 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-36c208eb-4e98-48f6-81ec-765851a867bf tempest-VolumesCloneTest-882742693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a47a9a15-e750-4ac2-a5e1-2a7f4bee29a1.6de0dbcf-74ed-4a58-a7e9-fbd682932c13 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:15:31 devstack sudo[94842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a47a9a15-e750-4ac2-a5e1-2a7f4bee29a1.6de0dbcf-74ed-4a58-a7e9-fbd682932c13 Aug 05 06:15:31 devstack sudo[94842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:15:31 devstack sudo[94842]: pam_unix(sudo:session): session closed for user root Aug 05 06:15:31 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-36c208eb-4e98-48f6-81ec-765851a867bf tempest-VolumesCloneTest-882742693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a47a9a15-e750-4ac2-a5e1-2a7f4bee29a1.6de0dbcf-74ed-4a58-a7e9-fbd682932c13" returned: 0 in 0.446s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:15:31 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-36c208eb-4e98-48f6-81ec-765851a867bf tempest-VolumesCloneTest-882742693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a47a9a15-e750-4ac2-a5e1-2a7f4bee29a1.6de0dbcf-74ed-4a58-a7e9-fbd682932c13 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:15:31 devstack sudo[94848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a47a9a15-e750-4ac2-a5e1-2a7f4bee29a1.6de0dbcf-74ed-4a58-a7e9-fbd682932c13 Aug 05 06:15:31 devstack sudo[94848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:15:32 devstack sudo[94848]: pam_unix(sudo:session): session closed for user root Aug 05 06:15:32 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-36c208eb-4e98-48f6-81ec-765851a867bf tempest-VolumesCloneTest-882742693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a47a9a15-e750-4ac2-a5e1-2a7f4bee29a1.6de0dbcf-74ed-4a58-a7e9-fbd682932c13" returned: 0 in 0.374s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:15:32 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-36c208eb-4e98-48f6-81ec-765851a867bf tempest-VolumesCloneTest-882742693 None] Lock "cinder-quobyte-6de0dbcf-74ed-4a58-a7e9-fbd682932c13" released by "_delete_snapshot" :: held 2.135s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:15:32 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-36c208eb-4e98-48f6-81ec-765851a867bf tempest-VolumesCloneTest-882742693 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 11.945s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:15:32 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-36c208eb-4e98-48f6-81ec-765851a867bf tempest-VolumesCloneTest-882742693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f9a5936-af7e-4619-9895-001135355c78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61975dc1-f774-4e6f-81c0-b9ec830220e4', 'volume_size': 2, 'source_volid': 'a47a9a15-e750-4ac2-a5e1-2a7f4bee29a1', 'source_volstatus': 'available'}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:15:32 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-36c208eb-4e98-48f6-81ec-765851a867bf tempest-VolumesCloneTest-882742693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56a6ca6c-5d3f-4fbc-88f7-5d7cc3d9036d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:15:32 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-36c208eb-4e98-48f6-81ec-765851a867bf tempest-VolumesCloneTest-882742693 None] Volume volume-61975dc1-f774-4e6f-81c0-b9ec830220e4 (61975dc1-f774-4e6f-81c0-b9ec830220e4): created successfully Aug 05 06:15:32 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-36c208eb-4e98-48f6-81ec-765851a867bf tempest-VolumesCloneTest-882742693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56a6ca6c-5d3f-4fbc-88f7-5d7cc3d9036d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:15:32 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-36c208eb-4e98-48f6-81ec-765851a867bf tempest-VolumesCloneTest-882742693 None] Flow 'volume_create_manager' (980d8155-a008-4130-b1ef-85fd1e1b8c54) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:15:32 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-36c208eb-4e98-48f6-81ec-765851a867bf tempest-VolumesCloneTest-882742693 None] Created volume successfully. Aug 05 06:15:33 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-9c1fc59b-de60-498a-9aa6-d526240be3a0 tempest-VolumesCloneTest-882742693 None] Acquiring lock "cinder-61975dc1-f774-4e6f-81c0-b9ec830220e4-delete_volume" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:15:33 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-9c1fc59b-de60-498a-9aa6-d526240be3a0 tempest-VolumesCloneTest-882742693 None] Lock "cinder-61975dc1-f774-4e6f-81c0-b9ec830220e4-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:15:33 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-9c1fc59b-de60-498a-9aa6-d526240be3a0 tempest-VolumesCloneTest-882742693 None] Acquiring lock "cinder-quobyte-61975dc1-f774-4e6f-81c0-b9ec830220e4" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:15:33 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-9c1fc59b-de60-498a-9aa6-d526240be3a0 tempest-VolumesCloneTest-882742693 None] Lock "cinder-quobyte-61975dc1-f774-4e6f-81c0-b9ec830220e4" acquired by "delete_volume" :: waited 0.021s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:15:33 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc7cea28-e808-4ebc-8eec-2225967a6840]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:15:33 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-9c1fc59b-de60-498a-9aa6-d526240be3a0 tempest-VolumesCloneTest-882742693 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-61975dc1-f774-4e6f-81c0-b9ec830220e4 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:15:33 devstack sudo[94888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-61975dc1-f774-4e6f-81c0-b9ec830220e4 Aug 05 06:15:33 devstack sudo[94888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:15:34 devstack sudo[94888]: pam_unix(sudo:session): session closed for user root Aug 05 06:15:34 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-9c1fc59b-de60-498a-9aa6-d526240be3a0 tempest-VolumesCloneTest-882742693 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-61975dc1-f774-4e6f-81c0-b9ec830220e4" returned: 0 in 0.557s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:15:34 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-9c1fc59b-de60-498a-9aa6-d526240be3a0 tempest-VolumesCloneTest-882742693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-61975dc1-f774-4e6f-81c0-b9ec830220e4 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:15:34 devstack sudo[94895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-61975dc1-f774-4e6f-81c0-b9ec830220e4 Aug 05 06:15:34 devstack sudo[94895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:15:34 devstack cinder-volume[88695]: INFO cinder.volume.manager [req-b031f916-b80d-4b7b-8678-ac91e86997fd req-bd40e341-d356-4290-a7c0-05ff1eeca823 tempest-ServerActionsTestOtherA-886527270 None] Terminate volume connection completed successfully. Aug 05 06:15:34 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [req-b031f916-b80d-4b7b-8678-ac91e86997fd req-bd40e341-d356-4290-a7c0-05ff1eeca823 tempest-ServerActionsTestOtherA-886527270 None] Deleting attachment 289c353f-e978-4785-aa95-043e1f8f9eff. {{(pid=88695) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 05 06:15:34 devstack cinder-volume[88695]: DEBUG cinder.coordination [req-b031f916-b80d-4b7b-8678-ac91e86997fd req-bd41309a-4179-43c5-a775-024f0b905f89 tempest-ServerActionsTestOtherA-886527270 None] Acquiring lock "cinder-36d2290d-861b-4b93-95e6-e660ba0e5f20-delete_volume" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:15:34 devstack sudo[94895]: pam_unix(sudo:session): session closed for user root Aug 05 06:15:34 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-9c1fc59b-de60-498a-9aa6-d526240be3a0 tempest-VolumesCloneTest-882742693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-61975dc1-f774-4e6f-81c0-b9ec830220e4" returned: 0 in 0.463s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:15:34 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-9c1fc59b-de60-498a-9aa6-d526240be3a0 tempest-VolumesCloneTest-882742693 None] Lock "cinder-quobyte-61975dc1-f774-4e6f-81c0-b9ec830220e4" released by "delete_volume" :: held 1.098s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:15:34 devstack cinder-volume[88695]: DEBUG cinder.coordination [req-b031f916-b80d-4b7b-8678-ac91e86997fd req-bd41309a-4179-43c5-a775-024f0b905f89 tempest-ServerActionsTestOtherA-886527270 None] Lock "cinder-36d2290d-861b-4b93-95e6-e660ba0e5f20-delete_volume" acquired by "delete_volume" :: waited 0.077s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:15:34 devstack cinder-volume[88695]: DEBUG cinder.coordination [req-b031f916-b80d-4b7b-8678-ac91e86997fd req-bd41309a-4179-43c5-a775-024f0b905f89 tempest-ServerActionsTestOtherA-886527270 None] Acquiring lock "cinder-quobyte-36d2290d-861b-4b93-95e6-e660ba0e5f20" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:15:34 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-9c1fc59b-de60-498a-9aa6-d526240be3a0 tempest-VolumesCloneTest-882742693 None] Created reservations ['a39e1723-51ee-4887-8fac-ae039853f984', 'ea13f33b-da73-4515-bd68-2ea9e0c31b64', '3391163e-ee0e-4244-84df-3530cfdda257', '6d8bc8da-6ad1-402b-9c94-92df935f98e1'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:15:34 devstack cinder-volume[88695]: DEBUG cinder.coordination [req-b031f916-b80d-4b7b-8678-ac91e86997fd req-bd41309a-4179-43c5-a775-024f0b905f89 tempest-ServerActionsTestOtherA-886527270 None] Lock "cinder-quobyte-36d2290d-861b-4b93-95e6-e660ba0e5f20" acquired by "delete_volume" :: waited 0.036s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:15:34 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[51a59c34-6b6a-40cc-81eb-f7f68df5bb46]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:15:34 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [req-b031f916-b80d-4b7b-8678-ac91e86997fd req-bd41309a-4179-43c5-a775-024f0b905f89 tempest-ServerActionsTestOtherA-886527270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-36d2290d-861b-4b93-95e6-e660ba0e5f20 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:15:35 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-9c1fc59b-de60-498a-9aa6-d526240be3a0 tempest-VolumesCloneTest-882742693 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:15:35 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-9c1fc59b-de60-498a-9aa6-d526240be3a0 tempest-VolumesCloneTest-882742693 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:15:35 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-9c1fc59b-de60-498a-9aa6-d526240be3a0 tempest-VolumesCloneTest-882742693 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:15:35 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-9c1fc59b-de60-498a-9aa6-d526240be3a0 tempest-VolumesCloneTest-882742693 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:15:35 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-9c1fc59b-de60-498a-9aa6-d526240be3a0 tempest-VolumesCloneTest-882742693 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:15:35 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-9c1fc59b-de60-498a-9aa6-d526240be3a0 tempest-VolumesCloneTest-882742693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:15:35 devstack sudo[94899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-36d2290d-861b-4b93-95e6-e660ba0e5f20 Aug 05 06:15:35 devstack sudo[94899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:15:35 devstack sudo[94900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce Aug 05 06:15:35 devstack sudo[94900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:15:35 devstack sudo[94899]: pam_unix(sudo:session): session closed for user root Aug 05 06:15:35 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [req-b031f916-b80d-4b7b-8678-ac91e86997fd req-bd41309a-4179-43c5-a775-024f0b905f89 tempest-ServerActionsTestOtherA-886527270 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-36d2290d-861b-4b93-95e6-e660ba0e5f20" returned: 0 in 0.645s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:15:35 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [req-b031f916-b80d-4b7b-8678-ac91e86997fd req-bd41309a-4179-43c5-a775-024f0b905f89 tempest-ServerActionsTestOtherA-886527270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-36d2290d-861b-4b93-95e6-e660ba0e5f20 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:15:35 devstack sudo[94900]: pam_unix(sudo:session): session closed for user root Aug 05 06:15:35 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-9c1fc59b-de60-498a-9aa6-d526240be3a0 tempest-VolumesCloneTest-882742693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce" returned: 0 in 0.538s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:15:35 devstack cinder-volume[88695]: DEBUG cinder.manager [None req-9c1fc59b-de60-498a-9aa6-d526240be3a0 tempest-VolumesCloneTest-882742693 None] Notifying Schedulers of capabilities ... {{(pid=88695) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 06:15:35 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-9c1fc59b-de60-498a-9aa6-d526240be3a0 tempest-VolumesCloneTest-882742693 None] Deleted volume successfully. Aug 05 06:15:35 devstack sudo[94907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-36d2290d-861b-4b93-95e6-e660ba0e5f20 Aug 05 06:15:35 devstack sudo[94907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:15:35 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-9c1fc59b-de60-498a-9aa6-d526240be3a0 tempest-VolumesCloneTest-882742693 None] Lock "cinder-61975dc1-f774-4e6f-81c0-b9ec830220e4-delete_volume" released by "delete_volume" :: held 2.141s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:15:35 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-a8d7bb2f-b49a-4e12-bea2-2a08d0171115 tempest-ServerActionsTestOtherA-886527270 None] Acquiring lock "cinder-4a625722-72b0-4600-9c45-29b3a07e9e82-delete_volume" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:15:36 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-a8d7bb2f-b49a-4e12-bea2-2a08d0171115 tempest-ServerActionsTestOtherA-886527270 None] Lock "cinder-4a625722-72b0-4600-9c45-29b3a07e9e82-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:15:36 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-a8d7bb2f-b49a-4e12-bea2-2a08d0171115 tempest-ServerActionsTestOtherA-886527270 None] Acquiring lock "cinder-quobyte-4a625722-72b0-4600-9c45-29b3a07e9e82" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:15:36 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-0d8d65d0-8bbe-4bed-b448-6b18de911998 tempest-VolumesCloneTest-882742693 None] Acquiring lock "cinder-a47a9a15-e750-4ac2-a5e1-2a7f4bee29a1-delete_volume" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:15:36 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-a8d7bb2f-b49a-4e12-bea2-2a08d0171115 tempest-ServerActionsTestOtherA-886527270 None] Lock "cinder-quobyte-4a625722-72b0-4600-9c45-29b3a07e9e82" acquired by "delete_volume" :: waited 0.046s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:15:36 devstack sudo[94907]: pam_unix(sudo:session): session closed for user root Aug 05 06:15:36 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-0d8d65d0-8bbe-4bed-b448-6b18de911998 tempest-VolumesCloneTest-882742693 None] Lock "cinder-a47a9a15-e750-4ac2-a5e1-2a7f4bee29a1-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:15:36 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [req-b031f916-b80d-4b7b-8678-ac91e86997fd req-bd41309a-4179-43c5-a775-024f0b905f89 tempest-ServerActionsTestOtherA-886527270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-36d2290d-861b-4b93-95e6-e660ba0e5f20" returned: 0 in 0.561s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:15:36 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe8f9309-bd58-4a4d-89cd-c399b320d33f]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:15:36 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-a8d7bb2f-b49a-4e12-bea2-2a08d0171115 tempest-ServerActionsTestOtherA-886527270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-4a625722-72b0-4600-9c45-29b3a07e9e82 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:15:36 devstack cinder-volume[88695]: DEBUG cinder.coordination [req-b031f916-b80d-4b7b-8678-ac91e86997fd req-bd41309a-4179-43c5-a775-024f0b905f89 tempest-ServerActionsTestOtherA-886527270 None] Lock "cinder-quobyte-36d2290d-861b-4b93-95e6-e660ba0e5f20" released by "delete_volume" :: held 1.298s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:15:36 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-0d8d65d0-8bbe-4bed-b448-6b18de911998 tempest-VolumesCloneTest-882742693 None] Acquiring lock "cinder-quobyte-a47a9a15-e750-4ac2-a5e1-2a7f4bee29a1" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:15:36 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-0d8d65d0-8bbe-4bed-b448-6b18de911998 tempest-VolumesCloneTest-882742693 None] Lock "cinder-quobyte-a47a9a15-e750-4ac2-a5e1-2a7f4bee29a1" acquired by "delete_volume" :: waited 0.023s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:15:36 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7efa71d-bcdc-48fb-8d5d-a3c47c8bcb93]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:15:36 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-0d8d65d0-8bbe-4bed-b448-6b18de911998 tempest-VolumesCloneTest-882742693 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a47a9a15-e750-4ac2-a5e1-2a7f4bee29a1 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:15:36 devstack sudo[94910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-4a625722-72b0-4600-9c45-29b3a07e9e82 Aug 05 06:15:36 devstack sudo[94910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:15:36 devstack cinder-volume[88695]: DEBUG cinder.quota [req-b031f916-b80d-4b7b-8678-ac91e86997fd req-bd41309a-4179-43c5-a775-024f0b905f89 tempest-ServerActionsTestOtherA-886527270 None] Created reservations ['b97e92e4-b29c-43d1-aa1c-77f9a6525829', '43791498-2d08-4171-be77-8568d167cf95', 'b3ae02a2-2603-4b08-afc4-f7c63c57b404', 'c3b15948-4de3-4f6d-a54e-ab9ccf7ab672'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:15:36 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [req-b031f916-b80d-4b7b-8678-ac91e86997fd req-bd41309a-4179-43c5-a775-024f0b905f89 tempest-ServerActionsTestOtherA-886527270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:15:36 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [req-b031f916-b80d-4b7b-8678-ac91e86997fd req-bd41309a-4179-43c5-a775-024f0b905f89 tempest-ServerActionsTestOtherA-886527270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:15:36 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [req-b031f916-b80d-4b7b-8678-ac91e86997fd req-bd41309a-4179-43c5-a775-024f0b905f89 tempest-ServerActionsTestOtherA-886527270 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:15:36 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [req-b031f916-b80d-4b7b-8678-ac91e86997fd req-bd41309a-4179-43c5-a775-024f0b905f89 tempest-ServerActionsTestOtherA-886527270 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:15:36 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [req-b031f916-b80d-4b7b-8678-ac91e86997fd req-bd41309a-4179-43c5-a775-024f0b905f89 tempest-ServerActionsTestOtherA-886527270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:15:36 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [req-b031f916-b80d-4b7b-8678-ac91e86997fd req-bd41309a-4179-43c5-a775-024f0b905f89 tempest-ServerActionsTestOtherA-886527270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:15:36 devstack sudo[94911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a47a9a15-e750-4ac2-a5e1-2a7f4bee29a1 Aug 05 06:15:36 devstack sudo[94911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:15:36 devstack sudo[94913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce Aug 05 06:15:36 devstack sudo[94913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:15:36 devstack sudo[94910]: pam_unix(sudo:session): session closed for user root Aug 05 06:15:36 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-a8d7bb2f-b49a-4e12-bea2-2a08d0171115 tempest-ServerActionsTestOtherA-886527270 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-4a625722-72b0-4600-9c45-29b3a07e9e82" returned: 0 in 0.671s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:15:36 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-a8d7bb2f-b49a-4e12-bea2-2a08d0171115 tempest-ServerActionsTestOtherA-886527270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-4a625722-72b0-4600-9c45-29b3a07e9e82 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:15:36 devstack sudo[94924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-4a625722-72b0-4600-9c45-29b3a07e9e82 Aug 05 06:15:36 devstack sudo[94924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:15:36 devstack sudo[94913]: pam_unix(sudo:session): session closed for user root Aug 05 06:15:36 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [req-b031f916-b80d-4b7b-8678-ac91e86997fd req-bd41309a-4179-43c5-a775-024f0b905f89 tempest-ServerActionsTestOtherA-886527270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce" returned: 0 in 0.412s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:15:36 devstack cinder-volume[88695]: DEBUG cinder.manager [req-b031f916-b80d-4b7b-8678-ac91e86997fd req-bd41309a-4179-43c5-a775-024f0b905f89 tempest-ServerActionsTestOtherA-886527270 None] Notifying Schedulers of capabilities ... {{(pid=88695) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 06:15:36 devstack cinder-volume[88695]: INFO cinder.volume.manager [req-b031f916-b80d-4b7b-8678-ac91e86997fd req-bd41309a-4179-43c5-a775-024f0b905f89 tempest-ServerActionsTestOtherA-886527270 None] Deleted volume successfully. Aug 05 06:15:36 devstack sudo[94911]: pam_unix(sudo:session): session closed for user root Aug 05 06:15:36 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-0d8d65d0-8bbe-4bed-b448-6b18de911998 tempest-VolumesCloneTest-882742693 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a47a9a15-e750-4ac2-a5e1-2a7f4bee29a1" returned: 0 in 0.645s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:15:37 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-0d8d65d0-8bbe-4bed-b448-6b18de911998 tempest-VolumesCloneTest-882742693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a47a9a15-e750-4ac2-a5e1-2a7f4bee29a1 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:15:37 devstack sudo[94927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a47a9a15-e750-4ac2-a5e1-2a7f4bee29a1 Aug 05 06:15:37 devstack sudo[94927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:15:37 devstack cinder-volume[88695]: DEBUG cinder.coordination [req-b031f916-b80d-4b7b-8678-ac91e86997fd req-bd41309a-4179-43c5-a775-024f0b905f89 tempest-ServerActionsTestOtherA-886527270 None] Lock "cinder-36d2290d-861b-4b93-95e6-e660ba0e5f20-delete_volume" released by "delete_volume" :: held 2.241s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:15:37 devstack sudo[94924]: pam_unix(sudo:session): session closed for user root Aug 05 06:15:37 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-a8d7bb2f-b49a-4e12-bea2-2a08d0171115 tempest-ServerActionsTestOtherA-886527270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-4a625722-72b0-4600-9c45-29b3a07e9e82" returned: 0 in 0.345s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:15:37 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-a8d7bb2f-b49a-4e12-bea2-2a08d0171115 tempest-ServerActionsTestOtherA-886527270 None] Lock "cinder-quobyte-4a625722-72b0-4600-9c45-29b3a07e9e82" released by "delete_volume" :: held 1.103s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:15:37 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-a8d7bb2f-b49a-4e12-bea2-2a08d0171115 tempest-ServerActionsTestOtherA-886527270 None] Created reservations ['c75cb580-c284-415b-9ef1-ec926d3fbfa2', '315462d1-bc51-437e-b480-b04ad6642157', '0dbd272f-3d1e-4dab-a852-9df2a2a2ae96', 'cd0acfd8-9ff6-421d-8d0b-4f30d6419c43'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:15:37 devstack sudo[94927]: pam_unix(sudo:session): session closed for user root Aug 05 06:15:37 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-0d8d65d0-8bbe-4bed-b448-6b18de911998 tempest-VolumesCloneTest-882742693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a47a9a15-e750-4ac2-a5e1-2a7f4bee29a1" returned: 0 in 0.350s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:15:37 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-0d8d65d0-8bbe-4bed-b448-6b18de911998 tempest-VolumesCloneTest-882742693 None] Lock "cinder-quobyte-a47a9a15-e750-4ac2-a5e1-2a7f4bee29a1" released by "delete_volume" :: held 1.089s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:15:37 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-a8d7bb2f-b49a-4e12-bea2-2a08d0171115 tempest-ServerActionsTestOtherA-886527270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:15:37 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-a8d7bb2f-b49a-4e12-bea2-2a08d0171115 tempest-ServerActionsTestOtherA-886527270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:15:37 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-a8d7bb2f-b49a-4e12-bea2-2a08d0171115 tempest-ServerActionsTestOtherA-886527270 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:15:37 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-a8d7bb2f-b49a-4e12-bea2-2a08d0171115 tempest-ServerActionsTestOtherA-886527270 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:15:37 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-a8d7bb2f-b49a-4e12-bea2-2a08d0171115 tempest-ServerActionsTestOtherA-886527270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:15:37 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-a8d7bb2f-b49a-4e12-bea2-2a08d0171115 tempest-ServerActionsTestOtherA-886527270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:15:37 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-0d8d65d0-8bbe-4bed-b448-6b18de911998 tempest-VolumesCloneTest-882742693 None] Created reservations ['e8237e11-39a4-4d64-a01c-5a17617605fb', '47ed531b-a0f2-4978-900d-fa3c57cd86a0', 'af0fe22d-4611-4de5-aba3-c1b1d5989a28', '1f8d6840-aaaa-4d19-85df-046b5a52d3da'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:15:37 devstack sudo[94931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce Aug 05 06:15:37 devstack sudo[94931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:15:37 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-0d8d65d0-8bbe-4bed-b448-6b18de911998 tempest-VolumesCloneTest-882742693 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:15:37 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-0d8d65d0-8bbe-4bed-b448-6b18de911998 tempest-VolumesCloneTest-882742693 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:15:37 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-0d8d65d0-8bbe-4bed-b448-6b18de911998 tempest-VolumesCloneTest-882742693 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:15:37 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-0d8d65d0-8bbe-4bed-b448-6b18de911998 tempest-VolumesCloneTest-882742693 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:15:37 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-0d8d65d0-8bbe-4bed-b448-6b18de911998 tempest-VolumesCloneTest-882742693 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:15:37 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-0d8d65d0-8bbe-4bed-b448-6b18de911998 tempest-VolumesCloneTest-882742693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:15:37 devstack sudo[94935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce Aug 05 06:15:37 devstack sudo[94935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:15:37 devstack sudo[94931]: pam_unix(sudo:session): session closed for user root Aug 05 06:15:37 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-a8d7bb2f-b49a-4e12-bea2-2a08d0171115 tempest-ServerActionsTestOtherA-886527270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce" returned: 0 in 0.352s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:15:37 devstack cinder-volume[88695]: DEBUG cinder.manager [None req-a8d7bb2f-b49a-4e12-bea2-2a08d0171115 tempest-ServerActionsTestOtherA-886527270 None] Notifying Schedulers of capabilities ... {{(pid=88695) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 06:15:37 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-a8d7bb2f-b49a-4e12-bea2-2a08d0171115 tempest-ServerActionsTestOtherA-886527270 None] Deleted volume successfully. Aug 05 06:15:37 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-a8d7bb2f-b49a-4e12-bea2-2a08d0171115 tempest-ServerActionsTestOtherA-886527270 None] Lock "cinder-4a625722-72b0-4600-9c45-29b3a07e9e82-delete_volume" released by "delete_volume" :: held 1.833s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:15:37 devstack sudo[94935]: pam_unix(sudo:session): session closed for user root Aug 05 06:15:37 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-0d8d65d0-8bbe-4bed-b448-6b18de911998 tempest-VolumesCloneTest-882742693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce" returned: 0 in 0.382s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:15:37 devstack cinder-volume[88695]: DEBUG cinder.manager [None req-0d8d65d0-8bbe-4bed-b448-6b18de911998 tempest-VolumesCloneTest-882742693 None] Notifying Schedulers of capabilities ... {{(pid=88695) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 06:15:37 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-0d8d65d0-8bbe-4bed-b448-6b18de911998 tempest-VolumesCloneTest-882742693 None] Deleted volume successfully. Aug 05 06:15:37 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-0d8d65d0-8bbe-4bed-b448-6b18de911998 tempest-VolumesCloneTest-882742693 None] Lock "cinder-a47a9a15-e750-4ac2-a5e1-2a7f4bee29a1-delete_volume" released by "delete_volume" :: held 1.804s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:15:43 devstack cinder-volume[88695]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff2938c5-3cf1-4c05-a6fb-3da5fe6c83a1 tempest-VolumesListTestJSON-435415017 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88695) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 06:15:43 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-ff2938c5-3cf1-4c05-a6fb-3da5fe6c83a1 tempest-VolumesListTestJSON-435415017 None] Flow 'volume_create_manager' (b398bfe2-807a-4c30-83f8-eadb8770dcda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:15:43 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-ff2938c5-3cf1-4c05-a6fb-3da5fe6c83a1 tempest-VolumesListTestJSON-435415017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c78a781-c75a-4bab-aeec-25a6e415ff5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:15:43 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-ff2938c5-3cf1-4c05-a6fb-3da5fe6c83a1 tempest-VolumesListTestJSON-435415017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c78a781-c75a-4bab-aeec-25a6e415ff5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:15:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-772339537',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2e65c75-5c6f-4518-8408-5b927272e5d4,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='06f51b1ebc3b4c019d16c95e123c8ab5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:15:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:15:43Z,use_quota=True,user_id='0dfb741e0b06438ead00436acde39936',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:15:43 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-ff2938c5-3cf1-4c05-a6fb-3da5fe6c83a1 tempest-VolumesListTestJSON-435415017 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d036a048-f48f-4e40-b891-810fcdfb6e9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:15:43 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-ff2938c5-3cf1-4c05-a6fb-3da5fe6c83a1 tempest-VolumesListTestJSON-435415017 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d036a048-f48f-4e40-b891-810fcdfb6e9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:15:43 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-ff2938c5-3cf1-4c05-a6fb-3da5fe6c83a1 tempest-VolumesListTestJSON-435415017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8ef72a2-12e1-4ba8-839f-2ef44a7a9aa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:15:43 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-ff2938c5-3cf1-4c05-a6fb-3da5fe6c83a1 tempest-VolumesListTestJSON-435415017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8ef72a2-12e1-4ba8-839f-2ef44a7a9aa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a2e65c75-5c6f-4518-8408-5b927272e5d4', 'volume_name': 'volume-a2e65c75-5c6f-4518-8408-5b927272e5d4', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:15:43 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-ff2938c5-3cf1-4c05-a6fb-3da5fe6c83a1 tempest-VolumesListTestJSON-435415017 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32802cd6-8245-4766-a9a8-41a4d6789d9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:15:43 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-ff2938c5-3cf1-4c05-a6fb-3da5fe6c83a1 tempest-VolumesListTestJSON-435415017 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32802cd6-8245-4766-a9a8-41a4d6789d9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:15:43 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-ff2938c5-3cf1-4c05-a6fb-3da5fe6c83a1 tempest-VolumesListTestJSON-435415017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61d4cf23-04fb-4041-8e88-61130e000d00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:15:43 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-ff2938c5-3cf1-4c05-a6fb-3da5fe6c83a1 tempest-VolumesListTestJSON-435415017 None] Volume a2e65c75-5c6f-4518-8408-5b927272e5d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a2e65c75-5c6f-4518-8408-5b927272e5d4', 'volume_size': 1} Aug 05 06:15:43 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-ff2938c5-3cf1-4c05-a6fb-3da5fe6c83a1 tempest-VolumesListTestJSON-435415017 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:15:43 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-ff2938c5-3cf1-4c05-a6fb-3da5fe6c83a1 tempest-VolumesListTestJSON-435415017 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:15:43 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-ff2938c5-3cf1-4c05-a6fb-3da5fe6c83a1 tempest-VolumesListTestJSON-435415017 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:15:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-772339537',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2e65c75-5c6f-4518-8408-5b927272e5d4,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='06f51b1ebc3b4c019d16c95e123c8ab5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:15:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:15:43Z,use_quota=True,user_id='0dfb741e0b06438ead00436acde39936',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)}" {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 06:15:43 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-ff2938c5-3cf1-4c05-a6fb-3da5fe6c83a1 tempest-VolumesListTestJSON-435415017 None] Creating volume a2e65c75-5c6f-4518-8408-5b927272e5d4 {{(pid=88695) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 06:15:43 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-ff2938c5-3cf1-4c05-a6fb-3da5fe6c83a1 tempest-VolumesListTestJSON-435415017 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:15:43 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-ff2938c5-3cf1-4c05-a6fb-3da5fe6c83a1 tempest-VolumesListTestJSON-435415017 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:15:43 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-ff2938c5-3cf1-4c05-a6fb-3da5fe6c83a1 tempest-VolumesListTestJSON-435415017 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:15:43 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-ff2938c5-3cf1-4c05-a6fb-3da5fe6c83a1 tempest-VolumesListTestJSON-435415017 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:15:43 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-ff2938c5-3cf1-4c05-a6fb-3da5fe6c83a1 tempest-VolumesListTestJSON-435415017 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:15:43 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-ff2938c5-3cf1-4c05-a6fb-3da5fe6c83a1 tempest-VolumesListTestJSON-435415017 None] Selected osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 as target Quobyte volume. {{(pid=88695) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 06:15:43 devstack cinder-volume[88695]: INFO cinder.volume.drivers.remotefs [None req-ff2938c5-3cf1-4c05-a6fb-3da5fe6c83a1 tempest-VolumesListTestJSON-435415017 None] casted to osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 Aug 05 06:15:43 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-ff2938c5-3cf1-4c05-a6fb-3da5fe6c83a1 tempest-VolumesListTestJSON-435415017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a2e65c75-5c6f-4518-8408-5b927272e5d4 1073741824 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:15:43 devstack sudo[94993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a2e65c75-5c6f-4518-8408-5b927272e5d4 1073741824 Aug 05 06:15:43 devstack sudo[94993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:15:43 devstack sudo[94993]: pam_unix(sudo:session): session closed for user root Aug 05 06:15:43 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-ff2938c5-3cf1-4c05-a6fb-3da5fe6c83a1 tempest-VolumesListTestJSON-435415017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a2e65c75-5c6f-4518-8408-5b927272e5d4 1073741824" returned: 0 in 0.551s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:15:43 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-ff2938c5-3cf1-4c05-a6fb-3da5fe6c83a1 tempest-VolumesListTestJSON-435415017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a2e65c75-5c6f-4518-8408-5b927272e5d4 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:15:43 devstack sudo[94999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a2e65c75-5c6f-4518-8408-5b927272e5d4 Aug 05 06:15:43 devstack sudo[94999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:15:44 devstack sudo[94999]: pam_unix(sudo:session): session closed for user root Aug 05 06:15:44 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-ff2938c5-3cf1-4c05-a6fb-3da5fe6c83a1 tempest-VolumesListTestJSON-435415017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a2e65c75-5c6f-4518-8408-5b927272e5d4" returned: 0 in 0.270s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:15:44 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-ff2938c5-3cf1-4c05-a6fb-3da5fe6c83a1 tempest-VolumesListTestJSON-435415017 None] <== create_volume: return (870ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'} {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 06:15:44 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-ff2938c5-3cf1-4c05-a6fb-3da5fe6c83a1 tempest-VolumesListTestJSON-435415017 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.873s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:15:44 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-ff2938c5-3cf1-4c05-a6fb-3da5fe6c83a1 tempest-VolumesListTestJSON-435415017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61d4cf23-04fb-4041-8e88-61130e000d00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2e65c75-5c6f-4518-8408-5b927272e5d4', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:15:44 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-ff2938c5-3cf1-4c05-a6fb-3da5fe6c83a1 tempest-VolumesListTestJSON-435415017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5312d65e-1c0c-4e72-b5c9-f21d130809e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:15:44 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-ff2938c5-3cf1-4c05-a6fb-3da5fe6c83a1 tempest-VolumesListTestJSON-435415017 None] Volume volume-a2e65c75-5c6f-4518-8408-5b927272e5d4 (a2e65c75-5c6f-4518-8408-5b927272e5d4): created successfully Aug 05 06:15:44 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-ff2938c5-3cf1-4c05-a6fb-3da5fe6c83a1 tempest-VolumesListTestJSON-435415017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5312d65e-1c0c-4e72-b5c9-f21d130809e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:15:44 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-ff2938c5-3cf1-4c05-a6fb-3da5fe6c83a1 tempest-VolumesListTestJSON-435415017 None] Flow 'volume_create_manager' (b398bfe2-807a-4c30-83f8-eadb8770dcda) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:15:44 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-ff2938c5-3cf1-4c05-a6fb-3da5fe6c83a1 tempest-VolumesListTestJSON-435415017 None] Created volume successfully. Aug 05 06:15:45 devstack cinder-volume[88695]: DEBUG dbcounter [-] [88695] Writing DB stats cinder:SELECT=80,cinder:UPDATE=86,cinder:INSERT=14,cinder:DELETE=8 {{(pid=88695) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 06:15:45 devstack cinder-volume[88695]: DEBUG dbcounter [-] [88695] Writing DB stats cinder:SELECT=83,cinder:UPDATE=102,cinder:DELETE=6,cinder:INSERT=29 {{(pid=88695) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 06:15:45 devstack cinder-volume[88695]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6a05025-2ffe-48cd-9b3b-90b467fbd678 tempest-VolumesListTestJSON-435415017 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88695) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 06:15:45 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-d6a05025-2ffe-48cd-9b3b-90b467fbd678 tempest-VolumesListTestJSON-435415017 None] Flow 'volume_create_manager' (89903570-e87d-40e9-b596-5ee68500d19d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:15:45 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-d6a05025-2ffe-48cd-9b3b-90b467fbd678 tempest-VolumesListTestJSON-435415017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f97127e7-b8c1-4ec9-a004-ac6a1b0b2ea2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:15:45 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-d6a05025-2ffe-48cd-9b3b-90b467fbd678 tempest-VolumesListTestJSON-435415017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f97127e7-b8c1-4ec9-a004-ac6a1b0b2ea2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:15:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1987160423',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54fd466c-7cc3-44cf-a60b-76b5f7d55c2c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='06f51b1ebc3b4c019d16c95e123c8ab5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:15:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:15:46Z,use_quota=True,user_id='0dfb741e0b06438ead00436acde39936',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:15:45 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-d6a05025-2ffe-48cd-9b3b-90b467fbd678 tempest-VolumesListTestJSON-435415017 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1af24b46-f322-4898-a164-e4e2ebb64369) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:15:45 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-d6a05025-2ffe-48cd-9b3b-90b467fbd678 tempest-VolumesListTestJSON-435415017 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1af24b46-f322-4898-a164-e4e2ebb64369) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:15:45 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-d6a05025-2ffe-48cd-9b3b-90b467fbd678 tempest-VolumesListTestJSON-435415017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f579673a-6027-442e-ac57-e29d266d7562) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:15:45 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-d6a05025-2ffe-48cd-9b3b-90b467fbd678 tempest-VolumesListTestJSON-435415017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f579673a-6027-442e-ac57-e29d266d7562) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '54fd466c-7cc3-44cf-a60b-76b5f7d55c2c', 'volume_name': 'volume-54fd466c-7cc3-44cf-a60b-76b5f7d55c2c', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:15:45 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-d6a05025-2ffe-48cd-9b3b-90b467fbd678 tempest-VolumesListTestJSON-435415017 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43c2ab4e-f08a-4084-868f-34ee789895e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:15:45 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-d6a05025-2ffe-48cd-9b3b-90b467fbd678 tempest-VolumesListTestJSON-435415017 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43c2ab4e-f08a-4084-868f-34ee789895e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:15:45 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-d6a05025-2ffe-48cd-9b3b-90b467fbd678 tempest-VolumesListTestJSON-435415017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6aa2454-ee45-438a-8672-691caa13a98d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:15:45 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-d6a05025-2ffe-48cd-9b3b-90b467fbd678 tempest-VolumesListTestJSON-435415017 None] Volume 54fd466c-7cc3-44cf-a60b-76b5f7d55c2c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-54fd466c-7cc3-44cf-a60b-76b5f7d55c2c', 'volume_size': 1} Aug 05 06:15:45 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-d6a05025-2ffe-48cd-9b3b-90b467fbd678 tempest-VolumesListTestJSON-435415017 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:15:45 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-d6a05025-2ffe-48cd-9b3b-90b467fbd678 tempest-VolumesListTestJSON-435415017 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:15:45 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-d6a05025-2ffe-48cd-9b3b-90b467fbd678 tempest-VolumesListTestJSON-435415017 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:15:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1987160423',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54fd466c-7cc3-44cf-a60b-76b5f7d55c2c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='06f51b1ebc3b4c019d16c95e123c8ab5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:15:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:15:46Z,use_quota=True,user_id='0dfb741e0b06438ead00436acde39936',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)}" {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 06:15:45 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-d6a05025-2ffe-48cd-9b3b-90b467fbd678 tempest-VolumesListTestJSON-435415017 None] Creating volume 54fd466c-7cc3-44cf-a60b-76b5f7d55c2c {{(pid=88695) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 06:15:45 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-d6a05025-2ffe-48cd-9b3b-90b467fbd678 tempest-VolumesListTestJSON-435415017 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:15:45 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-d6a05025-2ffe-48cd-9b3b-90b467fbd678 tempest-VolumesListTestJSON-435415017 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:15:45 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-d6a05025-2ffe-48cd-9b3b-90b467fbd678 tempest-VolumesListTestJSON-435415017 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:15:46 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-d6a05025-2ffe-48cd-9b3b-90b467fbd678 tempest-VolumesListTestJSON-435415017 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:15:46 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-d6a05025-2ffe-48cd-9b3b-90b467fbd678 tempest-VolumesListTestJSON-435415017 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:15:46 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-d6a05025-2ffe-48cd-9b3b-90b467fbd678 tempest-VolumesListTestJSON-435415017 None] Selected osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 as target Quobyte volume. {{(pid=88695) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 06:15:46 devstack cinder-volume[88695]: INFO cinder.volume.drivers.remotefs [None req-d6a05025-2ffe-48cd-9b3b-90b467fbd678 tempest-VolumesListTestJSON-435415017 None] casted to osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 Aug 05 06:15:46 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-d6a05025-2ffe-48cd-9b3b-90b467fbd678 tempest-VolumesListTestJSON-435415017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-54fd466c-7cc3-44cf-a60b-76b5f7d55c2c 1073741824 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:15:46 devstack sudo[95004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-54fd466c-7cc3-44cf-a60b-76b5f7d55c2c 1073741824 Aug 05 06:15:46 devstack sudo[95004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:15:46 devstack sudo[95004]: pam_unix(sudo:session): session closed for user root Aug 05 06:15:46 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-d6a05025-2ffe-48cd-9b3b-90b467fbd678 tempest-VolumesListTestJSON-435415017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-54fd466c-7cc3-44cf-a60b-76b5f7d55c2c 1073741824" returned: 0 in 0.877s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:15:46 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-d6a05025-2ffe-48cd-9b3b-90b467fbd678 tempest-VolumesListTestJSON-435415017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-54fd466c-7cc3-44cf-a60b-76b5f7d55c2c {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:15:47 devstack sudo[95056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-54fd466c-7cc3-44cf-a60b-76b5f7d55c2c Aug 05 06:15:47 devstack sudo[95056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:15:47 devstack sudo[95056]: pam_unix(sudo:session): session closed for user root Aug 05 06:15:47 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-d6a05025-2ffe-48cd-9b3b-90b467fbd678 tempest-VolumesListTestJSON-435415017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-54fd466c-7cc3-44cf-a60b-76b5f7d55c2c" returned: 0 in 0.329s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:15:47 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-d6a05025-2ffe-48cd-9b3b-90b467fbd678 tempest-VolumesListTestJSON-435415017 None] <== create_volume: return (1310ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'} {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 06:15:47 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-d6a05025-2ffe-48cd-9b3b-90b467fbd678 tempest-VolumesListTestJSON-435415017 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.317s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:15:47 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-d6a05025-2ffe-48cd-9b3b-90b467fbd678 tempest-VolumesListTestJSON-435415017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6aa2454-ee45-438a-8672-691caa13a98d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54fd466c-7cc3-44cf-a60b-76b5f7d55c2c', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:15:47 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-d6a05025-2ffe-48cd-9b3b-90b467fbd678 tempest-VolumesListTestJSON-435415017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (937c2945-7b0f-4351-91ef-c802d0ff4773) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:15:47 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-d6a05025-2ffe-48cd-9b3b-90b467fbd678 tempest-VolumesListTestJSON-435415017 None] Volume volume-54fd466c-7cc3-44cf-a60b-76b5f7d55c2c (54fd466c-7cc3-44cf-a60b-76b5f7d55c2c): created successfully Aug 05 06:15:47 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-d6a05025-2ffe-48cd-9b3b-90b467fbd678 tempest-VolumesListTestJSON-435415017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (937c2945-7b0f-4351-91ef-c802d0ff4773) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:15:47 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-d6a05025-2ffe-48cd-9b3b-90b467fbd678 tempest-VolumesListTestJSON-435415017 None] Flow 'volume_create_manager' (89903570-e87d-40e9-b596-5ee68500d19d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:15:47 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-d6a05025-2ffe-48cd-9b3b-90b467fbd678 tempest-VolumesListTestJSON-435415017 None] Created volume successfully. Aug 05 06:15:48 devstack cinder-volume[88695]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5b09168-d619-44ec-b653-a6511baa2433 tempest-VolumesListTestJSON-435415017 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88695) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 06:15:48 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-a5b09168-d619-44ec-b653-a6511baa2433 tempest-VolumesListTestJSON-435415017 None] Flow 'volume_create_manager' (33a6ea1f-c512-4c3b-926d-0b981d54011f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:15:48 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-a5b09168-d619-44ec-b653-a6511baa2433 tempest-VolumesListTestJSON-435415017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36f6dad7-74b3-46cf-b77c-cf3dfbf3969d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:15:48 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-a5b09168-d619-44ec-b653-a6511baa2433 tempest-VolumesListTestJSON-435415017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36f6dad7-74b3-46cf-b77c-cf3dfbf3969d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:15:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-560450006',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=113deca4-cae5-4f46-b5d4-93ea1a13686e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='06f51b1ebc3b4c019d16c95e123c8ab5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:15:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:15:49Z,use_quota=True,user_id='0dfb741e0b06438ead00436acde39936',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:15:48 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-a5b09168-d619-44ec-b653-a6511baa2433 tempest-VolumesListTestJSON-435415017 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0d108d1-38bf-47c4-881b-6ae77f2edc00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:15:48 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-a5b09168-d619-44ec-b653-a6511baa2433 tempest-VolumesListTestJSON-435415017 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0d108d1-38bf-47c4-881b-6ae77f2edc00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:15:48 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-a5b09168-d619-44ec-b653-a6511baa2433 tempest-VolumesListTestJSON-435415017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21a9c2bd-9a18-4821-89dd-e1db8a72eea7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:15:48 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-a5b09168-d619-44ec-b653-a6511baa2433 tempest-VolumesListTestJSON-435415017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21a9c2bd-9a18-4821-89dd-e1db8a72eea7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '113deca4-cae5-4f46-b5d4-93ea1a13686e', 'volume_name': 'volume-113deca4-cae5-4f46-b5d4-93ea1a13686e', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:15:48 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-a5b09168-d619-44ec-b653-a6511baa2433 tempest-VolumesListTestJSON-435415017 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e8f23ff-8f0c-4dfc-9cf2-526e4d12f965) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:15:48 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-a5b09168-d619-44ec-b653-a6511baa2433 tempest-VolumesListTestJSON-435415017 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e8f23ff-8f0c-4dfc-9cf2-526e4d12f965) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:15:48 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-a5b09168-d619-44ec-b653-a6511baa2433 tempest-VolumesListTestJSON-435415017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82e11f51-6a08-4108-a7f8-675180ba0c9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:15:48 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-a5b09168-d619-44ec-b653-a6511baa2433 tempest-VolumesListTestJSON-435415017 None] Volume 113deca4-cae5-4f46-b5d4-93ea1a13686e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-113deca4-cae5-4f46-b5d4-93ea1a13686e', 'volume_size': 1} Aug 05 06:15:48 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-a5b09168-d619-44ec-b653-a6511baa2433 tempest-VolumesListTestJSON-435415017 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:15:48 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-a5b09168-d619-44ec-b653-a6511baa2433 tempest-VolumesListTestJSON-435415017 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:15:48 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-a5b09168-d619-44ec-b653-a6511baa2433 tempest-VolumesListTestJSON-435415017 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:15:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-560450006',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=113deca4-cae5-4f46-b5d4-93ea1a13686e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='06f51b1ebc3b4c019d16c95e123c8ab5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:15:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:15:49Z,use_quota=True,user_id='0dfb741e0b06438ead00436acde39936',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)}" {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 06:15:48 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-a5b09168-d619-44ec-b653-a6511baa2433 tempest-VolumesListTestJSON-435415017 None] Creating volume 113deca4-cae5-4f46-b5d4-93ea1a13686e {{(pid=88695) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 06:15:48 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-a5b09168-d619-44ec-b653-a6511baa2433 tempest-VolumesListTestJSON-435415017 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:15:48 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-a5b09168-d619-44ec-b653-a6511baa2433 tempest-VolumesListTestJSON-435415017 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:15:48 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-a5b09168-d619-44ec-b653-a6511baa2433 tempest-VolumesListTestJSON-435415017 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:15:48 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-a5b09168-d619-44ec-b653-a6511baa2433 tempest-VolumesListTestJSON-435415017 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:15:48 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-a5b09168-d619-44ec-b653-a6511baa2433 tempest-VolumesListTestJSON-435415017 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:15:48 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-a5b09168-d619-44ec-b653-a6511baa2433 tempest-VolumesListTestJSON-435415017 None] Selected osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 as target Quobyte volume. {{(pid=88695) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 06:15:48 devstack cinder-volume[88695]: INFO cinder.volume.drivers.remotefs [None req-a5b09168-d619-44ec-b653-a6511baa2433 tempest-VolumesListTestJSON-435415017 None] casted to osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 Aug 05 06:15:48 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-a5b09168-d619-44ec-b653-a6511baa2433 tempest-VolumesListTestJSON-435415017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-113deca4-cae5-4f46-b5d4-93ea1a13686e 1073741824 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:15:48 devstack sudo[95097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-113deca4-cae5-4f46-b5d4-93ea1a13686e 1073741824 Aug 05 06:15:48 devstack sudo[95097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:15:49 devstack sudo[95097]: pam_unix(sudo:session): session closed for user root Aug 05 06:15:49 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-a5b09168-d619-44ec-b653-a6511baa2433 tempest-VolumesListTestJSON-435415017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-113deca4-cae5-4f46-b5d4-93ea1a13686e 1073741824" returned: 0 in 0.958s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:15:49 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-a5b09168-d619-44ec-b653-a6511baa2433 tempest-VolumesListTestJSON-435415017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-113deca4-cae5-4f46-b5d4-93ea1a13686e {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:15:49 devstack sudo[95111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-113deca4-cae5-4f46-b5d4-93ea1a13686e Aug 05 06:15:49 devstack sudo[95111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:15:50 devstack sudo[95111]: pam_unix(sudo:session): session closed for user root Aug 05 06:15:50 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-a5b09168-d619-44ec-b653-a6511baa2433 tempest-VolumesListTestJSON-435415017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-113deca4-cae5-4f46-b5d4-93ea1a13686e" returned: 0 in 0.370s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:15:50 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-a5b09168-d619-44ec-b653-a6511baa2433 tempest-VolumesListTestJSON-435415017 None] <== create_volume: return (1439ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'} {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 06:15:50 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-a5b09168-d619-44ec-b653-a6511baa2433 tempest-VolumesListTestJSON-435415017 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.441s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:15:50 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-a5b09168-d619-44ec-b653-a6511baa2433 tempest-VolumesListTestJSON-435415017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82e11f51-6a08-4108-a7f8-675180ba0c9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-113deca4-cae5-4f46-b5d4-93ea1a13686e', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:15:50 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-a5b09168-d619-44ec-b653-a6511baa2433 tempest-VolumesListTestJSON-435415017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17c0e1a7-cafd-4189-b92c-9593a3b28761) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:15:50 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-a5b09168-d619-44ec-b653-a6511baa2433 tempest-VolumesListTestJSON-435415017 None] Volume volume-113deca4-cae5-4f46-b5d4-93ea1a13686e (113deca4-cae5-4f46-b5d4-93ea1a13686e): created successfully Aug 05 06:15:50 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-a5b09168-d619-44ec-b653-a6511baa2433 tempest-VolumesListTestJSON-435415017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17c0e1a7-cafd-4189-b92c-9593a3b28761) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:15:50 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-a5b09168-d619-44ec-b653-a6511baa2433 tempest-VolumesListTestJSON-435415017 None] Flow 'volume_create_manager' (33a6ea1f-c512-4c3b-926d-0b981d54011f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:15:50 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-a5b09168-d619-44ec-b653-a6511baa2433 tempest-VolumesListTestJSON-435415017 None] Created volume successfully. Aug 05 06:15:54 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-937f7e7e-6e1c-478d-938c-9092d2b48e13 tempest-VolumesListTestJSON-435415017 None] Acquiring lock "cinder-113deca4-cae5-4f46-b5d4-93ea1a13686e-delete_volume" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:15:54 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-937f7e7e-6e1c-478d-938c-9092d2b48e13 tempest-VolumesListTestJSON-435415017 None] Lock "cinder-113deca4-cae5-4f46-b5d4-93ea1a13686e-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:15:54 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-937f7e7e-6e1c-478d-938c-9092d2b48e13 tempest-VolumesListTestJSON-435415017 None] Acquiring lock "cinder-quobyte-113deca4-cae5-4f46-b5d4-93ea1a13686e" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:15:54 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-937f7e7e-6e1c-478d-938c-9092d2b48e13 tempest-VolumesListTestJSON-435415017 None] Lock "cinder-quobyte-113deca4-cae5-4f46-b5d4-93ea1a13686e" acquired by "delete_volume" :: waited 0.022s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:15:54 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3f36ae9-7cde-42c9-bd71-ea6c06a96ae1]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:15:54 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-937f7e7e-6e1c-478d-938c-9092d2b48e13 tempest-VolumesListTestJSON-435415017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-113deca4-cae5-4f46-b5d4-93ea1a13686e {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:15:54 devstack sudo[95127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-113deca4-cae5-4f46-b5d4-93ea1a13686e Aug 05 06:15:54 devstack sudo[95127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:15:54 devstack sudo[95127]: pam_unix(sudo:session): session closed for user root Aug 05 06:15:54 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-937f7e7e-6e1c-478d-938c-9092d2b48e13 tempest-VolumesListTestJSON-435415017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-113deca4-cae5-4f46-b5d4-93ea1a13686e" returned: 0 in 0.617s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:15:54 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-937f7e7e-6e1c-478d-938c-9092d2b48e13 tempest-VolumesListTestJSON-435415017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-113deca4-cae5-4f46-b5d4-93ea1a13686e {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:15:55 devstack sudo[95133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-113deca4-cae5-4f46-b5d4-93ea1a13686e Aug 05 06:15:55 devstack sudo[95133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:15:55 devstack sudo[95133]: pam_unix(sudo:session): session closed for user root Aug 05 06:15:55 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-937f7e7e-6e1c-478d-938c-9092d2b48e13 tempest-VolumesListTestJSON-435415017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-113deca4-cae5-4f46-b5d4-93ea1a13686e" returned: 0 in 0.315s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:15:55 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-937f7e7e-6e1c-478d-938c-9092d2b48e13 tempest-VolumesListTestJSON-435415017 None] Lock "cinder-quobyte-113deca4-cae5-4f46-b5d4-93ea1a13686e" released by "delete_volume" :: held 1.021s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:15:55 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-937f7e7e-6e1c-478d-938c-9092d2b48e13 tempest-VolumesListTestJSON-435415017 None] Created reservations ['571eca2f-abfb-411e-9ee6-6e1efeba70dd', '408daac3-ba04-40ed-b7d0-be6d76b64be6', '548c16d8-dc1f-467f-ae82-d4e359c76248', '5f0f7ea4-3d7a-4c5a-94fe-b3f2186c17d0'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:15:55 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-937f7e7e-6e1c-478d-938c-9092d2b48e13 tempest-VolumesListTestJSON-435415017 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:15:55 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-937f7e7e-6e1c-478d-938c-9092d2b48e13 tempest-VolumesListTestJSON-435415017 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:15:55 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-937f7e7e-6e1c-478d-938c-9092d2b48e13 tempest-VolumesListTestJSON-435415017 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:15:55 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-937f7e7e-6e1c-478d-938c-9092d2b48e13 tempest-VolumesListTestJSON-435415017 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:15:55 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-937f7e7e-6e1c-478d-938c-9092d2b48e13 tempest-VolumesListTestJSON-435415017 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:15:55 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-937f7e7e-6e1c-478d-938c-9092d2b48e13 tempest-VolumesListTestJSON-435415017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:15:55 devstack sudo[95136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce Aug 05 06:15:55 devstack sudo[95136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:15:55 devstack sudo[95136]: pam_unix(sudo:session): session closed for user root Aug 05 06:15:55 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-937f7e7e-6e1c-478d-938c-9092d2b48e13 tempest-VolumesListTestJSON-435415017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce" returned: 0 in 0.337s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:15:55 devstack cinder-volume[88695]: DEBUG cinder.manager [None req-937f7e7e-6e1c-478d-938c-9092d2b48e13 tempest-VolumesListTestJSON-435415017 None] Notifying Schedulers of capabilities ... {{(pid=88695) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 06:15:55 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-937f7e7e-6e1c-478d-938c-9092d2b48e13 tempest-VolumesListTestJSON-435415017 None] Deleted volume successfully. Aug 05 06:15:55 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-937f7e7e-6e1c-478d-938c-9092d2b48e13 tempest-VolumesListTestJSON-435415017 None] Lock "cinder-113deca4-cae5-4f46-b5d4-93ea1a13686e-delete_volume" released by "delete_volume" :: held 1.662s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:15:56 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-f7006c95-3afd-442a-80de-cbef4bdb8dfb tempest-VolumesListTestJSON-435415017 None] Acquiring lock "cinder-54fd466c-7cc3-44cf-a60b-76b5f7d55c2c-delete_volume" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:15:56 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-f7006c95-3afd-442a-80de-cbef4bdb8dfb tempest-VolumesListTestJSON-435415017 None] Lock "cinder-54fd466c-7cc3-44cf-a60b-76b5f7d55c2c-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:15:56 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-f7006c95-3afd-442a-80de-cbef4bdb8dfb tempest-VolumesListTestJSON-435415017 None] Acquiring lock "cinder-quobyte-54fd466c-7cc3-44cf-a60b-76b5f7d55c2c" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:15:56 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-f7006c95-3afd-442a-80de-cbef4bdb8dfb tempest-VolumesListTestJSON-435415017 None] Lock "cinder-quobyte-54fd466c-7cc3-44cf-a60b-76b5f7d55c2c" acquired by "delete_volume" :: waited 0.018s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:15:56 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[6eac82ec-8b6c-4402-867d-eb777455448f]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:15:56 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-f7006c95-3afd-442a-80de-cbef4bdb8dfb tempest-VolumesListTestJSON-435415017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-54fd466c-7cc3-44cf-a60b-76b5f7d55c2c {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:15:56 devstack sudo[95139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-54fd466c-7cc3-44cf-a60b-76b5f7d55c2c Aug 05 06:15:56 devstack sudo[95139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:15:57 devstack sudo[95139]: pam_unix(sudo:session): session closed for user root Aug 05 06:15:57 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-f7006c95-3afd-442a-80de-cbef4bdb8dfb tempest-VolumesListTestJSON-435415017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-54fd466c-7cc3-44cf-a60b-76b5f7d55c2c" returned: 0 in 0.496s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:15:57 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-f7006c95-3afd-442a-80de-cbef4bdb8dfb tempest-VolumesListTestJSON-435415017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-54fd466c-7cc3-44cf-a60b-76b5f7d55c2c {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:15:57 devstack sudo[95144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-54fd466c-7cc3-44cf-a60b-76b5f7d55c2c Aug 05 06:15:57 devstack sudo[95144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:15:57 devstack sudo[95144]: pam_unix(sudo:session): session closed for user root Aug 05 06:15:57 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-f7006c95-3afd-442a-80de-cbef4bdb8dfb tempest-VolumesListTestJSON-435415017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-54fd466c-7cc3-44cf-a60b-76b5f7d55c2c" returned: 0 in 0.436s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:15:57 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-f7006c95-3afd-442a-80de-cbef4bdb8dfb tempest-VolumesListTestJSON-435415017 None] Lock "cinder-quobyte-54fd466c-7cc3-44cf-a60b-76b5f7d55c2c" released by "delete_volume" :: held 1.007s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:15:57 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-f7006c95-3afd-442a-80de-cbef4bdb8dfb tempest-VolumesListTestJSON-435415017 None] Created reservations ['612285c0-1c88-4c61-9bd8-11b1709b2a6f', 'e6748301-5aa6-425b-819a-20288ad665ec', 'ed095158-1b8b-4e77-8658-43493979deb2', 'e7982c89-268f-4048-95d2-ff4980c2467c'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:15:57 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-f7006c95-3afd-442a-80de-cbef4bdb8dfb tempest-VolumesListTestJSON-435415017 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:15:57 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-f7006c95-3afd-442a-80de-cbef4bdb8dfb tempest-VolumesListTestJSON-435415017 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:15:57 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-f7006c95-3afd-442a-80de-cbef4bdb8dfb tempest-VolumesListTestJSON-435415017 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:15:57 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-f7006c95-3afd-442a-80de-cbef4bdb8dfb tempest-VolumesListTestJSON-435415017 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:15:57 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-f7006c95-3afd-442a-80de-cbef4bdb8dfb tempest-VolumesListTestJSON-435415017 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:15:57 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-f7006c95-3afd-442a-80de-cbef4bdb8dfb tempest-VolumesListTestJSON-435415017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:15:58 devstack sudo[95148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce Aug 05 06:15:58 devstack sudo[95148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:15:58 devstack sudo[95148]: pam_unix(sudo:session): session closed for user root Aug 05 06:15:58 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-f7006c95-3afd-442a-80de-cbef4bdb8dfb tempest-VolumesListTestJSON-435415017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce" returned: 0 in 0.404s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:15:58 devstack cinder-volume[88695]: DEBUG cinder.manager [None req-f7006c95-3afd-442a-80de-cbef4bdb8dfb tempest-VolumesListTestJSON-435415017 None] Notifying Schedulers of capabilities ... {{(pid=88695) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 06:15:58 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-f7006c95-3afd-442a-80de-cbef4bdb8dfb tempest-VolumesListTestJSON-435415017 None] Deleted volume successfully. Aug 05 06:15:58 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-f7006c95-3afd-442a-80de-cbef4bdb8dfb tempest-VolumesListTestJSON-435415017 None] Lock "cinder-54fd466c-7cc3-44cf-a60b-76b5f7d55c2c-delete_volume" released by "delete_volume" :: held 1.790s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:15:59 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-0cf3b56a-8999-4ec6-b90e-44bbc0ab1c47 tempest-VolumesListTestJSON-435415017 None] Acquiring lock "cinder-a2e65c75-5c6f-4518-8408-5b927272e5d4-delete_volume" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:15:59 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-0cf3b56a-8999-4ec6-b90e-44bbc0ab1c47 tempest-VolumesListTestJSON-435415017 None] Lock "cinder-a2e65c75-5c6f-4518-8408-5b927272e5d4-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:15:59 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-0cf3b56a-8999-4ec6-b90e-44bbc0ab1c47 tempest-VolumesListTestJSON-435415017 None] Acquiring lock "cinder-quobyte-a2e65c75-5c6f-4518-8408-5b927272e5d4" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:15:59 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-0cf3b56a-8999-4ec6-b90e-44bbc0ab1c47 tempest-VolumesListTestJSON-435415017 None] Lock "cinder-quobyte-a2e65c75-5c6f-4518-8408-5b927272e5d4" acquired by "delete_volume" :: waited 0.044s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:15:59 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cef9922-03ba-4dbe-bbc4-4114efa256c0]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:15:59 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-0cf3b56a-8999-4ec6-b90e-44bbc0ab1c47 tempest-VolumesListTestJSON-435415017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a2e65c75-5c6f-4518-8408-5b927272e5d4 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:15:59 devstack sudo[95151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a2e65c75-5c6f-4518-8408-5b927272e5d4 Aug 05 06:15:59 devstack sudo[95151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:16:00 devstack sudo[95151]: pam_unix(sudo:session): session closed for user root Aug 05 06:16:00 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-0cf3b56a-8999-4ec6-b90e-44bbc0ab1c47 tempest-VolumesListTestJSON-435415017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a2e65c75-5c6f-4518-8408-5b927272e5d4" returned: 0 in 0.701s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:16:00 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-0cf3b56a-8999-4ec6-b90e-44bbc0ab1c47 tempest-VolumesListTestJSON-435415017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a2e65c75-5c6f-4518-8408-5b927272e5d4 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:16:00 devstack sudo[95158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a2e65c75-5c6f-4518-8408-5b927272e5d4 Aug 05 06:16:00 devstack sudo[95158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:16:00 devstack sudo[95158]: pam_unix(sudo:session): session closed for user root Aug 05 06:16:00 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-0cf3b56a-8999-4ec6-b90e-44bbc0ab1c47 tempest-VolumesListTestJSON-435415017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a2e65c75-5c6f-4518-8408-5b927272e5d4" returned: 0 in 0.312s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:16:00 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-0cf3b56a-8999-4ec6-b90e-44bbc0ab1c47 tempest-VolumesListTestJSON-435415017 None] Lock "cinder-quobyte-a2e65c75-5c6f-4518-8408-5b927272e5d4" released by "delete_volume" :: held 1.091s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:16:00 devstack cinder-volume[88695]: DEBUG oslo_service.periodic_task [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88695) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 06:16:00 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:16:00 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:16:00 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:16:00 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:16:00 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:16:00 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:16:00 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-0cf3b56a-8999-4ec6-b90e-44bbc0ab1c47 tempest-VolumesListTestJSON-435415017 None] Created reservations ['27d481d3-f785-40b0-a636-d8b0b46fb6c5', 'b2401bd3-9546-45c2-ac7e-f86616430edd', '0ad95163-6778-4d9e-afd8-bd2440165036', '83bdbb32-5073-4e71-a9ff-7460a27410e7'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:16:00 devstack sudo[95161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce Aug 05 06:16:00 devstack sudo[95161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:16:00 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-0cf3b56a-8999-4ec6-b90e-44bbc0ab1c47 tempest-VolumesListTestJSON-435415017 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:16:00 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-0cf3b56a-8999-4ec6-b90e-44bbc0ab1c47 tempest-VolumesListTestJSON-435415017 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:16:00 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-0cf3b56a-8999-4ec6-b90e-44bbc0ab1c47 tempest-VolumesListTestJSON-435415017 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:16:00 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-0cf3b56a-8999-4ec6-b90e-44bbc0ab1c47 tempest-VolumesListTestJSON-435415017 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:16:00 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-0cf3b56a-8999-4ec6-b90e-44bbc0ab1c47 tempest-VolumesListTestJSON-435415017 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:16:00 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-0cf3b56a-8999-4ec6-b90e-44bbc0ab1c47 tempest-VolumesListTestJSON-435415017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:16:00 devstack sudo[95163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce Aug 05 06:16:00 devstack sudo[95163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:16:00 devstack sudo[95161]: pam_unix(sudo:session): session closed for user root Aug 05 06:16:00 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce" returned: 0 in 0.511s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:16:00 devstack cinder-volume[88695]: DEBUG cinder.manager [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] Notifying Schedulers of capabilities ... {{(pid=88695) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 06:16:00 devstack cinder-volume[88695]: DEBUG oslo_service.periodic_task [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] Running periodic task VolumeManager._thread_info {{(pid=88695) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 06:16:00 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] thread count: 28 {{(pid=88695) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 05 06:16:00 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] thread info: [<_MainThread(MainThread, started 134469211893888)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88695) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 05 06:16:00 devstack sudo[95163]: pam_unix(sudo:session): session closed for user root Aug 05 06:16:00 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-0cf3b56a-8999-4ec6-b90e-44bbc0ab1c47 tempest-VolumesListTestJSON-435415017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce" returned: 0 in 0.435s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:16:00 devstack cinder-volume[88695]: DEBUG cinder.manager [None req-0cf3b56a-8999-4ec6-b90e-44bbc0ab1c47 tempest-VolumesListTestJSON-435415017 None] Notifying Schedulers of capabilities ... {{(pid=88695) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 06:16:00 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-0cf3b56a-8999-4ec6-b90e-44bbc0ab1c47 tempest-VolumesListTestJSON-435415017 None] Deleted volume successfully. Aug 05 06:16:01 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-0cf3b56a-8999-4ec6-b90e-44bbc0ab1c47 tempest-VolumesListTestJSON-435415017 None] Lock "cinder-a2e65c75-5c6f-4518-8408-5b927272e5d4-delete_volume" released by "delete_volume" :: held 1.859s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:16:10 devstack cinder-volume[88695]: DEBUG dbcounter [-] [88695] Writing DB stats cinder:SELECT=19,cinder:UPDATE=30,cinder:DELETE=2,cinder:INSERT=4 {{(pid=88695) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 06:16:10 devstack cinder-volume[88695]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad1b1129-b66e-4600-946d-774f5067e0ba tempest-VolumesNegativeTest-1015809760 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88695) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 06:16:10 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-ad1b1129-b66e-4600-946d-774f5067e0ba tempest-VolumesNegativeTest-1015809760 None] Flow 'volume_create_manager' (c7af8d3d-94bc-4164-91e5-9a75edf4e79f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:16:10 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-ad1b1129-b66e-4600-946d-774f5067e0ba tempest-VolumesNegativeTest-1015809760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d485a420-d37b-4d21-a728-0fafbe5156de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:16:10 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-ad1b1129-b66e-4600-946d-774f5067e0ba tempest-VolumesNegativeTest-1015809760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d485a420-d37b-4d21-a728-0fafbe5156de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:16:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-273465012',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=735888da-3dd1-4ae2-ba60-5f81225099c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2135d16555db43dba651a0fd89610ab5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:16:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:16:11Z,use_quota=True,user_id='9c08f84dcedc4a2cb8817a990d41c56a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:16:10 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-ad1b1129-b66e-4600-946d-774f5067e0ba tempest-VolumesNegativeTest-1015809760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c567d743-a3ba-4b7a-a658-9277f7dcabc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:16:10 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-ad1b1129-b66e-4600-946d-774f5067e0ba tempest-VolumesNegativeTest-1015809760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c567d743-a3ba-4b7a-a658-9277f7dcabc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:16:10 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-ad1b1129-b66e-4600-946d-774f5067e0ba tempest-VolumesNegativeTest-1015809760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0ccb6f4-3937-48ed-9097-4f8b572732a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:16:10 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-ad1b1129-b66e-4600-946d-774f5067e0ba tempest-VolumesNegativeTest-1015809760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0ccb6f4-3937-48ed-9097-4f8b572732a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '735888da-3dd1-4ae2-ba60-5f81225099c4', 'volume_name': 'volume-735888da-3dd1-4ae2-ba60-5f81225099c4', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:16:10 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-ad1b1129-b66e-4600-946d-774f5067e0ba tempest-VolumesNegativeTest-1015809760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4fe46bd-c29c-4419-84df-4159f39b922f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:16:10 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-ad1b1129-b66e-4600-946d-774f5067e0ba tempest-VolumesNegativeTest-1015809760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4fe46bd-c29c-4419-84df-4159f39b922f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:16:10 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-ad1b1129-b66e-4600-946d-774f5067e0ba tempest-VolumesNegativeTest-1015809760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0495867e-1e2c-4b8b-bfc9-54046805ce9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:16:10 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-ad1b1129-b66e-4600-946d-774f5067e0ba tempest-VolumesNegativeTest-1015809760 None] Volume 735888da-3dd1-4ae2-ba60-5f81225099c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-735888da-3dd1-4ae2-ba60-5f81225099c4', 'volume_size': 1} Aug 05 06:16:10 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-ad1b1129-b66e-4600-946d-774f5067e0ba tempest-VolumesNegativeTest-1015809760 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:16:10 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-ad1b1129-b66e-4600-946d-774f5067e0ba tempest-VolumesNegativeTest-1015809760 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:16:10 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-ad1b1129-b66e-4600-946d-774f5067e0ba tempest-VolumesNegativeTest-1015809760 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:16:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-273465012',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=735888da-3dd1-4ae2-ba60-5f81225099c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2135d16555db43dba651a0fd89610ab5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:16:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:16:11Z,use_quota=True,user_id='9c08f84dcedc4a2cb8817a990d41c56a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)}" {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 06:16:10 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-ad1b1129-b66e-4600-946d-774f5067e0ba tempest-VolumesNegativeTest-1015809760 None] Creating volume 735888da-3dd1-4ae2-ba60-5f81225099c4 {{(pid=88695) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 06:16:10 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-ad1b1129-b66e-4600-946d-774f5067e0ba tempest-VolumesNegativeTest-1015809760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:16:10 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-ad1b1129-b66e-4600-946d-774f5067e0ba tempest-VolumesNegativeTest-1015809760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:16:10 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-ad1b1129-b66e-4600-946d-774f5067e0ba tempest-VolumesNegativeTest-1015809760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:16:10 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-ad1b1129-b66e-4600-946d-774f5067e0ba tempest-VolumesNegativeTest-1015809760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:16:10 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-ad1b1129-b66e-4600-946d-774f5067e0ba tempest-VolumesNegativeTest-1015809760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:16:10 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-ad1b1129-b66e-4600-946d-774f5067e0ba tempest-VolumesNegativeTest-1015809760 None] Selected osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 as target Quobyte volume. {{(pid=88695) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 06:16:10 devstack cinder-volume[88695]: INFO cinder.volume.drivers.remotefs [None req-ad1b1129-b66e-4600-946d-774f5067e0ba tempest-VolumesNegativeTest-1015809760 None] casted to osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 Aug 05 06:16:10 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-ad1b1129-b66e-4600-946d-774f5067e0ba tempest-VolumesNegativeTest-1015809760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-735888da-3dd1-4ae2-ba60-5f81225099c4 1073741824 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:16:10 devstack sudo[95195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-735888da-3dd1-4ae2-ba60-5f81225099c4 1073741824 Aug 05 06:16:10 devstack sudo[95195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:16:11 devstack sudo[95195]: pam_unix(sudo:session): session closed for user root Aug 05 06:16:11 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-ad1b1129-b66e-4600-946d-774f5067e0ba tempest-VolumesNegativeTest-1015809760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-735888da-3dd1-4ae2-ba60-5f81225099c4 1073741824" returned: 0 in 0.814s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:16:11 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-ad1b1129-b66e-4600-946d-774f5067e0ba tempest-VolumesNegativeTest-1015809760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-735888da-3dd1-4ae2-ba60-5f81225099c4 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:16:11 devstack sudo[95201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-735888da-3dd1-4ae2-ba60-5f81225099c4 Aug 05 06:16:11 devstack sudo[95201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:16:12 devstack sudo[95201]: pam_unix(sudo:session): session closed for user root Aug 05 06:16:12 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-ad1b1129-b66e-4600-946d-774f5067e0ba tempest-VolumesNegativeTest-1015809760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-735888da-3dd1-4ae2-ba60-5f81225099c4" returned: 0 in 0.564s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:16:12 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-ad1b1129-b66e-4600-946d-774f5067e0ba tempest-VolumesNegativeTest-1015809760 None] <== create_volume: return (1497ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'} {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 06:16:12 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-ad1b1129-b66e-4600-946d-774f5067e0ba tempest-VolumesNegativeTest-1015809760 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.501s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:16:12 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-ad1b1129-b66e-4600-946d-774f5067e0ba tempest-VolumesNegativeTest-1015809760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0495867e-1e2c-4b8b-bfc9-54046805ce9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-735888da-3dd1-4ae2-ba60-5f81225099c4', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:16:12 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-ad1b1129-b66e-4600-946d-774f5067e0ba tempest-VolumesNegativeTest-1015809760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0402d41f-d05c-4afd-8760-61bbc68fe880) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:16:12 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-ad1b1129-b66e-4600-946d-774f5067e0ba tempest-VolumesNegativeTest-1015809760 None] Volume volume-735888da-3dd1-4ae2-ba60-5f81225099c4 (735888da-3dd1-4ae2-ba60-5f81225099c4): created successfully Aug 05 06:16:12 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-ad1b1129-b66e-4600-946d-774f5067e0ba tempest-VolumesNegativeTest-1015809760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0402d41f-d05c-4afd-8760-61bbc68fe880) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:16:12 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-ad1b1129-b66e-4600-946d-774f5067e0ba tempest-VolumesNegativeTest-1015809760 None] Flow 'volume_create_manager' (c7af8d3d-94bc-4164-91e5-9a75edf4e79f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:16:12 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-ad1b1129-b66e-4600-946d-774f5067e0ba tempest-VolumesNegativeTest-1015809760 None] Created volume successfully. Aug 05 06:16:14 devstack cinder-volume[88695]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c1fec96-60dc-4382-82f5-86e3ffbbc93f tempest-AttachVolumeShelveTestJSON-882480005 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88695) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 06:16:14 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-2c1fec96-60dc-4382-82f5-86e3ffbbc93f tempest-AttachVolumeShelveTestJSON-882480005 None] Flow 'volume_create_manager' (67bcd64a-d31a-4543-8665-c4741aed3619) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:16:14 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-2c1fec96-60dc-4382-82f5-86e3ffbbc93f tempest-AttachVolumeShelveTestJSON-882480005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4ad6b1f-6ffd-4746-8383-cad715ec3a4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:16:14 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-2c1fec96-60dc-4382-82f5-86e3ffbbc93f tempest-AttachVolumeShelveTestJSON-882480005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4ad6b1f-6ffd-4746-8383-cad715ec3a4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:16:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1318302211',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6587608b-4c8e-4ee2-a574-dc751b8eae3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fad7dbf4fc24b8ba50db009254f7b71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:16:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:16:14Z,use_quota=True,user_id='82cdab2925484c218de2a546b20a0115',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:16:14 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-2c1fec96-60dc-4382-82f5-86e3ffbbc93f tempest-AttachVolumeShelveTestJSON-882480005 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d675d17a-c0c6-436d-b230-bdf6876a090d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:16:14 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-2c1fec96-60dc-4382-82f5-86e3ffbbc93f tempest-AttachVolumeShelveTestJSON-882480005 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d675d17a-c0c6-436d-b230-bdf6876a090d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:16:14 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-2c1fec96-60dc-4382-82f5-86e3ffbbc93f tempest-AttachVolumeShelveTestJSON-882480005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7471b7c-bf03-4d12-a064-5f0d6768297e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:16:14 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-2c1fec96-60dc-4382-82f5-86e3ffbbc93f tempest-AttachVolumeShelveTestJSON-882480005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7471b7c-bf03-4d12-a064-5f0d6768297e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6587608b-4c8e-4ee2-a574-dc751b8eae3c', 'volume_name': 'volume-6587608b-4c8e-4ee2-a574-dc751b8eae3c', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:16:14 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-2c1fec96-60dc-4382-82f5-86e3ffbbc93f tempest-AttachVolumeShelveTestJSON-882480005 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7069eed7-9929-481f-9392-3f5b126fc685) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:16:14 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-2c1fec96-60dc-4382-82f5-86e3ffbbc93f tempest-AttachVolumeShelveTestJSON-882480005 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7069eed7-9929-481f-9392-3f5b126fc685) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:16:14 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-2c1fec96-60dc-4382-82f5-86e3ffbbc93f tempest-AttachVolumeShelveTestJSON-882480005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b97f36ed-bc74-49a2-801b-5fd5c8df06d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:16:14 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-2c1fec96-60dc-4382-82f5-86e3ffbbc93f tempest-AttachVolumeShelveTestJSON-882480005 None] Volume 6587608b-4c8e-4ee2-a574-dc751b8eae3c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6587608b-4c8e-4ee2-a574-dc751b8eae3c', 'volume_size': 1} Aug 05 06:16:14 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-2c1fec96-60dc-4382-82f5-86e3ffbbc93f tempest-AttachVolumeShelveTestJSON-882480005 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:16:14 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-2c1fec96-60dc-4382-82f5-86e3ffbbc93f tempest-AttachVolumeShelveTestJSON-882480005 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:16:14 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-2c1fec96-60dc-4382-82f5-86e3ffbbc93f tempest-AttachVolumeShelveTestJSON-882480005 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:16:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1318302211',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6587608b-4c8e-4ee2-a574-dc751b8eae3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fad7dbf4fc24b8ba50db009254f7b71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:16:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:16:14Z,use_quota=True,user_id='82cdab2925484c218de2a546b20a0115',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)}" {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 06:16:14 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-2c1fec96-60dc-4382-82f5-86e3ffbbc93f tempest-AttachVolumeShelveTestJSON-882480005 None] Creating volume 6587608b-4c8e-4ee2-a574-dc751b8eae3c {{(pid=88695) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 06:16:14 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-2c1fec96-60dc-4382-82f5-86e3ffbbc93f tempest-AttachVolumeShelveTestJSON-882480005 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:16:14 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-2c1fec96-60dc-4382-82f5-86e3ffbbc93f tempest-AttachVolumeShelveTestJSON-882480005 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:16:14 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-2c1fec96-60dc-4382-82f5-86e3ffbbc93f tempest-AttachVolumeShelveTestJSON-882480005 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:16:14 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-2c1fec96-60dc-4382-82f5-86e3ffbbc93f tempest-AttachVolumeShelveTestJSON-882480005 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:16:14 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-2c1fec96-60dc-4382-82f5-86e3ffbbc93f tempest-AttachVolumeShelveTestJSON-882480005 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:16:14 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-2c1fec96-60dc-4382-82f5-86e3ffbbc93f tempest-AttachVolumeShelveTestJSON-882480005 None] Selected osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 as target Quobyte volume. {{(pid=88695) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 06:16:14 devstack cinder-volume[88695]: INFO cinder.volume.drivers.remotefs [None req-2c1fec96-60dc-4382-82f5-86e3ffbbc93f tempest-AttachVolumeShelveTestJSON-882480005 None] casted to osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 Aug 05 06:16:14 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-2c1fec96-60dc-4382-82f5-86e3ffbbc93f tempest-AttachVolumeShelveTestJSON-882480005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-6587608b-4c8e-4ee2-a574-dc751b8eae3c 1073741824 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:16:14 devstack sudo[95233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-6587608b-4c8e-4ee2-a574-dc751b8eae3c 1073741824 Aug 05 06:16:14 devstack sudo[95233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:16:15 devstack sudo[95233]: pam_unix(sudo:session): session closed for user root Aug 05 06:16:15 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-2c1fec96-60dc-4382-82f5-86e3ffbbc93f tempest-AttachVolumeShelveTestJSON-882480005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-6587608b-4c8e-4ee2-a574-dc751b8eae3c 1073741824" returned: 0 in 0.552s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:16:15 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-2c1fec96-60dc-4382-82f5-86e3ffbbc93f tempest-AttachVolumeShelveTestJSON-882480005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-6587608b-4c8e-4ee2-a574-dc751b8eae3c {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:16:15 devstack sudo[95253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-6587608b-4c8e-4ee2-a574-dc751b8eae3c Aug 05 06:16:15 devstack sudo[95253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:16:15 devstack sudo[95253]: pam_unix(sudo:session): session closed for user root Aug 05 06:16:15 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-2c1fec96-60dc-4382-82f5-86e3ffbbc93f tempest-AttachVolumeShelveTestJSON-882480005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-6587608b-4c8e-4ee2-a574-dc751b8eae3c" returned: 0 in 0.336s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:16:15 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-2c1fec96-60dc-4382-82f5-86e3ffbbc93f tempest-AttachVolumeShelveTestJSON-882480005 None] <== create_volume: return (935ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'} {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 06:16:15 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-2c1fec96-60dc-4382-82f5-86e3ffbbc93f tempest-AttachVolumeShelveTestJSON-882480005 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.939s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:16:15 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-2c1fec96-60dc-4382-82f5-86e3ffbbc93f tempest-AttachVolumeShelveTestJSON-882480005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b97f36ed-bc74-49a2-801b-5fd5c8df06d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6587608b-4c8e-4ee2-a574-dc751b8eae3c', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:16:15 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-2c1fec96-60dc-4382-82f5-86e3ffbbc93f tempest-AttachVolumeShelveTestJSON-882480005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e5f86be-f010-41d5-87db-a256d3771167) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:16:15 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-2c1fec96-60dc-4382-82f5-86e3ffbbc93f tempest-AttachVolumeShelveTestJSON-882480005 None] Volume volume-6587608b-4c8e-4ee2-a574-dc751b8eae3c (6587608b-4c8e-4ee2-a574-dc751b8eae3c): created successfully Aug 05 06:16:15 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-2c1fec96-60dc-4382-82f5-86e3ffbbc93f tempest-AttachVolumeShelveTestJSON-882480005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e5f86be-f010-41d5-87db-a256d3771167) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:16:15 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-2c1fec96-60dc-4382-82f5-86e3ffbbc93f tempest-AttachVolumeShelveTestJSON-882480005 None] Flow 'volume_create_manager' (67bcd64a-d31a-4543-8665-c4741aed3619) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:16:15 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-2c1fec96-60dc-4382-82f5-86e3ffbbc93f tempest-AttachVolumeShelveTestJSON-882480005 None] Created volume successfully. Aug 05 06:16:25 devstack cinder-volume[88695]: DEBUG dbcounter [-] [88695] Writing DB stats cinder:UPDATE=35,cinder:SELECT=23,cinder:INSERT=12,cinder:DELETE=3 {{(pid=88695) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 06:16:25 devstack cinder-volume[88695]: DEBUG dbcounter [-] [88695] Writing DB stats cinder:UPDATE=7,cinder:SELECT=4,cinder:DELETE=2 {{(pid=88695) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 06:16:29 devstack cinder-volume[88695]: DEBUG cinder.volume.flows.manager.create_volume [None req-756fddba-3182-4b24-b295-d58bc6ed2308 tempest-TestImageHashVerification-939220271 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88695) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 06:16:29 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-756fddba-3182-4b24-b295-d58bc6ed2308 tempest-TestImageHashVerification-939220271 None] Flow 'volume_create_manager' (e81670e1-18c5-4cfa-8ac2-13f20bbc5e96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:16:29 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-756fddba-3182-4b24-b295-d58bc6ed2308 tempest-TestImageHashVerification-939220271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e44fd72-fcaa-4b52-8c84-deab9f45b5ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:16:29 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-756fddba-3182-4b24-b295-d58bc6ed2308 tempest-TestImageHashVerification-939220271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e44fd72-fcaa-4b52-8c84-deab9f45b5ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:16:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-660692960',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c960c80-d4ba-49ab-9f6d-6574307ca5a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd73e4e384b844e49123f05a8b068e90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:16:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:16:30Z,use_quota=True,user_id='476c753b31a0449a9a5bf26d2df20982',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:16:29 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-756fddba-3182-4b24-b295-d58bc6ed2308 tempest-TestImageHashVerification-939220271 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e446aa8d-a645-482b-81ef-b86826e26af3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:16:29 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-756fddba-3182-4b24-b295-d58bc6ed2308 tempest-TestImageHashVerification-939220271 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e446aa8d-a645-482b-81ef-b86826e26af3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:16:30 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-756fddba-3182-4b24-b295-d58bc6ed2308 tempest-TestImageHashVerification-939220271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9682395a-650f-47bf-a5c4-bcd990cb19e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:16:30 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-756fddba-3182-4b24-b295-d58bc6ed2308 tempest-TestImageHashVerification-939220271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9682395a-650f-47bf-a5c4-bcd990cb19e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c960c80-d4ba-49ab-9f6d-6574307ca5a5', 'volume_name': 'volume-1c960c80-d4ba-49ab-9f6d-6574307ca5a5', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:16:30 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-756fddba-3182-4b24-b295-d58bc6ed2308 tempest-TestImageHashVerification-939220271 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7339999-73e6-4b4f-a55d-2376762afbea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:16:30 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-756fddba-3182-4b24-b295-d58bc6ed2308 tempest-TestImageHashVerification-939220271 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7339999-73e6-4b4f-a55d-2376762afbea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:16:30 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-756fddba-3182-4b24-b295-d58bc6ed2308 tempest-TestImageHashVerification-939220271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e65a6c3a-549e-4801-a8c9-7344d68d1810) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:16:30 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-756fddba-3182-4b24-b295-d58bc6ed2308 tempest-TestImageHashVerification-939220271 None] Volume 1c960c80-d4ba-49ab-9f6d-6574307ca5a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c960c80-d4ba-49ab-9f6d-6574307ca5a5', 'volume_size': 1} Aug 05 06:16:30 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-756fddba-3182-4b24-b295-d58bc6ed2308 tempest-TestImageHashVerification-939220271 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:16:30 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-756fddba-3182-4b24-b295-d58bc6ed2308 tempest-TestImageHashVerification-939220271 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:16:30 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-756fddba-3182-4b24-b295-d58bc6ed2308 tempest-TestImageHashVerification-939220271 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:16:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-660692960',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c960c80-d4ba-49ab-9f6d-6574307ca5a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd73e4e384b844e49123f05a8b068e90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:16:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:16:30Z,use_quota=True,user_id='476c753b31a0449a9a5bf26d2df20982',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)}" {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 06:16:30 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-756fddba-3182-4b24-b295-d58bc6ed2308 tempest-TestImageHashVerification-939220271 None] Creating volume 1c960c80-d4ba-49ab-9f6d-6574307ca5a5 {{(pid=88695) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 06:16:30 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-756fddba-3182-4b24-b295-d58bc6ed2308 tempest-TestImageHashVerification-939220271 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:16:30 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-756fddba-3182-4b24-b295-d58bc6ed2308 tempest-TestImageHashVerification-939220271 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:16:30 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-756fddba-3182-4b24-b295-d58bc6ed2308 tempest-TestImageHashVerification-939220271 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:16:30 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-756fddba-3182-4b24-b295-d58bc6ed2308 tempest-TestImageHashVerification-939220271 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:16:30 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-756fddba-3182-4b24-b295-d58bc6ed2308 tempest-TestImageHashVerification-939220271 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.042s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:16:30 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-756fddba-3182-4b24-b295-d58bc6ed2308 tempest-TestImageHashVerification-939220271 None] Selected osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 as target Quobyte volume. {{(pid=88695) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 06:16:30 devstack cinder-volume[88695]: INFO cinder.volume.drivers.remotefs [None req-756fddba-3182-4b24-b295-d58bc6ed2308 tempest-TestImageHashVerification-939220271 None] casted to osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 Aug 05 06:16:30 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-756fddba-3182-4b24-b295-d58bc6ed2308 tempest-TestImageHashVerification-939220271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-1c960c80-d4ba-49ab-9f6d-6574307ca5a5 1073741824 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:16:30 devstack sudo[95442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-1c960c80-d4ba-49ab-9f6d-6574307ca5a5 1073741824 Aug 05 06:16:30 devstack sudo[95442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:16:31 devstack sudo[95442]: pam_unix(sudo:session): session closed for user root Aug 05 06:16:31 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-756fddba-3182-4b24-b295-d58bc6ed2308 tempest-TestImageHashVerification-939220271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-1c960c80-d4ba-49ab-9f6d-6574307ca5a5 1073741824" returned: 0 in 1.153s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:16:31 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-756fddba-3182-4b24-b295-d58bc6ed2308 tempest-TestImageHashVerification-939220271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-1c960c80-d4ba-49ab-9f6d-6574307ca5a5 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:16:31 devstack sudo[95450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-1c960c80-d4ba-49ab-9f6d-6574307ca5a5 Aug 05 06:16:31 devstack sudo[95450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:16:31 devstack sudo[95450]: pam_unix(sudo:session): session closed for user root Aug 05 06:16:31 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-756fddba-3182-4b24-b295-d58bc6ed2308 tempest-TestImageHashVerification-939220271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-1c960c80-d4ba-49ab-9f6d-6574307ca5a5" returned: 0 in 0.564s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:16:31 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-756fddba-3182-4b24-b295-d58bc6ed2308 tempest-TestImageHashVerification-939220271 None] <== create_volume: return (1822ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'} {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 06:16:31 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-756fddba-3182-4b24-b295-d58bc6ed2308 tempest-TestImageHashVerification-939220271 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.837s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:16:32 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-756fddba-3182-4b24-b295-d58bc6ed2308 tempest-TestImageHashVerification-939220271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e65a6c3a-549e-4801-a8c9-7344d68d1810) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c960c80-d4ba-49ab-9f6d-6574307ca5a5', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:16:32 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-756fddba-3182-4b24-b295-d58bc6ed2308 tempest-TestImageHashVerification-939220271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82d7e296-12de-434a-bece-0c81404b9d44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:16:32 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-756fddba-3182-4b24-b295-d58bc6ed2308 tempest-TestImageHashVerification-939220271 None] Volume volume-1c960c80-d4ba-49ab-9f6d-6574307ca5a5 (1c960c80-d4ba-49ab-9f6d-6574307ca5a5): created successfully Aug 05 06:16:32 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-756fddba-3182-4b24-b295-d58bc6ed2308 tempest-TestImageHashVerification-939220271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82d7e296-12de-434a-bece-0c81404b9d44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:16:32 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-756fddba-3182-4b24-b295-d58bc6ed2308 tempest-TestImageHashVerification-939220271 None] Flow 'volume_create_manager' (e81670e1-18c5-4cfa-8ac2-13f20bbc5e96) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:16:32 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-756fddba-3182-4b24-b295-d58bc6ed2308 tempest-TestImageHashVerification-939220271 None] Created volume successfully. Aug 05 06:16:34 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-eadf5302-c8fd-4b51-841f-708e836c566d tempest-TestImageHashVerification-939220271 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:16:34 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-eadf5302-c8fd-4b51-841f-708e836c566d tempest-TestImageHashVerification-939220271 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:16:34 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[55961e57-da70-4dec-8ea8-8b209e90f146]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:16:34 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-eadf5302-c8fd-4b51-841f-708e836c566d tempest-TestImageHashVerification-939220271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-1c960c80-d4ba-49ab-9f6d-6574307ca5a5 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:16:34 devstack sudo[95491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-1c960c80-d4ba-49ab-9f6d-6574307ca5a5 Aug 05 06:16:34 devstack sudo[95491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:16:34 devstack sudo[95491]: pam_unix(sudo:session): session closed for user root Aug 05 06:16:34 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-eadf5302-c8fd-4b51-841f-708e836c566d tempest-TestImageHashVerification-939220271 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-1c960c80-d4ba-49ab-9f6d-6574307ca5a5" returned: 0 in 0.571s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:16:34 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad4e4967-57d8-4007-9c4b-b2f6564b8beb]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:16:34 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-eadf5302-c8fd-4b51-841f-708e836c566d tempest-TestImageHashVerification-939220271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-1c960c80-d4ba-49ab-9f6d-6574307ca5a5 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:16:35 devstack sudo[95496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-1c960c80-d4ba-49ab-9f6d-6574307ca5a5 Aug 05 06:16:35 devstack sudo[95496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:16:36 devstack sudo[95496]: pam_unix(sudo:session): session closed for user root Aug 05 06:16:36 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-eadf5302-c8fd-4b51-841f-708e836c566d tempest-TestImageHashVerification-939220271 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-1c960c80-d4ba-49ab-9f6d-6574307ca5a5" returned: 0 in 1.669s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:16:36 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-eadf5302-c8fd-4b51-841f-708e836c566d tempest-TestImageHashVerification-939220271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-1c960c80-d4ba-49ab-9f6d-6574307ca5a5 /opt/stack/data/cinder/conversion/1c960c80-d4ba-49ab-9f6d-6574307ca5a5.temp_image.a956d55c-80c1-463e-b0df-fb378027371bchjbqg3f.img {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:16:36 devstack sudo[95552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-1c960c80-d4ba-49ab-9f6d-6574307ca5a5 /opt/stack/data/cinder/conversion/1c960c80-d4ba-49ab-9f6d-6574307ca5a5.temp_image.a956d55c-80c1-463e-b0df-fb378027371bchjbqg3f.img Aug 05 06:16:36 devstack sudo[95552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:16:42 devstack cinder-volume[88695]: DEBUG dbcounter [-] [88695] Writing DB stats cinder:UPDATE=3,cinder:SELECT=1,cinder:INSERT=1,cinder:DELETE=1 {{(pid=88695) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 06:16:42 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [req-ea504568-fab8-4948-af1b-b50b0c34c206 req-f820ef9b-442f-4496-9e7b-3b457895b6e4 tempest-AttachVolumeShelveTestJSON-882480005 None] No connector for attachment b4b96e6f-e39c-4be7-9068-98f973160bed; skipping storage backend terminate_connection call. {{(pid=88695) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Aug 05 06:16:42 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [req-ea504568-fab8-4948-af1b-b50b0c34c206 req-f820ef9b-442f-4496-9e7b-3b457895b6e4 tempest-AttachVolumeShelveTestJSON-882480005 None] Deleting attachment b4b96e6f-e39c-4be7-9068-98f973160bed. {{(pid=88695) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 05 06:16:45 devstack sudo[95552]: pam_unix(sudo:session): session closed for user root Aug 05 06:16:45 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-eadf5302-c8fd-4b51-841f-708e836c566d tempest-TestImageHashVerification-939220271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-1c960c80-d4ba-49ab-9f6d-6574307ca5a5 /opt/stack/data/cinder/conversion/1c960c80-d4ba-49ab-9f6d-6574307ca5a5.temp_image.a956d55c-80c1-463e-b0df-fb378027371bchjbqg3f.img" returned: 0 in 9.052s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:16:45 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a5df5a7-6cc2-4009-8663-561e583ace4d]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:16:45 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-eadf5302-c8fd-4b51-841f-708e836c566d tempest-TestImageHashVerification-939220271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-1c960c80-d4ba-49ab-9f6d-6574307ca5a5 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:16:46 devstack sudo[95714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-1c960c80-d4ba-49ab-9f6d-6574307ca5a5 Aug 05 06:16:46 devstack sudo[95714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:16:46 devstack sudo[95714]: pam_unix(sudo:session): session closed for user root Aug 05 06:16:46 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-eadf5302-c8fd-4b51-841f-708e836c566d tempest-TestImageHashVerification-939220271 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-1c960c80-d4ba-49ab-9f6d-6574307ca5a5" returned: 0 in 1.224s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:16:46 devstack cinder-volume[88695]: DEBUG cinder.image.image_utils [None req-eadf5302-c8fd-4b51-841f-708e836c566d tempest-TestImageHashVerification-939220271 None] Image conversion details: src /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-1c960c80-d4ba-49ab-9f6d-6574307ca5a5, size 1024.00 MB, duration 9.05 sec, destination /opt/stack/data/cinder/conversion/1c960c80-d4ba-49ab-9f6d-6574307ca5a5.temp_image.a956d55c-80c1-463e-b0df-fb378027371bchjbqg3f.img {{(pid=88695) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 05 06:16:47 devstack cinder-volume[88695]: INFO cinder.image.image_utils [None req-eadf5302-c8fd-4b51-841f-708e836c566d tempest-TestImageHashVerification-939220271 None] Converted 1024.00 MB image at 113.11 MB/s Aug 05 06:16:47 devstack cinder-volume[88695]: DEBUG cinder.image.image_utils [None req-eadf5302-c8fd-4b51-841f-708e836c566d tempest-TestImageHashVerification-939220271 None] a956d55c-80c1-463e-b0df-fb378027371b was raw, no need to convert to raw {{(pid=88695) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Aug 05 06:16:49 devstack cinder-volume[88695]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a3f6190-f8c3-47ab-b7a8-4515303bc90e tempest-ServerRescueNegativeTestJSON-553637740 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88695) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 06:16:49 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-5a3f6190-f8c3-47ab-b7a8-4515303bc90e tempest-ServerRescueNegativeTestJSON-553637740 None] Flow 'volume_create_manager' (60b70232-4640-486d-ab5e-3df415afcee1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:16:49 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-5a3f6190-f8c3-47ab-b7a8-4515303bc90e tempest-ServerRescueNegativeTestJSON-553637740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9736360a-106b-40da-97b7-20fb4521a381) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:16:49 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-5a3f6190-f8c3-47ab-b7a8-4515303bc90e tempest-ServerRescueNegativeTestJSON-553637740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9736360a-106b-40da-97b7-20fb4521a381) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:16:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-219025539',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0ea3eaa-2de3-4338-a359-e71d3c4e5cc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='194fb5380574424484d5521d4331bdbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:16:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:16:50Z,use_quota=True,user_id='ffd3a31ff73f4da3b652c18cbe28b826',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:16:49 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-5a3f6190-f8c3-47ab-b7a8-4515303bc90e tempest-ServerRescueNegativeTestJSON-553637740 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1b63383-e79e-4f20-9859-efa1979e6483) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:16:49 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-5a3f6190-f8c3-47ab-b7a8-4515303bc90e tempest-ServerRescueNegativeTestJSON-553637740 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1b63383-e79e-4f20-9859-efa1979e6483) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:16:49 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-5a3f6190-f8c3-47ab-b7a8-4515303bc90e tempest-ServerRescueNegativeTestJSON-553637740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (128323e0-0b65-4c16-b2df-e2987435715d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:16:49 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-5a3f6190-f8c3-47ab-b7a8-4515303bc90e tempest-ServerRescueNegativeTestJSON-553637740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (128323e0-0b65-4c16-b2df-e2987435715d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a0ea3eaa-2de3-4338-a359-e71d3c4e5cc1', 'volume_name': 'volume-a0ea3eaa-2de3-4338-a359-e71d3c4e5cc1', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:16:49 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-5a3f6190-f8c3-47ab-b7a8-4515303bc90e tempest-ServerRescueNegativeTestJSON-553637740 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39d490d1-26c7-4f14-a65f-f92b7194808a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:16:49 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-5a3f6190-f8c3-47ab-b7a8-4515303bc90e tempest-ServerRescueNegativeTestJSON-553637740 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39d490d1-26c7-4f14-a65f-f92b7194808a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:16:49 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-5a3f6190-f8c3-47ab-b7a8-4515303bc90e tempest-ServerRescueNegativeTestJSON-553637740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (951f19a2-1435-4056-a33e-94e7c0710b19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:16:49 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-5a3f6190-f8c3-47ab-b7a8-4515303bc90e tempest-ServerRescueNegativeTestJSON-553637740 None] Volume a0ea3eaa-2de3-4338-a359-e71d3c4e5cc1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a0ea3eaa-2de3-4338-a359-e71d3c4e5cc1', 'volume_size': 1} Aug 05 06:16:49 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-5a3f6190-f8c3-47ab-b7a8-4515303bc90e tempest-ServerRescueNegativeTestJSON-553637740 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:16:59 devstack cinder-volume[88695]: DEBUG dbcounter [-] [88695] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=88695) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 06:16:59 devstack cinder-volume[88695]: DEBUG dbcounter [-] [88695] Writing DB stats cinder:SELECT=8,cinder:UPDATE=3 {{(pid=88695) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 06:17:00 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-bcfad6aa-896e-4a4a-b88c-8e83a3f83450 tempest-VolumesNegativeTest-1015809760 None] Acquiring lock "cinder-735888da-3dd1-4ae2-ba60-5f81225099c4-delete_volume" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:17:00 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-bcfad6aa-896e-4a4a-b88c-8e83a3f83450 tempest-VolumesNegativeTest-1015809760 None] Lock "cinder-735888da-3dd1-4ae2-ba60-5f81225099c4-delete_volume" acquired by "delete_volume" :: waited 0.069s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:17:00 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-bcfad6aa-896e-4a4a-b88c-8e83a3f83450 tempest-VolumesNegativeTest-1015809760 None] Acquiring lock "cinder-quobyte-735888da-3dd1-4ae2-ba60-5f81225099c4" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:17:00 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-bcfad6aa-896e-4a4a-b88c-8e83a3f83450 tempest-VolumesNegativeTest-1015809760 None] Lock "cinder-quobyte-735888da-3dd1-4ae2-ba60-5f81225099c4" acquired by "delete_volume" :: waited 0.025s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:17:00 devstack cinder-volume[88695]: DEBUG oslo_service.periodic_task [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88695) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 06:17:00 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:17:00 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:17:00 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:17:00 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:17:00 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:17:00 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:17:00 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[93749d80-010a-47b8-817a-fd1d5b7f5a32]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:17:00 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-bcfad6aa-896e-4a4a-b88c-8e83a3f83450 tempest-VolumesNegativeTest-1015809760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-735888da-3dd1-4ae2-ba60-5f81225099c4 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:17:00 devstack sudo[95865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce Aug 05 06:17:00 devstack sudo[95865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:17:00 devstack sudo[95868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-735888da-3dd1-4ae2-ba60-5f81225099c4 Aug 05 06:17:00 devstack sudo[95868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:17:00 devstack sudo[95865]: pam_unix(sudo:session): session closed for user root Aug 05 06:17:00 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce" returned: 0 in 0.433s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:17:00 devstack cinder-volume[88695]: DEBUG cinder.manager [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] Notifying Schedulers of capabilities ... {{(pid=88695) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 06:17:00 devstack cinder-volume[88695]: DEBUG oslo_service.periodic_task [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] Running periodic task VolumeManager._thread_info {{(pid=88695) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 06:17:00 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] thread count: 28 {{(pid=88695) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 05 06:17:00 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] thread info: [<_MainThread(MainThread, started 134469211893888)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88695) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 05 06:17:01 devstack sudo[95868]: pam_unix(sudo:session): session closed for user root Aug 05 06:17:01 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-bcfad6aa-896e-4a4a-b88c-8e83a3f83450 tempest-VolumesNegativeTest-1015809760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-735888da-3dd1-4ae2-ba60-5f81225099c4" returned: 0 in 0.580s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:17:01 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-bcfad6aa-896e-4a4a-b88c-8e83a3f83450 tempest-VolumesNegativeTest-1015809760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-735888da-3dd1-4ae2-ba60-5f81225099c4 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:17:01 devstack sudo[95901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-735888da-3dd1-4ae2-ba60-5f81225099c4 Aug 05 06:17:01 devstack sudo[95901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:17:01 devstack sudo[95901]: pam_unix(sudo:session): session closed for user root Aug 05 06:17:01 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-bcfad6aa-896e-4a4a-b88c-8e83a3f83450 tempest-VolumesNegativeTest-1015809760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-735888da-3dd1-4ae2-ba60-5f81225099c4" returned: 0 in 0.299s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:17:01 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-bcfad6aa-896e-4a4a-b88c-8e83a3f83450 tempest-VolumesNegativeTest-1015809760 None] Lock "cinder-quobyte-735888da-3dd1-4ae2-ba60-5f81225099c4" released by "delete_volume" :: held 1.002s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:17:01 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-bcfad6aa-896e-4a4a-b88c-8e83a3f83450 tempest-VolumesNegativeTest-1015809760 None] Created reservations ['27ee48bb-94e3-4f70-a5ea-62eeb1b59ae1', '1b904ea5-b951-4cd6-aaa9-96d3ce3944be', 'c10748fe-aee7-4f2b-afc8-4430c6f250fe', '8f66598e-ad3f-4ef4-bee5-fd2730c80435'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:17:01 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-bcfad6aa-896e-4a4a-b88c-8e83a3f83450 tempest-VolumesNegativeTest-1015809760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:17:01 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-bcfad6aa-896e-4a4a-b88c-8e83a3f83450 tempest-VolumesNegativeTest-1015809760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:17:01 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-bcfad6aa-896e-4a4a-b88c-8e83a3f83450 tempest-VolumesNegativeTest-1015809760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:17:01 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-bcfad6aa-896e-4a4a-b88c-8e83a3f83450 tempest-VolumesNegativeTest-1015809760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:17:01 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-bcfad6aa-896e-4a4a-b88c-8e83a3f83450 tempest-VolumesNegativeTest-1015809760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:17:01 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-bcfad6aa-896e-4a4a-b88c-8e83a3f83450 tempest-VolumesNegativeTest-1015809760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:17:01 devstack sudo[95905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce Aug 05 06:17:01 devstack sudo[95905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:17:01 devstack sudo[95905]: pam_unix(sudo:session): session closed for user root Aug 05 06:17:01 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-bcfad6aa-896e-4a4a-b88c-8e83a3f83450 tempest-VolumesNegativeTest-1015809760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce" returned: 0 in 0.366s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:17:01 devstack cinder-volume[88695]: DEBUG cinder.manager [None req-bcfad6aa-896e-4a4a-b88c-8e83a3f83450 tempest-VolumesNegativeTest-1015809760 None] Notifying Schedulers of capabilities ... {{(pid=88695) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 06:17:01 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-bcfad6aa-896e-4a4a-b88c-8e83a3f83450 tempest-VolumesNegativeTest-1015809760 None] Deleted volume successfully. Aug 05 06:17:01 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-bcfad6aa-896e-4a4a-b88c-8e83a3f83450 tempest-VolumesNegativeTest-1015809760 None] Lock "cinder-735888da-3dd1-4ae2-ba60-5f81225099c4-delete_volume" released by "delete_volume" :: held 1.792s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:17:11 devstack cinder-volume[88695]: DEBUG dbcounter [-] [88695] Writing DB stats cinder:UPDATE=10,cinder:SELECT=3,cinder:INSERT=1 {{(pid=88695) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 06:17:11 devstack cinder-volume[88695]: DEBUG dbcounter [-] [88695] Writing DB stats cinder:SELECT=7,cinder:INSERT=3,cinder:UPDATE=6,cinder:DELETE=1 {{(pid=88695) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 06:17:17 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-eadf5302-c8fd-4b51-841f-708e836c566d tempest-TestImageHashVerification-939220271 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 43.650s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:17:17 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-eadf5302-c8fd-4b51-841f-708e836c566d tempest-TestImageHashVerification-939220271 None] Uploaded volume to glance image-id: a956d55c-80c1-463e-b0df-fb378027371b. {{(pid=88695) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Aug 05 06:17:18 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-5a3f6190-f8c3-47ab-b7a8-4515303bc90e tempest-ServerRescueNegativeTestJSON-553637740 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 28.079s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:17:18 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-5a3f6190-f8c3-47ab-b7a8-4515303bc90e tempest-ServerRescueNegativeTestJSON-553637740 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:16:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-219025539',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0ea3eaa-2de3-4338-a359-e71d3c4e5cc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='194fb5380574424484d5521d4331bdbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:16:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:16:50Z,use_quota=True,user_id='ffd3a31ff73f4da3b652c18cbe28b826',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)}" {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 06:17:18 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-5a3f6190-f8c3-47ab-b7a8-4515303bc90e tempest-ServerRescueNegativeTestJSON-553637740 None] Creating volume a0ea3eaa-2de3-4338-a359-e71d3c4e5cc1 {{(pid=88695) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 06:17:18 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-5a3f6190-f8c3-47ab-b7a8-4515303bc90e tempest-ServerRescueNegativeTestJSON-553637740 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:17:18 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-5a3f6190-f8c3-47ab-b7a8-4515303bc90e tempest-ServerRescueNegativeTestJSON-553637740 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:17:18 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-5a3f6190-f8c3-47ab-b7a8-4515303bc90e tempest-ServerRescueNegativeTestJSON-553637740 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:17:18 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-5a3f6190-f8c3-47ab-b7a8-4515303bc90e tempest-ServerRescueNegativeTestJSON-553637740 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:17:18 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-5a3f6190-f8c3-47ab-b7a8-4515303bc90e tempest-ServerRescueNegativeTestJSON-553637740 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:17:18 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-5a3f6190-f8c3-47ab-b7a8-4515303bc90e tempest-ServerRescueNegativeTestJSON-553637740 None] Selected osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 as target Quobyte volume. {{(pid=88695) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 06:17:18 devstack cinder-volume[88695]: INFO cinder.volume.drivers.remotefs [None req-5a3f6190-f8c3-47ab-b7a8-4515303bc90e tempest-ServerRescueNegativeTestJSON-553637740 None] casted to osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 Aug 05 06:17:18 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-5a3f6190-f8c3-47ab-b7a8-4515303bc90e tempest-ServerRescueNegativeTestJSON-553637740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a0ea3eaa-2de3-4338-a359-e71d3c4e5cc1 1073741824 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:17:18 devstack sudo[95919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a0ea3eaa-2de3-4338-a359-e71d3c4e5cc1 1073741824 Aug 05 06:17:18 devstack sudo[95919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:17:18 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-eadf5302-c8fd-4b51-841f-708e836c566d tempest-TestImageHashVerification-939220271 None] Copy volume to image completed successfully. Aug 05 06:17:18 devstack sudo[95919]: pam_unix(sudo:session): session closed for user root Aug 05 06:17:18 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-5a3f6190-f8c3-47ab-b7a8-4515303bc90e tempest-ServerRescueNegativeTestJSON-553637740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a0ea3eaa-2de3-4338-a359-e71d3c4e5cc1 1073741824" returned: 0 in 0.467s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:17:18 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-5a3f6190-f8c3-47ab-b7a8-4515303bc90e tempest-ServerRescueNegativeTestJSON-553637740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a0ea3eaa-2de3-4338-a359-e71d3c4e5cc1 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:17:18 devstack sudo[95924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a0ea3eaa-2de3-4338-a359-e71d3c4e5cc1 Aug 05 06:17:18 devstack sudo[95924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:17:18 devstack sudo[95924]: pam_unix(sudo:session): session closed for user root Aug 05 06:17:18 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-5a3f6190-f8c3-47ab-b7a8-4515303bc90e tempest-ServerRescueNegativeTestJSON-553637740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a0ea3eaa-2de3-4338-a359-e71d3c4e5cc1" returned: 0 in 0.404s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:17:18 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-5a3f6190-f8c3-47ab-b7a8-4515303bc90e tempest-ServerRescueNegativeTestJSON-553637740 None] <== create_volume: return (920ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'} {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 06:17:18 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-5a3f6190-f8c3-47ab-b7a8-4515303bc90e tempest-ServerRescueNegativeTestJSON-553637740 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.922s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:17:18 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-5a3f6190-f8c3-47ab-b7a8-4515303bc90e tempest-ServerRescueNegativeTestJSON-553637740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (951f19a2-1435-4056-a33e-94e7c0710b19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0ea3eaa-2de3-4338-a359-e71d3c4e5cc1', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:17:18 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-5a3f6190-f8c3-47ab-b7a8-4515303bc90e tempest-ServerRescueNegativeTestJSON-553637740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ba8a2ca-5f56-410a-ad69-136ce86582db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:17:18 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-5a3f6190-f8c3-47ab-b7a8-4515303bc90e tempest-ServerRescueNegativeTestJSON-553637740 None] Volume volume-a0ea3eaa-2de3-4338-a359-e71d3c4e5cc1 (a0ea3eaa-2de3-4338-a359-e71d3c4e5cc1): created successfully Aug 05 06:17:18 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-5a3f6190-f8c3-47ab-b7a8-4515303bc90e tempest-ServerRescueNegativeTestJSON-553637740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ba8a2ca-5f56-410a-ad69-136ce86582db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:17:18 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-5a3f6190-f8c3-47ab-b7a8-4515303bc90e tempest-ServerRescueNegativeTestJSON-553637740 None] Flow 'volume_create_manager' (60b70232-4640-486d-ab5e-3df415afcee1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:17:19 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-5a3f6190-f8c3-47ab-b7a8-4515303bc90e tempest-ServerRescueNegativeTestJSON-553637740 None] Created volume successfully. Aug 05 06:17:19 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-54c90b45-ff8b-4550-b163-2cf07a274432 tempest-TestImageHashVerification-939220271 None] Acquiring lock "cinder-1c960c80-d4ba-49ab-9f6d-6574307ca5a5-delete_volume" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:17:19 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-54c90b45-ff8b-4550-b163-2cf07a274432 tempest-TestImageHashVerification-939220271 None] Lock "cinder-1c960c80-d4ba-49ab-9f6d-6574307ca5a5-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:17:19 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-54c90b45-ff8b-4550-b163-2cf07a274432 tempest-TestImageHashVerification-939220271 None] Acquiring lock "cinder-quobyte-1c960c80-d4ba-49ab-9f6d-6574307ca5a5" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:17:19 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-54c90b45-ff8b-4550-b163-2cf07a274432 tempest-TestImageHashVerification-939220271 None] Lock "cinder-quobyte-1c960c80-d4ba-49ab-9f6d-6574307ca5a5" acquired by "delete_volume" :: waited 0.019s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:17:19 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbdb766a-0690-4f8d-9876-8218a281ad96]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:17:19 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-54c90b45-ff8b-4550-b163-2cf07a274432 tempest-TestImageHashVerification-939220271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-1c960c80-d4ba-49ab-9f6d-6574307ca5a5 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:17:19 devstack sudo[95927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-1c960c80-d4ba-49ab-9f6d-6574307ca5a5 Aug 05 06:17:19 devstack sudo[95927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:17:19 devstack sudo[95927]: pam_unix(sudo:session): session closed for user root Aug 05 06:17:19 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-54c90b45-ff8b-4550-b163-2cf07a274432 tempest-TestImageHashVerification-939220271 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-1c960c80-d4ba-49ab-9f6d-6574307ca5a5" returned: 0 in 0.401s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:17:19 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-54c90b45-ff8b-4550-b163-2cf07a274432 tempest-TestImageHashVerification-939220271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-1c960c80-d4ba-49ab-9f6d-6574307ca5a5 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:17:19 devstack sudo[95932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-1c960c80-d4ba-49ab-9f6d-6574307ca5a5 Aug 05 06:17:19 devstack sudo[95932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:17:19 devstack cinder-volume[88695]: DEBUG cinder.volume.flows.manager.create_volume [None req-d39fe803-fb05-4020-b81b-079b428d75cf tempest-VolumesSnapshotTestJSON-1364937772 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88695) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 06:17:20 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-d39fe803-fb05-4020-b81b-079b428d75cf tempest-VolumesSnapshotTestJSON-1364937772 None] Flow 'volume_create_manager' (cbb1b87c-3da4-475f-aea1-932cf9b7241f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:17:20 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-d39fe803-fb05-4020-b81b-079b428d75cf tempest-VolumesSnapshotTestJSON-1364937772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a04fdcaa-3379-416c-934b-1acf64949b83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:17:20 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-d39fe803-fb05-4020-b81b-079b428d75cf tempest-VolumesSnapshotTestJSON-1364937772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a04fdcaa-3379-416c-934b-1acf64949b83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:17:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-230472531',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a9920a5-aeef-475d-a471-a4e48a5c7932,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f87c02595984b10b4b2ed8e5d9cb883',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:17:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:17:20Z,use_quota=True,user_id='0566fcce709945bf9523b15b9d04dfc1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:17:20 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-d39fe803-fb05-4020-b81b-079b428d75cf tempest-VolumesSnapshotTestJSON-1364937772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5829d0c-1537-43e9-8b3c-bb08de0c3e91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:17:20 devstack sudo[95932]: pam_unix(sudo:session): session closed for user root Aug 05 06:17:20 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-d39fe803-fb05-4020-b81b-079b428d75cf tempest-VolumesSnapshotTestJSON-1364937772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5829d0c-1537-43e9-8b3c-bb08de0c3e91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:17:20 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-d39fe803-fb05-4020-b81b-079b428d75cf tempest-VolumesSnapshotTestJSON-1364937772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca0e4795-da7a-43bc-8a61-f8383fc738f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:17:20 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-d39fe803-fb05-4020-b81b-079b428d75cf tempest-VolumesSnapshotTestJSON-1364937772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca0e4795-da7a-43bc-8a61-f8383fc738f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a9920a5-aeef-475d-a471-a4e48a5c7932', 'volume_name': 'volume-7a9920a5-aeef-475d-a471-a4e48a5c7932', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:17:20 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-d39fe803-fb05-4020-b81b-079b428d75cf tempest-VolumesSnapshotTestJSON-1364937772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8bf7f5d-3ce0-4ec9-9cdf-1a3e597a58c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:17:20 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-d39fe803-fb05-4020-b81b-079b428d75cf tempest-VolumesSnapshotTestJSON-1364937772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8bf7f5d-3ce0-4ec9-9cdf-1a3e597a58c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:17:20 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-d39fe803-fb05-4020-b81b-079b428d75cf tempest-VolumesSnapshotTestJSON-1364937772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa830b57-167b-4708-b266-12fa138fd58b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:17:20 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-d39fe803-fb05-4020-b81b-079b428d75cf tempest-VolumesSnapshotTestJSON-1364937772 None] Volume 7a9920a5-aeef-475d-a471-a4e48a5c7932: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a9920a5-aeef-475d-a471-a4e48a5c7932', 'volume_size': 1} Aug 05 06:17:20 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-d39fe803-fb05-4020-b81b-079b428d75cf tempest-VolumesSnapshotTestJSON-1364937772 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:17:20 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-d39fe803-fb05-4020-b81b-079b428d75cf tempest-VolumesSnapshotTestJSON-1364937772 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:17:20 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-d39fe803-fb05-4020-b81b-079b428d75cf tempest-VolumesSnapshotTestJSON-1364937772 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:17:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-230472531',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a9920a5-aeef-475d-a471-a4e48a5c7932,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f87c02595984b10b4b2ed8e5d9cb883',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:17:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:17:20Z,use_quota=True,user_id='0566fcce709945bf9523b15b9d04dfc1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)}" {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 06:17:20 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-d39fe803-fb05-4020-b81b-079b428d75cf tempest-VolumesSnapshotTestJSON-1364937772 None] Creating volume 7a9920a5-aeef-475d-a471-a4e48a5c7932 {{(pid=88695) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 06:17:20 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-d39fe803-fb05-4020-b81b-079b428d75cf tempest-VolumesSnapshotTestJSON-1364937772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:17:20 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-d39fe803-fb05-4020-b81b-079b428d75cf tempest-VolumesSnapshotTestJSON-1364937772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:17:20 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-d39fe803-fb05-4020-b81b-079b428d75cf tempest-VolumesSnapshotTestJSON-1364937772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:17:20 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-d39fe803-fb05-4020-b81b-079b428d75cf tempest-VolumesSnapshotTestJSON-1364937772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:17:20 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-d39fe803-fb05-4020-b81b-079b428d75cf tempest-VolumesSnapshotTestJSON-1364937772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:17:20 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-d39fe803-fb05-4020-b81b-079b428d75cf tempest-VolumesSnapshotTestJSON-1364937772 None] Selected osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 as target Quobyte volume. {{(pid=88695) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 06:17:20 devstack cinder-volume[88695]: INFO cinder.volume.drivers.remotefs [None req-d39fe803-fb05-4020-b81b-079b428d75cf tempest-VolumesSnapshotTestJSON-1364937772 None] casted to osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 Aug 05 06:17:20 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-d39fe803-fb05-4020-b81b-079b428d75cf tempest-VolumesSnapshotTestJSON-1364937772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7a9920a5-aeef-475d-a471-a4e48a5c7932 1073741824 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:17:20 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-54c90b45-ff8b-4550-b163-2cf07a274432 tempest-TestImageHashVerification-939220271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-1c960c80-d4ba-49ab-9f6d-6574307ca5a5" returned: 0 in 0.345s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:17:20 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-54c90b45-ff8b-4550-b163-2cf07a274432 tempest-TestImageHashVerification-939220271 None] Lock "cinder-quobyte-1c960c80-d4ba-49ab-9f6d-6574307ca5a5" released by "delete_volume" :: held 0.795s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:17:20 devstack sudo[95936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7a9920a5-aeef-475d-a471-a4e48a5c7932 1073741824 Aug 05 06:17:20 devstack sudo[95936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:17:20 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-54c90b45-ff8b-4550-b163-2cf07a274432 tempest-TestImageHashVerification-939220271 None] Created reservations ['c0ae512b-2dba-410f-a922-21d88c13b36e', 'ea2c42da-01fb-4855-bf0f-994b153f0639', '27914adb-7c0e-47b2-982e-2c467528adbc', 'd9dcfce4-72e1-40eb-950c-c190136969fb'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:17:20 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-54c90b45-ff8b-4550-b163-2cf07a274432 tempest-TestImageHashVerification-939220271 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:17:20 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-54c90b45-ff8b-4550-b163-2cf07a274432 tempest-TestImageHashVerification-939220271 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:17:20 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-54c90b45-ff8b-4550-b163-2cf07a274432 tempest-TestImageHashVerification-939220271 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:17:20 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-54c90b45-ff8b-4550-b163-2cf07a274432 tempest-TestImageHashVerification-939220271 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:17:20 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-54c90b45-ff8b-4550-b163-2cf07a274432 tempest-TestImageHashVerification-939220271 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:17:20 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-54c90b45-ff8b-4550-b163-2cf07a274432 tempest-TestImageHashVerification-939220271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:17:20 devstack sudo[95939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce Aug 05 06:17:20 devstack sudo[95939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:17:20 devstack sudo[95939]: pam_unix(sudo:session): session closed for user root Aug 05 06:17:20 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-54c90b45-ff8b-4550-b163-2cf07a274432 tempest-TestImageHashVerification-939220271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce" returned: 0 in 0.276s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:17:20 devstack cinder-volume[88695]: DEBUG cinder.manager [None req-54c90b45-ff8b-4550-b163-2cf07a274432 tempest-TestImageHashVerification-939220271 None] Notifying Schedulers of capabilities ... {{(pid=88695) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 06:17:20 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-54c90b45-ff8b-4550-b163-2cf07a274432 tempest-TestImageHashVerification-939220271 None] Deleted volume successfully. Aug 05 06:17:20 devstack sudo[95936]: pam_unix(sudo:session): session closed for user root Aug 05 06:17:20 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-54c90b45-ff8b-4550-b163-2cf07a274432 tempest-TestImageHashVerification-939220271 None] Lock "cinder-1c960c80-d4ba-49ab-9f6d-6574307ca5a5-delete_volume" released by "delete_volume" :: held 1.463s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:17:20 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-d39fe803-fb05-4020-b81b-079b428d75cf tempest-VolumesSnapshotTestJSON-1364937772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7a9920a5-aeef-475d-a471-a4e48a5c7932 1073741824" returned: 0 in 0.641s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:17:20 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-d39fe803-fb05-4020-b81b-079b428d75cf tempest-VolumesSnapshotTestJSON-1364937772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7a9920a5-aeef-475d-a471-a4e48a5c7932 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:17:20 devstack sudo[95945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7a9920a5-aeef-475d-a471-a4e48a5c7932 Aug 05 06:17:20 devstack sudo[95945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:17:21 devstack sudo[95945]: pam_unix(sudo:session): session closed for user root Aug 05 06:17:21 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-d39fe803-fb05-4020-b81b-079b428d75cf tempest-VolumesSnapshotTestJSON-1364937772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7a9920a5-aeef-475d-a471-a4e48a5c7932" returned: 0 in 0.291s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:17:21 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-d39fe803-fb05-4020-b81b-079b428d75cf tempest-VolumesSnapshotTestJSON-1364937772 None] <== create_volume: return (980ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'} {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 06:17:21 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-d39fe803-fb05-4020-b81b-079b428d75cf tempest-VolumesSnapshotTestJSON-1364937772 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.983s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:17:21 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-d39fe803-fb05-4020-b81b-079b428d75cf tempest-VolumesSnapshotTestJSON-1364937772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa830b57-167b-4708-b266-12fa138fd58b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a9920a5-aeef-475d-a471-a4e48a5c7932', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:17:21 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-d39fe803-fb05-4020-b81b-079b428d75cf tempest-VolumesSnapshotTestJSON-1364937772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1e89dbe-bf0d-4d8b-8a16-4bf0926e49e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:17:21 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-d39fe803-fb05-4020-b81b-079b428d75cf tempest-VolumesSnapshotTestJSON-1364937772 None] Volume volume-7a9920a5-aeef-475d-a471-a4e48a5c7932 (7a9920a5-aeef-475d-a471-a4e48a5c7932): created successfully Aug 05 06:17:21 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-d39fe803-fb05-4020-b81b-079b428d75cf tempest-VolumesSnapshotTestJSON-1364937772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1e89dbe-bf0d-4d8b-8a16-4bf0926e49e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:17:21 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-d39fe803-fb05-4020-b81b-079b428d75cf tempest-VolumesSnapshotTestJSON-1364937772 None] Flow 'volume_create_manager' (cbb1b87c-3da4-475f-aea1-932cf9b7241f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:17:21 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-d39fe803-fb05-4020-b81b-079b428d75cf tempest-VolumesSnapshotTestJSON-1364937772 None] Created volume successfully. Aug 05 06:17:22 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-87f4f944-0635-49bf-83a9-eed03e9b54b9 tempest-VolumesSnapshotTestJSON-1364937772 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:17:22 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-87f4f944-0635-49bf-83a9-eed03e9b54b9 tempest-VolumesSnapshotTestJSON-1364937772 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:17:22 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-87f4f944-0635-49bf-83a9-eed03e9b54b9 tempest-VolumesSnapshotTestJSON-1364937772 None] Creating offline snapshot 51353d5c-d4ac-4b47-9f5e-b372005c59fb of volume 7a9920a5-aeef-475d-a471-a4e48a5c7932 {{(pid=88695) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 06:17:22 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4eb5747-bdff-4c0c-b6cf-17441323fb5a]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:17:22 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-87f4f944-0635-49bf-83a9-eed03e9b54b9 tempest-VolumesSnapshotTestJSON-1364937772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7a9920a5-aeef-475d-a471-a4e48a5c7932 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:17:22 devstack sudo[95980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7a9920a5-aeef-475d-a471-a4e48a5c7932 Aug 05 06:17:22 devstack sudo[95980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:17:23 devstack sudo[95980]: pam_unix(sudo:session): session closed for user root Aug 05 06:17:23 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-87f4f944-0635-49bf-83a9-eed03e9b54b9 tempest-VolumesSnapshotTestJSON-1364937772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7a9920a5-aeef-475d-a471-a4e48a5c7932" returned: 0 in 0.504s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:17:23 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-87f4f944-0635-49bf-83a9-eed03e9b54b9 tempest-VolumesSnapshotTestJSON-1364937772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7a9920a5-aeef-475d-a471-a4e48a5c7932,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7a9920a5-aeef-475d-a471-a4e48a5c7932.51353d5c-d4ac-4b47-9f5e-b372005c59fb 1G {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:17:23 devstack sudo[95999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7a9920a5-aeef-475d-a471-a4e48a5c7932,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7a9920a5-aeef-475d-a471-a4e48a5c7932.51353d5c-d4ac-4b47-9f5e-b372005c59fb 1G Aug 05 06:17:23 devstack sudo[95999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:17:23 devstack sudo[95999]: pam_unix(sudo:session): session closed for user root Aug 05 06:17:23 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-87f4f944-0635-49bf-83a9-eed03e9b54b9 tempest-VolumesSnapshotTestJSON-1364937772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7a9920a5-aeef-475d-a471-a4e48a5c7932,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7a9920a5-aeef-475d-a471-a4e48a5c7932.51353d5c-d4ac-4b47-9f5e-b372005c59fb 1G" returned: 0 in 0.775s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:17:23 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-87f4f944-0635-49bf-83a9-eed03e9b54b9 tempest-VolumesSnapshotTestJSON-1364937772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7a9920a5-aeef-475d-a471-a4e48a5c7932 -F qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7a9920a5-aeef-475d-a471-a4e48a5c7932.51353d5c-d4ac-4b47-9f5e-b372005c59fb {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:17:23 devstack sudo[96013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7a9920a5-aeef-475d-a471-a4e48a5c7932 -F qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7a9920a5-aeef-475d-a471-a4e48a5c7932.51353d5c-d4ac-4b47-9f5e-b372005c59fb Aug 05 06:17:23 devstack sudo[96013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:17:24 devstack sudo[96013]: pam_unix(sudo:session): session closed for user root Aug 05 06:17:24 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-87f4f944-0635-49bf-83a9-eed03e9b54b9 tempest-VolumesSnapshotTestJSON-1364937772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7a9920a5-aeef-475d-a471-a4e48a5c7932 -F qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7a9920a5-aeef-475d-a471-a4e48a5c7932.51353d5c-d4ac-4b47-9f5e-b372005c59fb" returned: 0 in 0.357s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:17:24 devstack cinder-volume[88695]: WARNING cinder.volume.drivers.remotefs [None req-87f4f944-0635-49bf-83a9-eed03e9b54b9 tempest-VolumesSnapshotTestJSON-1364937772 None] /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7a9920a5-aeef-475d-a471-a4e48a5c7932.51353d5c-d4ac-4b47-9f5e-b372005c59fb is being set with open permissions: ugo+rw Aug 05 06:17:24 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-87f4f944-0635-49bf-83a9-eed03e9b54b9 tempest-VolumesSnapshotTestJSON-1364937772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7a9920a5-aeef-475d-a471-a4e48a5c7932.51353d5c-d4ac-4b47-9f5e-b372005c59fb {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:17:24 devstack sudo[96019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7a9920a5-aeef-475d-a471-a4e48a5c7932.51353d5c-d4ac-4b47-9f5e-b372005c59fb Aug 05 06:17:24 devstack sudo[96019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:17:24 devstack sudo[96019]: pam_unix(sudo:session): session closed for user root Aug 05 06:17:24 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-87f4f944-0635-49bf-83a9-eed03e9b54b9 tempest-VolumesSnapshotTestJSON-1364937772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7a9920a5-aeef-475d-a471-a4e48a5c7932.51353d5c-d4ac-4b47-9f5e-b372005c59fb" returned: 0 in 0.452s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:17:24 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-87f4f944-0635-49bf-83a9-eed03e9b54b9 tempest-VolumesSnapshotTestJSON-1364937772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7a9920a5-aeef-475d-a471-a4e48a5c7932.info {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:17:24 devstack sudo[96023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7a9920a5-aeef-475d-a471-a4e48a5c7932.info Aug 05 06:17:24 devstack sudo[96023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:17:24 devstack sudo[96023]: pam_unix(sudo:session): session closed for user root Aug 05 06:17:24 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-87f4f944-0635-49bf-83a9-eed03e9b54b9 tempest-VolumesSnapshotTestJSON-1364937772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7a9920a5-aeef-475d-a471-a4e48a5c7932.info" returned: 0 in 0.347s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:17:24 devstack cinder-volume[88695]: WARNING cinder.volume.drivers.remotefs [None req-87f4f944-0635-49bf-83a9-eed03e9b54b9 tempest-VolumesSnapshotTestJSON-1364937772 None] /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7a9920a5-aeef-475d-a471-a4e48a5c7932.info is being set with open permissions: ugo+rw Aug 05 06:17:24 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-87f4f944-0635-49bf-83a9-eed03e9b54b9 tempest-VolumesSnapshotTestJSON-1364937772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7a9920a5-aeef-475d-a471-a4e48a5c7932.info {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:17:25 devstack sudo[96027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7a9920a5-aeef-475d-a471-a4e48a5c7932.info Aug 05 06:17:25 devstack sudo[96027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:17:25 devstack sudo[96027]: pam_unix(sudo:session): session closed for user root Aug 05 06:17:25 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-87f4f944-0635-49bf-83a9-eed03e9b54b9 tempest-VolumesSnapshotTestJSON-1364937772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7a9920a5-aeef-475d-a471-a4e48a5c7932.info" returned: 0 in 0.314s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:17:25 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-87f4f944-0635-49bf-83a9-eed03e9b54b9 tempest-VolumesSnapshotTestJSON-1364937772 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.873s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:17:25 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-87f4f944-0635-49bf-83a9-eed03e9b54b9 tempest-VolumesSnapshotTestJSON-1364937772 None] Create snapshot completed successfully Aug 05 06:17:26 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-08b2d269-33d6-47be-b006-77ea9ace33f5 tempest-VolumesSnapshotTestJSON-1364937772 None] Acquiring lock "cinder-51353d5c-d4ac-4b47-9f5e-b372005c59fb-delete_snapshot" by "delete_snapshot" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:17:26 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-08b2d269-33d6-47be-b006-77ea9ace33f5 tempest-VolumesSnapshotTestJSON-1364937772 None] Lock "cinder-51353d5c-d4ac-4b47-9f5e-b372005c59fb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.058s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:17:26 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-08b2d269-33d6-47be-b006-77ea9ace33f5 tempest-VolumesSnapshotTestJSON-1364937772 None] Acquiring lock "cinder-quobyte-7a9920a5-aeef-475d-a471-a4e48a5c7932" by "delete_snapshot" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:17:26 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-08b2d269-33d6-47be-b006-77ea9ace33f5 tempest-VolumesSnapshotTestJSON-1364937772 None] Lock "cinder-quobyte-7a9920a5-aeef-475d-a471-a4e48a5c7932" acquired by "delete_snapshot" :: waited 0.035s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:17:26 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-08b2d269-33d6-47be-b006-77ea9ace33f5 tempest-VolumesSnapshotTestJSON-1364937772 None] Acquiring lock "cinder-quobyte-51353d5c-d4ac-4b47-9f5e-b372005c59fb" by "_delete_snapshot" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:17:26 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-08b2d269-33d6-47be-b006-77ea9ace33f5 tempest-VolumesSnapshotTestJSON-1364937772 None] Lock "cinder-quobyte-51353d5c-d4ac-4b47-9f5e-b372005c59fb" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:17:26 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-08b2d269-33d6-47be-b006-77ea9ace33f5 tempest-VolumesSnapshotTestJSON-1364937772 None] Deleting offline snapshot 51353d5c-d4ac-4b47-9f5e-b372005c59fb of volume 7a9920a5-aeef-475d-a471-a4e48a5c7932 {{(pid=88695) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 06:17:26 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-08b2d269-33d6-47be-b006-77ea9ace33f5 tempest-VolumesSnapshotTestJSON-1364937772 None] snapshot_file for this snap is: volume-7a9920a5-aeef-475d-a471-a4e48a5c7932.51353d5c-d4ac-4b47-9f5e-b372005c59fb {{(pid=88695) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 06:17:26 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3f1553a-06b5-46b8-a660-69fd2a54599d]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:17:26 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-08b2d269-33d6-47be-b006-77ea9ace33f5 tempest-VolumesSnapshotTestJSON-1364937772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7a9920a5-aeef-475d-a471-a4e48a5c7932.51353d5c-d4ac-4b47-9f5e-b372005c59fb {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:17:26 devstack sudo[96046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7a9920a5-aeef-475d-a471-a4e48a5c7932.51353d5c-d4ac-4b47-9f5e-b372005c59fb Aug 05 06:17:26 devstack sudo[96046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:17:27 devstack sudo[96046]: pam_unix(sudo:session): session closed for user root Aug 05 06:17:27 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-08b2d269-33d6-47be-b006-77ea9ace33f5 tempest-VolumesSnapshotTestJSON-1364937772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7a9920a5-aeef-475d-a471-a4e48a5c7932.51353d5c-d4ac-4b47-9f5e-b372005c59fb" returned: 0 in 0.758s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:17:27 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-08b2d269-33d6-47be-b006-77ea9ace33f5 tempest-VolumesSnapshotTestJSON-1364937772 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7a9920a5-aeef-475d-a471-a4e48a5c7932(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88695) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 06:17:27 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f84dd88-4136-49bd-8c1a-a478baa7c3b9]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:17:27 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-08b2d269-33d6-47be-b006-77ea9ace33f5 tempest-VolumesSnapshotTestJSON-1364937772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7a9920a5-aeef-475d-a471-a4e48a5c7932 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:17:27 devstack sudo[96067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7a9920a5-aeef-475d-a471-a4e48a5c7932 Aug 05 06:17:27 devstack sudo[96067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:17:28 devstack sudo[96067]: pam_unix(sudo:session): session closed for user root Aug 05 06:17:28 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-08b2d269-33d6-47be-b006-77ea9ace33f5 tempest-VolumesSnapshotTestJSON-1364937772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7a9920a5-aeef-475d-a471-a4e48a5c7932" returned: 0 in 0.770s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:17:28 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-08b2d269-33d6-47be-b006-77ea9ace33f5 tempest-VolumesSnapshotTestJSON-1364937772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7a9920a5-aeef-475d-a471-a4e48a5c7932.51353d5c-d4ac-4b47-9f5e-b372005c59fb {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:17:28 devstack sudo[96074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7a9920a5-aeef-475d-a471-a4e48a5c7932.51353d5c-d4ac-4b47-9f5e-b372005c59fb Aug 05 06:17:28 devstack sudo[96074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:17:28 devstack sudo[96074]: pam_unix(sudo:session): session closed for user root Aug 05 06:17:28 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-08b2d269-33d6-47be-b006-77ea9ace33f5 tempest-VolumesSnapshotTestJSON-1364937772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7a9920a5-aeef-475d-a471-a4e48a5c7932.51353d5c-d4ac-4b47-9f5e-b372005c59fb" returned: 0 in 0.478s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:17:28 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-08b2d269-33d6-47be-b006-77ea9ace33f5 tempest-VolumesSnapshotTestJSON-1364937772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7a9920a5-aeef-475d-a471-a4e48a5c7932.51353d5c-d4ac-4b47-9f5e-b372005c59fb {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:17:28 devstack sudo[96080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7a9920a5-aeef-475d-a471-a4e48a5c7932.51353d5c-d4ac-4b47-9f5e-b372005c59fb Aug 05 06:17:28 devstack sudo[96080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:17:28 devstack sudo[96080]: pam_unix(sudo:session): session closed for user root Aug 05 06:17:28 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-08b2d269-33d6-47be-b006-77ea9ace33f5 tempest-VolumesSnapshotTestJSON-1364937772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7a9920a5-aeef-475d-a471-a4e48a5c7932.51353d5c-d4ac-4b47-9f5e-b372005c59fb" returned: 0 in 0.316s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:17:29 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-08b2d269-33d6-47be-b006-77ea9ace33f5 tempest-VolumesSnapshotTestJSON-1364937772 None] Lock "cinder-quobyte-51353d5c-d4ac-4b47-9f5e-b372005c59fb" released by "_delete_snapshot" :: held 2.570s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:17:29 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-08b2d269-33d6-47be-b006-77ea9ace33f5 tempest-VolumesSnapshotTestJSON-1364937772 None] Lock "cinder-quobyte-7a9920a5-aeef-475d-a471-a4e48a5c7932" released by "delete_snapshot" :: held 2.624s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:17:29 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-08b2d269-33d6-47be-b006-77ea9ace33f5 tempest-VolumesSnapshotTestJSON-1364937772 None] Created reservations ['038f16f3-5b5b-4dcd-b15c-5aee08be505d', '4ccc4fd6-c680-45c8-85db-7f962ca00111', '2f32f04e-f441-409e-92a4-c22b2f81c553', '8ed7e81c-2ec7-4b91-8191-ba70d155c939'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:17:29 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-08b2d269-33d6-47be-b006-77ea9ace33f5 tempest-VolumesSnapshotTestJSON-1364937772 None] Delete snapshot completed successfully. Aug 05 06:17:29 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-08b2d269-33d6-47be-b006-77ea9ace33f5 tempest-VolumesSnapshotTestJSON-1364937772 None] Lock "cinder-51353d5c-d4ac-4b47-9f5e-b372005c59fb-delete_snapshot" released by "delete_snapshot" :: held 2.995s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:17:30 devstack cinder-volume[88695]: DEBUG cinder.volume.flows.manager.create_volume [None req-e26005c4-264a-40e0-bd35-9efc3246ff61 tempest-VolumesSnapshotTestJSON-1364937772 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88695) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 06:17:30 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-e26005c4-264a-40e0-bd35-9efc3246ff61 tempest-VolumesSnapshotTestJSON-1364937772 None] Flow 'volume_create_manager' (01d1e56c-f932-4813-8ff2-59dc6bcb5d20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:17:30 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-e26005c4-264a-40e0-bd35-9efc3246ff61 tempest-VolumesSnapshotTestJSON-1364937772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d563810b-4744-49dc-b88c-85646ba9efb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:17:30 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-e26005c4-264a-40e0-bd35-9efc3246ff61 tempest-VolumesSnapshotTestJSON-1364937772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d563810b-4744-49dc-b88c-85646ba9efb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:17:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-185395403',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=394dff4b-d03b-4200-8cd0-72eb763d45f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f87c02595984b10b4b2ed8e5d9cb883',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:17:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:17:30Z,use_quota=True,user_id='0566fcce709945bf9523b15b9d04dfc1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:17:30 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-e26005c4-264a-40e0-bd35-9efc3246ff61 tempest-VolumesSnapshotTestJSON-1364937772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c962e2ba-15fd-40d5-bd0f-073009753ffc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:17:30 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-e26005c4-264a-40e0-bd35-9efc3246ff61 tempest-VolumesSnapshotTestJSON-1364937772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c962e2ba-15fd-40d5-bd0f-073009753ffc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:17:30 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-e26005c4-264a-40e0-bd35-9efc3246ff61 tempest-VolumesSnapshotTestJSON-1364937772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61bd8b83-7c91-4d3b-a5be-fe72cb923cd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:17:30 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-e26005c4-264a-40e0-bd35-9efc3246ff61 tempest-VolumesSnapshotTestJSON-1364937772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61bd8b83-7c91-4d3b-a5be-fe72cb923cd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '394dff4b-d03b-4200-8cd0-72eb763d45f6', 'volume_name': 'volume-394dff4b-d03b-4200-8cd0-72eb763d45f6', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:17:30 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-e26005c4-264a-40e0-bd35-9efc3246ff61 tempest-VolumesSnapshotTestJSON-1364937772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cead315-14c6-4b91-89f4-74c767e32119) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:17:30 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-e26005c4-264a-40e0-bd35-9efc3246ff61 tempest-VolumesSnapshotTestJSON-1364937772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cead315-14c6-4b91-89f4-74c767e32119) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:17:30 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-e26005c4-264a-40e0-bd35-9efc3246ff61 tempest-VolumesSnapshotTestJSON-1364937772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60f543ab-9857-468c-9055-7ed0bb63f7c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:17:30 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-e26005c4-264a-40e0-bd35-9efc3246ff61 tempest-VolumesSnapshotTestJSON-1364937772 None] Volume 394dff4b-d03b-4200-8cd0-72eb763d45f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-394dff4b-d03b-4200-8cd0-72eb763d45f6', 'volume_size': 1} Aug 05 06:17:30 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-e26005c4-264a-40e0-bd35-9efc3246ff61 tempest-VolumesSnapshotTestJSON-1364937772 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:17:30 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-e26005c4-264a-40e0-bd35-9efc3246ff61 tempest-VolumesSnapshotTestJSON-1364937772 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:17:30 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-e26005c4-264a-40e0-bd35-9efc3246ff61 tempest-VolumesSnapshotTestJSON-1364937772 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:17:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-185395403',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=394dff4b-d03b-4200-8cd0-72eb763d45f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f87c02595984b10b4b2ed8e5d9cb883',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:17:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:17:30Z,use_quota=True,user_id='0566fcce709945bf9523b15b9d04dfc1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)}" {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 06:17:30 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-e26005c4-264a-40e0-bd35-9efc3246ff61 tempest-VolumesSnapshotTestJSON-1364937772 None] Creating volume 394dff4b-d03b-4200-8cd0-72eb763d45f6 {{(pid=88695) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 06:17:30 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-e26005c4-264a-40e0-bd35-9efc3246ff61 tempest-VolumesSnapshotTestJSON-1364937772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:17:30 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-e26005c4-264a-40e0-bd35-9efc3246ff61 tempest-VolumesSnapshotTestJSON-1364937772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:17:30 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-e26005c4-264a-40e0-bd35-9efc3246ff61 tempest-VolumesSnapshotTestJSON-1364937772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:17:30 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-e26005c4-264a-40e0-bd35-9efc3246ff61 tempest-VolumesSnapshotTestJSON-1364937772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:17:30 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-e26005c4-264a-40e0-bd35-9efc3246ff61 tempest-VolumesSnapshotTestJSON-1364937772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:17:30 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-e26005c4-264a-40e0-bd35-9efc3246ff61 tempest-VolumesSnapshotTestJSON-1364937772 None] Selected osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 as target Quobyte volume. {{(pid=88695) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 06:17:30 devstack cinder-volume[88695]: INFO cinder.volume.drivers.remotefs [None req-e26005c4-264a-40e0-bd35-9efc3246ff61 tempest-VolumesSnapshotTestJSON-1364937772 None] casted to osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 Aug 05 06:17:30 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-e26005c4-264a-40e0-bd35-9efc3246ff61 tempest-VolumesSnapshotTestJSON-1364937772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-394dff4b-d03b-4200-8cd0-72eb763d45f6 1073741824 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:17:30 devstack sudo[96101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-394dff4b-d03b-4200-8cd0-72eb763d45f6 1073741824 Aug 05 06:17:30 devstack sudo[96101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:17:31 devstack sudo[96101]: pam_unix(sudo:session): session closed for user root Aug 05 06:17:31 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-e26005c4-264a-40e0-bd35-9efc3246ff61 tempest-VolumesSnapshotTestJSON-1364937772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-394dff4b-d03b-4200-8cd0-72eb763d45f6 1073741824" returned: 0 in 0.509s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:17:31 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-e26005c4-264a-40e0-bd35-9efc3246ff61 tempest-VolumesSnapshotTestJSON-1364937772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-394dff4b-d03b-4200-8cd0-72eb763d45f6 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:17:31 devstack sudo[96118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-394dff4b-d03b-4200-8cd0-72eb763d45f6 Aug 05 06:17:31 devstack sudo[96118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:17:31 devstack sudo[96118]: pam_unix(sudo:session): session closed for user root Aug 05 06:17:31 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-0f8f130b-4b4d-43b8-8e41-b818cc279604 tempest-AttachVolumeShelveTestJSON-882480005 None] Acquiring lock "cinder-6587608b-4c8e-4ee2-a574-dc751b8eae3c-delete_volume" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:17:31 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-e26005c4-264a-40e0-bd35-9efc3246ff61 tempest-VolumesSnapshotTestJSON-1364937772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-394dff4b-d03b-4200-8cd0-72eb763d45f6" returned: 0 in 0.414s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:17:31 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-e26005c4-264a-40e0-bd35-9efc3246ff61 tempest-VolumesSnapshotTestJSON-1364937772 None] <== create_volume: return (1027ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'} {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 06:17:31 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-e26005c4-264a-40e0-bd35-9efc3246ff61 tempest-VolumesSnapshotTestJSON-1364937772 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.030s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:17:31 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-0f8f130b-4b4d-43b8-8e41-b818cc279604 tempest-AttachVolumeShelveTestJSON-882480005 None] Lock "cinder-6587608b-4c8e-4ee2-a574-dc751b8eae3c-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:17:31 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-e26005c4-264a-40e0-bd35-9efc3246ff61 tempest-VolumesSnapshotTestJSON-1364937772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60f543ab-9857-468c-9055-7ed0bb63f7c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-394dff4b-d03b-4200-8cd0-72eb763d45f6', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:17:31 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-e26005c4-264a-40e0-bd35-9efc3246ff61 tempest-VolumesSnapshotTestJSON-1364937772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a129e325-c850-4751-926e-4dfc58c49944) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:17:31 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-e26005c4-264a-40e0-bd35-9efc3246ff61 tempest-VolumesSnapshotTestJSON-1364937772 None] Volume volume-394dff4b-d03b-4200-8cd0-72eb763d45f6 (394dff4b-d03b-4200-8cd0-72eb763d45f6): created successfully Aug 05 06:17:31 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-e26005c4-264a-40e0-bd35-9efc3246ff61 tempest-VolumesSnapshotTestJSON-1364937772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a129e325-c850-4751-926e-4dfc58c49944) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:17:31 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-e26005c4-264a-40e0-bd35-9efc3246ff61 tempest-VolumesSnapshotTestJSON-1364937772 None] Flow 'volume_create_manager' (01d1e56c-f932-4813-8ff2-59dc6bcb5d20) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:17:31 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-0f8f130b-4b4d-43b8-8e41-b818cc279604 tempest-AttachVolumeShelveTestJSON-882480005 None] Acquiring lock "cinder-quobyte-6587608b-4c8e-4ee2-a574-dc751b8eae3c" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:17:31 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-e26005c4-264a-40e0-bd35-9efc3246ff61 tempest-VolumesSnapshotTestJSON-1364937772 None] Created volume successfully. Aug 05 06:17:31 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-0f8f130b-4b4d-43b8-8e41-b818cc279604 tempest-AttachVolumeShelveTestJSON-882480005 None] Lock "cinder-quobyte-6587608b-4c8e-4ee2-a574-dc751b8eae3c" acquired by "delete_volume" :: waited 0.024s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:17:31 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[11e19c3d-bbdf-4061-a56c-8ed4bfd66971]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:17:31 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-0f8f130b-4b4d-43b8-8e41-b818cc279604 tempest-AttachVolumeShelveTestJSON-882480005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-6587608b-4c8e-4ee2-a574-dc751b8eae3c {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:17:31 devstack sudo[96141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-6587608b-4c8e-4ee2-a574-dc751b8eae3c Aug 05 06:17:31 devstack sudo[96141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:17:32 devstack sudo[96141]: pam_unix(sudo:session): session closed for user root Aug 05 06:17:32 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-0f8f130b-4b4d-43b8-8e41-b818cc279604 tempest-AttachVolumeShelveTestJSON-882480005 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-6587608b-4c8e-4ee2-a574-dc751b8eae3c" returned: 0 in 0.437s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:17:32 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-0f8f130b-4b4d-43b8-8e41-b818cc279604 tempest-AttachVolumeShelveTestJSON-882480005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-6587608b-4c8e-4ee2-a574-dc751b8eae3c {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:17:32 devstack sudo[96147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-6587608b-4c8e-4ee2-a574-dc751b8eae3c Aug 05 06:17:32 devstack sudo[96147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:17:32 devstack sudo[96147]: pam_unix(sudo:session): session closed for user root Aug 05 06:17:32 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-0f8f130b-4b4d-43b8-8e41-b818cc279604 tempest-AttachVolumeShelveTestJSON-882480005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-6587608b-4c8e-4ee2-a574-dc751b8eae3c" returned: 0 in 0.420s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:17:32 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-0f8f130b-4b4d-43b8-8e41-b818cc279604 tempest-AttachVolumeShelveTestJSON-882480005 None] Lock "cinder-quobyte-6587608b-4c8e-4ee2-a574-dc751b8eae3c" released by "delete_volume" :: held 0.928s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:17:32 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-0f8f130b-4b4d-43b8-8e41-b818cc279604 tempest-AttachVolumeShelveTestJSON-882480005 None] Created reservations ['90241da0-3778-4980-b8fd-664b7e9cd00a', '40c07ff4-2956-4a9f-87e6-6063551faaf1', '3761a169-14ea-4ab2-a1a5-ecbbb9418dd2', '1eacdc89-d07b-4822-9a5a-53269bc8f6a8'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:17:32 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-0f8f130b-4b4d-43b8-8e41-b818cc279604 tempest-AttachVolumeShelveTestJSON-882480005 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:17:32 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-0f8f130b-4b4d-43b8-8e41-b818cc279604 tempest-AttachVolumeShelveTestJSON-882480005 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:17:32 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-0f8f130b-4b4d-43b8-8e41-b818cc279604 tempest-AttachVolumeShelveTestJSON-882480005 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:17:32 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-0f8f130b-4b4d-43b8-8e41-b818cc279604 tempest-AttachVolumeShelveTestJSON-882480005 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:17:32 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-0f8f130b-4b4d-43b8-8e41-b818cc279604 tempest-AttachVolumeShelveTestJSON-882480005 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:17:32 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-0f8f130b-4b4d-43b8-8e41-b818cc279604 tempest-AttachVolumeShelveTestJSON-882480005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:17:33 devstack sudo[96152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce Aug 05 06:17:33 devstack sudo[96152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:17:33 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-65f02e2b-eee4-4a65-b72c-61d68ff39779 tempest-VolumesSnapshotTestJSON-1364937772 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:17:33 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-65f02e2b-eee4-4a65-b72c-61d68ff39779 tempest-VolumesSnapshotTestJSON-1364937772 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:17:33 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-65f02e2b-eee4-4a65-b72c-61d68ff39779 tempest-VolumesSnapshotTestJSON-1364937772 None] Creating offline snapshot 910851aa-4508-4c15-a2b7-15d720a33041 of volume 394dff4b-d03b-4200-8cd0-72eb763d45f6 {{(pid=88695) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 06:17:33 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fe15b33-94b2-46a9-a8a6-dc679b46a810]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:17:33 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-65f02e2b-eee4-4a65-b72c-61d68ff39779 tempest-VolumesSnapshotTestJSON-1364937772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-394dff4b-d03b-4200-8cd0-72eb763d45f6 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:17:33 devstack sudo[96154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-394dff4b-d03b-4200-8cd0-72eb763d45f6 Aug 05 06:17:33 devstack sudo[96154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:17:33 devstack sudo[96152]: pam_unix(sudo:session): session closed for user root Aug 05 06:17:33 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-0f8f130b-4b4d-43b8-8e41-b818cc279604 tempest-AttachVolumeShelveTestJSON-882480005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce" returned: 0 in 0.453s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:17:33 devstack cinder-volume[88695]: DEBUG cinder.manager [None req-0f8f130b-4b4d-43b8-8e41-b818cc279604 tempest-AttachVolumeShelveTestJSON-882480005 None] Notifying Schedulers of capabilities ... {{(pid=88695) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 06:17:33 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-0f8f130b-4b4d-43b8-8e41-b818cc279604 tempest-AttachVolumeShelveTestJSON-882480005 None] Deleted volume successfully. Aug 05 06:17:33 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-0f8f130b-4b4d-43b8-8e41-b818cc279604 tempest-AttachVolumeShelveTestJSON-882480005 None] Lock "cinder-6587608b-4c8e-4ee2-a574-dc751b8eae3c-delete_volume" released by "delete_volume" :: held 1.872s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:17:33 devstack sudo[96154]: pam_unix(sudo:session): session closed for user root Aug 05 06:17:33 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-65f02e2b-eee4-4a65-b72c-61d68ff39779 tempest-VolumesSnapshotTestJSON-1364937772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-394dff4b-d03b-4200-8cd0-72eb763d45f6" returned: 0 in 0.540s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:17:33 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-65f02e2b-eee4-4a65-b72c-61d68ff39779 tempest-VolumesSnapshotTestJSON-1364937772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-394dff4b-d03b-4200-8cd0-72eb763d45f6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-394dff4b-d03b-4200-8cd0-72eb763d45f6.910851aa-4508-4c15-a2b7-15d720a33041 1G {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:17:33 devstack sudo[96194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-394dff4b-d03b-4200-8cd0-72eb763d45f6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-394dff4b-d03b-4200-8cd0-72eb763d45f6.910851aa-4508-4c15-a2b7-15d720a33041 1G Aug 05 06:17:33 devstack sudo[96194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:17:34 devstack sudo[96194]: pam_unix(sudo:session): session closed for user root Aug 05 06:17:34 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-65f02e2b-eee4-4a65-b72c-61d68ff39779 tempest-VolumesSnapshotTestJSON-1364937772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-394dff4b-d03b-4200-8cd0-72eb763d45f6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-394dff4b-d03b-4200-8cd0-72eb763d45f6.910851aa-4508-4c15-a2b7-15d720a33041 1G" returned: 0 in 0.833s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:17:34 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-65f02e2b-eee4-4a65-b72c-61d68ff39779 tempest-VolumesSnapshotTestJSON-1364937772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-394dff4b-d03b-4200-8cd0-72eb763d45f6 -F qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-394dff4b-d03b-4200-8cd0-72eb763d45f6.910851aa-4508-4c15-a2b7-15d720a33041 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:17:34 devstack sudo[96202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-394dff4b-d03b-4200-8cd0-72eb763d45f6 -F qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-394dff4b-d03b-4200-8cd0-72eb763d45f6.910851aa-4508-4c15-a2b7-15d720a33041 Aug 05 06:17:34 devstack sudo[96202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:17:34 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-30471fd8-5a2b-4208-9d8b-ba4ce0501dae tempest-ServerRescueNegativeTestJSON-553637740 None] Acquiring lock "cinder-a0ea3eaa-2de3-4338-a359-e71d3c4e5cc1-delete_volume" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:17:34 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-30471fd8-5a2b-4208-9d8b-ba4ce0501dae tempest-ServerRescueNegativeTestJSON-553637740 None] Lock "cinder-a0ea3eaa-2de3-4338-a359-e71d3c4e5cc1-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:17:34 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-30471fd8-5a2b-4208-9d8b-ba4ce0501dae tempest-ServerRescueNegativeTestJSON-553637740 None] Acquiring lock "cinder-quobyte-a0ea3eaa-2de3-4338-a359-e71d3c4e5cc1" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:17:34 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-30471fd8-5a2b-4208-9d8b-ba4ce0501dae tempest-ServerRescueNegativeTestJSON-553637740 None] Lock "cinder-quobyte-a0ea3eaa-2de3-4338-a359-e71d3c4e5cc1" acquired by "delete_volume" :: waited 0.026s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:17:34 devstack sudo[96202]: pam_unix(sudo:session): session closed for user root Aug 05 06:17:34 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-65f02e2b-eee4-4a65-b72c-61d68ff39779 tempest-VolumesSnapshotTestJSON-1364937772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-394dff4b-d03b-4200-8cd0-72eb763d45f6 -F qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-394dff4b-d03b-4200-8cd0-72eb763d45f6.910851aa-4508-4c15-a2b7-15d720a33041" returned: 0 in 0.523s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:17:34 devstack cinder-volume[88695]: WARNING cinder.volume.drivers.remotefs [None req-65f02e2b-eee4-4a65-b72c-61d68ff39779 tempest-VolumesSnapshotTestJSON-1364937772 None] /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-394dff4b-d03b-4200-8cd0-72eb763d45f6.910851aa-4508-4c15-a2b7-15d720a33041 is being set with open permissions: ugo+rw Aug 05 06:17:34 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-65f02e2b-eee4-4a65-b72c-61d68ff39779 tempest-VolumesSnapshotTestJSON-1364937772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-394dff4b-d03b-4200-8cd0-72eb763d45f6.910851aa-4508-4c15-a2b7-15d720a33041 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:17:35 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdd97d03-6777-423a-b327-ec13128f17f1]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:17:35 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-30471fd8-5a2b-4208-9d8b-ba4ce0501dae tempest-ServerRescueNegativeTestJSON-553637740 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a0ea3eaa-2de3-4338-a359-e71d3c4e5cc1 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:17:35 devstack sudo[96207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-394dff4b-d03b-4200-8cd0-72eb763d45f6.910851aa-4508-4c15-a2b7-15d720a33041 Aug 05 06:17:35 devstack sudo[96207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:17:35 devstack sudo[96208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a0ea3eaa-2de3-4338-a359-e71d3c4e5cc1 Aug 05 06:17:35 devstack sudo[96208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:17:35 devstack sudo[96207]: pam_unix(sudo:session): session closed for user root Aug 05 06:17:35 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-65f02e2b-eee4-4a65-b72c-61d68ff39779 tempest-VolumesSnapshotTestJSON-1364937772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-394dff4b-d03b-4200-8cd0-72eb763d45f6.910851aa-4508-4c15-a2b7-15d720a33041" returned: 0 in 0.357s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:17:35 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-65f02e2b-eee4-4a65-b72c-61d68ff39779 tempest-VolumesSnapshotTestJSON-1364937772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-394dff4b-d03b-4200-8cd0-72eb763d45f6.info {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:17:35 devstack sudo[96212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-394dff4b-d03b-4200-8cd0-72eb763d45f6.info Aug 05 06:17:35 devstack sudo[96212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:17:35 devstack sudo[96208]: pam_unix(sudo:session): session closed for user root Aug 05 06:17:35 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-30471fd8-5a2b-4208-9d8b-ba4ce0501dae tempest-ServerRescueNegativeTestJSON-553637740 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a0ea3eaa-2de3-4338-a359-e71d3c4e5cc1" returned: 0 in 0.652s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:17:35 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-30471fd8-5a2b-4208-9d8b-ba4ce0501dae tempest-ServerRescueNegativeTestJSON-553637740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a0ea3eaa-2de3-4338-a359-e71d3c4e5cc1 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:17:35 devstack sudo[96218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a0ea3eaa-2de3-4338-a359-e71d3c4e5cc1 Aug 05 06:17:35 devstack sudo[96218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:17:35 devstack sudo[96212]: pam_unix(sudo:session): session closed for user root Aug 05 06:17:35 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-65f02e2b-eee4-4a65-b72c-61d68ff39779 tempest-VolumesSnapshotTestJSON-1364937772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-394dff4b-d03b-4200-8cd0-72eb763d45f6.info" returned: 0 in 0.425s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:17:35 devstack cinder-volume[88695]: WARNING cinder.volume.drivers.remotefs [None req-65f02e2b-eee4-4a65-b72c-61d68ff39779 tempest-VolumesSnapshotTestJSON-1364937772 None] /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-394dff4b-d03b-4200-8cd0-72eb763d45f6.info is being set with open permissions: ugo+rw Aug 05 06:17:35 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-65f02e2b-eee4-4a65-b72c-61d68ff39779 tempest-VolumesSnapshotTestJSON-1364937772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-394dff4b-d03b-4200-8cd0-72eb763d45f6.info {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:17:35 devstack sudo[96221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-394dff4b-d03b-4200-8cd0-72eb763d45f6.info Aug 05 06:17:35 devstack sudo[96221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:17:36 devstack sudo[96218]: pam_unix(sudo:session): session closed for user root Aug 05 06:17:36 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-30471fd8-5a2b-4208-9d8b-ba4ce0501dae tempest-ServerRescueNegativeTestJSON-553637740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a0ea3eaa-2de3-4338-a359-e71d3c4e5cc1" returned: 0 in 0.428s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:17:36 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-30471fd8-5a2b-4208-9d8b-ba4ce0501dae tempest-ServerRescueNegativeTestJSON-553637740 None] Lock "cinder-quobyte-a0ea3eaa-2de3-4338-a359-e71d3c4e5cc1" released by "delete_volume" :: held 1.176s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:17:36 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-30471fd8-5a2b-4208-9d8b-ba4ce0501dae tempest-ServerRescueNegativeTestJSON-553637740 None] Created reservations ['0fadc0ef-3554-4aa8-ac29-54da6cdc00ac', 'c4210564-9afb-4707-bd90-356cc22616df', '8da87103-bae2-48a2-8a9e-29781ed15e0e', '20bec094-7294-461e-b089-811e6f054bb2'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:17:36 devstack sudo[96221]: pam_unix(sudo:session): session closed for user root Aug 05 06:17:36 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-65f02e2b-eee4-4a65-b72c-61d68ff39779 tempest-VolumesSnapshotTestJSON-1364937772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-394dff4b-d03b-4200-8cd0-72eb763d45f6.info" returned: 0 in 0.372s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:17:36 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-65f02e2b-eee4-4a65-b72c-61d68ff39779 tempest-VolumesSnapshotTestJSON-1364937772 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.199s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:17:36 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-65f02e2b-eee4-4a65-b72c-61d68ff39779 tempest-VolumesSnapshotTestJSON-1364937772 None] Create snapshot completed successfully Aug 05 06:17:36 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-30471fd8-5a2b-4208-9d8b-ba4ce0501dae tempest-ServerRescueNegativeTestJSON-553637740 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:17:36 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-30471fd8-5a2b-4208-9d8b-ba4ce0501dae tempest-ServerRescueNegativeTestJSON-553637740 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:17:36 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-30471fd8-5a2b-4208-9d8b-ba4ce0501dae tempest-ServerRescueNegativeTestJSON-553637740 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:17:36 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-30471fd8-5a2b-4208-9d8b-ba4ce0501dae tempest-ServerRescueNegativeTestJSON-553637740 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:17:36 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-30471fd8-5a2b-4208-9d8b-ba4ce0501dae tempest-ServerRescueNegativeTestJSON-553637740 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:17:36 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-30471fd8-5a2b-4208-9d8b-ba4ce0501dae tempest-ServerRescueNegativeTestJSON-553637740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:17:36 devstack sudo[96225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce Aug 05 06:17:36 devstack sudo[96225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:17:36 devstack sudo[96225]: pam_unix(sudo:session): session closed for user root Aug 05 06:17:36 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-30471fd8-5a2b-4208-9d8b-ba4ce0501dae tempest-ServerRescueNegativeTestJSON-553637740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce" returned: 0 in 0.286s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:17:36 devstack cinder-volume[88695]: DEBUG cinder.manager [None req-30471fd8-5a2b-4208-9d8b-ba4ce0501dae tempest-ServerRescueNegativeTestJSON-553637740 None] Notifying Schedulers of capabilities ... {{(pid=88695) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 06:17:36 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-30471fd8-5a2b-4208-9d8b-ba4ce0501dae tempest-ServerRescueNegativeTestJSON-553637740 None] Deleted volume successfully. Aug 05 06:17:36 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-30471fd8-5a2b-4208-9d8b-ba4ce0501dae tempest-ServerRescueNegativeTestJSON-553637740 None] Lock "cinder-a0ea3eaa-2de3-4338-a359-e71d3c4e5cc1-delete_volume" released by "delete_volume" :: held 1.797s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:17:38 devstack cinder-volume[88695]: DEBUG cinder.volume.flows.manager.create_volume [None req-53448f42-681b-43d3-afa3-9f4b8ec8c87a tempest-VolumesSnapshotTestJSON-1364937772 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88695) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 06:17:38 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-53448f42-681b-43d3-afa3-9f4b8ec8c87a tempest-VolumesSnapshotTestJSON-1364937772 None] Flow 'volume_create_manager' (665717ee-5c1c-4c9b-bf90-cf173ef1f925) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:17:38 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-53448f42-681b-43d3-afa3-9f4b8ec8c87a tempest-VolumesSnapshotTestJSON-1364937772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aeddc8ff-d251-4787-a387-38b26c6603cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:17:38 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-53448f42-681b-43d3-afa3-9f4b8ec8c87a tempest-VolumesSnapshotTestJSON-1364937772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aeddc8ff-d251-4787-a387-38b26c6603cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:17:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1064783644',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b46013b-eb5f-404f-a3af-b051a7e4d459,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f87c02595984b10b4b2ed8e5d9cb883',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:17:39Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=910851aa-4508-4c15-a2b7-15d720a33041,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:17:39Z,use_quota=True,user_id='0566fcce709945bf9523b15b9d04dfc1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:17:38 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-53448f42-681b-43d3-afa3-9f4b8ec8c87a tempest-VolumesSnapshotTestJSON-1364937772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b000788-e675-4ee0-99b9-d453b84fa688) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:17:38 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-53448f42-681b-43d3-afa3-9f4b8ec8c87a tempest-VolumesSnapshotTestJSON-1364937772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b000788-e675-4ee0-99b9-d453b84fa688) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:17:38 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-53448f42-681b-43d3-afa3-9f4b8ec8c87a tempest-VolumesSnapshotTestJSON-1364937772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23f1ac7c-92be-4953-8807-2d190660d706) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:17:38 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-53448f42-681b-43d3-afa3-9f4b8ec8c87a tempest-VolumesSnapshotTestJSON-1364937772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23f1ac7c-92be-4953-8807-2d190660d706) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '9b46013b-eb5f-404f-a3af-b051a7e4d459', 'volume_name': 'volume-9b46013b-eb5f-404f-a3af-b051a7e4d459', 'volume_size': 2, 'snapshot_id': '910851aa-4508-4c15-a2b7-15d720a33041'}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:17:38 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-53448f42-681b-43d3-afa3-9f4b8ec8c87a tempest-VolumesSnapshotTestJSON-1364937772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0cbf2ee1-4383-44fc-a1b1-411025e7ea06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:17:38 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-53448f42-681b-43d3-afa3-9f4b8ec8c87a tempest-VolumesSnapshotTestJSON-1364937772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0cbf2ee1-4383-44fc-a1b1-411025e7ea06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:17:38 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-53448f42-681b-43d3-afa3-9f4b8ec8c87a tempest-VolumesSnapshotTestJSON-1364937772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22b3a65e-76f9-44ce-bf3c-2afc3ffd4c4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:17:38 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-53448f42-681b-43d3-afa3-9f4b8ec8c87a tempest-VolumesSnapshotTestJSON-1364937772 None] Volume 9b46013b-eb5f-404f-a3af-b051a7e4d459: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-9b46013b-eb5f-404f-a3af-b051a7e4d459', 'volume_size': 2, 'snapshot_id': '910851aa-4508-4c15-a2b7-15d720a33041'} Aug 05 06:17:38 devstack cinder-volume[88695]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e7240a4-1e39-4963-a286-f2462dba4236 tempest-CreateVolumesFromSnapshotTest-6647266 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88695) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 06:17:38 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-2e7240a4-1e39-4963-a286-f2462dba4236 tempest-CreateVolumesFromSnapshotTest-6647266 None] Flow 'volume_create_manager' (dfbc5a1d-f9d2-406a-bfd1-9c6eaded9327) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:17:38 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-2e7240a4-1e39-4963-a286-f2462dba4236 tempest-CreateVolumesFromSnapshotTest-6647266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59dc3c51-1b5d-4459-84a7-7b1a547663cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:17:38 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-53448f42-681b-43d3-afa3-9f4b8ec8c87a tempest-VolumesSnapshotTestJSON-1364937772 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:17:38 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-53448f42-681b-43d3-afa3-9f4b8ec8c87a tempest-VolumesSnapshotTestJSON-1364937772 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:17:38 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-53448f42-681b-43d3-afa3-9f4b8ec8c87a tempest-VolumesSnapshotTestJSON-1364937772 None] Acquiring lock "cinder-quobyte-910851aa-4508-4c15-a2b7-15d720a33041-9b46013b-eb5f-404f-a3af-b051a7e4d459" by "_create_volume_from_snapshot" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:17:39 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-2e7240a4-1e39-4963-a286-f2462dba4236 tempest-CreateVolumesFromSnapshotTest-6647266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59dc3c51-1b5d-4459-84a7-7b1a547663cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:17:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-767844417',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5b77965-8f02-4906-8558-6748c2f65262,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec2e03d1e62242eda420b5693d1ec1eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:17:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:17:39Z,use_quota=True,user_id='25a8ed454666434f8bb14fa0e263507d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:17:39 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-2e7240a4-1e39-4963-a286-f2462dba4236 tempest-CreateVolumesFromSnapshotTest-6647266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34cd660a-28b5-41c5-aced-c417d5fdbff7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:17:39 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-2e7240a4-1e39-4963-a286-f2462dba4236 tempest-CreateVolumesFromSnapshotTest-6647266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34cd660a-28b5-41c5-aced-c417d5fdbff7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:17:39 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-2e7240a4-1e39-4963-a286-f2462dba4236 tempest-CreateVolumesFromSnapshotTest-6647266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f370db93-46c7-455c-8aa8-65164c560df9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:17:39 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-2e7240a4-1e39-4963-a286-f2462dba4236 tempest-CreateVolumesFromSnapshotTest-6647266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f370db93-46c7-455c-8aa8-65164c560df9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c5b77965-8f02-4906-8558-6748c2f65262', 'volume_name': 'volume-c5b77965-8f02-4906-8558-6748c2f65262', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:17:39 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-2e7240a4-1e39-4963-a286-f2462dba4236 tempest-CreateVolumesFromSnapshotTest-6647266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79665be5-e91e-4c7a-b153-9e386a187151) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:17:39 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-2e7240a4-1e39-4963-a286-f2462dba4236 tempest-CreateVolumesFromSnapshotTest-6647266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79665be5-e91e-4c7a-b153-9e386a187151) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:17:39 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-2e7240a4-1e39-4963-a286-f2462dba4236 tempest-CreateVolumesFromSnapshotTest-6647266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d58b36fe-a016-4fd7-bc37-bb50c4c4f63e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:17:39 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-2e7240a4-1e39-4963-a286-f2462dba4236 tempest-CreateVolumesFromSnapshotTest-6647266 None] Volume c5b77965-8f02-4906-8558-6748c2f65262: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c5b77965-8f02-4906-8558-6748c2f65262', 'volume_size': 1} Aug 05 06:17:39 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-2e7240a4-1e39-4963-a286-f2462dba4236 tempest-CreateVolumesFromSnapshotTest-6647266 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:17:39 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-53448f42-681b-43d3-afa3-9f4b8ec8c87a tempest-VolumesSnapshotTestJSON-1364937772 None] Lock "cinder-quobyte-910851aa-4508-4c15-a2b7-15d720a33041-9b46013b-eb5f-404f-a3af-b051a7e4d459" acquired by "_create_volume_from_snapshot" :: waited 0.066s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:17:39 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-53448f42-681b-43d3-afa3-9f4b8ec8c87a tempest-VolumesSnapshotTestJSON-1364937772 None] Creating volume 9b46013b-eb5f-404f-a3af-b051a7e4d459 from snapshot 910851aa-4508-4c15-a2b7-15d720a33041 {{(pid=88695) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 05 06:17:39 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-53448f42-681b-43d3-afa3-9f4b8ec8c87a tempest-VolumesSnapshotTestJSON-1364937772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:17:39 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-53448f42-681b-43d3-afa3-9f4b8ec8c87a tempest-VolumesSnapshotTestJSON-1364937772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:17:39 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-53448f42-681b-43d3-afa3-9f4b8ec8c87a tempest-VolumesSnapshotTestJSON-1364937772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:17:39 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-53448f42-681b-43d3-afa3-9f4b8ec8c87a tempest-VolumesSnapshotTestJSON-1364937772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:17:39 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-53448f42-681b-43d3-afa3-9f4b8ec8c87a tempest-VolumesSnapshotTestJSON-1364937772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:17:39 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-53448f42-681b-43d3-afa3-9f4b8ec8c87a tempest-VolumesSnapshotTestJSON-1364937772 None] Selected osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 as target Quobyte volume. {{(pid=88695) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 06:17:39 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-53448f42-681b-43d3-afa3-9f4b8ec8c87a tempest-VolumesSnapshotTestJSON-1364937772 None] Acquiring lock "cinder-quobyte-9b46013b-eb5f-404f-a3af-b051a7e4d459" by "_copy_volume_from_snapshot" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:17:39 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-53448f42-681b-43d3-afa3-9f4b8ec8c87a tempest-VolumesSnapshotTestJSON-1364937772 None] Lock "cinder-quobyte-9b46013b-eb5f-404f-a3af-b051a7e4d459" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:17:39 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-53448f42-681b-43d3-afa3-9f4b8ec8c87a tempest-VolumesSnapshotTestJSON-1364937772 None] snapshot: 910851aa-4508-4c15-a2b7-15d720a33041, volume: 9b46013b-eb5f-404f-a3af-b051a7e4d459, {{(pid=88695) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 05 06:17:39 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-53448f42-681b-43d3-afa3-9f4b8ec8c87a tempest-VolumesSnapshotTestJSON-1364937772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:17:39 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-53448f42-681b-43d3-afa3-9f4b8ec8c87a tempest-VolumesSnapshotTestJSON-1364937772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:17:39 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-53448f42-681b-43d3-afa3-9f4b8ec8c87a tempest-VolumesSnapshotTestJSON-1364937772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:17:39 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-53448f42-681b-43d3-afa3-9f4b8ec8c87a tempest-VolumesSnapshotTestJSON-1364937772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:17:39 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-53448f42-681b-43d3-afa3-9f4b8ec8c87a tempest-VolumesSnapshotTestJSON-1364937772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:17:39 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[24a3644f-8f49-4928-9446-ecfae7fd67bf]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:17:39 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-53448f42-681b-43d3-afa3-9f4b8ec8c87a tempest-VolumesSnapshotTestJSON-1364937772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-394dff4b-d03b-4200-8cd0-72eb763d45f6.910851aa-4508-4c15-a2b7-15d720a33041 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:17:39 devstack sudo[96261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-394dff4b-d03b-4200-8cd0-72eb763d45f6.910851aa-4508-4c15-a2b7-15d720a33041 Aug 05 06:17:39 devstack sudo[96261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:17:39 devstack sudo[96261]: pam_unix(sudo:session): session closed for user root Aug 05 06:17:39 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-53448f42-681b-43d3-afa3-9f4b8ec8c87a tempest-VolumesSnapshotTestJSON-1364937772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-394dff4b-d03b-4200-8cd0-72eb763d45f6.910851aa-4508-4c15-a2b7-15d720a33041" returned: 0 in 0.783s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:17:39 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-53448f42-681b-43d3-afa3-9f4b8ec8c87a tempest-VolumesSnapshotTestJSON-1364937772 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-394dff4b-d03b-4200-8cd0-72eb763d45f6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88695) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 06:17:39 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[67e1c873-c817-4634-a245-5abcbd1edbde]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:17:39 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-53448f42-681b-43d3-afa3-9f4b8ec8c87a tempest-VolumesSnapshotTestJSON-1364937772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-394dff4b-d03b-4200-8cd0-72eb763d45f6 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:17:40 devstack sudo[96268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-394dff4b-d03b-4200-8cd0-72eb763d45f6 Aug 05 06:17:40 devstack sudo[96268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:17:40 devstack sudo[96268]: pam_unix(sudo:session): session closed for user root Aug 05 06:17:40 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-53448f42-681b-43d3-afa3-9f4b8ec8c87a tempest-VolumesSnapshotTestJSON-1364937772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-394dff4b-d03b-4200-8cd0-72eb763d45f6" returned: 0 in 0.663s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:17:40 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-53448f42-681b-43d3-afa3-9f4b8ec8c87a tempest-VolumesSnapshotTestJSON-1364937772 None] will copy from snapshot at /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-394dff4b-d03b-4200-8cd0-72eb763d45f6 {{(pid=88695) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 05 06:17:40 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-53448f42-681b-43d3-afa3-9f4b8ec8c87a tempest-VolumesSnapshotTestJSON-1364937772 None] Creating direct copy from snapshot {{(pid=88695) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 05 06:17:40 devstack cinder-volume[88695]: DEBUG cinder.utils [None req-53448f42-681b-43d3-afa3-9f4b8ec8c87a tempest-VolumesSnapshotTestJSON-1364937772 None] Path /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9b46013b-eb5f-404f-a3af-b051a7e4d459 not found in is_blk_device check {{(pid=88695) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 05 06:17:40 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-53448f42-681b-43d3-afa3-9f4b8ec8c87a tempest-VolumesSnapshotTestJSON-1364937772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-394dff4b-d03b-4200-8cd0-72eb763d45f6 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9b46013b-eb5f-404f-a3af-b051a7e4d459 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:17:40 devstack sudo[96275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-394dff4b-d03b-4200-8cd0-72eb763d45f6 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9b46013b-eb5f-404f-a3af-b051a7e4d459 Aug 05 06:17:40 devstack sudo[96275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:17:46 devstack sudo[96275]: pam_unix(sudo:session): session closed for user root Aug 05 06:17:46 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-53448f42-681b-43d3-afa3-9f4b8ec8c87a tempest-VolumesSnapshotTestJSON-1364937772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-394dff4b-d03b-4200-8cd0-72eb763d45f6 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9b46013b-eb5f-404f-a3af-b051a7e4d459" returned: 0 in 6.025s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:17:46 devstack cinder-volume[88695]: DEBUG cinder.image.image_utils [None req-53448f42-681b-43d3-afa3-9f4b8ec8c87a tempest-VolumesSnapshotTestJSON-1364937772 None] Image conversion details: src /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-394dff4b-d03b-4200-8cd0-72eb763d45f6, size 1024.00 MB, duration 6.03 sec, destination /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9b46013b-eb5f-404f-a3af-b051a7e4d459 {{(pid=88695) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 05 06:17:46 devstack cinder-volume[88695]: INFO cinder.image.image_utils [None req-53448f42-681b-43d3-afa3-9f4b8ec8c87a tempest-VolumesSnapshotTestJSON-1364937772 None] Converted 1024.00 MB image at 169.91 MB/s Aug 05 06:17:46 devstack cinder-volume[88695]: WARNING cinder.volume.drivers.remotefs [None req-53448f42-681b-43d3-afa3-9f4b8ec8c87a tempest-VolumesSnapshotTestJSON-1364937772 None] /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9b46013b-eb5f-404f-a3af-b051a7e4d459 is being set with open permissions: ugo+rw Aug 05 06:17:46 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-53448f42-681b-43d3-afa3-9f4b8ec8c87a tempest-VolumesSnapshotTestJSON-1364937772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9b46013b-eb5f-404f-a3af-b051a7e4d459 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:17:46 devstack sudo[96316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9b46013b-eb5f-404f-a3af-b051a7e4d459 Aug 05 06:17:46 devstack sudo[96316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:17:46 devstack sudo[96316]: pam_unix(sudo:session): session closed for user root Aug 05 06:17:46 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-53448f42-681b-43d3-afa3-9f4b8ec8c87a tempest-VolumesSnapshotTestJSON-1364937772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9b46013b-eb5f-404f-a3af-b051a7e4d459" returned: 0 in 0.269s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:17:46 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-53448f42-681b-43d3-afa3-9f4b8ec8c87a tempest-VolumesSnapshotTestJSON-1364937772 None] Lock "cinder-quobyte-9b46013b-eb5f-404f-a3af-b051a7e4d459" released by "_copy_volume_from_snapshot" :: held 7.897s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:17:47 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-53448f42-681b-43d3-afa3-9f4b8ec8c87a tempest-VolumesSnapshotTestJSON-1364937772 None] Lock "cinder-quobyte-910851aa-4508-4c15-a2b7-15d720a33041-9b46013b-eb5f-404f-a3af-b051a7e4d459" released by "_create_volume_from_snapshot" :: held 7.999s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:17:47 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-53448f42-681b-43d3-afa3-9f4b8ec8c87a tempest-VolumesSnapshotTestJSON-1364937772 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.066s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:17:47 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-2e7240a4-1e39-4963-a286-f2462dba4236 tempest-CreateVolumesFromSnapshotTest-6647266 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.008s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:17:47 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-2e7240a4-1e39-4963-a286-f2462dba4236 tempest-CreateVolumesFromSnapshotTest-6647266 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:17:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-767844417',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5b77965-8f02-4906-8558-6748c2f65262,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec2e03d1e62242eda420b5693d1ec1eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:17:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:17:39Z,use_quota=True,user_id='25a8ed454666434f8bb14fa0e263507d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)}" {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 06:17:47 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-2e7240a4-1e39-4963-a286-f2462dba4236 tempest-CreateVolumesFromSnapshotTest-6647266 None] Creating volume c5b77965-8f02-4906-8558-6748c2f65262 {{(pid=88695) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 06:17:47 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-2e7240a4-1e39-4963-a286-f2462dba4236 tempest-CreateVolumesFromSnapshotTest-6647266 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:17:47 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-2e7240a4-1e39-4963-a286-f2462dba4236 tempest-CreateVolumesFromSnapshotTest-6647266 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:17:47 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-2e7240a4-1e39-4963-a286-f2462dba4236 tempest-CreateVolumesFromSnapshotTest-6647266 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:17:47 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-2e7240a4-1e39-4963-a286-f2462dba4236 tempest-CreateVolumesFromSnapshotTest-6647266 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:17:47 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-2e7240a4-1e39-4963-a286-f2462dba4236 tempest-CreateVolumesFromSnapshotTest-6647266 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:17:47 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-2e7240a4-1e39-4963-a286-f2462dba4236 tempest-CreateVolumesFromSnapshotTest-6647266 None] Selected osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 as target Quobyte volume. {{(pid=88695) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 06:17:47 devstack cinder-volume[88695]: INFO cinder.volume.drivers.remotefs [None req-2e7240a4-1e39-4963-a286-f2462dba4236 tempest-CreateVolumesFromSnapshotTest-6647266 None] casted to osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 Aug 05 06:17:47 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-2e7240a4-1e39-4963-a286-f2462dba4236 tempest-CreateVolumesFromSnapshotTest-6647266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-c5b77965-8f02-4906-8558-6748c2f65262 1073741824 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:17:47 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-53448f42-681b-43d3-afa3-9f4b8ec8c87a tempest-VolumesSnapshotTestJSON-1364937772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22b3a65e-76f9-44ce-bf3c-2afc3ffd4c4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b46013b-eb5f-404f-a3af-b051a7e4d459', 'volume_size': 2, 'snapshot_id': '910851aa-4508-4c15-a2b7-15d720a33041'}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:17:47 devstack sudo[96319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-c5b77965-8f02-4906-8558-6748c2f65262 1073741824 Aug 05 06:17:47 devstack sudo[96319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:17:47 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-53448f42-681b-43d3-afa3-9f4b8ec8c87a tempest-VolumesSnapshotTestJSON-1364937772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d6042ea-05c7-4bef-a2c9-ed6d9e944c65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:17:47 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-53448f42-681b-43d3-afa3-9f4b8ec8c87a tempest-VolumesSnapshotTestJSON-1364937772 None] Volume volume-9b46013b-eb5f-404f-a3af-b051a7e4d459 (9b46013b-eb5f-404f-a3af-b051a7e4d459): created successfully Aug 05 06:17:47 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-53448f42-681b-43d3-afa3-9f4b8ec8c87a tempest-VolumesSnapshotTestJSON-1364937772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d6042ea-05c7-4bef-a2c9-ed6d9e944c65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:17:47 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-53448f42-681b-43d3-afa3-9f4b8ec8c87a tempest-VolumesSnapshotTestJSON-1364937772 None] Flow 'volume_create_manager' (665717ee-5c1c-4c9b-bf90-cf173ef1f925) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:17:47 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-53448f42-681b-43d3-afa3-9f4b8ec8c87a tempest-VolumesSnapshotTestJSON-1364937772 None] Created volume successfully. Aug 05 06:17:47 devstack sudo[96319]: pam_unix(sudo:session): session closed for user root Aug 05 06:17:47 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-2e7240a4-1e39-4963-a286-f2462dba4236 tempest-CreateVolumesFromSnapshotTest-6647266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-c5b77965-8f02-4906-8558-6748c2f65262 1073741824" returned: 0 in 0.573s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:17:47 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-2e7240a4-1e39-4963-a286-f2462dba4236 tempest-CreateVolumesFromSnapshotTest-6647266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-c5b77965-8f02-4906-8558-6748c2f65262 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:17:47 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-fe93c903-2efe-4056-a988-b9fd9d0bfc62 tempest-VolumesSnapshotTestJSON-1364937772 None] Acquiring lock "cinder-9b46013b-eb5f-404f-a3af-b051a7e4d459-delete_volume" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:17:47 devstack sudo[96326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-c5b77965-8f02-4906-8558-6748c2f65262 Aug 05 06:17:47 devstack sudo[96326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:17:47 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-fe93c903-2efe-4056-a988-b9fd9d0bfc62 tempest-VolumesSnapshotTestJSON-1364937772 None] Lock "cinder-9b46013b-eb5f-404f-a3af-b051a7e4d459-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:17:47 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-fe93c903-2efe-4056-a988-b9fd9d0bfc62 tempest-VolumesSnapshotTestJSON-1364937772 None] Acquiring lock "cinder-quobyte-9b46013b-eb5f-404f-a3af-b051a7e4d459" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:17:47 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-fe93c903-2efe-4056-a988-b9fd9d0bfc62 tempest-VolumesSnapshotTestJSON-1364937772 None] Lock "cinder-quobyte-9b46013b-eb5f-404f-a3af-b051a7e4d459" acquired by "delete_volume" :: waited 0.045s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:17:47 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[3321e890-c8ed-4d6b-aac7-93137ed7af3b]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:17:47 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-fe93c903-2efe-4056-a988-b9fd9d0bfc62 tempest-VolumesSnapshotTestJSON-1364937772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9b46013b-eb5f-404f-a3af-b051a7e4d459 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:17:48 devstack sudo[96329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9b46013b-eb5f-404f-a3af-b051a7e4d459 Aug 05 06:17:48 devstack sudo[96329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:17:48 devstack sudo[96326]: pam_unix(sudo:session): session closed for user root Aug 05 06:17:48 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-2e7240a4-1e39-4963-a286-f2462dba4236 tempest-CreateVolumesFromSnapshotTest-6647266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-c5b77965-8f02-4906-8558-6748c2f65262" returned: 0 in 0.435s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:17:48 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-2e7240a4-1e39-4963-a286-f2462dba4236 tempest-CreateVolumesFromSnapshotTest-6647266 None] <== create_volume: return (1065ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'} {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 06:17:48 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-2e7240a4-1e39-4963-a286-f2462dba4236 tempest-CreateVolumesFromSnapshotTest-6647266 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.067s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:17:48 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-2e7240a4-1e39-4963-a286-f2462dba4236 tempest-CreateVolumesFromSnapshotTest-6647266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d58b36fe-a016-4fd7-bc37-bb50c4c4f63e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5b77965-8f02-4906-8558-6748c2f65262', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:17:48 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-2e7240a4-1e39-4963-a286-f2462dba4236 tempest-CreateVolumesFromSnapshotTest-6647266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83f4d08c-d349-465d-a1cb-0eeb2fb0f8b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:17:48 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-2e7240a4-1e39-4963-a286-f2462dba4236 tempest-CreateVolumesFromSnapshotTest-6647266 None] Volume volume-c5b77965-8f02-4906-8558-6748c2f65262 (c5b77965-8f02-4906-8558-6748c2f65262): created successfully Aug 05 06:17:48 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-2e7240a4-1e39-4963-a286-f2462dba4236 tempest-CreateVolumesFromSnapshotTest-6647266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83f4d08c-d349-465d-a1cb-0eeb2fb0f8b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:17:48 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-2e7240a4-1e39-4963-a286-f2462dba4236 tempest-CreateVolumesFromSnapshotTest-6647266 None] Flow 'volume_create_manager' (dfbc5a1d-f9d2-406a-bfd1-9c6eaded9327) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:17:48 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-2e7240a4-1e39-4963-a286-f2462dba4236 tempest-CreateVolumesFromSnapshotTest-6647266 None] Created volume successfully. Aug 05 06:17:48 devstack sudo[96329]: pam_unix(sudo:session): session closed for user root Aug 05 06:17:48 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-fe93c903-2efe-4056-a988-b9fd9d0bfc62 tempest-VolumesSnapshotTestJSON-1364937772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9b46013b-eb5f-404f-a3af-b051a7e4d459" returned: 0 in 0.420s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:17:48 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-fe93c903-2efe-4056-a988-b9fd9d0bfc62 tempest-VolumesSnapshotTestJSON-1364937772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9b46013b-eb5f-404f-a3af-b051a7e4d459 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:17:48 devstack sudo[96335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9b46013b-eb5f-404f-a3af-b051a7e4d459 Aug 05 06:17:48 devstack sudo[96335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:17:48 devstack sudo[96335]: pam_unix(sudo:session): session closed for user root Aug 05 06:17:48 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-fe93c903-2efe-4056-a988-b9fd9d0bfc62 tempest-VolumesSnapshotTestJSON-1364937772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9b46013b-eb5f-404f-a3af-b051a7e4d459" returned: 0 in 0.283s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:17:48 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-fe93c903-2efe-4056-a988-b9fd9d0bfc62 tempest-VolumesSnapshotTestJSON-1364937772 None] Lock "cinder-quobyte-9b46013b-eb5f-404f-a3af-b051a7e4d459" released by "delete_volume" :: held 0.774s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:17:48 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-fe93c903-2efe-4056-a988-b9fd9d0bfc62 tempest-VolumesSnapshotTestJSON-1364937772 None] Created reservations ['3a2c6804-6209-47f9-9d48-fb00aa4689e7', '350f9ff7-b909-4757-b508-7648249ea8fc', '23ab2863-a74f-467d-a220-96f5274af65e', '4b06ef3c-c95f-4051-9c1a-7c7eade6eb47'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:17:48 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-fe93c903-2efe-4056-a988-b9fd9d0bfc62 tempest-VolumesSnapshotTestJSON-1364937772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:17:48 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-fe93c903-2efe-4056-a988-b9fd9d0bfc62 tempest-VolumesSnapshotTestJSON-1364937772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:17:48 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-fe93c903-2efe-4056-a988-b9fd9d0bfc62 tempest-VolumesSnapshotTestJSON-1364937772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:17:48 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-fe93c903-2efe-4056-a988-b9fd9d0bfc62 tempest-VolumesSnapshotTestJSON-1364937772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:17:48 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-fe93c903-2efe-4056-a988-b9fd9d0bfc62 tempest-VolumesSnapshotTestJSON-1364937772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:17:48 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-fe93c903-2efe-4056-a988-b9fd9d0bfc62 tempest-VolumesSnapshotTestJSON-1364937772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:17:48 devstack sudo[96338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce Aug 05 06:17:48 devstack sudo[96338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:17:49 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-1169c329-f91d-4f77-95f4-9cdd95b0777b tempest-CreateVolumesFromSnapshotTest-6647266 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:17:49 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-1169c329-f91d-4f77-95f4-9cdd95b0777b tempest-CreateVolumesFromSnapshotTest-6647266 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:17:49 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-1169c329-f91d-4f77-95f4-9cdd95b0777b tempest-CreateVolumesFromSnapshotTest-6647266 None] Creating offline snapshot 33ab530e-8bf9-4f14-83f2-4a93863a479d of volume c5b77965-8f02-4906-8558-6748c2f65262 {{(pid=88695) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 06:17:49 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-4ecb4213-7609-4e4e-96f1-cb71b2c112a5 tempest-GroupSnapshotsTest-1900443889 None] Group tempest-GroupSnapshotsTest-Group-1921340416: creating Aug 05 06:17:49 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-1cbee25e-956f-498d-bc57-e8999d8c14d7 tempest-VolumesSnapshotTestJSON-1364937772 None] Acquiring lock "cinder-910851aa-4508-4c15-a2b7-15d720a33041-delete_snapshot" by "delete_snapshot" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:17:49 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a7100a4-6cf7-4acd-a5a5-c8adaa578467]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:17:49 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-1169c329-f91d-4f77-95f4-9cdd95b0777b tempest-CreateVolumesFromSnapshotTest-6647266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-c5b77965-8f02-4906-8558-6748c2f65262 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:17:49 devstack sudo[96338]: pam_unix(sudo:session): session closed for user root Aug 05 06:17:49 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-fe93c903-2efe-4056-a988-b9fd9d0bfc62 tempest-VolumesSnapshotTestJSON-1364937772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce" returned: 0 in 0.358s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:17:49 devstack cinder-volume[88695]: DEBUG cinder.manager [None req-fe93c903-2efe-4056-a988-b9fd9d0bfc62 tempest-VolumesSnapshotTestJSON-1364937772 None] Notifying Schedulers of capabilities ... {{(pid=88695) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 06:17:49 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-1cbee25e-956f-498d-bc57-e8999d8c14d7 tempest-VolumesSnapshotTestJSON-1364937772 None] Lock "cinder-910851aa-4508-4c15-a2b7-15d720a33041-delete_snapshot" acquired by "delete_snapshot" :: waited 0.083s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:17:49 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-1cbee25e-956f-498d-bc57-e8999d8c14d7 tempest-VolumesSnapshotTestJSON-1364937772 None] Acquiring lock "cinder-quobyte-394dff4b-d03b-4200-8cd0-72eb763d45f6" by "delete_snapshot" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:17:49 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-fe93c903-2efe-4056-a988-b9fd9d0bfc62 tempest-VolumesSnapshotTestJSON-1364937772 None] Deleted volume successfully. Aug 05 06:17:49 devstack sudo[96341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-c5b77965-8f02-4906-8558-6748c2f65262 Aug 05 06:17:49 devstack sudo[96341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:17:49 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-4ecb4213-7609-4e4e-96f1-cb71b2c112a5 tempest-GroupSnapshotsTest-1900443889 None] Group tempest-GroupSnapshotsTest-Group-1921340416: created successfully Aug 05 06:17:49 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-1cbee25e-956f-498d-bc57-e8999d8c14d7 tempest-VolumesSnapshotTestJSON-1364937772 None] Lock "cinder-quobyte-394dff4b-d03b-4200-8cd0-72eb763d45f6" acquired by "delete_snapshot" :: waited 0.234s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:17:49 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-1cbee25e-956f-498d-bc57-e8999d8c14d7 tempest-VolumesSnapshotTestJSON-1364937772 None] Acquiring lock "cinder-quobyte-910851aa-4508-4c15-a2b7-15d720a33041" by "_delete_snapshot" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:17:49 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-4ecb4213-7609-4e4e-96f1-cb71b2c112a5 tempest-GroupSnapshotsTest-1900443889 None] Create group completed successfully. Aug 05 06:17:49 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-fe93c903-2efe-4056-a988-b9fd9d0bfc62 tempest-VolumesSnapshotTestJSON-1364937772 None] Lock "cinder-9b46013b-eb5f-404f-a3af-b051a7e4d459-delete_volume" released by "delete_volume" :: held 1.717s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:17:49 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-1cbee25e-956f-498d-bc57-e8999d8c14d7 tempest-VolumesSnapshotTestJSON-1364937772 None] Lock "cinder-quobyte-910851aa-4508-4c15-a2b7-15d720a33041" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:17:49 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-1cbee25e-956f-498d-bc57-e8999d8c14d7 tempest-VolumesSnapshotTestJSON-1364937772 None] Deleting offline snapshot 910851aa-4508-4c15-a2b7-15d720a33041 of volume 394dff4b-d03b-4200-8cd0-72eb763d45f6 {{(pid=88695) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 06:17:49 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-1cbee25e-956f-498d-bc57-e8999d8c14d7 tempest-VolumesSnapshotTestJSON-1364937772 None] snapshot_file for this snap is: volume-394dff4b-d03b-4200-8cd0-72eb763d45f6.910851aa-4508-4c15-a2b7-15d720a33041 {{(pid=88695) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 06:17:49 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[e175a2b4-4a63-4725-b2ce-d2843e7f84b6]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:17:49 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-1cbee25e-956f-498d-bc57-e8999d8c14d7 tempest-VolumesSnapshotTestJSON-1364937772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-394dff4b-d03b-4200-8cd0-72eb763d45f6.910851aa-4508-4c15-a2b7-15d720a33041 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:17:49 devstack sudo[96344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-394dff4b-d03b-4200-8cd0-72eb763d45f6.910851aa-4508-4c15-a2b7-15d720a33041 Aug 05 06:17:49 devstack sudo[96344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:17:49 devstack sudo[96341]: pam_unix(sudo:session): session closed for user root Aug 05 06:17:49 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-1169c329-f91d-4f77-95f4-9cdd95b0777b tempest-CreateVolumesFromSnapshotTest-6647266 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-c5b77965-8f02-4906-8558-6748c2f65262" returned: 0 in 0.524s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:17:49 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-1169c329-f91d-4f77-95f4-9cdd95b0777b tempest-CreateVolumesFromSnapshotTest-6647266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-c5b77965-8f02-4906-8558-6748c2f65262,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-c5b77965-8f02-4906-8558-6748c2f65262.33ab530e-8bf9-4f14-83f2-4a93863a479d 1G {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:17:49 devstack sudo[96349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-c5b77965-8f02-4906-8558-6748c2f65262,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-c5b77965-8f02-4906-8558-6748c2f65262.33ab530e-8bf9-4f14-83f2-4a93863a479d 1G Aug 05 06:17:49 devstack sudo[96349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:17:49 devstack sudo[96344]: pam_unix(sudo:session): session closed for user root Aug 05 06:17:49 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-1cbee25e-956f-498d-bc57-e8999d8c14d7 tempest-VolumesSnapshotTestJSON-1364937772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-394dff4b-d03b-4200-8cd0-72eb763d45f6.910851aa-4508-4c15-a2b7-15d720a33041" returned: 0 in 0.394s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:17:49 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-1cbee25e-956f-498d-bc57-e8999d8c14d7 tempest-VolumesSnapshotTestJSON-1364937772 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-394dff4b-d03b-4200-8cd0-72eb763d45f6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88695) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 06:17:49 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ec7c0f6-a13d-465d-9d9e-880f0e98e794]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:17:49 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-1cbee25e-956f-498d-bc57-e8999d8c14d7 tempest-VolumesSnapshotTestJSON-1364937772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-394dff4b-d03b-4200-8cd0-72eb763d45f6 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:17:50 devstack sudo[96358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-394dff4b-d03b-4200-8cd0-72eb763d45f6 Aug 05 06:17:50 devstack sudo[96358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:17:50 devstack sudo[96349]: pam_unix(sudo:session): session closed for user root Aug 05 06:17:50 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-1169c329-f91d-4f77-95f4-9cdd95b0777b tempest-CreateVolumesFromSnapshotTest-6647266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-c5b77965-8f02-4906-8558-6748c2f65262,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-c5b77965-8f02-4906-8558-6748c2f65262.33ab530e-8bf9-4f14-83f2-4a93863a479d 1G" returned: 0 in 0.526s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:17:50 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-1169c329-f91d-4f77-95f4-9cdd95b0777b tempest-CreateVolumesFromSnapshotTest-6647266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c5b77965-8f02-4906-8558-6748c2f65262 -F qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-c5b77965-8f02-4906-8558-6748c2f65262.33ab530e-8bf9-4f14-83f2-4a93863a479d {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:17:50 devstack sudo[96367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c5b77965-8f02-4906-8558-6748c2f65262 -F qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-c5b77965-8f02-4906-8558-6748c2f65262.33ab530e-8bf9-4f14-83f2-4a93863a479d Aug 05 06:17:50 devstack sudo[96367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:17:50 devstack sudo[96367]: pam_unix(sudo:session): session closed for user root Aug 05 06:17:50 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-1169c329-f91d-4f77-95f4-9cdd95b0777b tempest-CreateVolumesFromSnapshotTest-6647266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c5b77965-8f02-4906-8558-6748c2f65262 -F qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-c5b77965-8f02-4906-8558-6748c2f65262.33ab530e-8bf9-4f14-83f2-4a93863a479d" returned: 0 in 0.406s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:17:50 devstack cinder-volume[88695]: WARNING cinder.volume.drivers.remotefs [None req-1169c329-f91d-4f77-95f4-9cdd95b0777b tempest-CreateVolumesFromSnapshotTest-6647266 None] /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-c5b77965-8f02-4906-8558-6748c2f65262.33ab530e-8bf9-4f14-83f2-4a93863a479d is being set with open permissions: ugo+rw Aug 05 06:17:50 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-1169c329-f91d-4f77-95f4-9cdd95b0777b tempest-CreateVolumesFromSnapshotTest-6647266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-c5b77965-8f02-4906-8558-6748c2f65262.33ab530e-8bf9-4f14-83f2-4a93863a479d {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:17:50 devstack sudo[96375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-c5b77965-8f02-4906-8558-6748c2f65262.33ab530e-8bf9-4f14-83f2-4a93863a479d Aug 05 06:17:50 devstack sudo[96375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:17:50 devstack sudo[96358]: pam_unix(sudo:session): session closed for user root Aug 05 06:17:50 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-1cbee25e-956f-498d-bc57-e8999d8c14d7 tempest-VolumesSnapshotTestJSON-1364937772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-394dff4b-d03b-4200-8cd0-72eb763d45f6" returned: 0 in 0.780s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:17:50 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-1cbee25e-956f-498d-bc57-e8999d8c14d7 tempest-VolumesSnapshotTestJSON-1364937772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-394dff4b-d03b-4200-8cd0-72eb763d45f6.910851aa-4508-4c15-a2b7-15d720a33041 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:17:50 devstack sudo[96378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-394dff4b-d03b-4200-8cd0-72eb763d45f6.910851aa-4508-4c15-a2b7-15d720a33041 Aug 05 06:17:50 devstack sudo[96378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:17:50 devstack cinder-volume[88695]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff124f86-aa62-4d88-a31e-3417214a531b tempest-GroupSnapshotsTest-1900443889 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88695) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 06:17:50 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-ff124f86-aa62-4d88-a31e-3417214a531b tempest-GroupSnapshotsTest-1900443889 None] Flow 'volume_create_manager' (7360afbf-3714-4540-a7e7-cbb18a2de039) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:17:50 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-ff124f86-aa62-4d88-a31e-3417214a531b tempest-GroupSnapshotsTest-1900443889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38a91985-0ccc-403e-a19c-1752bf9c03bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:17:50 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-ff124f86-aa62-4d88-a31e-3417214a531b tempest-GroupSnapshotsTest-1900443889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38a91985-0ccc-403e-a19c-1752bf9c03bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:17:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-294749061',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=49e7df14-7214-4b9c-ad63-149b6a6a2fbf,host='devstack@QuobyteHD#QuobyteHD',id=3af399bf-7c2f-4f6a-975c-6c6e301aeb99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='646f9e7e464f47f988d81ced7f2a0ee5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:17:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:17:51Z,use_quota=True,user_id='314aad5bb7ff4695a905f4a939e5b490',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50e37c64-8b16-404e-b575-4a6f926febe7),volume_type_id=50e37c64-8b16-404e-b575-4a6f926febe7)' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:17:50 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-ff124f86-aa62-4d88-a31e-3417214a531b tempest-GroupSnapshotsTest-1900443889 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5c25749-a39b-4439-8bb2-a6e2cd8234bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:17:50 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-ff124f86-aa62-4d88-a31e-3417214a531b tempest-GroupSnapshotsTest-1900443889 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5c25749-a39b-4439-8bb2-a6e2cd8234bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:17:50 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-ff124f86-aa62-4d88-a31e-3417214a531b tempest-GroupSnapshotsTest-1900443889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7700b60-3b45-4b6e-9ebb-7574cae98265) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:17:50 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-ff124f86-aa62-4d88-a31e-3417214a531b tempest-GroupSnapshotsTest-1900443889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7700b60-3b45-4b6e-9ebb-7574cae98265) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3af399bf-7c2f-4f6a-975c-6c6e301aeb99', 'volume_name': 'volume-3af399bf-7c2f-4f6a-975c-6c6e301aeb99', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:17:50 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-ff124f86-aa62-4d88-a31e-3417214a531b tempest-GroupSnapshotsTest-1900443889 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0582621-d61a-43ab-8c0d-9b225b0ccc72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:17:50 devstack sudo[96375]: pam_unix(sudo:session): session closed for user root Aug 05 06:17:50 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-ff124f86-aa62-4d88-a31e-3417214a531b tempest-GroupSnapshotsTest-1900443889 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0582621-d61a-43ab-8c0d-9b225b0ccc72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:17:50 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-ff124f86-aa62-4d88-a31e-3417214a531b tempest-GroupSnapshotsTest-1900443889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8c5e1af-e543-4b48-9898-ef4b64c096bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:17:50 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-ff124f86-aa62-4d88-a31e-3417214a531b tempest-GroupSnapshotsTest-1900443889 None] Volume 3af399bf-7c2f-4f6a-975c-6c6e301aeb99: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3af399bf-7c2f-4f6a-975c-6c6e301aeb99', 'volume_size': 1} Aug 05 06:17:50 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-ff124f86-aa62-4d88-a31e-3417214a531b tempest-GroupSnapshotsTest-1900443889 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:17:50 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-1169c329-f91d-4f77-95f4-9cdd95b0777b tempest-CreateVolumesFromSnapshotTest-6647266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-c5b77965-8f02-4906-8558-6748c2f65262.33ab530e-8bf9-4f14-83f2-4a93863a479d" returned: 0 in 0.382s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:17:51 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-1169c329-f91d-4f77-95f4-9cdd95b0777b tempest-CreateVolumesFromSnapshotTest-6647266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-c5b77965-8f02-4906-8558-6748c2f65262.info {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:17:51 devstack sudo[96383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-c5b77965-8f02-4906-8558-6748c2f65262.info Aug 05 06:17:51 devstack sudo[96383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:17:51 devstack sudo[96378]: pam_unix(sudo:session): session closed for user root Aug 05 06:17:51 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-1cbee25e-956f-498d-bc57-e8999d8c14d7 tempest-VolumesSnapshotTestJSON-1364937772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-394dff4b-d03b-4200-8cd0-72eb763d45f6.910851aa-4508-4c15-a2b7-15d720a33041" returned: 0 in 0.415s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:17:51 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-1cbee25e-956f-498d-bc57-e8999d8c14d7 tempest-VolumesSnapshotTestJSON-1364937772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-394dff4b-d03b-4200-8cd0-72eb763d45f6.910851aa-4508-4c15-a2b7-15d720a33041 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:17:51 devstack sudo[96386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-394dff4b-d03b-4200-8cd0-72eb763d45f6.910851aa-4508-4c15-a2b7-15d720a33041 Aug 05 06:17:51 devstack sudo[96386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:17:51 devstack sudo[96383]: pam_unix(sudo:session): session closed for user root Aug 05 06:17:51 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-1169c329-f91d-4f77-95f4-9cdd95b0777b tempest-CreateVolumesFromSnapshotTest-6647266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-c5b77965-8f02-4906-8558-6748c2f65262.info" returned: 0 in 0.318s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:17:51 devstack cinder-volume[88695]: WARNING cinder.volume.drivers.remotefs [None req-1169c329-f91d-4f77-95f4-9cdd95b0777b tempest-CreateVolumesFromSnapshotTest-6647266 None] /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-c5b77965-8f02-4906-8558-6748c2f65262.info is being set with open permissions: ugo+rw Aug 05 06:17:51 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-1169c329-f91d-4f77-95f4-9cdd95b0777b tempest-CreateVolumesFromSnapshotTest-6647266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-c5b77965-8f02-4906-8558-6748c2f65262.info {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:17:51 devstack sudo[96389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-c5b77965-8f02-4906-8558-6748c2f65262.info Aug 05 06:17:51 devstack sudo[96389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:17:51 devstack sudo[96386]: pam_unix(sudo:session): session closed for user root Aug 05 06:17:51 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-1cbee25e-956f-498d-bc57-e8999d8c14d7 tempest-VolumesSnapshotTestJSON-1364937772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-394dff4b-d03b-4200-8cd0-72eb763d45f6.910851aa-4508-4c15-a2b7-15d720a33041" returned: 0 in 0.292s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:17:51 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-1cbee25e-956f-498d-bc57-e8999d8c14d7 tempest-VolumesSnapshotTestJSON-1364937772 None] Lock "cinder-quobyte-910851aa-4508-4c15-a2b7-15d720a33041" released by "_delete_snapshot" :: held 2.000s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:17:51 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-1cbee25e-956f-498d-bc57-e8999d8c14d7 tempest-VolumesSnapshotTestJSON-1364937772 None] Lock "cinder-quobyte-394dff4b-d03b-4200-8cd0-72eb763d45f6" released by "delete_snapshot" :: held 2.044s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:17:51 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-1cbee25e-956f-498d-bc57-e8999d8c14d7 tempest-VolumesSnapshotTestJSON-1364937772 None] Created reservations ['546fb94f-0b35-4a03-9999-d024def2e591', '5b0bed42-707c-4d15-8ab7-4b988a3ad0ef', '544e40ba-0a91-4a54-80aa-f6566f50d649', 'a1118b1c-cbf4-43aa-8379-1d173a1fa5b4'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:17:51 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-1cbee25e-956f-498d-bc57-e8999d8c14d7 tempest-VolumesSnapshotTestJSON-1364937772 None] Delete snapshot completed successfully. Aug 05 06:17:51 devstack sudo[96389]: pam_unix(sudo:session): session closed for user root Aug 05 06:17:51 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-1cbee25e-956f-498d-bc57-e8999d8c14d7 tempest-VolumesSnapshotTestJSON-1364937772 None] Lock "cinder-910851aa-4508-4c15-a2b7-15d720a33041-delete_snapshot" released by "delete_snapshot" :: held 2.418s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:17:51 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-1169c329-f91d-4f77-95f4-9cdd95b0777b tempest-CreateVolumesFromSnapshotTest-6647266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-c5b77965-8f02-4906-8558-6748c2f65262.info" returned: 0 in 0.290s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:17:51 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-1169c329-f91d-4f77-95f4-9cdd95b0777b tempest-CreateVolumesFromSnapshotTest-6647266 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.592s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:17:51 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-ff124f86-aa62-4d88-a31e-3417214a531b tempest-GroupSnapshotsTest-1900443889 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.667s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:17:51 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-ff124f86-aa62-4d88-a31e-3417214a531b tempest-GroupSnapshotsTest-1900443889 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=49e7df14-7214-4b9c-ad63-149b6a6a2fbf,created_at=2026-08-05T04:17:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-294749061',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=49e7df14-7214-4b9c-ad63-149b6a6a2fbf,host='devstack@QuobyteHD#QuobyteHD',id=3af399bf-7c2f-4f6a-975c-6c6e301aeb99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='646f9e7e464f47f988d81ced7f2a0ee5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:17:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:17:51Z,use_quota=True,user_id='314aad5bb7ff4695a905f4a939e5b490',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50e37c64-8b16-404e-b575-4a6f926febe7),volume_type_id=50e37c64-8b16-404e-b575-4a6f926febe7)}" {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 06:17:51 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-ff124f86-aa62-4d88-a31e-3417214a531b tempest-GroupSnapshotsTest-1900443889 None] Creating volume 3af399bf-7c2f-4f6a-975c-6c6e301aeb99 {{(pid=88695) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 06:17:51 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-ff124f86-aa62-4d88-a31e-3417214a531b tempest-GroupSnapshotsTest-1900443889 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:17:51 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-ff124f86-aa62-4d88-a31e-3417214a531b tempest-GroupSnapshotsTest-1900443889 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:17:51 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-ff124f86-aa62-4d88-a31e-3417214a531b tempest-GroupSnapshotsTest-1900443889 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:17:51 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-ff124f86-aa62-4d88-a31e-3417214a531b tempest-GroupSnapshotsTest-1900443889 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:17:51 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-ff124f86-aa62-4d88-a31e-3417214a531b tempest-GroupSnapshotsTest-1900443889 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:17:51 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-ff124f86-aa62-4d88-a31e-3417214a531b tempest-GroupSnapshotsTest-1900443889 None] Selected osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 as target Quobyte volume. {{(pid=88695) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 06:17:51 devstack cinder-volume[88695]: INFO cinder.volume.drivers.remotefs [None req-ff124f86-aa62-4d88-a31e-3417214a531b tempest-GroupSnapshotsTest-1900443889 None] casted to osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 Aug 05 06:17:51 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-ff124f86-aa62-4d88-a31e-3417214a531b tempest-GroupSnapshotsTest-1900443889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-3af399bf-7c2f-4f6a-975c-6c6e301aeb99 1073741824 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:17:51 devstack sudo[96393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-3af399bf-7c2f-4f6a-975c-6c6e301aeb99 1073741824 Aug 05 06:17:51 devstack sudo[96393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:17:51 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-1169c329-f91d-4f77-95f4-9cdd95b0777b tempest-CreateVolumesFromSnapshotTest-6647266 None] Create snapshot completed successfully Aug 05 06:17:52 devstack sudo[96393]: pam_unix(sudo:session): session closed for user root Aug 05 06:17:52 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-ff124f86-aa62-4d88-a31e-3417214a531b tempest-GroupSnapshotsTest-1900443889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-3af399bf-7c2f-4f6a-975c-6c6e301aeb99 1073741824" returned: 0 in 0.488s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:17:52 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-ff124f86-aa62-4d88-a31e-3417214a531b tempest-GroupSnapshotsTest-1900443889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-3af399bf-7c2f-4f6a-975c-6c6e301aeb99 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:17:52 devstack sudo[96399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-3af399bf-7c2f-4f6a-975c-6c6e301aeb99 Aug 05 06:17:52 devstack sudo[96399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:17:52 devstack sudo[96399]: pam_unix(sudo:session): session closed for user root Aug 05 06:17:52 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-ff124f86-aa62-4d88-a31e-3417214a531b tempest-GroupSnapshotsTest-1900443889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-3af399bf-7c2f-4f6a-975c-6c6e301aeb99" returned: 0 in 0.311s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:17:52 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-ff124f86-aa62-4d88-a31e-3417214a531b tempest-GroupSnapshotsTest-1900443889 None] <== create_volume: return (847ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'} {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 06:17:52 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-ff124f86-aa62-4d88-a31e-3417214a531b tempest-GroupSnapshotsTest-1900443889 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.850s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:17:52 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-ff124f86-aa62-4d88-a31e-3417214a531b tempest-GroupSnapshotsTest-1900443889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8c5e1af-e543-4b48-9898-ef4b64c096bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3af399bf-7c2f-4f6a-975c-6c6e301aeb99', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:17:52 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-ff124f86-aa62-4d88-a31e-3417214a531b tempest-GroupSnapshotsTest-1900443889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a636f625-c7ff-4bf9-89de-b8ef9171c777) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:17:52 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-1031a0cc-d832-4ae6-8c4c-f24508cb1e64 tempest-VolumesSnapshotTestJSON-1364937772 None] Acquiring lock "cinder-394dff4b-d03b-4200-8cd0-72eb763d45f6-delete_volume" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:17:52 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-ff124f86-aa62-4d88-a31e-3417214a531b tempest-GroupSnapshotsTest-1900443889 None] Volume volume-3af399bf-7c2f-4f6a-975c-6c6e301aeb99 (3af399bf-7c2f-4f6a-975c-6c6e301aeb99): created successfully Aug 05 06:17:52 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-ff124f86-aa62-4d88-a31e-3417214a531b tempest-GroupSnapshotsTest-1900443889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a636f625-c7ff-4bf9-89de-b8ef9171c777) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:17:52 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-ff124f86-aa62-4d88-a31e-3417214a531b tempest-GroupSnapshotsTest-1900443889 None] Flow 'volume_create_manager' (7360afbf-3714-4540-a7e7-cbb18a2de039) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:17:52 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-1031a0cc-d832-4ae6-8c4c-f24508cb1e64 tempest-VolumesSnapshotTestJSON-1364937772 None] Lock "cinder-394dff4b-d03b-4200-8cd0-72eb763d45f6-delete_volume" acquired by "delete_volume" :: waited 0.068s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:17:52 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-ff124f86-aa62-4d88-a31e-3417214a531b tempest-GroupSnapshotsTest-1900443889 None] Created volume successfully. Aug 05 06:17:52 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-1031a0cc-d832-4ae6-8c4c-f24508cb1e64 tempest-VolumesSnapshotTestJSON-1364937772 None] Acquiring lock "cinder-quobyte-394dff4b-d03b-4200-8cd0-72eb763d45f6" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:17:52 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-1031a0cc-d832-4ae6-8c4c-f24508cb1e64 tempest-VolumesSnapshotTestJSON-1364937772 None] Lock "cinder-quobyte-394dff4b-d03b-4200-8cd0-72eb763d45f6" acquired by "delete_volume" :: waited 0.014s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:17:52 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[500c41a6-14eb-4ebc-bd25-d9fe9aa96863]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:17:52 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-1031a0cc-d832-4ae6-8c4c-f24508cb1e64 tempest-VolumesSnapshotTestJSON-1364937772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-394dff4b-d03b-4200-8cd0-72eb763d45f6 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:17:52 devstack cinder-volume[88695]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e3e4283-e80c-480c-a13f-a3122bc25cdb tempest-CreateVolumesFromSnapshotTest-6647266 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88695) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 06:17:52 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-6e3e4283-e80c-480c-a13f-a3122bc25cdb tempest-CreateVolumesFromSnapshotTest-6647266 None] Flow 'volume_create_manager' (304a153a-059e-4656-b85c-4302b6ddb1ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:17:52 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-6e3e4283-e80c-480c-a13f-a3122bc25cdb tempest-CreateVolumesFromSnapshotTest-6647266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63cf1b4e-a8e1-40df-88ee-db6e1feed2cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:17:52 devstack sudo[96402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-394dff4b-d03b-4200-8cd0-72eb763d45f6 Aug 05 06:17:52 devstack sudo[96402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:17:52 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-6e3e4283-e80c-480c-a13f-a3122bc25cdb tempest-CreateVolumesFromSnapshotTest-6647266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63cf1b4e-a8e1-40df-88ee-db6e1feed2cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:17:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-447917896',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e62715ce-f2c7-4341-9dde-e241f0c6bc17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec2e03d1e62242eda420b5693d1ec1eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:17:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:17:53Z,use_quota=True,user_id='25a8ed454666434f8bb14fa0e263507d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:17:52 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-6e3e4283-e80c-480c-a13f-a3122bc25cdb tempest-CreateVolumesFromSnapshotTest-6647266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12467b76-0bf9-4a56-8904-a25b77331248) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:17:52 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-6e3e4283-e80c-480c-a13f-a3122bc25cdb tempest-CreateVolumesFromSnapshotTest-6647266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12467b76-0bf9-4a56-8904-a25b77331248) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:17:52 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-6e3e4283-e80c-480c-a13f-a3122bc25cdb tempest-CreateVolumesFromSnapshotTest-6647266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46e0d0e6-857f-4c9f-bd51-1a5ef19543ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:17:52 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-6e3e4283-e80c-480c-a13f-a3122bc25cdb tempest-CreateVolumesFromSnapshotTest-6647266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46e0d0e6-857f-4c9f-bd51-1a5ef19543ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e62715ce-f2c7-4341-9dde-e241f0c6bc17', 'volume_name': 'volume-e62715ce-f2c7-4341-9dde-e241f0c6bc17', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:17:52 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-6e3e4283-e80c-480c-a13f-a3122bc25cdb tempest-CreateVolumesFromSnapshotTest-6647266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40122923-2a23-4fb3-8812-e01c4cdbc761) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:17:52 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-6e3e4283-e80c-480c-a13f-a3122bc25cdb tempest-CreateVolumesFromSnapshotTest-6647266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40122923-2a23-4fb3-8812-e01c4cdbc761) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:17:52 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-6e3e4283-e80c-480c-a13f-a3122bc25cdb tempest-CreateVolumesFromSnapshotTest-6647266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff2b3b8e-dd34-4ea1-83b1-75bd689f8946) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:17:52 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-6e3e4283-e80c-480c-a13f-a3122bc25cdb tempest-CreateVolumesFromSnapshotTest-6647266 None] Volume e62715ce-f2c7-4341-9dde-e241f0c6bc17: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e62715ce-f2c7-4341-9dde-e241f0c6bc17', 'volume_size': 1} Aug 05 06:17:52 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-6e3e4283-e80c-480c-a13f-a3122bc25cdb tempest-CreateVolumesFromSnapshotTest-6647266 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:17:52 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-6e3e4283-e80c-480c-a13f-a3122bc25cdb tempest-CreateVolumesFromSnapshotTest-6647266 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:17:52 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-6e3e4283-e80c-480c-a13f-a3122bc25cdb tempest-CreateVolumesFromSnapshotTest-6647266 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:17:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-447917896',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e62715ce-f2c7-4341-9dde-e241f0c6bc17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec2e03d1e62242eda420b5693d1ec1eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:17:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:17:53Z,use_quota=True,user_id='25a8ed454666434f8bb14fa0e263507d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)}" {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 06:17:52 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-6e3e4283-e80c-480c-a13f-a3122bc25cdb tempest-CreateVolumesFromSnapshotTest-6647266 None] Creating volume e62715ce-f2c7-4341-9dde-e241f0c6bc17 {{(pid=88695) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 06:17:52 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-6e3e4283-e80c-480c-a13f-a3122bc25cdb tempest-CreateVolumesFromSnapshotTest-6647266 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:17:52 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-6e3e4283-e80c-480c-a13f-a3122bc25cdb tempest-CreateVolumesFromSnapshotTest-6647266 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:17:52 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-6e3e4283-e80c-480c-a13f-a3122bc25cdb tempest-CreateVolumesFromSnapshotTest-6647266 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:17:52 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-6e3e4283-e80c-480c-a13f-a3122bc25cdb tempest-CreateVolumesFromSnapshotTest-6647266 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:17:52 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-6e3e4283-e80c-480c-a13f-a3122bc25cdb tempest-CreateVolumesFromSnapshotTest-6647266 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:17:53 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-6e3e4283-e80c-480c-a13f-a3122bc25cdb tempest-CreateVolumesFromSnapshotTest-6647266 None] Selected osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 as target Quobyte volume. {{(pid=88695) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 06:17:53 devstack cinder-volume[88695]: INFO cinder.volume.drivers.remotefs [None req-6e3e4283-e80c-480c-a13f-a3122bc25cdb tempest-CreateVolumesFromSnapshotTest-6647266 None] casted to osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 Aug 05 06:17:53 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-6e3e4283-e80c-480c-a13f-a3122bc25cdb tempest-CreateVolumesFromSnapshotTest-6647266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-e62715ce-f2c7-4341-9dde-e241f0c6bc17 1073741824 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:17:53 devstack sudo[96404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-e62715ce-f2c7-4341-9dde-e241f0c6bc17 1073741824 Aug 05 06:17:53 devstack sudo[96404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:17:53 devstack cinder-volume[88695]: DEBUG cinder.volume.flows.manager.create_volume [None req-3cf13c20-bf70-4ed9-a1cf-91948f27983c tempest-CreateVolumesFromSnapshotTest-6647266 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88695) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 06:17:53 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-3cf13c20-bf70-4ed9-a1cf-91948f27983c tempest-CreateVolumesFromSnapshotTest-6647266 None] Flow 'volume_create_manager' (a7d46f18-cc80-4759-b0a1-2cd094f70e6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:17:53 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-3cf13c20-bf70-4ed9-a1cf-91948f27983c tempest-CreateVolumesFromSnapshotTest-6647266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4dac09c-8a31-467e-bd29-81b6d43ba434) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:17:53 devstack sudo[96402]: pam_unix(sudo:session): session closed for user root Aug 05 06:17:53 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-3cf13c20-bf70-4ed9-a1cf-91948f27983c tempest-CreateVolumesFromSnapshotTest-6647266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4dac09c-8a31-467e-bd29-81b6d43ba434) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:17:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-373787380',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af65a6f1-a4d3-4424-8ddb-a7646e4568a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec2e03d1e62242eda420b5693d1ec1eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:17:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:17:53Z,use_quota=True,user_id='25a8ed454666434f8bb14fa0e263507d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:17:53 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-3cf13c20-bf70-4ed9-a1cf-91948f27983c tempest-CreateVolumesFromSnapshotTest-6647266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01ac80ba-a891-45ce-b899-a177fa40379b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:17:53 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-3cf13c20-bf70-4ed9-a1cf-91948f27983c tempest-CreateVolumesFromSnapshotTest-6647266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01ac80ba-a891-45ce-b899-a177fa40379b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:17:53 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-3cf13c20-bf70-4ed9-a1cf-91948f27983c tempest-CreateVolumesFromSnapshotTest-6647266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ecafa00-c174-446a-affe-46eb3c90fc03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:17:53 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-3cf13c20-bf70-4ed9-a1cf-91948f27983c tempest-CreateVolumesFromSnapshotTest-6647266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ecafa00-c174-446a-affe-46eb3c90fc03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af65a6f1-a4d3-4424-8ddb-a7646e4568a0', 'volume_name': 'volume-af65a6f1-a4d3-4424-8ddb-a7646e4568a0', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:17:53 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-3cf13c20-bf70-4ed9-a1cf-91948f27983c tempest-CreateVolumesFromSnapshotTest-6647266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be32f783-44f6-4350-b7b4-2b553a4f6dc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:17:53 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-3cf13c20-bf70-4ed9-a1cf-91948f27983c tempest-CreateVolumesFromSnapshotTest-6647266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be32f783-44f6-4350-b7b4-2b553a4f6dc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:17:53 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-3cf13c20-bf70-4ed9-a1cf-91948f27983c tempest-CreateVolumesFromSnapshotTest-6647266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (620ce8f5-7343-4053-9f03-8415b3ee6b25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:17:53 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-3cf13c20-bf70-4ed9-a1cf-91948f27983c tempest-CreateVolumesFromSnapshotTest-6647266 None] Volume af65a6f1-a4d3-4424-8ddb-a7646e4568a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af65a6f1-a4d3-4424-8ddb-a7646e4568a0', 'volume_size': 1} Aug 05 06:17:53 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-3cf13c20-bf70-4ed9-a1cf-91948f27983c tempest-CreateVolumesFromSnapshotTest-6647266 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:17:53 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-1031a0cc-d832-4ae6-8c4c-f24508cb1e64 tempest-VolumesSnapshotTestJSON-1364937772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-394dff4b-d03b-4200-8cd0-72eb763d45f6" returned: 0 in 0.793s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:17:53 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-1031a0cc-d832-4ae6-8c4c-f24508cb1e64 tempest-VolumesSnapshotTestJSON-1364937772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-394dff4b-d03b-4200-8cd0-72eb763d45f6 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:17:53 devstack sudo[96411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-394dff4b-d03b-4200-8cd0-72eb763d45f6 Aug 05 06:17:53 devstack sudo[96411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:17:53 devstack cinder-volume[88695]: DEBUG cinder.volume.flows.manager.create_volume [None req-753f9ec8-2c99-4a21-aed8-43c11e2b0063 tempest-CreateVolumesFromSnapshotTest-6647266 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88695) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 06:17:53 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-753f9ec8-2c99-4a21-aed8-43c11e2b0063 tempest-CreateVolumesFromSnapshotTest-6647266 None] Flow 'volume_create_manager' (66846623-9dc4-4ab8-9ada-6fed0412ec0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:17:53 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-753f9ec8-2c99-4a21-aed8-43c11e2b0063 tempest-CreateVolumesFromSnapshotTest-6647266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ba18ba2-4b19-42be-b96a-d897bc3d9143) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:17:53 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-ba45c068-b595-4714-b717-a12bd1e576f8 tempest-GroupSnapshotsTest-1900443889 None] GroupSnapshot 5987e81c-0460-435c-b59e-eff323c33af7: creating. Aug 05 06:17:53 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-753f9ec8-2c99-4a21-aed8-43c11e2b0063 tempest-CreateVolumesFromSnapshotTest-6647266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ba18ba2-4b19-42be-b96a-d897bc3d9143) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:17:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1642716742',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bde357d6-40c1-45b3-a542-0ad0e99c733f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec2e03d1e62242eda420b5693d1ec1eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:17:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:17:54Z,use_quota=True,user_id='25a8ed454666434f8bb14fa0e263507d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:17:53 devstack sudo[96404]: pam_unix(sudo:session): session closed for user root Aug 05 06:17:53 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-753f9ec8-2c99-4a21-aed8-43c11e2b0063 tempest-CreateVolumesFromSnapshotTest-6647266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (636a3118-bc79-491c-90b7-b6066698cd98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:17:53 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-753f9ec8-2c99-4a21-aed8-43c11e2b0063 tempest-CreateVolumesFromSnapshotTest-6647266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (636a3118-bc79-491c-90b7-b6066698cd98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:17:53 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-753f9ec8-2c99-4a21-aed8-43c11e2b0063 tempest-CreateVolumesFromSnapshotTest-6647266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df69148f-79e3-4fcb-a5a3-8720ccb4ad25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:17:53 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-753f9ec8-2c99-4a21-aed8-43c11e2b0063 tempest-CreateVolumesFromSnapshotTest-6647266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df69148f-79e3-4fcb-a5a3-8720ccb4ad25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bde357d6-40c1-45b3-a542-0ad0e99c733f', 'volume_name': 'volume-bde357d6-40c1-45b3-a542-0ad0e99c733f', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:17:53 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-753f9ec8-2c99-4a21-aed8-43c11e2b0063 tempest-CreateVolumesFromSnapshotTest-6647266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e355fe17-2e5f-4921-abf9-09585f389a4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:17:53 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-753f9ec8-2c99-4a21-aed8-43c11e2b0063 tempest-CreateVolumesFromSnapshotTest-6647266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e355fe17-2e5f-4921-abf9-09585f389a4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:17:53 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-753f9ec8-2c99-4a21-aed8-43c11e2b0063 tempest-CreateVolumesFromSnapshotTest-6647266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70ca2283-0b70-409f-966d-6f1fe5754af1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:17:53 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-753f9ec8-2c99-4a21-aed8-43c11e2b0063 tempest-CreateVolumesFromSnapshotTest-6647266 None] Volume bde357d6-40c1-45b3-a542-0ad0e99c733f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bde357d6-40c1-45b3-a542-0ad0e99c733f', 'volume_size': 1} Aug 05 06:17:53 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-753f9ec8-2c99-4a21-aed8-43c11e2b0063 tempest-CreateVolumesFromSnapshotTest-6647266 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:17:53 devstack sudo[96411]: pam_unix(sudo:session): session closed for user root Aug 05 06:17:53 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-6e3e4283-e80c-480c-a13f-a3122bc25cdb tempest-CreateVolumesFromSnapshotTest-6647266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-e62715ce-f2c7-4341-9dde-e241f0c6bc17 1073741824" returned: 0 in 0.945s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:17:53 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-1031a0cc-d832-4ae6-8c4c-f24508cb1e64 tempest-VolumesSnapshotTestJSON-1364937772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-394dff4b-d03b-4200-8cd0-72eb763d45f6" returned: 0 in 0.418s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:17:53 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-ba45c068-b595-4714-b717-a12bd1e576f8 tempest-GroupSnapshotsTest-1900443889 None] Group snapshot 5987e81c-0460-435c-b59e-eff323c33af7: creating. {{(pid=88695) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Aug 05 06:17:53 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-1031a0cc-d832-4ae6-8c4c-f24508cb1e64 tempest-VolumesSnapshotTestJSON-1364937772 None] Lock "cinder-quobyte-394dff4b-d03b-4200-8cd0-72eb763d45f6" released by "delete_volume" :: held 1.304s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:17:54 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-ba45c068-b595-4714-b717-a12bd1e576f8 tempest-GroupSnapshotsTest-1900443889 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:17:54 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-6e3e4283-e80c-480c-a13f-a3122bc25cdb tempest-CreateVolumesFromSnapshotTest-6647266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-e62715ce-f2c7-4341-9dde-e241f0c6bc17 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:17:54 devstack sudo[96416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-e62715ce-f2c7-4341-9dde-e241f0c6bc17 Aug 05 06:17:54 devstack sudo[96416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:17:54 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-1031a0cc-d832-4ae6-8c4c-f24508cb1e64 tempest-VolumesSnapshotTestJSON-1364937772 None] Created reservations ['51bac2bb-d6d5-4241-b13b-1e69d103eddb', '58fd3867-7652-444b-bc02-1109e874fdf0', '2c0cb06f-2b89-4516-bfde-ce367c9a7fb1', '6f00c92c-cc2d-4007-9ea5-7fffc76c7573'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:17:54 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-1031a0cc-d832-4ae6-8c4c-f24508cb1e64 tempest-VolumesSnapshotTestJSON-1364937772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:17:54 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-1031a0cc-d832-4ae6-8c4c-f24508cb1e64 tempest-VolumesSnapshotTestJSON-1364937772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:17:54 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-1031a0cc-d832-4ae6-8c4c-f24508cb1e64 tempest-VolumesSnapshotTestJSON-1364937772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:17:54 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-1031a0cc-d832-4ae6-8c4c-f24508cb1e64 tempest-VolumesSnapshotTestJSON-1364937772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:17:54 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-1031a0cc-d832-4ae6-8c4c-f24508cb1e64 tempest-VolumesSnapshotTestJSON-1364937772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:17:54 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-1031a0cc-d832-4ae6-8c4c-f24508cb1e64 tempest-VolumesSnapshotTestJSON-1364937772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:17:54 devstack sudo[96418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce Aug 05 06:17:54 devstack sudo[96418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:17:54 devstack sudo[96416]: pam_unix(sudo:session): session closed for user root Aug 05 06:17:54 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-6e3e4283-e80c-480c-a13f-a3122bc25cdb tempest-CreateVolumesFromSnapshotTest-6647266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-e62715ce-f2c7-4341-9dde-e241f0c6bc17" returned: 0 in 0.310s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:17:54 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-6e3e4283-e80c-480c-a13f-a3122bc25cdb tempest-CreateVolumesFromSnapshotTest-6647266 None] <== create_volume: return (1356ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'} {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 06:17:54 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-6e3e4283-e80c-480c-a13f-a3122bc25cdb tempest-CreateVolumesFromSnapshotTest-6647266 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.363s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:17:54 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-3cf13c20-bf70-4ed9-a1cf-91948f27983c tempest-CreateVolumesFromSnapshotTest-6647266 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.811s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:17:54 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-3cf13c20-bf70-4ed9-a1cf-91948f27983c tempest-CreateVolumesFromSnapshotTest-6647266 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:17:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-373787380',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af65a6f1-a4d3-4424-8ddb-a7646e4568a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec2e03d1e62242eda420b5693d1ec1eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:17:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:17:53Z,use_quota=True,user_id='25a8ed454666434f8bb14fa0e263507d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)}" {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 06:17:54 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-3cf13c20-bf70-4ed9-a1cf-91948f27983c tempest-CreateVolumesFromSnapshotTest-6647266 None] Creating volume af65a6f1-a4d3-4424-8ddb-a7646e4568a0 {{(pid=88695) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 06:17:54 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-3cf13c20-bf70-4ed9-a1cf-91948f27983c tempest-CreateVolumesFromSnapshotTest-6647266 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:17:54 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-3cf13c20-bf70-4ed9-a1cf-91948f27983c tempest-CreateVolumesFromSnapshotTest-6647266 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:17:54 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-3cf13c20-bf70-4ed9-a1cf-91948f27983c tempest-CreateVolumesFromSnapshotTest-6647266 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:17:54 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-3cf13c20-bf70-4ed9-a1cf-91948f27983c tempest-CreateVolumesFromSnapshotTest-6647266 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:17:54 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-3cf13c20-bf70-4ed9-a1cf-91948f27983c tempest-CreateVolumesFromSnapshotTest-6647266 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:17:54 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-3cf13c20-bf70-4ed9-a1cf-91948f27983c tempest-CreateVolumesFromSnapshotTest-6647266 None] Selected osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 as target Quobyte volume. {{(pid=88695) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 06:17:54 devstack cinder-volume[88695]: INFO cinder.volume.drivers.remotefs [None req-3cf13c20-bf70-4ed9-a1cf-91948f27983c tempest-CreateVolumesFromSnapshotTest-6647266 None] casted to osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 Aug 05 06:17:54 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-3cf13c20-bf70-4ed9-a1cf-91948f27983c tempest-CreateVolumesFromSnapshotTest-6647266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-af65a6f1-a4d3-4424-8ddb-a7646e4568a0 1073741824 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:17:54 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-6e3e4283-e80c-480c-a13f-a3122bc25cdb tempest-CreateVolumesFromSnapshotTest-6647266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff2b3b8e-dd34-4ea1-83b1-75bd689f8946) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e62715ce-f2c7-4341-9dde-e241f0c6bc17', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:17:54 devstack sudo[96421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-af65a6f1-a4d3-4424-8ddb-a7646e4568a0 1073741824 Aug 05 06:17:54 devstack sudo[96421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:17:54 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-6e3e4283-e80c-480c-a13f-a3122bc25cdb tempest-CreateVolumesFromSnapshotTest-6647266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f3464bb-c743-403a-aa3a-37c756c68c90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:17:54 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-6e3e4283-e80c-480c-a13f-a3122bc25cdb tempest-CreateVolumesFromSnapshotTest-6647266 None] Volume volume-e62715ce-f2c7-4341-9dde-e241f0c6bc17 (e62715ce-f2c7-4341-9dde-e241f0c6bc17): created successfully Aug 05 06:17:54 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-6e3e4283-e80c-480c-a13f-a3122bc25cdb tempest-CreateVolumesFromSnapshotTest-6647266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f3464bb-c743-403a-aa3a-37c756c68c90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:17:54 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-6e3e4283-e80c-480c-a13f-a3122bc25cdb tempest-CreateVolumesFromSnapshotTest-6647266 None] Flow 'volume_create_manager' (304a153a-059e-4656-b85c-4302b6ddb1ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:17:54 devstack cinder-volume[88695]: DEBUG cinder.volume.flows.manager.create_volume [None req-81e740f7-f68b-44b6-9f9a-a93b0f2a0f86 tempest-CreateVolumesFromSnapshotTest-6647266 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88695) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 06:17:54 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-81e740f7-f68b-44b6-9f9a-a93b0f2a0f86 tempest-CreateVolumesFromSnapshotTest-6647266 None] Flow 'volume_create_manager' (756aaba2-bd24-4b63-bdcb-4787e3f5a1c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:17:54 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-81e740f7-f68b-44b6-9f9a-a93b0f2a0f86 tempest-CreateVolumesFromSnapshotTest-6647266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7a79977-28b8-48e3-ac77-bc5e7b76e406) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:17:54 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-6e3e4283-e80c-480c-a13f-a3122bc25cdb tempest-CreateVolumesFromSnapshotTest-6647266 None] Created volume successfully. Aug 05 06:17:54 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-81e740f7-f68b-44b6-9f9a-a93b0f2a0f86 tempest-CreateVolumesFromSnapshotTest-6647266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7a79977-28b8-48e3-ac77-bc5e7b76e406) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:17:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-61849152',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a371b10a-5786-402a-b333-70c13b72614a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec2e03d1e62242eda420b5693d1ec1eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:17:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:17:54Z,use_quota=True,user_id='25a8ed454666434f8bb14fa0e263507d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:17:54 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-81e740f7-f68b-44b6-9f9a-a93b0f2a0f86 tempest-CreateVolumesFromSnapshotTest-6647266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f042075-9ee9-4250-8969-86995047b50d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:17:54 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-81e740f7-f68b-44b6-9f9a-a93b0f2a0f86 tempest-CreateVolumesFromSnapshotTest-6647266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f042075-9ee9-4250-8969-86995047b50d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:17:54 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-81e740f7-f68b-44b6-9f9a-a93b0f2a0f86 tempest-CreateVolumesFromSnapshotTest-6647266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d64587ab-a3ba-4124-99c4-958fe8454377) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:17:54 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-81e740f7-f68b-44b6-9f9a-a93b0f2a0f86 tempest-CreateVolumesFromSnapshotTest-6647266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d64587ab-a3ba-4124-99c4-958fe8454377) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a371b10a-5786-402a-b333-70c13b72614a', 'volume_name': 'volume-a371b10a-5786-402a-b333-70c13b72614a', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:17:54 devstack sudo[96418]: pam_unix(sudo:session): session closed for user root Aug 05 06:17:54 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-81e740f7-f68b-44b6-9f9a-a93b0f2a0f86 tempest-CreateVolumesFromSnapshotTest-6647266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e449986e-3570-4399-99dd-7b9ba6bf0f4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:17:54 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-81e740f7-f68b-44b6-9f9a-a93b0f2a0f86 tempest-CreateVolumesFromSnapshotTest-6647266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e449986e-3570-4399-99dd-7b9ba6bf0f4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:17:54 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-81e740f7-f68b-44b6-9f9a-a93b0f2a0f86 tempest-CreateVolumesFromSnapshotTest-6647266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (682b67ca-2568-4f80-b7ed-7c2b1a5347ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:17:54 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-81e740f7-f68b-44b6-9f9a-a93b0f2a0f86 tempest-CreateVolumesFromSnapshotTest-6647266 None] Volume a371b10a-5786-402a-b333-70c13b72614a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a371b10a-5786-402a-b333-70c13b72614a', 'volume_size': 1} Aug 05 06:17:54 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-81e740f7-f68b-44b6-9f9a-a93b0f2a0f86 tempest-CreateVolumesFromSnapshotTest-6647266 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:17:54 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-1031a0cc-d832-4ae6-8c4c-f24508cb1e64 tempest-VolumesSnapshotTestJSON-1364937772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce" returned: 0 in 0.537s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:17:54 devstack cinder-volume[88695]: DEBUG cinder.manager [None req-1031a0cc-d832-4ae6-8c4c-f24508cb1e64 tempest-VolumesSnapshotTestJSON-1364937772 None] Notifying Schedulers of capabilities ... {{(pid=88695) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 06:17:54 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-1031a0cc-d832-4ae6-8c4c-f24508cb1e64 tempest-VolumesSnapshotTestJSON-1364937772 None] Deleted volume successfully. Aug 05 06:17:54 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-1031a0cc-d832-4ae6-8c4c-f24508cb1e64 tempest-VolumesSnapshotTestJSON-1364937772 None] Lock "cinder-394dff4b-d03b-4200-8cd0-72eb763d45f6-delete_volume" released by "delete_volume" :: held 2.177s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:17:54 devstack cinder-volume[88695]: DEBUG cinder.volume.flows.manager.create_volume [None req-a029e16e-445f-48f1-9a80-231b700453dc tempest-CreateVolumesFromSnapshotTest-6647266 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88695) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 06:17:54 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-a029e16e-445f-48f1-9a80-231b700453dc tempest-CreateVolumesFromSnapshotTest-6647266 None] Flow 'volume_create_manager' (8c54ea2d-37a3-4201-b32b-e6026fccb4c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:17:54 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-a029e16e-445f-48f1-9a80-231b700453dc tempest-CreateVolumesFromSnapshotTest-6647266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e060644-149d-4a18-9c68-98765458ad86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:17:55 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-a029e16e-445f-48f1-9a80-231b700453dc tempest-CreateVolumesFromSnapshotTest-6647266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e060644-149d-4a18-9c68-98765458ad86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:17:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-921245489',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30b62f93-ef86-4426-a711-cc14af869376,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec2e03d1e62242eda420b5693d1ec1eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:17:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:17:55Z,use_quota=True,user_id='25a8ed454666434f8bb14fa0e263507d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:17:55 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-a029e16e-445f-48f1-9a80-231b700453dc tempest-CreateVolumesFromSnapshotTest-6647266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d3b7e4d-2d9a-4a8d-9ebf-5b473756b783) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:17:55 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-a029e16e-445f-48f1-9a80-231b700453dc tempest-CreateVolumesFromSnapshotTest-6647266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d3b7e4d-2d9a-4a8d-9ebf-5b473756b783) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:17:55 devstack sudo[96421]: pam_unix(sudo:session): session closed for user root Aug 05 06:17:55 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-a029e16e-445f-48f1-9a80-231b700453dc tempest-CreateVolumesFromSnapshotTest-6647266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0376fa91-9e5f-461d-bfe4-e795e232dace) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:17:55 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-a029e16e-445f-48f1-9a80-231b700453dc tempest-CreateVolumesFromSnapshotTest-6647266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0376fa91-9e5f-461d-bfe4-e795e232dace) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '30b62f93-ef86-4426-a711-cc14af869376', 'volume_name': 'volume-30b62f93-ef86-4426-a711-cc14af869376', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:17:55 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-a029e16e-445f-48f1-9a80-231b700453dc tempest-CreateVolumesFromSnapshotTest-6647266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b6b5bd3-138a-4ae0-9e92-754ca49e85f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:17:55 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-a029e16e-445f-48f1-9a80-231b700453dc tempest-CreateVolumesFromSnapshotTest-6647266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b6b5bd3-138a-4ae0-9e92-754ca49e85f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:17:55 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-a029e16e-445f-48f1-9a80-231b700453dc tempest-CreateVolumesFromSnapshotTest-6647266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a67767f-25ad-417d-ad00-183a2f7434be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:17:55 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-a029e16e-445f-48f1-9a80-231b700453dc tempest-CreateVolumesFromSnapshotTest-6647266 None] Volume 30b62f93-ef86-4426-a711-cc14af869376: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-30b62f93-ef86-4426-a711-cc14af869376', 'volume_size': 1} Aug 05 06:17:55 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-a029e16e-445f-48f1-9a80-231b700453dc tempest-CreateVolumesFromSnapshotTest-6647266 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:17:55 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-3cf13c20-bf70-4ed9-a1cf-91948f27983c tempest-CreateVolumesFromSnapshotTest-6647266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-af65a6f1-a4d3-4424-8ddb-a7646e4568a0 1073741824" returned: 0 in 0.689s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:17:55 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-3cf13c20-bf70-4ed9-a1cf-91948f27983c tempest-CreateVolumesFromSnapshotTest-6647266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-af65a6f1-a4d3-4424-8ddb-a7646e4568a0 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:17:55 devstack sudo[96428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-af65a6f1-a4d3-4424-8ddb-a7646e4568a0 Aug 05 06:17:55 devstack sudo[96428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:17:55 devstack sudo[96428]: pam_unix(sudo:session): session closed for user root Aug 05 06:17:55 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-3cf13c20-bf70-4ed9-a1cf-91948f27983c tempest-CreateVolumesFromSnapshotTest-6647266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-af65a6f1-a4d3-4424-8ddb-a7646e4568a0" returned: 0 in 0.294s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:17:55 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-3cf13c20-bf70-4ed9-a1cf-91948f27983c tempest-CreateVolumesFromSnapshotTest-6647266 None] <== create_volume: return (1038ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'} {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 06:17:55 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-3cf13c20-bf70-4ed9-a1cf-91948f27983c tempest-CreateVolumesFromSnapshotTest-6647266 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.040s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:17:55 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-753f9ec8-2c99-4a21-aed8-43c11e2b0063 tempest-CreateVolumesFromSnapshotTest-6647266 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.450s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:17:55 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-753f9ec8-2c99-4a21-aed8-43c11e2b0063 tempest-CreateVolumesFromSnapshotTest-6647266 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:17:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1642716742',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bde357d6-40c1-45b3-a542-0ad0e99c733f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec2e03d1e62242eda420b5693d1ec1eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:17:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:17:54Z,use_quota=True,user_id='25a8ed454666434f8bb14fa0e263507d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)}" {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 06:17:55 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-753f9ec8-2c99-4a21-aed8-43c11e2b0063 tempest-CreateVolumesFromSnapshotTest-6647266 None] Creating volume bde357d6-40c1-45b3-a542-0ad0e99c733f {{(pid=88695) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 06:17:55 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-753f9ec8-2c99-4a21-aed8-43c11e2b0063 tempest-CreateVolumesFromSnapshotTest-6647266 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:17:55 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-753f9ec8-2c99-4a21-aed8-43c11e2b0063 tempest-CreateVolumesFromSnapshotTest-6647266 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:17:55 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-753f9ec8-2c99-4a21-aed8-43c11e2b0063 tempest-CreateVolumesFromSnapshotTest-6647266 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:17:55 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-753f9ec8-2c99-4a21-aed8-43c11e2b0063 tempest-CreateVolumesFromSnapshotTest-6647266 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:17:55 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-753f9ec8-2c99-4a21-aed8-43c11e2b0063 tempest-CreateVolumesFromSnapshotTest-6647266 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:17:55 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-753f9ec8-2c99-4a21-aed8-43c11e2b0063 tempest-CreateVolumesFromSnapshotTest-6647266 None] Selected osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 as target Quobyte volume. {{(pid=88695) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 06:17:55 devstack cinder-volume[88695]: INFO cinder.volume.drivers.remotefs [None req-753f9ec8-2c99-4a21-aed8-43c11e2b0063 tempest-CreateVolumesFromSnapshotTest-6647266 None] casted to osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 Aug 05 06:17:55 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-753f9ec8-2c99-4a21-aed8-43c11e2b0063 tempest-CreateVolumesFromSnapshotTest-6647266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-bde357d6-40c1-45b3-a542-0ad0e99c733f 1073741824 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:17:55 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-3cf13c20-bf70-4ed9-a1cf-91948f27983c tempest-CreateVolumesFromSnapshotTest-6647266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (620ce8f5-7343-4053-9f03-8415b3ee6b25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af65a6f1-a4d3-4424-8ddb-a7646e4568a0', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:17:55 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-3cf13c20-bf70-4ed9-a1cf-91948f27983c tempest-CreateVolumesFromSnapshotTest-6647266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c6d40e3-1500-4579-a3c3-daeceb08fd2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:17:55 devstack sudo[96431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-bde357d6-40c1-45b3-a542-0ad0e99c733f 1073741824 Aug 05 06:17:55 devstack sudo[96431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:17:55 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-3cf13c20-bf70-4ed9-a1cf-91948f27983c tempest-CreateVolumesFromSnapshotTest-6647266 None] Volume volume-af65a6f1-a4d3-4424-8ddb-a7646e4568a0 (af65a6f1-a4d3-4424-8ddb-a7646e4568a0): created successfully Aug 05 06:17:55 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-3cf13c20-bf70-4ed9-a1cf-91948f27983c tempest-CreateVolumesFromSnapshotTest-6647266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c6d40e3-1500-4579-a3c3-daeceb08fd2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:17:55 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-3cf13c20-bf70-4ed9-a1cf-91948f27983c tempest-CreateVolumesFromSnapshotTest-6647266 None] Flow 'volume_create_manager' (a7d46f18-cc80-4759-b0a1-2cd094f70e6f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:17:55 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-3cf13c20-bf70-4ed9-a1cf-91948f27983c tempest-CreateVolumesFromSnapshotTest-6647266 None] Created volume successfully. Aug 05 06:17:55 devstack cinder-volume[88695]: DEBUG cinder.volume.flows.manager.create_volume [None req-06558623-1a8c-4dc1-b081-a1178dcc9a40 tempest-VolumesSnapshotTestJSON-1364937772 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88695) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 06:17:55 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-06558623-1a8c-4dc1-b081-a1178dcc9a40 tempest-VolumesSnapshotTestJSON-1364937772 None] Flow 'volume_create_manager' (affc223b-cf33-41ba-bc42-b3dfa289501e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:17:55 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-06558623-1a8c-4dc1-b081-a1178dcc9a40 tempest-VolumesSnapshotTestJSON-1364937772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5678163f-4f70-4d74-8d82-a236d65fd5ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:17:55 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-06558623-1a8c-4dc1-b081-a1178dcc9a40 tempest-VolumesSnapshotTestJSON-1364937772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5678163f-4f70-4d74-8d82-a236d65fd5ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:17:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1843151620',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ab0b058-7dd3-499c-9824-bdb6e6ee4619,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f87c02595984b10b4b2ed8e5d9cb883',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:17:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:17:56Z,use_quota=True,user_id='0566fcce709945bf9523b15b9d04dfc1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:17:55 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-06558623-1a8c-4dc1-b081-a1178dcc9a40 tempest-VolumesSnapshotTestJSON-1364937772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e676923e-7c8f-4959-8c9a-52755eed7bd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:17:55 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-06558623-1a8c-4dc1-b081-a1178dcc9a40 tempest-VolumesSnapshotTestJSON-1364937772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e676923e-7c8f-4959-8c9a-52755eed7bd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:17:55 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-06558623-1a8c-4dc1-b081-a1178dcc9a40 tempest-VolumesSnapshotTestJSON-1364937772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1012e77f-e050-43fd-b09b-3ab761e5ca37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:17:55 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-06558623-1a8c-4dc1-b081-a1178dcc9a40 tempest-VolumesSnapshotTestJSON-1364937772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1012e77f-e050-43fd-b09b-3ab761e5ca37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ab0b058-7dd3-499c-9824-bdb6e6ee4619', 'volume_name': 'volume-9ab0b058-7dd3-499c-9824-bdb6e6ee4619', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:17:55 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-06558623-1a8c-4dc1-b081-a1178dcc9a40 tempest-VolumesSnapshotTestJSON-1364937772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21be5ee5-2045-47c7-94c3-64574b12a9c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:17:55 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-06558623-1a8c-4dc1-b081-a1178dcc9a40 tempest-VolumesSnapshotTestJSON-1364937772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21be5ee5-2045-47c7-94c3-64574b12a9c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:17:55 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-06558623-1a8c-4dc1-b081-a1178dcc9a40 tempest-VolumesSnapshotTestJSON-1364937772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5703579f-0376-46db-80c0-3e2ee7654bd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:17:55 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-06558623-1a8c-4dc1-b081-a1178dcc9a40 tempest-VolumesSnapshotTestJSON-1364937772 None] Volume 9ab0b058-7dd3-499c-9824-bdb6e6ee4619: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ab0b058-7dd3-499c-9824-bdb6e6ee4619', 'volume_size': 1} Aug 05 06:17:55 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-06558623-1a8c-4dc1-b081-a1178dcc9a40 tempest-VolumesSnapshotTestJSON-1364937772 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:17:55 devstack sudo[96431]: pam_unix(sudo:session): session closed for user root Aug 05 06:17:55 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-753f9ec8-2c99-4a21-aed8-43c11e2b0063 tempest-CreateVolumesFromSnapshotTest-6647266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-bde357d6-40c1-45b3-a542-0ad0e99c733f 1073741824" returned: 0 in 0.568s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:17:56 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-753f9ec8-2c99-4a21-aed8-43c11e2b0063 tempest-CreateVolumesFromSnapshotTest-6647266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-bde357d6-40c1-45b3-a542-0ad0e99c733f {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:17:56 devstack sudo[96439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-bde357d6-40c1-45b3-a542-0ad0e99c733f Aug 05 06:17:56 devstack sudo[96439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:17:56 devstack sudo[96439]: pam_unix(sudo:session): session closed for user root Aug 05 06:17:56 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-753f9ec8-2c99-4a21-aed8-43c11e2b0063 tempest-CreateVolumesFromSnapshotTest-6647266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-bde357d6-40c1-45b3-a542-0ad0e99c733f" returned: 0 in 0.282s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:17:56 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-753f9ec8-2c99-4a21-aed8-43c11e2b0063 tempest-CreateVolumesFromSnapshotTest-6647266 None] <== create_volume: return (900ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'} {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 06:17:56 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-753f9ec8-2c99-4a21-aed8-43c11e2b0063 tempest-CreateVolumesFromSnapshotTest-6647266 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.904s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:17:56 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-ba45c068-b595-4714-b717-a12bd1e576f8 tempest-GroupSnapshotsTest-1900443889 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.307s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:17:56 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-753f9ec8-2c99-4a21-aed8-43c11e2b0063 tempest-CreateVolumesFromSnapshotTest-6647266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70ca2283-0b70-409f-966d-6f1fe5754af1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bde357d6-40c1-45b3-a542-0ad0e99c733f', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:17:56 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-753f9ec8-2c99-4a21-aed8-43c11e2b0063 tempest-CreateVolumesFromSnapshotTest-6647266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fd243f0-24f4-4b98-aec6-5dd184af0d4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:17:56 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-ba45c068-b595-4714-b717-a12bd1e576f8 tempest-GroupSnapshotsTest-1900443889 None] Creating offline snapshot fa1c43b1-351b-4eac-8fb0-43fb0901af62 of volume 3af399bf-7c2f-4f6a-975c-6c6e301aeb99 {{(pid=88695) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 06:17:56 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-753f9ec8-2c99-4a21-aed8-43c11e2b0063 tempest-CreateVolumesFromSnapshotTest-6647266 None] Volume volume-bde357d6-40c1-45b3-a542-0ad0e99c733f (bde357d6-40c1-45b3-a542-0ad0e99c733f): created successfully Aug 05 06:17:56 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-753f9ec8-2c99-4a21-aed8-43c11e2b0063 tempest-CreateVolumesFromSnapshotTest-6647266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fd243f0-24f4-4b98-aec6-5dd184af0d4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:17:56 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-753f9ec8-2c99-4a21-aed8-43c11e2b0063 tempest-CreateVolumesFromSnapshotTest-6647266 None] Flow 'volume_create_manager' (66846623-9dc4-4ab8-9ada-6fed0412ec0c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:17:56 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[09914c65-10cc-4624-8995-97545913a89f]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:17:56 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-ba45c068-b595-4714-b717-a12bd1e576f8 tempest-GroupSnapshotsTest-1900443889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-3af399bf-7c2f-4f6a-975c-6c6e301aeb99 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:17:56 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-753f9ec8-2c99-4a21-aed8-43c11e2b0063 tempest-CreateVolumesFromSnapshotTest-6647266 None] Created volume successfully. Aug 05 06:17:56 devstack sudo[96442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-3af399bf-7c2f-4f6a-975c-6c6e301aeb99 Aug 05 06:17:56 devstack sudo[96442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:17:56 devstack sudo[96442]: pam_unix(sudo:session): session closed for user root Aug 05 06:17:56 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-ba45c068-b595-4714-b717-a12bd1e576f8 tempest-GroupSnapshotsTest-1900443889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-3af399bf-7c2f-4f6a-975c-6c6e301aeb99" returned: 0 in 0.406s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:17:56 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-ba45c068-b595-4714-b717-a12bd1e576f8 tempest-GroupSnapshotsTest-1900443889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-3af399bf-7c2f-4f6a-975c-6c6e301aeb99,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-3af399bf-7c2f-4f6a-975c-6c6e301aeb99.fa1c43b1-351b-4eac-8fb0-43fb0901af62 1G {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:17:56 devstack sudo[96447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-3af399bf-7c2f-4f6a-975c-6c6e301aeb99,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-3af399bf-7c2f-4f6a-975c-6c6e301aeb99.fa1c43b1-351b-4eac-8fb0-43fb0901af62 1G Aug 05 06:17:56 devstack sudo[96447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:17:57 devstack sudo[96447]: pam_unix(sudo:session): session closed for user root Aug 05 06:17:57 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-ba45c068-b595-4714-b717-a12bd1e576f8 tempest-GroupSnapshotsTest-1900443889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-3af399bf-7c2f-4f6a-975c-6c6e301aeb99,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-3af399bf-7c2f-4f6a-975c-6c6e301aeb99.fa1c43b1-351b-4eac-8fb0-43fb0901af62 1G" returned: 0 in 0.433s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:17:57 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-ba45c068-b595-4714-b717-a12bd1e576f8 tempest-GroupSnapshotsTest-1900443889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3af399bf-7c2f-4f6a-975c-6c6e301aeb99 -F qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-3af399bf-7c2f-4f6a-975c-6c6e301aeb99.fa1c43b1-351b-4eac-8fb0-43fb0901af62 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:17:57 devstack sudo[96453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3af399bf-7c2f-4f6a-975c-6c6e301aeb99 -F qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-3af399bf-7c2f-4f6a-975c-6c6e301aeb99.fa1c43b1-351b-4eac-8fb0-43fb0901af62 Aug 05 06:17:57 devstack sudo[96453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:17:57 devstack sudo[96453]: pam_unix(sudo:session): session closed for user root Aug 05 06:17:57 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-ba45c068-b595-4714-b717-a12bd1e576f8 tempest-GroupSnapshotsTest-1900443889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3af399bf-7c2f-4f6a-975c-6c6e301aeb99 -F qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-3af399bf-7c2f-4f6a-975c-6c6e301aeb99.fa1c43b1-351b-4eac-8fb0-43fb0901af62" returned: 0 in 0.343s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:17:57 devstack cinder-volume[88695]: WARNING cinder.volume.drivers.remotefs [None req-ba45c068-b595-4714-b717-a12bd1e576f8 tempest-GroupSnapshotsTest-1900443889 None] /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-3af399bf-7c2f-4f6a-975c-6c6e301aeb99.fa1c43b1-351b-4eac-8fb0-43fb0901af62 is being set with open permissions: ugo+rw: NotImplementedError Aug 05 06:17:57 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-ba45c068-b595-4714-b717-a12bd1e576f8 tempest-GroupSnapshotsTest-1900443889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-3af399bf-7c2f-4f6a-975c-6c6e301aeb99.fa1c43b1-351b-4eac-8fb0-43fb0901af62 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:17:57 devstack sudo[96459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-3af399bf-7c2f-4f6a-975c-6c6e301aeb99.fa1c43b1-351b-4eac-8fb0-43fb0901af62 Aug 05 06:17:57 devstack sudo[96459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:17:57 devstack sudo[96459]: pam_unix(sudo:session): session closed for user root Aug 05 06:17:57 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-ba45c068-b595-4714-b717-a12bd1e576f8 tempest-GroupSnapshotsTest-1900443889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-3af399bf-7c2f-4f6a-975c-6c6e301aeb99.fa1c43b1-351b-4eac-8fb0-43fb0901af62" returned: 0 in 0.256s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:17:57 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-ba45c068-b595-4714-b717-a12bd1e576f8 tempest-GroupSnapshotsTest-1900443889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-3af399bf-7c2f-4f6a-975c-6c6e301aeb99.info {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:17:57 devstack sudo[96463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-3af399bf-7c2f-4f6a-975c-6c6e301aeb99.info Aug 05 06:17:57 devstack sudo[96463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:17:58 devstack sudo[96463]: pam_unix(sudo:session): session closed for user root Aug 05 06:17:58 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-ba45c068-b595-4714-b717-a12bd1e576f8 tempest-GroupSnapshotsTest-1900443889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-3af399bf-7c2f-4f6a-975c-6c6e301aeb99.info" returned: 0 in 0.265s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:17:58 devstack cinder-volume[88695]: WARNING cinder.volume.drivers.remotefs [None req-ba45c068-b595-4714-b717-a12bd1e576f8 tempest-GroupSnapshotsTest-1900443889 None] /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-3af399bf-7c2f-4f6a-975c-6c6e301aeb99.info is being set with open permissions: ugo+rw: NotImplementedError Aug 05 06:17:58 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-ba45c068-b595-4714-b717-a12bd1e576f8 tempest-GroupSnapshotsTest-1900443889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-3af399bf-7c2f-4f6a-975c-6c6e301aeb99.info {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:17:58 devstack sudo[96466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-3af399bf-7c2f-4f6a-975c-6c6e301aeb99.info Aug 05 06:17:58 devstack sudo[96466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:17:58 devstack sudo[96466]: pam_unix(sudo:session): session closed for user root Aug 05 06:17:58 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-ba45c068-b595-4714-b717-a12bd1e576f8 tempest-GroupSnapshotsTest-1900443889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-3af399bf-7c2f-4f6a-975c-6c6e301aeb99.info" returned: 0 in 0.274s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:17:58 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-ba45c068-b595-4714-b717-a12bd1e576f8 tempest-GroupSnapshotsTest-1900443889 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.118s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:17:58 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-81e740f7-f68b-44b6-9f9a-a93b0f2a0f86 tempest-CreateVolumesFromSnapshotTest-6647266 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.723s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:17:58 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-81e740f7-f68b-44b6-9f9a-a93b0f2a0f86 tempest-CreateVolumesFromSnapshotTest-6647266 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:17:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-61849152',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a371b10a-5786-402a-b333-70c13b72614a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec2e03d1e62242eda420b5693d1ec1eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:17:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:17:54Z,use_quota=True,user_id='25a8ed454666434f8bb14fa0e263507d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)}" {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 06:17:58 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-81e740f7-f68b-44b6-9f9a-a93b0f2a0f86 tempest-CreateVolumesFromSnapshotTest-6647266 None] Creating volume a371b10a-5786-402a-b333-70c13b72614a {{(pid=88695) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 06:17:58 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-81e740f7-f68b-44b6-9f9a-a93b0f2a0f86 tempest-CreateVolumesFromSnapshotTest-6647266 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:17:58 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-81e740f7-f68b-44b6-9f9a-a93b0f2a0f86 tempest-CreateVolumesFromSnapshotTest-6647266 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:17:58 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-81e740f7-f68b-44b6-9f9a-a93b0f2a0f86 tempest-CreateVolumesFromSnapshotTest-6647266 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:17:58 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-81e740f7-f68b-44b6-9f9a-a93b0f2a0f86 tempest-CreateVolumesFromSnapshotTest-6647266 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:17:58 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-81e740f7-f68b-44b6-9f9a-a93b0f2a0f86 tempest-CreateVolumesFromSnapshotTest-6647266 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:17:58 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-81e740f7-f68b-44b6-9f9a-a93b0f2a0f86 tempest-CreateVolumesFromSnapshotTest-6647266 None] Selected osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 as target Quobyte volume. {{(pid=88695) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 06:17:58 devstack cinder-volume[88695]: INFO cinder.volume.drivers.remotefs [None req-81e740f7-f68b-44b6-9f9a-a93b0f2a0f86 tempest-CreateVolumesFromSnapshotTest-6647266 None] casted to osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 Aug 05 06:17:58 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-81e740f7-f68b-44b6-9f9a-a93b0f2a0f86 tempest-CreateVolumesFromSnapshotTest-6647266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a371b10a-5786-402a-b333-70c13b72614a 1073741824 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:17:58 devstack sudo[96469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a371b10a-5786-402a-b333-70c13b72614a 1073741824 Aug 05 06:17:58 devstack sudo[96469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:17:58 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-ba45c068-b595-4714-b717-a12bd1e576f8 tempest-GroupSnapshotsTest-1900443889 None] group_snapshot 5987e81c-0460-435c-b59e-eff323c33af7: created successfully Aug 05 06:17:59 devstack sudo[96469]: pam_unix(sudo:session): session closed for user root Aug 05 06:17:59 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-81e740f7-f68b-44b6-9f9a-a93b0f2a0f86 tempest-CreateVolumesFromSnapshotTest-6647266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a371b10a-5786-402a-b333-70c13b72614a 1073741824" returned: 0 in 0.648s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:17:59 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-81e740f7-f68b-44b6-9f9a-a93b0f2a0f86 tempest-CreateVolumesFromSnapshotTest-6647266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a371b10a-5786-402a-b333-70c13b72614a {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:17:59 devstack sudo[96475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a371b10a-5786-402a-b333-70c13b72614a Aug 05 06:17:59 devstack sudo[96475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:17:59 devstack sudo[96475]: pam_unix(sudo:session): session closed for user root Aug 05 06:17:59 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-81e740f7-f68b-44b6-9f9a-a93b0f2a0f86 tempest-CreateVolumesFromSnapshotTest-6647266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a371b10a-5786-402a-b333-70c13b72614a" returned: 0 in 0.330s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:17:59 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-81e740f7-f68b-44b6-9f9a-a93b0f2a0f86 tempest-CreateVolumesFromSnapshotTest-6647266 None] <== create_volume: return (1021ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'} {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 06:17:59 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-81e740f7-f68b-44b6-9f9a-a93b0f2a0f86 tempest-CreateVolumesFromSnapshotTest-6647266 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.024s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:17:59 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-a029e16e-445f-48f1-9a80-231b700453dc tempest-CreateVolumesFromSnapshotTest-6647266 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.406s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:17:59 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-a029e16e-445f-48f1-9a80-231b700453dc tempest-CreateVolumesFromSnapshotTest-6647266 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:17:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-921245489',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30b62f93-ef86-4426-a711-cc14af869376,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec2e03d1e62242eda420b5693d1ec1eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:17:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:17:55Z,use_quota=True,user_id='25a8ed454666434f8bb14fa0e263507d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)}" {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 06:17:59 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-a029e16e-445f-48f1-9a80-231b700453dc tempest-CreateVolumesFromSnapshotTest-6647266 None] Creating volume 30b62f93-ef86-4426-a711-cc14af869376 {{(pid=88695) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 06:17:59 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-a029e16e-445f-48f1-9a80-231b700453dc tempest-CreateVolumesFromSnapshotTest-6647266 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:17:59 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-a029e16e-445f-48f1-9a80-231b700453dc tempest-CreateVolumesFromSnapshotTest-6647266 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:17:59 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-a029e16e-445f-48f1-9a80-231b700453dc tempest-CreateVolumesFromSnapshotTest-6647266 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:17:59 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-a029e16e-445f-48f1-9a80-231b700453dc tempest-CreateVolumesFromSnapshotTest-6647266 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:17:59 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-a029e16e-445f-48f1-9a80-231b700453dc tempest-CreateVolumesFromSnapshotTest-6647266 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:17:59 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-a029e16e-445f-48f1-9a80-231b700453dc tempest-CreateVolumesFromSnapshotTest-6647266 None] Selected osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 as target Quobyte volume. {{(pid=88695) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 06:17:59 devstack cinder-volume[88695]: INFO cinder.volume.drivers.remotefs [None req-a029e16e-445f-48f1-9a80-231b700453dc tempest-CreateVolumesFromSnapshotTest-6647266 None] casted to osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 Aug 05 06:17:59 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-a029e16e-445f-48f1-9a80-231b700453dc tempest-CreateVolumesFromSnapshotTest-6647266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-30b62f93-ef86-4426-a711-cc14af869376 1073741824 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:17:59 devstack sudo[96478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-30b62f93-ef86-4426-a711-cc14af869376 1073741824 Aug 05 06:17:59 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-81e740f7-f68b-44b6-9f9a-a93b0f2a0f86 tempest-CreateVolumesFromSnapshotTest-6647266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (682b67ca-2568-4f80-b7ed-7c2b1a5347ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a371b10a-5786-402a-b333-70c13b72614a', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:17:59 devstack sudo[96478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:17:59 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-81e740f7-f68b-44b6-9f9a-a93b0f2a0f86 tempest-CreateVolumesFromSnapshotTest-6647266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04dad927-8820-46c2-b1e3-b7583b69ea70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:17:59 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-81e740f7-f68b-44b6-9f9a-a93b0f2a0f86 tempest-CreateVolumesFromSnapshotTest-6647266 None] Volume volume-a371b10a-5786-402a-b333-70c13b72614a (a371b10a-5786-402a-b333-70c13b72614a): created successfully Aug 05 06:17:59 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-81e740f7-f68b-44b6-9f9a-a93b0f2a0f86 tempest-CreateVolumesFromSnapshotTest-6647266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04dad927-8820-46c2-b1e3-b7583b69ea70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:17:59 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-81e740f7-f68b-44b6-9f9a-a93b0f2a0f86 tempest-CreateVolumesFromSnapshotTest-6647266 None] Flow 'volume_create_manager' (756aaba2-bd24-4b63-bdcb-4787e3f5a1c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:17:59 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-81e740f7-f68b-44b6-9f9a-a93b0f2a0f86 tempest-CreateVolumesFromSnapshotTest-6647266 None] Created volume successfully. Aug 05 06:18:00 devstack sudo[96478]: pam_unix(sudo:session): session closed for user root Aug 05 06:18:00 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-a029e16e-445f-48f1-9a80-231b700453dc tempest-CreateVolumesFromSnapshotTest-6647266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-30b62f93-ef86-4426-a711-cc14af869376 1073741824" returned: 0 in 0.732s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:18:00 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-f9f51c81-8baf-4e20-94d0-ce2f70a29d68 tempest-GroupSnapshotsTest-1900443889 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:18:00 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-a029e16e-445f-48f1-9a80-231b700453dc tempest-CreateVolumesFromSnapshotTest-6647266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-30b62f93-ef86-4426-a711-cc14af869376 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:18:00 devstack sudo[96484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-30b62f93-ef86-4426-a711-cc14af869376 Aug 05 06:18:00 devstack sudo[96484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:18:00 devstack cinder-volume[88695]: DEBUG oslo_service.periodic_task [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88695) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 06:18:00 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:18:00 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:18:00 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:18:00 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:18:00 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:18:00 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:18:00 devstack sudo[96486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce Aug 05 06:18:00 devstack sudo[96486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:18:00 devstack sudo[96484]: pam_unix(sudo:session): session closed for user root Aug 05 06:18:00 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-a029e16e-445f-48f1-9a80-231b700453dc tempest-CreateVolumesFromSnapshotTest-6647266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-30b62f93-ef86-4426-a711-cc14af869376" returned: 0 in 0.393s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:18:00 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-a029e16e-445f-48f1-9a80-231b700453dc tempest-CreateVolumesFromSnapshotTest-6647266 None] <== create_volume: return (1192ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'} {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 06:18:00 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-a029e16e-445f-48f1-9a80-231b700453dc tempest-CreateVolumesFromSnapshotTest-6647266 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.196s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:18:00 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-06558623-1a8c-4dc1-b081-a1178dcc9a40 tempest-VolumesSnapshotTestJSON-1364937772 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.835s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:18:00 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-06558623-1a8c-4dc1-b081-a1178dcc9a40 tempest-VolumesSnapshotTestJSON-1364937772 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:17:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1843151620',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ab0b058-7dd3-499c-9824-bdb6e6ee4619,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f87c02595984b10b4b2ed8e5d9cb883',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:17:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:17:56Z,use_quota=True,user_id='0566fcce709945bf9523b15b9d04dfc1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)}" {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 06:18:00 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-06558623-1a8c-4dc1-b081-a1178dcc9a40 tempest-VolumesSnapshotTestJSON-1364937772 None] Creating volume 9ab0b058-7dd3-499c-9824-bdb6e6ee4619 {{(pid=88695) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 06:18:00 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-06558623-1a8c-4dc1-b081-a1178dcc9a40 tempest-VolumesSnapshotTestJSON-1364937772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:18:00 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-06558623-1a8c-4dc1-b081-a1178dcc9a40 tempest-VolumesSnapshotTestJSON-1364937772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:18:00 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-06558623-1a8c-4dc1-b081-a1178dcc9a40 tempest-VolumesSnapshotTestJSON-1364937772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:18:00 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-06558623-1a8c-4dc1-b081-a1178dcc9a40 tempest-VolumesSnapshotTestJSON-1364937772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:18:00 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-06558623-1a8c-4dc1-b081-a1178dcc9a40 tempest-VolumesSnapshotTestJSON-1364937772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:18:00 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-06558623-1a8c-4dc1-b081-a1178dcc9a40 tempest-VolumesSnapshotTestJSON-1364937772 None] Selected osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 as target Quobyte volume. {{(pid=88695) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 06:18:00 devstack cinder-volume[88695]: INFO cinder.volume.drivers.remotefs [None req-06558623-1a8c-4dc1-b081-a1178dcc9a40 tempest-VolumesSnapshotTestJSON-1364937772 None] casted to osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 Aug 05 06:18:00 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-06558623-1a8c-4dc1-b081-a1178dcc9a40 tempest-VolumesSnapshotTestJSON-1364937772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9ab0b058-7dd3-499c-9824-bdb6e6ee4619 1073741824 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:18:00 devstack sudo[96489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9ab0b058-7dd3-499c-9824-bdb6e6ee4619 1073741824 Aug 05 06:18:00 devstack sudo[96489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:18:00 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-a029e16e-445f-48f1-9a80-231b700453dc tempest-CreateVolumesFromSnapshotTest-6647266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a67767f-25ad-417d-ad00-183a2f7434be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30b62f93-ef86-4426-a711-cc14af869376', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:18:00 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-a029e16e-445f-48f1-9a80-231b700453dc tempest-CreateVolumesFromSnapshotTest-6647266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (049c20ee-7610-4f15-8dc3-ad0b95873625) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:18:00 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-a029e16e-445f-48f1-9a80-231b700453dc tempest-CreateVolumesFromSnapshotTest-6647266 None] Volume volume-30b62f93-ef86-4426-a711-cc14af869376 (30b62f93-ef86-4426-a711-cc14af869376): created successfully Aug 05 06:18:00 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-a029e16e-445f-48f1-9a80-231b700453dc tempest-CreateVolumesFromSnapshotTest-6647266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (049c20ee-7610-4f15-8dc3-ad0b95873625) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:18:00 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-a029e16e-445f-48f1-9a80-231b700453dc tempest-CreateVolumesFromSnapshotTest-6647266 None] Flow 'volume_create_manager' (8c54ea2d-37a3-4201-b32b-e6026fccb4c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:18:00 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-a029e16e-445f-48f1-9a80-231b700453dc tempest-CreateVolumesFromSnapshotTest-6647266 None] Created volume successfully. Aug 05 06:18:00 devstack sudo[96486]: pam_unix(sudo:session): session closed for user root Aug 05 06:18:00 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce" returned: 0 in 0.400s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:18:00 devstack cinder-volume[88695]: DEBUG cinder.manager [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] Notifying Schedulers of capabilities ... {{(pid=88695) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 06:18:00 devstack cinder-volume[88695]: DEBUG oslo_service.periodic_task [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] Running periodic task VolumeManager._thread_info {{(pid=88695) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 06:18:00 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] thread count: 28 {{(pid=88695) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 05 06:18:00 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] thread info: [<_MainThread(MainThread, started 134469211893888)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88695) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 05 06:18:01 devstack sudo[96489]: pam_unix(sudo:session): session closed for user root Aug 05 06:18:01 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-06558623-1a8c-4dc1-b081-a1178dcc9a40 tempest-VolumesSnapshotTestJSON-1364937772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9ab0b058-7dd3-499c-9824-bdb6e6ee4619 1073741824" returned: 0 in 0.566s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:18:01 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-06558623-1a8c-4dc1-b081-a1178dcc9a40 tempest-VolumesSnapshotTestJSON-1364937772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9ab0b058-7dd3-499c-9824-bdb6e6ee4619 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:18:01 devstack sudo[96495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9ab0b058-7dd3-499c-9824-bdb6e6ee4619 Aug 05 06:18:01 devstack sudo[96495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:18:01 devstack sudo[96495]: pam_unix(sudo:session): session closed for user root Aug 05 06:18:01 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-06558623-1a8c-4dc1-b081-a1178dcc9a40 tempest-VolumesSnapshotTestJSON-1364937772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9ab0b058-7dd3-499c-9824-bdb6e6ee4619" returned: 0 in 0.274s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:18:01 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-06558623-1a8c-4dc1-b081-a1178dcc9a40 tempest-VolumesSnapshotTestJSON-1364937772 None] <== create_volume: return (904ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'} {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 06:18:01 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-06558623-1a8c-4dc1-b081-a1178dcc9a40 tempest-VolumesSnapshotTestJSON-1364937772 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.907s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:18:01 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-f9f51c81-8baf-4e20-94d0-ce2f70a29d68 tempest-GroupSnapshotsTest-1900443889 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.325s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:18:01 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-f9f51c81-8baf-4e20-94d0-ce2f70a29d68 tempest-GroupSnapshotsTest-1900443889 None] Acquiring lock "cinder-quobyte-fa1c43b1-351b-4eac-8fb0-43fb0901af62-119ac236-0259-4684-b573-f6f2a49c0208" by "_create_volume_from_snapshot" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:18:01 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-06558623-1a8c-4dc1-b081-a1178dcc9a40 tempest-VolumesSnapshotTestJSON-1364937772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5703579f-0376-46db-80c0-3e2ee7654bd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ab0b058-7dd3-499c-9824-bdb6e6ee4619', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:18:01 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-06558623-1a8c-4dc1-b081-a1178dcc9a40 tempest-VolumesSnapshotTestJSON-1364937772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ea8ea56-93ab-4199-9cb7-d2c77feccbf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:18:01 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-f9f51c81-8baf-4e20-94d0-ce2f70a29d68 tempest-GroupSnapshotsTest-1900443889 None] Lock "cinder-quobyte-fa1c43b1-351b-4eac-8fb0-43fb0901af62-119ac236-0259-4684-b573-f6f2a49c0208" acquired by "_create_volume_from_snapshot" :: waited 0.048s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:18:01 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-f9f51c81-8baf-4e20-94d0-ce2f70a29d68 tempest-GroupSnapshotsTest-1900443889 None] Creating volume 119ac236-0259-4684-b573-f6f2a49c0208 from snapshot fa1c43b1-351b-4eac-8fb0-43fb0901af62 {{(pid=88695) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 05 06:18:01 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-f9f51c81-8baf-4e20-94d0-ce2f70a29d68 tempest-GroupSnapshotsTest-1900443889 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:18:01 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-f9f51c81-8baf-4e20-94d0-ce2f70a29d68 tempest-GroupSnapshotsTest-1900443889 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:18:01 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-f9f51c81-8baf-4e20-94d0-ce2f70a29d68 tempest-GroupSnapshotsTest-1900443889 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:18:01 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-f9f51c81-8baf-4e20-94d0-ce2f70a29d68 tempest-GroupSnapshotsTest-1900443889 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:18:01 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-f9f51c81-8baf-4e20-94d0-ce2f70a29d68 tempest-GroupSnapshotsTest-1900443889 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:18:01 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-f9f51c81-8baf-4e20-94d0-ce2f70a29d68 tempest-GroupSnapshotsTest-1900443889 None] Selected osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 as target Quobyte volume. {{(pid=88695) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 06:18:01 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-f9f51c81-8baf-4e20-94d0-ce2f70a29d68 tempest-GroupSnapshotsTest-1900443889 None] Acquiring lock "cinder-quobyte-119ac236-0259-4684-b573-f6f2a49c0208" by "_copy_volume_from_snapshot" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:18:01 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-06558623-1a8c-4dc1-b081-a1178dcc9a40 tempest-VolumesSnapshotTestJSON-1364937772 None] Volume volume-9ab0b058-7dd3-499c-9824-bdb6e6ee4619 (9ab0b058-7dd3-499c-9824-bdb6e6ee4619): created successfully Aug 05 06:18:01 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-06558623-1a8c-4dc1-b081-a1178dcc9a40 tempest-VolumesSnapshotTestJSON-1364937772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ea8ea56-93ab-4199-9cb7-d2c77feccbf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:18:01 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-06558623-1a8c-4dc1-b081-a1178dcc9a40 tempest-VolumesSnapshotTestJSON-1364937772 None] Flow 'volume_create_manager' (affc223b-cf33-41ba-bc42-b3dfa289501e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:18:01 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-f9f51c81-8baf-4e20-94d0-ce2f70a29d68 tempest-GroupSnapshotsTest-1900443889 None] Lock "cinder-quobyte-119ac236-0259-4684-b573-f6f2a49c0208" acquired by "_copy_volume_from_snapshot" :: waited 0.037s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:18:01 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-f9f51c81-8baf-4e20-94d0-ce2f70a29d68 tempest-GroupSnapshotsTest-1900443889 None] snapshot: fa1c43b1-351b-4eac-8fb0-43fb0901af62, volume: 119ac236-0259-4684-b573-f6f2a49c0208, {{(pid=88695) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 05 06:18:01 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-06558623-1a8c-4dc1-b081-a1178dcc9a40 tempest-VolumesSnapshotTestJSON-1364937772 None] Created volume successfully. Aug 05 06:18:01 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-f9f51c81-8baf-4e20-94d0-ce2f70a29d68 tempest-GroupSnapshotsTest-1900443889 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:18:01 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-f9f51c81-8baf-4e20-94d0-ce2f70a29d68 tempest-GroupSnapshotsTest-1900443889 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:18:01 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-f9f51c81-8baf-4e20-94d0-ce2f70a29d68 tempest-GroupSnapshotsTest-1900443889 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:18:01 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-f9f51c81-8baf-4e20-94d0-ce2f70a29d68 tempest-GroupSnapshotsTest-1900443889 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:18:01 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-f9f51c81-8baf-4e20-94d0-ce2f70a29d68 tempest-GroupSnapshotsTest-1900443889 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:18:01 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bdc3f8c-31df-4265-a75d-5aa764ff0878]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:18:01 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-f9f51c81-8baf-4e20-94d0-ce2f70a29d68 tempest-GroupSnapshotsTest-1900443889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-3af399bf-7c2f-4f6a-975c-6c6e301aeb99.fa1c43b1-351b-4eac-8fb0-43fb0901af62 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:18:01 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-827d815c-4b80-4582-aff1-8af99e210aa8 tempest-CreateVolumesFromSnapshotTest-6647266 None] Acquiring lock "cinder-30b62f93-ef86-4426-a711-cc14af869376-delete_volume" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:18:01 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-827d815c-4b80-4582-aff1-8af99e210aa8 tempest-CreateVolumesFromSnapshotTest-6647266 None] Lock "cinder-30b62f93-ef86-4426-a711-cc14af869376-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:18:01 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-827d815c-4b80-4582-aff1-8af99e210aa8 tempest-CreateVolumesFromSnapshotTest-6647266 None] Acquiring lock "cinder-quobyte-30b62f93-ef86-4426-a711-cc14af869376" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:18:01 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-827d815c-4b80-4582-aff1-8af99e210aa8 tempest-CreateVolumesFromSnapshotTest-6647266 None] Lock "cinder-quobyte-30b62f93-ef86-4426-a711-cc14af869376" acquired by "delete_volume" :: waited 0.021s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:18:01 devstack sudo[96498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-3af399bf-7c2f-4f6a-975c-6c6e301aeb99.fa1c43b1-351b-4eac-8fb0-43fb0901af62 Aug 05 06:18:01 devstack sudo[96498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:18:01 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ef749ec-33d2-4b9d-9c1f-cfe637ea04bb]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:18:01 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-827d815c-4b80-4582-aff1-8af99e210aa8 tempest-CreateVolumesFromSnapshotTest-6647266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-30b62f93-ef86-4426-a711-cc14af869376 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:18:02 devstack sudo[96500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-30b62f93-ef86-4426-a711-cc14af869376 Aug 05 06:18:02 devstack sudo[96500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:18:02 devstack sudo[96498]: pam_unix(sudo:session): session closed for user root Aug 05 06:18:02 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-f9f51c81-8baf-4e20-94d0-ce2f70a29d68 tempest-GroupSnapshotsTest-1900443889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-3af399bf-7c2f-4f6a-975c-6c6e301aeb99.fa1c43b1-351b-4eac-8fb0-43fb0901af62" returned: 0 in 0.643s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:18:02 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-f9f51c81-8baf-4e20-94d0-ce2f70a29d68 tempest-GroupSnapshotsTest-1900443889 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3af399bf-7c2f-4f6a-975c-6c6e301aeb99(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88695) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 06:18:02 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdf498a5-73de-4f00-b585-4bbbea292a0b]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:18:02 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-f9f51c81-8baf-4e20-94d0-ce2f70a29d68 tempest-GroupSnapshotsTest-1900443889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-3af399bf-7c2f-4f6a-975c-6c6e301aeb99 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:18:02 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-53f0da5d-9b1a-449d-9019-9c9faeb72727 tempest-VolumesSnapshotTestJSON-1364937772 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:18:02 devstack sudo[96500]: pam_unix(sudo:session): session closed for user root Aug 05 06:18:02 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-827d815c-4b80-4582-aff1-8af99e210aa8 tempest-CreateVolumesFromSnapshotTest-6647266 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-30b62f93-ef86-4426-a711-cc14af869376" returned: 0 in 0.599s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:18:02 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-827d815c-4b80-4582-aff1-8af99e210aa8 tempest-CreateVolumesFromSnapshotTest-6647266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-30b62f93-ef86-4426-a711-cc14af869376 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:18:02 devstack sudo[96507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-3af399bf-7c2f-4f6a-975c-6c6e301aeb99 Aug 05 06:18:02 devstack sudo[96507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:18:02 devstack sudo[96509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-30b62f93-ef86-4426-a711-cc14af869376 Aug 05 06:18:02 devstack sudo[96509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:18:02 devstack sudo[96507]: pam_unix(sudo:session): session closed for user root Aug 05 06:18:02 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-f9f51c81-8baf-4e20-94d0-ce2f70a29d68 tempest-GroupSnapshotsTest-1900443889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-3af399bf-7c2f-4f6a-975c-6c6e301aeb99" returned: 0 in 0.478s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:18:02 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-f9f51c81-8baf-4e20-94d0-ce2f70a29d68 tempest-GroupSnapshotsTest-1900443889 None] will copy from snapshot at /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-3af399bf-7c2f-4f6a-975c-6c6e301aeb99 {{(pid=88695) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 05 06:18:02 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-f9f51c81-8baf-4e20-94d0-ce2f70a29d68 tempest-GroupSnapshotsTest-1900443889 None] Creating direct copy from snapshot {{(pid=88695) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 05 06:18:02 devstack cinder-volume[88695]: DEBUG cinder.utils [None req-f9f51c81-8baf-4e20-94d0-ce2f70a29d68 tempest-GroupSnapshotsTest-1900443889 None] Path /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-119ac236-0259-4684-b573-f6f2a49c0208 not found in is_blk_device check {{(pid=88695) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 05 06:18:02 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-f9f51c81-8baf-4e20-94d0-ce2f70a29d68 tempest-GroupSnapshotsTest-1900443889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-3af399bf-7c2f-4f6a-975c-6c6e301aeb99 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-119ac236-0259-4684-b573-f6f2a49c0208 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:18:02 devstack sudo[96516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-3af399bf-7c2f-4f6a-975c-6c6e301aeb99 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-119ac236-0259-4684-b573-f6f2a49c0208 Aug 05 06:18:02 devstack sudo[96516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:18:03 devstack sudo[96509]: pam_unix(sudo:session): session closed for user root Aug 05 06:18:03 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-827d815c-4b80-4582-aff1-8af99e210aa8 tempest-CreateVolumesFromSnapshotTest-6647266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-30b62f93-ef86-4426-a711-cc14af869376" returned: 0 in 0.480s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:18:03 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-827d815c-4b80-4582-aff1-8af99e210aa8 tempest-CreateVolumesFromSnapshotTest-6647266 None] Lock "cinder-quobyte-30b62f93-ef86-4426-a711-cc14af869376" released by "delete_volume" :: held 1.133s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:18:03 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-827d815c-4b80-4582-aff1-8af99e210aa8 tempest-CreateVolumesFromSnapshotTest-6647266 None] Created reservations ['a802fdbc-e262-43b8-9b67-3efd90ca102e', '1aadf2fb-2d6b-499a-8788-7c610f57b9e5', '1d66552f-b4f7-48ed-bb2a-25acf4da7df7', '71207235-5b03-4081-9f48-dfd66b7fb66d'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:18:03 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-827d815c-4b80-4582-aff1-8af99e210aa8 tempest-CreateVolumesFromSnapshotTest-6647266 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:18:03 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-827d815c-4b80-4582-aff1-8af99e210aa8 tempest-CreateVolumesFromSnapshotTest-6647266 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:18:03 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-827d815c-4b80-4582-aff1-8af99e210aa8 tempest-CreateVolumesFromSnapshotTest-6647266 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:18:03 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-827d815c-4b80-4582-aff1-8af99e210aa8 tempest-CreateVolumesFromSnapshotTest-6647266 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:18:03 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-827d815c-4b80-4582-aff1-8af99e210aa8 tempest-CreateVolumesFromSnapshotTest-6647266 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:18:03 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-827d815c-4b80-4582-aff1-8af99e210aa8 tempest-CreateVolumesFromSnapshotTest-6647266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:18:03 devstack sudo[96520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce Aug 05 06:18:03 devstack sudo[96520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:18:03 devstack sudo[96520]: pam_unix(sudo:session): session closed for user root Aug 05 06:18:03 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-827d815c-4b80-4582-aff1-8af99e210aa8 tempest-CreateVolumesFromSnapshotTest-6647266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce" returned: 0 in 0.269s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:18:03 devstack cinder-volume[88695]: DEBUG cinder.manager [None req-827d815c-4b80-4582-aff1-8af99e210aa8 tempest-CreateVolumesFromSnapshotTest-6647266 None] Notifying Schedulers of capabilities ... {{(pid=88695) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 06:18:03 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-827d815c-4b80-4582-aff1-8af99e210aa8 tempest-CreateVolumesFromSnapshotTest-6647266 None] Deleted volume successfully. Aug 05 06:18:03 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-827d815c-4b80-4582-aff1-8af99e210aa8 tempest-CreateVolumesFromSnapshotTest-6647266 None] Lock "cinder-30b62f93-ef86-4426-a711-cc14af869376-delete_volume" released by "delete_volume" :: held 1.778s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:18:04 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-782d6662-ff34-4ad0-bd2f-8e9bca65f900 tempest-CreateVolumesFromSnapshotTest-6647266 None] Acquiring lock "cinder-a371b10a-5786-402a-b333-70c13b72614a-delete_volume" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:18:04 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-782d6662-ff34-4ad0-bd2f-8e9bca65f900 tempest-CreateVolumesFromSnapshotTest-6647266 None] Lock "cinder-a371b10a-5786-402a-b333-70c13b72614a-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:18:04 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-782d6662-ff34-4ad0-bd2f-8e9bca65f900 tempest-CreateVolumesFromSnapshotTest-6647266 None] Acquiring lock "cinder-quobyte-a371b10a-5786-402a-b333-70c13b72614a" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:18:04 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-782d6662-ff34-4ad0-bd2f-8e9bca65f900 tempest-CreateVolumesFromSnapshotTest-6647266 None] Lock "cinder-quobyte-a371b10a-5786-402a-b333-70c13b72614a" acquired by "delete_volume" :: waited 0.032s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:18:04 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[69c6e74b-c6e1-4ab8-a371-c79a6c72cd92]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:18:04 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-782d6662-ff34-4ad0-bd2f-8e9bca65f900 tempest-CreateVolumesFromSnapshotTest-6647266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a371b10a-5786-402a-b333-70c13b72614a {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:18:04 devstack sudo[96532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a371b10a-5786-402a-b333-70c13b72614a Aug 05 06:18:04 devstack sudo[96532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:18:05 devstack sudo[96532]: pam_unix(sudo:session): session closed for user root Aug 05 06:18:05 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-782d6662-ff34-4ad0-bd2f-8e9bca65f900 tempest-CreateVolumesFromSnapshotTest-6647266 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a371b10a-5786-402a-b333-70c13b72614a" returned: 0 in 0.833s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:18:05 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-782d6662-ff34-4ad0-bd2f-8e9bca65f900 tempest-CreateVolumesFromSnapshotTest-6647266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a371b10a-5786-402a-b333-70c13b72614a {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:18:05 devstack sudo[96537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a371b10a-5786-402a-b333-70c13b72614a Aug 05 06:18:05 devstack sudo[96537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:18:05 devstack sudo[96537]: pam_unix(sudo:session): session closed for user root Aug 05 06:18:05 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-782d6662-ff34-4ad0-bd2f-8e9bca65f900 tempest-CreateVolumesFromSnapshotTest-6647266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a371b10a-5786-402a-b333-70c13b72614a" returned: 0 in 0.626s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:18:06 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-782d6662-ff34-4ad0-bd2f-8e9bca65f900 tempest-CreateVolumesFromSnapshotTest-6647266 None] Lock "cinder-quobyte-a371b10a-5786-402a-b333-70c13b72614a" released by "delete_volume" :: held 1.580s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:18:06 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-782d6662-ff34-4ad0-bd2f-8e9bca65f900 tempest-CreateVolumesFromSnapshotTest-6647266 None] Created reservations ['2b8c509b-5e8b-4eab-a6b7-b1be6a528c53', '954a2ae0-495a-4bf4-aade-82b162828c03', 'a71b42e4-d3f4-49ce-8321-b5824e2ad103', '286cf803-a587-44fd-89a1-06ccf86936cf'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:18:06 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-782d6662-ff34-4ad0-bd2f-8e9bca65f900 tempest-CreateVolumesFromSnapshotTest-6647266 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:18:06 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-782d6662-ff34-4ad0-bd2f-8e9bca65f900 tempest-CreateVolumesFromSnapshotTest-6647266 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:18:06 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-782d6662-ff34-4ad0-bd2f-8e9bca65f900 tempest-CreateVolumesFromSnapshotTest-6647266 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:18:06 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-782d6662-ff34-4ad0-bd2f-8e9bca65f900 tempest-CreateVolumesFromSnapshotTest-6647266 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:18:06 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-782d6662-ff34-4ad0-bd2f-8e9bca65f900 tempest-CreateVolumesFromSnapshotTest-6647266 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:18:06 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-782d6662-ff34-4ad0-bd2f-8e9bca65f900 tempest-CreateVolumesFromSnapshotTest-6647266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:18:06 devstack sudo[96540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce Aug 05 06:18:06 devstack sudo[96540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:18:06 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-1577d7b1-6984-417b-a122-dbeca1d46d25 tempest-CreateVolumesFromSnapshotTest-6647266 None] Acquiring lock "cinder-bde357d6-40c1-45b3-a542-0ad0e99c733f-delete_volume" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:18:06 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-1577d7b1-6984-417b-a122-dbeca1d46d25 tempest-CreateVolumesFromSnapshotTest-6647266 None] Lock "cinder-bde357d6-40c1-45b3-a542-0ad0e99c733f-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:18:07 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-1577d7b1-6984-417b-a122-dbeca1d46d25 tempest-CreateVolumesFromSnapshotTest-6647266 None] Acquiring lock "cinder-quobyte-bde357d6-40c1-45b3-a542-0ad0e99c733f" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:18:07 devstack sudo[96540]: pam_unix(sudo:session): session closed for user root Aug 05 06:18:07 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-782d6662-ff34-4ad0-bd2f-8e9bca65f900 tempest-CreateVolumesFromSnapshotTest-6647266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce" returned: 0 in 0.656s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:18:07 devstack cinder-volume[88695]: DEBUG cinder.manager [None req-782d6662-ff34-4ad0-bd2f-8e9bca65f900 tempest-CreateVolumesFromSnapshotTest-6647266 None] Notifying Schedulers of capabilities ... {{(pid=88695) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 06:18:07 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-782d6662-ff34-4ad0-bd2f-8e9bca65f900 tempest-CreateVolumesFromSnapshotTest-6647266 None] Deleted volume successfully. Aug 05 06:18:07 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-1577d7b1-6984-417b-a122-dbeca1d46d25 tempest-CreateVolumesFromSnapshotTest-6647266 None] Lock "cinder-quobyte-bde357d6-40c1-45b3-a542-0ad0e99c733f" acquired by "delete_volume" :: waited 0.030s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:18:07 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[43eb13d3-f233-4d3e-a70a-7a105bf1acf0]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:18:07 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-1577d7b1-6984-417b-a122-dbeca1d46d25 tempest-CreateVolumesFromSnapshotTest-6647266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-bde357d6-40c1-45b3-a542-0ad0e99c733f {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:18:07 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-782d6662-ff34-4ad0-bd2f-8e9bca65f900 tempest-CreateVolumesFromSnapshotTest-6647266 None] Lock "cinder-a371b10a-5786-402a-b333-70c13b72614a-delete_volume" released by "delete_volume" :: held 2.812s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:18:07 devstack sudo[96543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-bde357d6-40c1-45b3-a542-0ad0e99c733f Aug 05 06:18:07 devstack sudo[96543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:18:08 devstack sudo[96543]: pam_unix(sudo:session): session closed for user root Aug 05 06:18:08 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-1577d7b1-6984-417b-a122-dbeca1d46d25 tempest-CreateVolumesFromSnapshotTest-6647266 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-bde357d6-40c1-45b3-a542-0ad0e99c733f" returned: 0 in 1.032s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:18:08 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-1577d7b1-6984-417b-a122-dbeca1d46d25 tempest-CreateVolumesFromSnapshotTest-6647266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-bde357d6-40c1-45b3-a542-0ad0e99c733f {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:18:08 devstack sudo[96549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-bde357d6-40c1-45b3-a542-0ad0e99c733f Aug 05 06:18:08 devstack sudo[96549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:18:08 devstack sudo[96516]: pam_unix(sudo:session): session closed for user root Aug 05 06:18:08 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-f9f51c81-8baf-4e20-94d0-ce2f70a29d68 tempest-GroupSnapshotsTest-1900443889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-3af399bf-7c2f-4f6a-975c-6c6e301aeb99 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-119ac236-0259-4684-b573-f6f2a49c0208" returned: 0 in 5.717s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:18:08 devstack cinder-volume[88695]: DEBUG cinder.image.image_utils [None req-f9f51c81-8baf-4e20-94d0-ce2f70a29d68 tempest-GroupSnapshotsTest-1900443889 None] Image conversion details: src /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-3af399bf-7c2f-4f6a-975c-6c6e301aeb99, size 1024.00 MB, duration 5.72 sec, destination /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-119ac236-0259-4684-b573-f6f2a49c0208 {{(pid=88695) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 05 06:18:08 devstack cinder-volume[88695]: INFO cinder.image.image_utils [None req-f9f51c81-8baf-4e20-94d0-ce2f70a29d68 tempest-GroupSnapshotsTest-1900443889 None] Converted 1024.00 MB image at 179.06 MB/s Aug 05 06:18:08 devstack cinder-volume[88695]: WARNING cinder.volume.drivers.remotefs [None req-f9f51c81-8baf-4e20-94d0-ce2f70a29d68 tempest-GroupSnapshotsTest-1900443889 None] /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-119ac236-0259-4684-b573-f6f2a49c0208 is being set with open permissions: ugo+rw: NotImplementedError Aug 05 06:18:08 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-f9f51c81-8baf-4e20-94d0-ce2f70a29d68 tempest-GroupSnapshotsTest-1900443889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-119ac236-0259-4684-b573-f6f2a49c0208 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:18:08 devstack sudo[96552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-119ac236-0259-4684-b573-f6f2a49c0208 Aug 05 06:18:08 devstack sudo[96552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:18:08 devstack sudo[96549]: pam_unix(sudo:session): session closed for user root Aug 05 06:18:08 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-1577d7b1-6984-417b-a122-dbeca1d46d25 tempest-CreateVolumesFromSnapshotTest-6647266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-bde357d6-40c1-45b3-a542-0ad0e99c733f" returned: 0 in 0.576s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:18:08 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-1577d7b1-6984-417b-a122-dbeca1d46d25 tempest-CreateVolumesFromSnapshotTest-6647266 None] Lock "cinder-quobyte-bde357d6-40c1-45b3-a542-0ad0e99c733f" released by "delete_volume" :: held 1.688s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:18:08 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-1577d7b1-6984-417b-a122-dbeca1d46d25 tempest-CreateVolumesFromSnapshotTest-6647266 None] Created reservations ['6daf7162-a550-49e7-95c4-915d20194570', '29e6bad5-62cc-4275-8c5d-274165749b0c', 'baf99f7a-78c8-4f4d-971d-f3fc2479990b', '20571baf-0b2b-421c-b328-34c361c4b12f'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:18:08 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-1577d7b1-6984-417b-a122-dbeca1d46d25 tempest-CreateVolumesFromSnapshotTest-6647266 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:18:08 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-1577d7b1-6984-417b-a122-dbeca1d46d25 tempest-CreateVolumesFromSnapshotTest-6647266 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:18:08 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-1577d7b1-6984-417b-a122-dbeca1d46d25 tempest-CreateVolumesFromSnapshotTest-6647266 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:18:08 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-1577d7b1-6984-417b-a122-dbeca1d46d25 tempest-CreateVolumesFromSnapshotTest-6647266 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:18:08 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-1577d7b1-6984-417b-a122-dbeca1d46d25 tempest-CreateVolumesFromSnapshotTest-6647266 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:18:08 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-1577d7b1-6984-417b-a122-dbeca1d46d25 tempest-CreateVolumesFromSnapshotTest-6647266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:18:08 devstack sudo[96554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce Aug 05 06:18:08 devstack sudo[96554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:18:08 devstack sudo[96552]: pam_unix(sudo:session): session closed for user root Aug 05 06:18:08 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-f9f51c81-8baf-4e20-94d0-ce2f70a29d68 tempest-GroupSnapshotsTest-1900443889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-119ac236-0259-4684-b573-f6f2a49c0208" returned: 0 in 0.279s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:18:08 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-f9f51c81-8baf-4e20-94d0-ce2f70a29d68 tempest-GroupSnapshotsTest-1900443889 None] Lock "cinder-quobyte-119ac236-0259-4684-b573-f6f2a49c0208" released by "_copy_volume_from_snapshot" :: held 7.263s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:18:08 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-f9f51c81-8baf-4e20-94d0-ce2f70a29d68 tempest-GroupSnapshotsTest-1900443889 None] Lock "cinder-quobyte-fa1c43b1-351b-4eac-8fb0-43fb0901af62-119ac236-0259-4684-b573-f6f2a49c0208" released by "_create_volume_from_snapshot" :: held 7.362s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:18:08 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-f9f51c81-8baf-4e20-94d0-ce2f70a29d68 tempest-GroupSnapshotsTest-1900443889 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.412s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:18:08 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-53f0da5d-9b1a-449d-9019-9c9faeb72727 tempest-VolumesSnapshotTestJSON-1364937772 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.477s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:18:09 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-53f0da5d-9b1a-449d-9019-9c9faeb72727 tempest-VolumesSnapshotTestJSON-1364937772 None] Creating offline snapshot c3e443f7-f1bb-4dae-8958-5f59eb96d927 of volume 9ab0b058-7dd3-499c-9824-bdb6e6ee4619 {{(pid=88695) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 06:18:09 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a62e452-a3db-4dd5-9413-476f21fd3578]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:18:09 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-53f0da5d-9b1a-449d-9019-9c9faeb72727 tempest-VolumesSnapshotTestJSON-1364937772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9ab0b058-7dd3-499c-9824-bdb6e6ee4619 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:18:09 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-f9f51c81-8baf-4e20-94d0-ce2f70a29d68 tempest-GroupSnapshotsTest-1900443889 None] Create group from source-snapshot-5987e81c-0460-435c-b59e-eff323c33af7 completed successfully. Aug 05 06:18:09 devstack sudo[96554]: pam_unix(sudo:session): session closed for user root Aug 05 06:18:09 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-1577d7b1-6984-417b-a122-dbeca1d46d25 tempest-CreateVolumesFromSnapshotTest-6647266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce" returned: 0 in 0.272s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:18:09 devstack cinder-volume[88695]: DEBUG cinder.manager [None req-1577d7b1-6984-417b-a122-dbeca1d46d25 tempest-CreateVolumesFromSnapshotTest-6647266 None] Notifying Schedulers of capabilities ... {{(pid=88695) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 06:18:09 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-1577d7b1-6984-417b-a122-dbeca1d46d25 tempest-CreateVolumesFromSnapshotTest-6647266 None] Deleted volume successfully. Aug 05 06:18:09 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-1577d7b1-6984-417b-a122-dbeca1d46d25 tempest-CreateVolumesFromSnapshotTest-6647266 None] Lock "cinder-bde357d6-40c1-45b3-a542-0ad0e99c733f-delete_volume" released by "delete_volume" :: held 2.222s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:18:09 devstack sudo[96557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9ab0b058-7dd3-499c-9824-bdb6e6ee4619 Aug 05 06:18:09 devstack sudo[96557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:18:09 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-044b9219-a688-4f55-b5a8-cc014736989d tempest-CreateVolumesFromSnapshotTest-6647266 None] Acquiring lock "cinder-af65a6f1-a4d3-4424-8ddb-a7646e4568a0-delete_volume" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:18:09 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-044b9219-a688-4f55-b5a8-cc014736989d tempest-CreateVolumesFromSnapshotTest-6647266 None] Lock "cinder-af65a6f1-a4d3-4424-8ddb-a7646e4568a0-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:18:09 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-044b9219-a688-4f55-b5a8-cc014736989d tempest-CreateVolumesFromSnapshotTest-6647266 None] Acquiring lock "cinder-quobyte-af65a6f1-a4d3-4424-8ddb-a7646e4568a0" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:18:09 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-044b9219-a688-4f55-b5a8-cc014736989d tempest-CreateVolumesFromSnapshotTest-6647266 None] Lock "cinder-quobyte-af65a6f1-a4d3-4424-8ddb-a7646e4568a0" acquired by "delete_volume" :: waited 0.017s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:18:09 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[219c5249-8fca-4a95-9e8a-590d6e17edea]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:18:09 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-044b9219-a688-4f55-b5a8-cc014736989d tempest-CreateVolumesFromSnapshotTest-6647266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-af65a6f1-a4d3-4424-8ddb-a7646e4568a0 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:18:09 devstack sudo[96557]: pam_unix(sudo:session): session closed for user root Aug 05 06:18:09 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-53f0da5d-9b1a-449d-9019-9c9faeb72727 tempest-VolumesSnapshotTestJSON-1364937772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9ab0b058-7dd3-499c-9824-bdb6e6ee4619" returned: 0 in 0.436s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:18:09 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-53f0da5d-9b1a-449d-9019-9c9faeb72727 tempest-VolumesSnapshotTestJSON-1364937772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9ab0b058-7dd3-499c-9824-bdb6e6ee4619,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9ab0b058-7dd3-499c-9824-bdb6e6ee4619.c3e443f7-f1bb-4dae-8958-5f59eb96d927 1G {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:18:09 devstack sudo[96564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9ab0b058-7dd3-499c-9824-bdb6e6ee4619,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9ab0b058-7dd3-499c-9824-bdb6e6ee4619.c3e443f7-f1bb-4dae-8958-5f59eb96d927 1G Aug 05 06:18:09 devstack sudo[96564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:18:09 devstack sudo[96562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-af65a6f1-a4d3-4424-8ddb-a7646e4568a0 Aug 05 06:18:09 devstack sudo[96562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:18:09 devstack sudo[96562]: pam_unix(sudo:session): session closed for user root Aug 05 06:18:09 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-044b9219-a688-4f55-b5a8-cc014736989d tempest-CreateVolumesFromSnapshotTest-6647266 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-af65a6f1-a4d3-4424-8ddb-a7646e4568a0" returned: 0 in 0.391s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:18:09 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-044b9219-a688-4f55-b5a8-cc014736989d tempest-CreateVolumesFromSnapshotTest-6647266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-af65a6f1-a4d3-4424-8ddb-a7646e4568a0 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:18:09 devstack sudo[96574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-af65a6f1-a4d3-4424-8ddb-a7646e4568a0 Aug 05 06:18:09 devstack sudo[96574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:18:09 devstack sudo[96564]: pam_unix(sudo:session): session closed for user root Aug 05 06:18:09 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-53f0da5d-9b1a-449d-9019-9c9faeb72727 tempest-VolumesSnapshotTestJSON-1364937772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9ab0b058-7dd3-499c-9824-bdb6e6ee4619,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9ab0b058-7dd3-499c-9824-bdb6e6ee4619.c3e443f7-f1bb-4dae-8958-5f59eb96d927 1G" returned: 0 in 0.471s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:18:09 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-53f0da5d-9b1a-449d-9019-9c9faeb72727 tempest-VolumesSnapshotTestJSON-1364937772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ab0b058-7dd3-499c-9824-bdb6e6ee4619 -F qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9ab0b058-7dd3-499c-9824-bdb6e6ee4619.c3e443f7-f1bb-4dae-8958-5f59eb96d927 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:18:09 devstack sudo[96579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ab0b058-7dd3-499c-9824-bdb6e6ee4619 -F qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9ab0b058-7dd3-499c-9824-bdb6e6ee4619.c3e443f7-f1bb-4dae-8958-5f59eb96d927 Aug 05 06:18:09 devstack sudo[96579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:18:10 devstack sudo[96574]: pam_unix(sudo:session): session closed for user root Aug 05 06:18:10 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-044b9219-a688-4f55-b5a8-cc014736989d tempest-CreateVolumesFromSnapshotTest-6647266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-af65a6f1-a4d3-4424-8ddb-a7646e4568a0" returned: 0 in 0.323s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:18:10 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-044b9219-a688-4f55-b5a8-cc014736989d tempest-CreateVolumesFromSnapshotTest-6647266 None] Lock "cinder-quobyte-af65a6f1-a4d3-4424-8ddb-a7646e4568a0" released by "delete_volume" :: held 0.764s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:18:10 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-044b9219-a688-4f55-b5a8-cc014736989d tempest-CreateVolumesFromSnapshotTest-6647266 None] Created reservations ['0d531723-d45b-4300-ad6d-af7704911589', '96ad3ab5-2cf3-4509-aaee-34b3eadd4df0', '99897026-1701-4c32-a724-9b61296bb046', 'c0020d2d-06d9-46e1-8ce9-1c511f49ad26'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:18:10 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-044b9219-a688-4f55-b5a8-cc014736989d tempest-CreateVolumesFromSnapshotTest-6647266 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:18:10 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-044b9219-a688-4f55-b5a8-cc014736989d tempest-CreateVolumesFromSnapshotTest-6647266 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:18:10 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-044b9219-a688-4f55-b5a8-cc014736989d tempest-CreateVolumesFromSnapshotTest-6647266 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:18:10 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-044b9219-a688-4f55-b5a8-cc014736989d tempest-CreateVolumesFromSnapshotTest-6647266 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:18:10 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-044b9219-a688-4f55-b5a8-cc014736989d tempest-CreateVolumesFromSnapshotTest-6647266 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:18:10 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-044b9219-a688-4f55-b5a8-cc014736989d tempest-CreateVolumesFromSnapshotTest-6647266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:18:10 devstack sudo[96585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce Aug 05 06:18:10 devstack sudo[96585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:18:10 devstack sudo[96579]: pam_unix(sudo:session): session closed for user root Aug 05 06:18:10 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-53f0da5d-9b1a-449d-9019-9c9faeb72727 tempest-VolumesSnapshotTestJSON-1364937772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ab0b058-7dd3-499c-9824-bdb6e6ee4619 -F qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9ab0b058-7dd3-499c-9824-bdb6e6ee4619.c3e443f7-f1bb-4dae-8958-5f59eb96d927" returned: 0 in 0.460s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:18:10 devstack cinder-volume[88695]: WARNING cinder.volume.drivers.remotefs [None req-53f0da5d-9b1a-449d-9019-9c9faeb72727 tempest-VolumesSnapshotTestJSON-1364937772 None] /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9ab0b058-7dd3-499c-9824-bdb6e6ee4619.c3e443f7-f1bb-4dae-8958-5f59eb96d927 is being set with open permissions: ugo+rw Aug 05 06:18:10 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-53f0da5d-9b1a-449d-9019-9c9faeb72727 tempest-VolumesSnapshotTestJSON-1364937772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9ab0b058-7dd3-499c-9824-bdb6e6ee4619.c3e443f7-f1bb-4dae-8958-5f59eb96d927 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:18:10 devstack sudo[96587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9ab0b058-7dd3-499c-9824-bdb6e6ee4619.c3e443f7-f1bb-4dae-8958-5f59eb96d927 Aug 05 06:18:10 devstack sudo[96587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:18:10 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-f8a27da5-cb6d-4a36-84c0-c29ef55aea1e tempest-CreateVolumesFromSnapshotTest-6647266 None] Acquiring lock "cinder-e62715ce-f2c7-4341-9dde-e241f0c6bc17-delete_volume" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:18:10 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-f8a27da5-cb6d-4a36-84c0-c29ef55aea1e tempest-CreateVolumesFromSnapshotTest-6647266 None] Lock "cinder-e62715ce-f2c7-4341-9dde-e241f0c6bc17-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:18:10 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-104ccf83-e02c-422b-9aa2-0bcadb68344a tempest-GroupSnapshotsTest-1900443889 None] Acquiring lock "cinder-quobyte-119ac236-0259-4684-b573-f6f2a49c0208" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:18:10 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-104ccf83-e02c-422b-9aa2-0bcadb68344a tempest-GroupSnapshotsTest-1900443889 None] Lock "cinder-quobyte-119ac236-0259-4684-b573-f6f2a49c0208" acquired by "delete_volume" :: waited 0.034s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:18:10 devstack sudo[96585]: pam_unix(sudo:session): session closed for user root Aug 05 06:18:10 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-044b9219-a688-4f55-b5a8-cc014736989d tempest-CreateVolumesFromSnapshotTest-6647266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce" returned: 0 in 0.372s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:18:10 devstack cinder-volume[88695]: DEBUG cinder.manager [None req-044b9219-a688-4f55-b5a8-cc014736989d tempest-CreateVolumesFromSnapshotTest-6647266 None] Notifying Schedulers of capabilities ... {{(pid=88695) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 06:18:10 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ca339a8-6b46-4194-8141-5ae72fd5a5a0]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:18:10 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-044b9219-a688-4f55-b5a8-cc014736989d tempest-CreateVolumesFromSnapshotTest-6647266 None] Deleted volume successfully. Aug 05 06:18:10 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-104ccf83-e02c-422b-9aa2-0bcadb68344a tempest-GroupSnapshotsTest-1900443889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-119ac236-0259-4684-b573-f6f2a49c0208 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:18:10 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-f8a27da5-cb6d-4a36-84c0-c29ef55aea1e tempest-CreateVolumesFromSnapshotTest-6647266 None] Acquiring lock "cinder-quobyte-e62715ce-f2c7-4341-9dde-e241f0c6bc17" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:18:10 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-f8a27da5-cb6d-4a36-84c0-c29ef55aea1e tempest-CreateVolumesFromSnapshotTest-6647266 None] Lock "cinder-quobyte-e62715ce-f2c7-4341-9dde-e241f0c6bc17" acquired by "delete_volume" :: waited 0.038s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:18:10 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-044b9219-a688-4f55-b5a8-cc014736989d tempest-CreateVolumesFromSnapshotTest-6647266 None] Lock "cinder-af65a6f1-a4d3-4424-8ddb-a7646e4568a0-delete_volume" released by "delete_volume" :: held 1.462s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:18:10 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfc637e5-b171-48a8-83bd-efc74809099d]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:18:10 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-f8a27da5-cb6d-4a36-84c0-c29ef55aea1e tempest-CreateVolumesFromSnapshotTest-6647266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-e62715ce-f2c7-4341-9dde-e241f0c6bc17 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:18:10 devstack sudo[96587]: pam_unix(sudo:session): session closed for user root Aug 05 06:18:10 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-53f0da5d-9b1a-449d-9019-9c9faeb72727 tempest-VolumesSnapshotTestJSON-1364937772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9ab0b058-7dd3-499c-9824-bdb6e6ee4619.c3e443f7-f1bb-4dae-8958-5f59eb96d927" returned: 0 in 0.435s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:18:10 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-53f0da5d-9b1a-449d-9019-9c9faeb72727 tempest-VolumesSnapshotTestJSON-1364937772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9ab0b058-7dd3-499c-9824-bdb6e6ee4619.info {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:18:10 devstack sudo[96592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-119ac236-0259-4684-b573-f6f2a49c0208 Aug 05 06:18:10 devstack sudo[96592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:18:10 devstack sudo[96595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9ab0b058-7dd3-499c-9824-bdb6e6ee4619.info Aug 05 06:18:10 devstack sudo[96595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:18:10 devstack sudo[96594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-e62715ce-f2c7-4341-9dde-e241f0c6bc17 Aug 05 06:18:10 devstack sudo[96594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:18:11 devstack sudo[96595]: pam_unix(sudo:session): session closed for user root Aug 05 06:18:11 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-53f0da5d-9b1a-449d-9019-9c9faeb72727 tempest-VolumesSnapshotTestJSON-1364937772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9ab0b058-7dd3-499c-9824-bdb6e6ee4619.info" returned: 0 in 0.346s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:18:11 devstack cinder-volume[88695]: WARNING cinder.volume.drivers.remotefs [None req-53f0da5d-9b1a-449d-9019-9c9faeb72727 tempest-VolumesSnapshotTestJSON-1364937772 None] /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9ab0b058-7dd3-499c-9824-bdb6e6ee4619.info is being set with open permissions: ugo+rw Aug 05 06:18:11 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-53f0da5d-9b1a-449d-9019-9c9faeb72727 tempest-VolumesSnapshotTestJSON-1364937772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9ab0b058-7dd3-499c-9824-bdb6e6ee4619.info {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:18:11 devstack sudo[96592]: pam_unix(sudo:session): session closed for user root Aug 05 06:18:11 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-104ccf83-e02c-422b-9aa2-0bcadb68344a tempest-GroupSnapshotsTest-1900443889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-119ac236-0259-4684-b573-f6f2a49c0208" returned: 0 in 0.536s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:18:11 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-104ccf83-e02c-422b-9aa2-0bcadb68344a tempest-GroupSnapshotsTest-1900443889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-119ac236-0259-4684-b573-f6f2a49c0208 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:18:11 devstack sudo[96606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9ab0b058-7dd3-499c-9824-bdb6e6ee4619.info Aug 05 06:18:11 devstack sudo[96606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:18:11 devstack sudo[96607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-119ac236-0259-4684-b573-f6f2a49c0208 Aug 05 06:18:11 devstack sudo[96607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:18:11 devstack sudo[96594]: pam_unix(sudo:session): session closed for user root Aug 05 06:18:11 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-f8a27da5-cb6d-4a36-84c0-c29ef55aea1e tempest-CreateVolumesFromSnapshotTest-6647266 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-e62715ce-f2c7-4341-9dde-e241f0c6bc17" returned: 0 in 0.485s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:18:11 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-f8a27da5-cb6d-4a36-84c0-c29ef55aea1e tempest-CreateVolumesFromSnapshotTest-6647266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-e62715ce-f2c7-4341-9dde-e241f0c6bc17 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:18:11 devstack sudo[96610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-e62715ce-f2c7-4341-9dde-e241f0c6bc17 Aug 05 06:18:11 devstack sudo[96610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:18:11 devstack sudo[96610]: pam_unix(sudo:session): session closed for user root Aug 05 06:18:11 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-f8a27da5-cb6d-4a36-84c0-c29ef55aea1e tempest-CreateVolumesFromSnapshotTest-6647266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-e62715ce-f2c7-4341-9dde-e241f0c6bc17" returned: 0 in 0.307s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:18:11 devstack sudo[96606]: pam_unix(sudo:session): session closed for user root Aug 05 06:18:11 devstack sudo[96607]: pam_unix(sudo:session): session closed for user root Aug 05 06:18:11 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-f8a27da5-cb6d-4a36-84c0-c29ef55aea1e tempest-CreateVolumesFromSnapshotTest-6647266 None] Lock "cinder-quobyte-e62715ce-f2c7-4341-9dde-e241f0c6bc17" released by "delete_volume" :: held 0.864s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:18:11 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-53f0da5d-9b1a-449d-9019-9c9faeb72727 tempest-VolumesSnapshotTestJSON-1364937772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9ab0b058-7dd3-499c-9824-bdb6e6ee4619.info" returned: 0 in 0.410s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:18:11 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-53f0da5d-9b1a-449d-9019-9c9faeb72727 tempest-VolumesSnapshotTestJSON-1364937772 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.682s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:18:11 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-104ccf83-e02c-422b-9aa2-0bcadb68344a tempest-GroupSnapshotsTest-1900443889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-119ac236-0259-4684-b573-f6f2a49c0208" returned: 0 in 0.429s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:18:11 devstack cinder-volume[88695]: DEBUG dbcounter [-] [88695] Writing DB stats cinder:SELECT=119,cinder:UPDATE=129,cinder:DELETE=11,cinder:INSERT=30 {{(pid=88695) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 06:18:11 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-104ccf83-e02c-422b-9aa2-0bcadb68344a tempest-GroupSnapshotsTest-1900443889 None] Lock "cinder-quobyte-119ac236-0259-4684-b573-f6f2a49c0208" released by "delete_volume" :: held 1.066s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:18:11 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-53f0da5d-9b1a-449d-9019-9c9faeb72727 tempest-VolumesSnapshotTestJSON-1364937772 None] Create snapshot completed successfully Aug 05 06:18:11 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-f8a27da5-cb6d-4a36-84c0-c29ef55aea1e tempest-CreateVolumesFromSnapshotTest-6647266 None] Created reservations ['7a27c0f7-3584-4533-bac8-7fd2fbe8bc9f', 'f1a0cfe6-77df-4a11-92f6-0e56dfc29b49', 'f26847c0-a622-4a38-ba79-c874e40de107', '391650c2-e909-4b96-8427-0c91812bf8e0'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:18:11 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-104ccf83-e02c-422b-9aa2-0bcadb68344a tempest-GroupSnapshotsTest-1900443889 None] Created reservations ['1baff156-4cb9-4731-9a5a-56e273202a0e'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:18:11 devstack cinder-volume[88695]: WARNING cinder.quota [None req-104ccf83-e02c-422b-9aa2-0bcadb68344a tempest-GroupSnapshotsTest-1900443889 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1266385959 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1266385959, it is now deprecated. Please use the default quota class for default quota. Aug 05 06:18:11 devstack cinder-volume[88695]: WARNING cinder.quota [None req-104ccf83-e02c-422b-9aa2-0bcadb68344a tempest-GroupSnapshotsTest-1900443889 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1266385959 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1266385959, it is now deprecated. Please use the default quota class for default quota. Aug 05 06:18:11 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-f8a27da5-cb6d-4a36-84c0-c29ef55aea1e tempest-CreateVolumesFromSnapshotTest-6647266 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:18:11 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-f8a27da5-cb6d-4a36-84c0-c29ef55aea1e tempest-CreateVolumesFromSnapshotTest-6647266 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:18:11 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-f8a27da5-cb6d-4a36-84c0-c29ef55aea1e tempest-CreateVolumesFromSnapshotTest-6647266 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:18:11 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-f8a27da5-cb6d-4a36-84c0-c29ef55aea1e tempest-CreateVolumesFromSnapshotTest-6647266 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:18:11 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-f8a27da5-cb6d-4a36-84c0-c29ef55aea1e tempest-CreateVolumesFromSnapshotTest-6647266 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:18:11 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-f8a27da5-cb6d-4a36-84c0-c29ef55aea1e tempest-CreateVolumesFromSnapshotTest-6647266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:18:11 devstack sudo[96619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce Aug 05 06:18:11 devstack sudo[96619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:18:11 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-104ccf83-e02c-422b-9aa2-0bcadb68344a tempest-GroupSnapshotsTest-1900443889 None] Created reservations ['f39d4b92-2201-47ea-a054-e21c2f1c9920', '21f9a012-dd39-40d7-8e5b-64417f3abd24', '6a92ede6-f401-4e79-8c6e-19fdd19db567', 'ddf60251-cffc-460f-96e5-335e23d7fddb'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:18:12 devstack cinder-volume[88695]: DEBUG dbcounter [-] [88695] Writing DB stats cinder:SELECT=128,cinder:INSERT=34,cinder:UPDATE=153,cinder:DELETE=14 {{(pid=88695) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 06:18:12 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-104ccf83-e02c-422b-9aa2-0bcadb68344a tempest-GroupSnapshotsTest-1900443889 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:18:12 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-104ccf83-e02c-422b-9aa2-0bcadb68344a tempest-GroupSnapshotsTest-1900443889 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:18:12 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-104ccf83-e02c-422b-9aa2-0bcadb68344a tempest-GroupSnapshotsTest-1900443889 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:18:12 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-104ccf83-e02c-422b-9aa2-0bcadb68344a tempest-GroupSnapshotsTest-1900443889 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:18:12 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-104ccf83-e02c-422b-9aa2-0bcadb68344a tempest-GroupSnapshotsTest-1900443889 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:18:12 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-104ccf83-e02c-422b-9aa2-0bcadb68344a tempest-GroupSnapshotsTest-1900443889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:18:12 devstack sudo[96628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce Aug 05 06:18:12 devstack sudo[96628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:18:12 devstack sudo[96619]: pam_unix(sudo:session): session closed for user root Aug 05 06:18:12 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-f8a27da5-cb6d-4a36-84c0-c29ef55aea1e tempest-CreateVolumesFromSnapshotTest-6647266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce" returned: 0 in 0.418s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:18:12 devstack cinder-volume[88695]: DEBUG cinder.manager [None req-f8a27da5-cb6d-4a36-84c0-c29ef55aea1e tempest-CreateVolumesFromSnapshotTest-6647266 None] Notifying Schedulers of capabilities ... {{(pid=88695) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 06:18:12 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-f8a27da5-cb6d-4a36-84c0-c29ef55aea1e tempest-CreateVolumesFromSnapshotTest-6647266 None] Deleted volume successfully. Aug 05 06:18:12 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-f8a27da5-cb6d-4a36-84c0-c29ef55aea1e tempest-CreateVolumesFromSnapshotTest-6647266 None] Lock "cinder-e62715ce-f2c7-4341-9dde-e241f0c6bc17-delete_volume" released by "delete_volume" :: held 1.803s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:18:12 devstack sudo[96628]: pam_unix(sudo:session): session closed for user root Aug 05 06:18:12 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-104ccf83-e02c-422b-9aa2-0bcadb68344a tempest-GroupSnapshotsTest-1900443889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce" returned: 0 in 0.379s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:18:12 devstack cinder-volume[88695]: DEBUG cinder.manager [None req-104ccf83-e02c-422b-9aa2-0bcadb68344a tempest-GroupSnapshotsTest-1900443889 None] Notifying Schedulers of capabilities ... {{(pid=88695) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 06:18:12 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-104ccf83-e02c-422b-9aa2-0bcadb68344a tempest-GroupSnapshotsTest-1900443889 None] Delete group completed successfully. Aug 05 06:18:12 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-0fbe9733-02f3-4399-bff8-9a7c5013d4f4 tempest-CreateVolumesFromSnapshotTest-6647266 None] Acquiring lock "cinder-33ab530e-8bf9-4f14-83f2-4a93863a479d-delete_snapshot" by "delete_snapshot" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:18:12 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-0fbe9733-02f3-4399-bff8-9a7c5013d4f4 tempest-CreateVolumesFromSnapshotTest-6647266 None] Lock "cinder-33ab530e-8bf9-4f14-83f2-4a93863a479d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:18:12 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-0fbe9733-02f3-4399-bff8-9a7c5013d4f4 tempest-CreateVolumesFromSnapshotTest-6647266 None] Acquiring lock "cinder-quobyte-c5b77965-8f02-4906-8558-6748c2f65262" by "delete_snapshot" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:18:12 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-0fbe9733-02f3-4399-bff8-9a7c5013d4f4 tempest-CreateVolumesFromSnapshotTest-6647266 None] Lock "cinder-quobyte-c5b77965-8f02-4906-8558-6748c2f65262" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:18:12 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-0fbe9733-02f3-4399-bff8-9a7c5013d4f4 tempest-CreateVolumesFromSnapshotTest-6647266 None] Acquiring lock "cinder-quobyte-33ab530e-8bf9-4f14-83f2-4a93863a479d" by "_delete_snapshot" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:18:12 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-0fbe9733-02f3-4399-bff8-9a7c5013d4f4 tempest-CreateVolumesFromSnapshotTest-6647266 None] Lock "cinder-quobyte-33ab530e-8bf9-4f14-83f2-4a93863a479d" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:18:12 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-0fbe9733-02f3-4399-bff8-9a7c5013d4f4 tempest-CreateVolumesFromSnapshotTest-6647266 None] Deleting offline snapshot 33ab530e-8bf9-4f14-83f2-4a93863a479d of volume c5b77965-8f02-4906-8558-6748c2f65262 {{(pid=88695) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 06:18:12 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-0fbe9733-02f3-4399-bff8-9a7c5013d4f4 tempest-CreateVolumesFromSnapshotTest-6647266 None] snapshot_file for this snap is: volume-c5b77965-8f02-4906-8558-6748c2f65262.33ab530e-8bf9-4f14-83f2-4a93863a479d {{(pid=88695) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 06:18:12 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[79f2a6f0-e0eb-4777-9eb8-6bc8be3bf410]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:18:12 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-0fbe9733-02f3-4399-bff8-9a7c5013d4f4 tempest-CreateVolumesFromSnapshotTest-6647266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-c5b77965-8f02-4906-8558-6748c2f65262.33ab530e-8bf9-4f14-83f2-4a93863a479d {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:18:13 devstack cinder-volume[88695]: DEBUG cinder.volume.flows.manager.create_volume [None req-dbdf5ca8-78e0-4fdd-8384-82907916a987 tempest-VolumesSnapshotTestJSON-1364937772 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88695) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 06:18:13 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-dbdf5ca8-78e0-4fdd-8384-82907916a987 tempest-VolumesSnapshotTestJSON-1364937772 None] Flow 'volume_create_manager' (0b8ca54b-8a3c-45f7-a034-c1a1d5138329) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:18:13 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-dbdf5ca8-78e0-4fdd-8384-82907916a987 tempest-VolumesSnapshotTestJSON-1364937772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (676f2cf9-6aa2-4ba0-a2e9-6774aff3ca82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:18:13 devstack sudo[96638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-c5b77965-8f02-4906-8558-6748c2f65262.33ab530e-8bf9-4f14-83f2-4a93863a479d Aug 05 06:18:13 devstack sudo[96638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:18:13 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-dbdf5ca8-78e0-4fdd-8384-82907916a987 tempest-VolumesSnapshotTestJSON-1364937772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (676f2cf9-6aa2-4ba0-a2e9-6774aff3ca82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:18:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-990860619',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1c19266-9b97-4257-91ae-59532d518a58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f87c02595984b10b4b2ed8e5d9cb883',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:18:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=c3e443f7-f1bb-4dae-8958-5f59eb96d927,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:18:13Z,use_quota=True,user_id='0566fcce709945bf9523b15b9d04dfc1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:18:13 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-dbdf5ca8-78e0-4fdd-8384-82907916a987 tempest-VolumesSnapshotTestJSON-1364937772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db49963c-5b0f-4770-afc4-9597872e41c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:18:13 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-dbdf5ca8-78e0-4fdd-8384-82907916a987 tempest-VolumesSnapshotTestJSON-1364937772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db49963c-5b0f-4770-afc4-9597872e41c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:18:13 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-dbdf5ca8-78e0-4fdd-8384-82907916a987 tempest-VolumesSnapshotTestJSON-1364937772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50fb2a06-9cfc-4c81-88d0-266398cd7cfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:18:13 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-dbdf5ca8-78e0-4fdd-8384-82907916a987 tempest-VolumesSnapshotTestJSON-1364937772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50fb2a06-9cfc-4c81-88d0-266398cd7cfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'e1c19266-9b97-4257-91ae-59532d518a58', 'volume_name': 'volume-e1c19266-9b97-4257-91ae-59532d518a58', 'volume_size': 1, 'snapshot_id': 'c3e443f7-f1bb-4dae-8958-5f59eb96d927'}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:18:13 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-dbdf5ca8-78e0-4fdd-8384-82907916a987 tempest-VolumesSnapshotTestJSON-1364937772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be36f0e0-f60b-4204-b182-91369035293e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:18:13 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-dbdf5ca8-78e0-4fdd-8384-82907916a987 tempest-VolumesSnapshotTestJSON-1364937772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be36f0e0-f60b-4204-b182-91369035293e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:18:13 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-dbdf5ca8-78e0-4fdd-8384-82907916a987 tempest-VolumesSnapshotTestJSON-1364937772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9e9f33e-9237-487e-9aa0-173a12e9ff4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:18:13 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-dbdf5ca8-78e0-4fdd-8384-82907916a987 tempest-VolumesSnapshotTestJSON-1364937772 None] Volume e1c19266-9b97-4257-91ae-59532d518a58: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-e1c19266-9b97-4257-91ae-59532d518a58', 'volume_size': 1, 'snapshot_id': 'c3e443f7-f1bb-4dae-8958-5f59eb96d927'} Aug 05 06:18:13 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-dbdf5ca8-78e0-4fdd-8384-82907916a987 tempest-VolumesSnapshotTestJSON-1364937772 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:18:13 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-dbdf5ca8-78e0-4fdd-8384-82907916a987 tempest-VolumesSnapshotTestJSON-1364937772 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:18:13 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-dbdf5ca8-78e0-4fdd-8384-82907916a987 tempest-VolumesSnapshotTestJSON-1364937772 None] Acquiring lock "cinder-quobyte-c3e443f7-f1bb-4dae-8958-5f59eb96d927-e1c19266-9b97-4257-91ae-59532d518a58" by "_create_volume_from_snapshot" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:18:13 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-dbdf5ca8-78e0-4fdd-8384-82907916a987 tempest-VolumesSnapshotTestJSON-1364937772 None] Lock "cinder-quobyte-c3e443f7-f1bb-4dae-8958-5f59eb96d927-e1c19266-9b97-4257-91ae-59532d518a58" acquired by "_create_volume_from_snapshot" :: waited 0.020s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:18:13 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-dbdf5ca8-78e0-4fdd-8384-82907916a987 tempest-VolumesSnapshotTestJSON-1364937772 None] Creating volume e1c19266-9b97-4257-91ae-59532d518a58 from snapshot c3e443f7-f1bb-4dae-8958-5f59eb96d927 {{(pid=88695) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 05 06:18:13 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-dbdf5ca8-78e0-4fdd-8384-82907916a987 tempest-VolumesSnapshotTestJSON-1364937772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:18:13 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-dbdf5ca8-78e0-4fdd-8384-82907916a987 tempest-VolumesSnapshotTestJSON-1364937772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:18:13 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-dbdf5ca8-78e0-4fdd-8384-82907916a987 tempest-VolumesSnapshotTestJSON-1364937772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:18:13 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-dbdf5ca8-78e0-4fdd-8384-82907916a987 tempest-VolumesSnapshotTestJSON-1364937772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:18:13 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-dbdf5ca8-78e0-4fdd-8384-82907916a987 tempest-VolumesSnapshotTestJSON-1364937772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:18:13 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-dbdf5ca8-78e0-4fdd-8384-82907916a987 tempest-VolumesSnapshotTestJSON-1364937772 None] Selected osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 as target Quobyte volume. {{(pid=88695) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 06:18:13 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-dbdf5ca8-78e0-4fdd-8384-82907916a987 tempest-VolumesSnapshotTestJSON-1364937772 None] Acquiring lock "cinder-quobyte-e1c19266-9b97-4257-91ae-59532d518a58" by "_copy_volume_from_snapshot" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:18:13 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-bb1b45f9-33b1-4322-8292-132f3c9778f7 tempest-GroupSnapshotsTest-1900443889 None] group_snapshot 5987e81c-0460-435c-b59e-eff323c33af7: deleting Aug 05 06:18:13 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-dbdf5ca8-78e0-4fdd-8384-82907916a987 tempest-VolumesSnapshotTestJSON-1364937772 None] Lock "cinder-quobyte-e1c19266-9b97-4257-91ae-59532d518a58" acquired by "_copy_volume_from_snapshot" :: waited 0.039s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:18:13 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-dbdf5ca8-78e0-4fdd-8384-82907916a987 tempest-VolumesSnapshotTestJSON-1364937772 None] snapshot: c3e443f7-f1bb-4dae-8958-5f59eb96d927, volume: e1c19266-9b97-4257-91ae-59532d518a58, {{(pid=88695) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 05 06:18:13 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-bb1b45f9-33b1-4322-8292-132f3c9778f7 tempest-GroupSnapshotsTest-1900443889 None] group_snapshot 5987e81c-0460-435c-b59e-eff323c33af7: deleting {{(pid=88695) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Aug 05 06:18:13 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-dbdf5ca8-78e0-4fdd-8384-82907916a987 tempest-VolumesSnapshotTestJSON-1364937772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:18:13 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-dbdf5ca8-78e0-4fdd-8384-82907916a987 tempest-VolumesSnapshotTestJSON-1364937772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:18:13 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-dbdf5ca8-78e0-4fdd-8384-82907916a987 tempest-VolumesSnapshotTestJSON-1364937772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:18:13 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-dbdf5ca8-78e0-4fdd-8384-82907916a987 tempest-VolumesSnapshotTestJSON-1364937772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:18:13 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-dbdf5ca8-78e0-4fdd-8384-82907916a987 tempest-VolumesSnapshotTestJSON-1364937772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:18:13 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[9debca9a-e45c-4cbb-89bc-45dfe02be617]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:18:13 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-dbdf5ca8-78e0-4fdd-8384-82907916a987 tempest-VolumesSnapshotTestJSON-1364937772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9ab0b058-7dd3-499c-9824-bdb6e6ee4619.c3e443f7-f1bb-4dae-8958-5f59eb96d927 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:18:13 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-bb1b45f9-33b1-4322-8292-132f3c9778f7 tempest-GroupSnapshotsTest-1900443889 None] Acquiring lock "cinder-quobyte-3af399bf-7c2f-4f6a-975c-6c6e301aeb99" by "delete_snapshot" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:18:13 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-bb1b45f9-33b1-4322-8292-132f3c9778f7 tempest-GroupSnapshotsTest-1900443889 None] Lock "cinder-quobyte-3af399bf-7c2f-4f6a-975c-6c6e301aeb99" acquired by "delete_snapshot" :: waited 0.038s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:18:13 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-bb1b45f9-33b1-4322-8292-132f3c9778f7 tempest-GroupSnapshotsTest-1900443889 None] Acquiring lock "cinder-quobyte-fa1c43b1-351b-4eac-8fb0-43fb0901af62" by "_delete_snapshot" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:18:13 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-bb1b45f9-33b1-4322-8292-132f3c9778f7 tempest-GroupSnapshotsTest-1900443889 None] Lock "cinder-quobyte-fa1c43b1-351b-4eac-8fb0-43fb0901af62" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:18:13 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-bb1b45f9-33b1-4322-8292-132f3c9778f7 tempest-GroupSnapshotsTest-1900443889 None] Deleting offline snapshot fa1c43b1-351b-4eac-8fb0-43fb0901af62 of volume 3af399bf-7c2f-4f6a-975c-6c6e301aeb99 {{(pid=88695) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 06:18:13 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-bb1b45f9-33b1-4322-8292-132f3c9778f7 tempest-GroupSnapshotsTest-1900443889 None] snapshot_file for this snap is: volume-3af399bf-7c2f-4f6a-975c-6c6e301aeb99.fa1c43b1-351b-4eac-8fb0-43fb0901af62 {{(pid=88695) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 06:18:13 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[20ff13d6-c307-443b-be05-b0be696f54c2]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:18:13 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-bb1b45f9-33b1-4322-8292-132f3c9778f7 tempest-GroupSnapshotsTest-1900443889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-3af399bf-7c2f-4f6a-975c-6c6e301aeb99.fa1c43b1-351b-4eac-8fb0-43fb0901af62 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:18:13 devstack sudo[96640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9ab0b058-7dd3-499c-9824-bdb6e6ee4619.c3e443f7-f1bb-4dae-8958-5f59eb96d927 Aug 05 06:18:13 devstack sudo[96640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:18:13 devstack sudo[96638]: pam_unix(sudo:session): session closed for user root Aug 05 06:18:13 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-0fbe9733-02f3-4399-bff8-9a7c5013d4f4 tempest-CreateVolumesFromSnapshotTest-6647266 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-c5b77965-8f02-4906-8558-6748c2f65262.33ab530e-8bf9-4f14-83f2-4a93863a479d" returned: 0 in 0.517s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:18:13 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-0fbe9733-02f3-4399-bff8-9a7c5013d4f4 tempest-CreateVolumesFromSnapshotTest-6647266 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c5b77965-8f02-4906-8558-6748c2f65262(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88695) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 06:18:13 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[a005d7b8-bd87-4e9c-9fde-14a94c4368a3]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:18:13 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-0fbe9733-02f3-4399-bff8-9a7c5013d4f4 tempest-CreateVolumesFromSnapshotTest-6647266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-c5b77965-8f02-4906-8558-6748c2f65262 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:18:13 devstack sudo[96644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-3af399bf-7c2f-4f6a-975c-6c6e301aeb99.fa1c43b1-351b-4eac-8fb0-43fb0901af62 Aug 05 06:18:13 devstack sudo[96644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:18:13 devstack sudo[96646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-c5b77965-8f02-4906-8558-6748c2f65262 Aug 05 06:18:13 devstack sudo[96646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:18:13 devstack sudo[96640]: pam_unix(sudo:session): session closed for user root Aug 05 06:18:13 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-dbdf5ca8-78e0-4fdd-8384-82907916a987 tempest-VolumesSnapshotTestJSON-1364937772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9ab0b058-7dd3-499c-9824-bdb6e6ee4619.c3e443f7-f1bb-4dae-8958-5f59eb96d927" returned: 0 in 0.470s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:18:13 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-dbdf5ca8-78e0-4fdd-8384-82907916a987 tempest-VolumesSnapshotTestJSON-1364937772 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9ab0b058-7dd3-499c-9824-bdb6e6ee4619(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88695) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 06:18:13 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b685fc9-c7b9-459d-aff1-bed4cba5d758]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:18:13 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-dbdf5ca8-78e0-4fdd-8384-82907916a987 tempest-VolumesSnapshotTestJSON-1364937772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9ab0b058-7dd3-499c-9824-bdb6e6ee4619 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:18:13 devstack sudo[96644]: pam_unix(sudo:session): session closed for user root Aug 05 06:18:13 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-bb1b45f9-33b1-4322-8292-132f3c9778f7 tempest-GroupSnapshotsTest-1900443889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-3af399bf-7c2f-4f6a-975c-6c6e301aeb99.fa1c43b1-351b-4eac-8fb0-43fb0901af62" returned: 0 in 0.542s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:18:13 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-bb1b45f9-33b1-4322-8292-132f3c9778f7 tempest-GroupSnapshotsTest-1900443889 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3af399bf-7c2f-4f6a-975c-6c6e301aeb99(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88695) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 06:18:14 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[db524e73-0077-4bed-ab73-f951f234eda3]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:18:14 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-bb1b45f9-33b1-4322-8292-132f3c9778f7 tempest-GroupSnapshotsTest-1900443889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-3af399bf-7c2f-4f6a-975c-6c6e301aeb99 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:18:14 devstack sudo[96646]: pam_unix(sudo:session): session closed for user root Aug 05 06:18:14 devstack sudo[96655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9ab0b058-7dd3-499c-9824-bdb6e6ee4619 Aug 05 06:18:14 devstack sudo[96655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:18:14 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-0fbe9733-02f3-4399-bff8-9a7c5013d4f4 tempest-CreateVolumesFromSnapshotTest-6647266 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-c5b77965-8f02-4906-8558-6748c2f65262" returned: 0 in 0.533s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:18:14 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-0fbe9733-02f3-4399-bff8-9a7c5013d4f4 tempest-CreateVolumesFromSnapshotTest-6647266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-c5b77965-8f02-4906-8558-6748c2f65262.33ab530e-8bf9-4f14-83f2-4a93863a479d {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:18:14 devstack sudo[96662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-c5b77965-8f02-4906-8558-6748c2f65262.33ab530e-8bf9-4f14-83f2-4a93863a479d Aug 05 06:18:14 devstack sudo[96662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:18:14 devstack sudo[96660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-3af399bf-7c2f-4f6a-975c-6c6e301aeb99 Aug 05 06:18:14 devstack sudo[96660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:18:14 devstack sudo[96655]: pam_unix(sudo:session): session closed for user root Aug 05 06:18:14 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-dbdf5ca8-78e0-4fdd-8384-82907916a987 tempest-VolumesSnapshotTestJSON-1364937772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9ab0b058-7dd3-499c-9824-bdb6e6ee4619" returned: 0 in 0.539s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:18:14 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-dbdf5ca8-78e0-4fdd-8384-82907916a987 tempest-VolumesSnapshotTestJSON-1364937772 None] will copy from snapshot at /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9ab0b058-7dd3-499c-9824-bdb6e6ee4619 {{(pid=88695) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 05 06:18:14 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-dbdf5ca8-78e0-4fdd-8384-82907916a987 tempest-VolumesSnapshotTestJSON-1364937772 None] Creating direct copy from snapshot {{(pid=88695) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 05 06:18:14 devstack cinder-volume[88695]: DEBUG cinder.utils [None req-dbdf5ca8-78e0-4fdd-8384-82907916a987 tempest-VolumesSnapshotTestJSON-1364937772 None] Path /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-e1c19266-9b97-4257-91ae-59532d518a58 not found in is_blk_device check {{(pid=88695) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 05 06:18:14 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-dbdf5ca8-78e0-4fdd-8384-82907916a987 tempest-VolumesSnapshotTestJSON-1364937772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9ab0b058-7dd3-499c-9824-bdb6e6ee4619 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-e1c19266-9b97-4257-91ae-59532d518a58 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:18:14 devstack sudo[96672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9ab0b058-7dd3-499c-9824-bdb6e6ee4619 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-e1c19266-9b97-4257-91ae-59532d518a58 Aug 05 06:18:14 devstack sudo[96672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:18:14 devstack sudo[96662]: pam_unix(sudo:session): session closed for user root Aug 05 06:18:14 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-0fbe9733-02f3-4399-bff8-9a7c5013d4f4 tempest-CreateVolumesFromSnapshotTest-6647266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-c5b77965-8f02-4906-8558-6748c2f65262.33ab530e-8bf9-4f14-83f2-4a93863a479d" returned: 0 in 0.533s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:18:14 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-0fbe9733-02f3-4399-bff8-9a7c5013d4f4 tempest-CreateVolumesFromSnapshotTest-6647266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-c5b77965-8f02-4906-8558-6748c2f65262.33ab530e-8bf9-4f14-83f2-4a93863a479d {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:18:14 devstack sudo[96677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-c5b77965-8f02-4906-8558-6748c2f65262.33ab530e-8bf9-4f14-83f2-4a93863a479d Aug 05 06:18:14 devstack sudo[96677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:18:14 devstack sudo[96660]: pam_unix(sudo:session): session closed for user root Aug 05 06:18:14 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-bb1b45f9-33b1-4322-8292-132f3c9778f7 tempest-GroupSnapshotsTest-1900443889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-3af399bf-7c2f-4f6a-975c-6c6e301aeb99" returned: 0 in 0.860s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:18:14 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-bb1b45f9-33b1-4322-8292-132f3c9778f7 tempest-GroupSnapshotsTest-1900443889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-3af399bf-7c2f-4f6a-975c-6c6e301aeb99.fa1c43b1-351b-4eac-8fb0-43fb0901af62 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:18:14 devstack sudo[96683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-3af399bf-7c2f-4f6a-975c-6c6e301aeb99.fa1c43b1-351b-4eac-8fb0-43fb0901af62 Aug 05 06:18:14 devstack sudo[96683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:18:15 devstack sudo[96677]: pam_unix(sudo:session): session closed for user root Aug 05 06:18:15 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-0fbe9733-02f3-4399-bff8-9a7c5013d4f4 tempest-CreateVolumesFromSnapshotTest-6647266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-c5b77965-8f02-4906-8558-6748c2f65262.33ab530e-8bf9-4f14-83f2-4a93863a479d" returned: 0 in 0.461s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:18:15 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-0fbe9733-02f3-4399-bff8-9a7c5013d4f4 tempest-CreateVolumesFromSnapshotTest-6647266 None] Lock "cinder-quobyte-33ab530e-8bf9-4f14-83f2-4a93863a479d" released by "_delete_snapshot" :: held 2.302s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:18:15 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-0fbe9733-02f3-4399-bff8-9a7c5013d4f4 tempest-CreateVolumesFromSnapshotTest-6647266 None] Lock "cinder-quobyte-c5b77965-8f02-4906-8558-6748c2f65262" released by "delete_snapshot" :: held 2.387s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:18:15 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-0fbe9733-02f3-4399-bff8-9a7c5013d4f4 tempest-CreateVolumesFromSnapshotTest-6647266 None] Created reservations ['5a28b600-77d5-43e0-9678-fd45048dc1c2', '65ba6fbf-176f-45f8-8656-a229b69bea61', 'e101428b-8cef-4df4-9f37-7bb4916ebb6a', 'f5c5912a-24a2-4e93-ba52-d54cbf8b2c94'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:18:15 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-0fbe9733-02f3-4399-bff8-9a7c5013d4f4 tempest-CreateVolumesFromSnapshotTest-6647266 None] Delete snapshot completed successfully. Aug 05 06:18:15 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-0fbe9733-02f3-4399-bff8-9a7c5013d4f4 tempest-CreateVolumesFromSnapshotTest-6647266 None] Lock "cinder-33ab530e-8bf9-4f14-83f2-4a93863a479d-delete_snapshot" released by "delete_snapshot" :: held 2.732s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:18:16 devstack sudo[96683]: pam_unix(sudo:session): session closed for user root Aug 05 06:18:16 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-bb1b45f9-33b1-4322-8292-132f3c9778f7 tempest-GroupSnapshotsTest-1900443889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-3af399bf-7c2f-4f6a-975c-6c6e301aeb99.fa1c43b1-351b-4eac-8fb0-43fb0901af62" returned: 0 in 1.279s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:18:16 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-bb1b45f9-33b1-4322-8292-132f3c9778f7 tempest-GroupSnapshotsTest-1900443889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-3af399bf-7c2f-4f6a-975c-6c6e301aeb99.fa1c43b1-351b-4eac-8fb0-43fb0901af62 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:18:16 devstack sudo[96731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-3af399bf-7c2f-4f6a-975c-6c6e301aeb99.fa1c43b1-351b-4eac-8fb0-43fb0901af62 Aug 05 06:18:16 devstack sudo[96731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:18:16 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-0ae38556-a583-4fa1-9331-cdbe9511dcca tempest-CreateVolumesFromSnapshotTest-6647266 None] Acquiring lock "cinder-c5b77965-8f02-4906-8558-6748c2f65262-delete_volume" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:18:16 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-0ae38556-a583-4fa1-9331-cdbe9511dcca tempest-CreateVolumesFromSnapshotTest-6647266 None] Lock "cinder-c5b77965-8f02-4906-8558-6748c2f65262-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:18:16 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-0ae38556-a583-4fa1-9331-cdbe9511dcca tempest-CreateVolumesFromSnapshotTest-6647266 None] Acquiring lock "cinder-quobyte-c5b77965-8f02-4906-8558-6748c2f65262" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:18:16 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-0ae38556-a583-4fa1-9331-cdbe9511dcca tempest-CreateVolumesFromSnapshotTest-6647266 None] Lock "cinder-quobyte-c5b77965-8f02-4906-8558-6748c2f65262" acquired by "delete_volume" :: waited 0.099s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:18:16 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5c612ca-7104-47a9-a27f-446a203f2f71]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:18:16 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-0ae38556-a583-4fa1-9331-cdbe9511dcca tempest-CreateVolumesFromSnapshotTest-6647266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-c5b77965-8f02-4906-8558-6748c2f65262 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:18:17 devstack sudo[96731]: pam_unix(sudo:session): session closed for user root Aug 05 06:18:17 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-bb1b45f9-33b1-4322-8292-132f3c9778f7 tempest-GroupSnapshotsTest-1900443889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-3af399bf-7c2f-4f6a-975c-6c6e301aeb99.fa1c43b1-351b-4eac-8fb0-43fb0901af62" returned: 0 in 0.885s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:18:17 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-bb1b45f9-33b1-4322-8292-132f3c9778f7 tempest-GroupSnapshotsTest-1900443889 None] Lock "cinder-quobyte-fa1c43b1-351b-4eac-8fb0-43fb0901af62" released by "_delete_snapshot" :: held 3.748s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:18:17 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-bb1b45f9-33b1-4322-8292-132f3c9778f7 tempest-GroupSnapshotsTest-1900443889 None] Lock "cinder-quobyte-3af399bf-7c2f-4f6a-975c-6c6e301aeb99" released by "delete_snapshot" :: held 3.840s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:18:17 devstack sudo[96749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-c5b77965-8f02-4906-8558-6748c2f65262 Aug 05 06:18:17 devstack sudo[96749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:18:17 devstack cinder-volume[88695]: WARNING cinder.quota [None req-bb1b45f9-33b1-4322-8292-132f3c9778f7 tempest-GroupSnapshotsTest-1900443889 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1266385959 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1266385959, it is now deprecated. Please use the default quota class for default quota. Aug 05 06:18:17 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-bb1b45f9-33b1-4322-8292-132f3c9778f7 tempest-GroupSnapshotsTest-1900443889 None] Created reservations ['61229dc5-60eb-47f2-8c11-8e3a553e525e', 'ec06da20-98d3-46c9-b2ce-d817aac45527', '214d6e4e-674f-46cf-a9df-744b38d24d12', '6b0bb02f-c99f-42ba-9803-9e320e80426b'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:18:17 devstack sudo[96749]: pam_unix(sudo:session): session closed for user root Aug 05 06:18:17 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-0ae38556-a583-4fa1-9331-cdbe9511dcca tempest-CreateVolumesFromSnapshotTest-6647266 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-c5b77965-8f02-4906-8558-6748c2f65262" returned: 0 in 0.914s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:18:17 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-0ae38556-a583-4fa1-9331-cdbe9511dcca tempest-CreateVolumesFromSnapshotTest-6647266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-c5b77965-8f02-4906-8558-6748c2f65262 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:18:17 devstack sudo[96773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-c5b77965-8f02-4906-8558-6748c2f65262 Aug 05 06:18:17 devstack sudo[96773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:18:18 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-bb1b45f9-33b1-4322-8292-132f3c9778f7 tempest-GroupSnapshotsTest-1900443889 None] group_snapshot 5987e81c-0460-435c-b59e-eff323c33af7: deleted successfully Aug 05 06:18:18 devstack sudo[96773]: pam_unix(sudo:session): session closed for user root Aug 05 06:18:18 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-0ae38556-a583-4fa1-9331-cdbe9511dcca tempest-CreateVolumesFromSnapshotTest-6647266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-c5b77965-8f02-4906-8558-6748c2f65262" returned: 0 in 0.685s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:18:18 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-0ae38556-a583-4fa1-9331-cdbe9511dcca tempest-CreateVolumesFromSnapshotTest-6647266 None] Lock "cinder-quobyte-c5b77965-8f02-4906-8558-6748c2f65262" released by "delete_volume" :: held 1.798s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:18:18 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-0ae38556-a583-4fa1-9331-cdbe9511dcca tempest-CreateVolumesFromSnapshotTest-6647266 None] Created reservations ['2e520ef1-4eab-4612-a147-82b88cf2eea9', '152b6c2f-eee9-46bf-b775-fbe98437b9cf', 'c5158ab9-be6f-47d0-8a33-494e5d0f400f', 'bfc59b60-aac6-4e6a-b61b-5a5d17be9e7d'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:18:18 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-0ae38556-a583-4fa1-9331-cdbe9511dcca tempest-CreateVolumesFromSnapshotTest-6647266 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:18:18 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-0ae38556-a583-4fa1-9331-cdbe9511dcca tempest-CreateVolumesFromSnapshotTest-6647266 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:18:18 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-0ae38556-a583-4fa1-9331-cdbe9511dcca tempest-CreateVolumesFromSnapshotTest-6647266 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:18:19 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-0ae38556-a583-4fa1-9331-cdbe9511dcca tempest-CreateVolumesFromSnapshotTest-6647266 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:18:19 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-0ae38556-a583-4fa1-9331-cdbe9511dcca tempest-CreateVolumesFromSnapshotTest-6647266 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:18:19 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-0ae38556-a583-4fa1-9331-cdbe9511dcca tempest-CreateVolumesFromSnapshotTest-6647266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:18:19 devstack sudo[96793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce Aug 05 06:18:19 devstack sudo[96793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:18:19 devstack sudo[96793]: pam_unix(sudo:session): session closed for user root Aug 05 06:18:19 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-0ae38556-a583-4fa1-9331-cdbe9511dcca tempest-CreateVolumesFromSnapshotTest-6647266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce" returned: 0 in 0.483s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:18:19 devstack cinder-volume[88695]: DEBUG cinder.manager [None req-0ae38556-a583-4fa1-9331-cdbe9511dcca tempest-CreateVolumesFromSnapshotTest-6647266 None] Notifying Schedulers of capabilities ... {{(pid=88695) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 06:18:19 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-0ae38556-a583-4fa1-9331-cdbe9511dcca tempest-CreateVolumesFromSnapshotTest-6647266 None] Deleted volume successfully. Aug 05 06:18:19 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-0ae38556-a583-4fa1-9331-cdbe9511dcca tempest-CreateVolumesFromSnapshotTest-6647266 None] Lock "cinder-c5b77965-8f02-4906-8558-6748c2f65262-delete_volume" released by "delete_volume" :: held 3.132s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:18:20 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-b88a6995-d3dc-469f-bfbf-d4503d699927 tempest-GroupSnapshotsTest-1900443889 None] Acquiring lock "cinder-quobyte-3af399bf-7c2f-4f6a-975c-6c6e301aeb99" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:18:20 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-b88a6995-d3dc-469f-bfbf-d4503d699927 tempest-GroupSnapshotsTest-1900443889 None] Lock "cinder-quobyte-3af399bf-7c2f-4f6a-975c-6c6e301aeb99" acquired by "delete_volume" :: waited 0.075s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:18:20 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[dabefd09-6edf-4663-ae81-7297679711ad]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:18:20 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-b88a6995-d3dc-469f-bfbf-d4503d699927 tempest-GroupSnapshotsTest-1900443889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-3af399bf-7c2f-4f6a-975c-6c6e301aeb99 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:18:20 devstack sudo[96798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-3af399bf-7c2f-4f6a-975c-6c6e301aeb99 Aug 05 06:18:20 devstack sudo[96798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:18:21 devstack sudo[96798]: pam_unix(sudo:session): session closed for user root Aug 05 06:18:21 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-b88a6995-d3dc-469f-bfbf-d4503d699927 tempest-GroupSnapshotsTest-1900443889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-3af399bf-7c2f-4f6a-975c-6c6e301aeb99" returned: 0 in 0.887s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:18:21 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-b88a6995-d3dc-469f-bfbf-d4503d699927 tempest-GroupSnapshotsTest-1900443889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-3af399bf-7c2f-4f6a-975c-6c6e301aeb99 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:18:21 devstack sudo[96803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-3af399bf-7c2f-4f6a-975c-6c6e301aeb99 Aug 05 06:18:21 devstack sudo[96803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:18:22 devstack sudo[96803]: pam_unix(sudo:session): session closed for user root Aug 05 06:18:22 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-b88a6995-d3dc-469f-bfbf-d4503d699927 tempest-GroupSnapshotsTest-1900443889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-3af399bf-7c2f-4f6a-975c-6c6e301aeb99" returned: 0 in 1.109s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:18:22 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-b88a6995-d3dc-469f-bfbf-d4503d699927 tempest-GroupSnapshotsTest-1900443889 None] Lock "cinder-quobyte-3af399bf-7c2f-4f6a-975c-6c6e301aeb99" released by "delete_volume" :: held 2.244s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:18:22 devstack sudo[96672]: pam_unix(sudo:session): session closed for user root Aug 05 06:18:22 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-dbdf5ca8-78e0-4fdd-8384-82907916a987 tempest-VolumesSnapshotTestJSON-1364937772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9ab0b058-7dd3-499c-9824-bdb6e6ee4619 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-e1c19266-9b97-4257-91ae-59532d518a58" returned: 0 in 8.299s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:18:22 devstack cinder-volume[88695]: DEBUG cinder.image.image_utils [None req-dbdf5ca8-78e0-4fdd-8384-82907916a987 tempest-VolumesSnapshotTestJSON-1364937772 None] Image conversion details: src /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9ab0b058-7dd3-499c-9824-bdb6e6ee4619, size 1024.00 MB, duration 8.31 sec, destination /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-e1c19266-9b97-4257-91ae-59532d518a58 {{(pid=88695) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 05 06:18:22 devstack cinder-volume[88695]: INFO cinder.image.image_utils [None req-dbdf5ca8-78e0-4fdd-8384-82907916a987 tempest-VolumesSnapshotTestJSON-1364937772 None] Converted 1024.00 MB image at 123.26 MB/s Aug 05 06:18:22 devstack cinder-volume[88695]: WARNING cinder.volume.drivers.remotefs [None req-dbdf5ca8-78e0-4fdd-8384-82907916a987 tempest-VolumesSnapshotTestJSON-1364937772 None] /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-e1c19266-9b97-4257-91ae-59532d518a58 is being set with open permissions: ugo+rw Aug 05 06:18:22 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-dbdf5ca8-78e0-4fdd-8384-82907916a987 tempest-VolumesSnapshotTestJSON-1364937772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-e1c19266-9b97-4257-91ae-59532d518a58 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:18:22 devstack sudo[96806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-e1c19266-9b97-4257-91ae-59532d518a58 Aug 05 06:18:22 devstack sudo[96806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:18:22 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-b88a6995-d3dc-469f-bfbf-d4503d699927 tempest-GroupSnapshotsTest-1900443889 None] Created reservations ['2393ad5b-ac81-48d0-8bd1-9764828761a5'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:18:22 devstack cinder-volume[88695]: WARNING cinder.db.api [None req-b88a6995-d3dc-469f-bfbf-d4503d699927 tempest-GroupSnapshotsTest-1900443889 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1266385959'] Aug 05 06:18:22 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-b88a6995-d3dc-469f-bfbf-d4503d699927 tempest-GroupSnapshotsTest-1900443889 None] Created reservations ['7d8943ff-dc0c-4e58-8ea4-f0be80571a01', 'a0e0a034-e896-4f5a-8afe-21b2e029a592', 'be75d5cc-ee23-44e5-acd9-04064109708e', 'bfc78d19-c9d5-4fde-aed0-86024f76954e'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:18:22 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-b88a6995-d3dc-469f-bfbf-d4503d699927 tempest-GroupSnapshotsTest-1900443889 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:18:22 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-b88a6995-d3dc-469f-bfbf-d4503d699927 tempest-GroupSnapshotsTest-1900443889 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:18:22 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-b88a6995-d3dc-469f-bfbf-d4503d699927 tempest-GroupSnapshotsTest-1900443889 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:18:22 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-b88a6995-d3dc-469f-bfbf-d4503d699927 tempest-GroupSnapshotsTest-1900443889 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:18:22 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-b88a6995-d3dc-469f-bfbf-d4503d699927 tempest-GroupSnapshotsTest-1900443889 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:18:22 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-b88a6995-d3dc-469f-bfbf-d4503d699927 tempest-GroupSnapshotsTest-1900443889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:18:23 devstack sudo[96808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce Aug 05 06:18:23 devstack sudo[96808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:18:23 devstack sudo[96806]: pam_unix(sudo:session): session closed for user root Aug 05 06:18:23 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-dbdf5ca8-78e0-4fdd-8384-82907916a987 tempest-VolumesSnapshotTestJSON-1364937772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-e1c19266-9b97-4257-91ae-59532d518a58" returned: 0 in 0.397s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:18:23 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-dbdf5ca8-78e0-4fdd-8384-82907916a987 tempest-VolumesSnapshotTestJSON-1364937772 None] Lock "cinder-quobyte-e1c19266-9b97-4257-91ae-59532d518a58" released by "_copy_volume_from_snapshot" :: held 9.834s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:18:23 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-dbdf5ca8-78e0-4fdd-8384-82907916a987 tempest-VolumesSnapshotTestJSON-1364937772 None] Lock "cinder-quobyte-c3e443f7-f1bb-4dae-8958-5f59eb96d927-e1c19266-9b97-4257-91ae-59532d518a58" released by "_create_volume_from_snapshot" :: held 9.948s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:18:23 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-dbdf5ca8-78e0-4fdd-8384-82907916a987 tempest-VolumesSnapshotTestJSON-1364937772 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.971s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:18:23 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-dbdf5ca8-78e0-4fdd-8384-82907916a987 tempest-VolumesSnapshotTestJSON-1364937772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9e9f33e-9237-487e-9aa0-173a12e9ff4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1c19266-9b97-4257-91ae-59532d518a58', 'volume_size': 1, 'snapshot_id': 'c3e443f7-f1bb-4dae-8958-5f59eb96d927'}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:18:23 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-dbdf5ca8-78e0-4fdd-8384-82907916a987 tempest-VolumesSnapshotTestJSON-1364937772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (736b9801-cdc2-4a8b-ba74-53f41741f6f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:18:23 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-dbdf5ca8-78e0-4fdd-8384-82907916a987 tempest-VolumesSnapshotTestJSON-1364937772 None] Volume volume-e1c19266-9b97-4257-91ae-59532d518a58 (e1c19266-9b97-4257-91ae-59532d518a58): created successfully Aug 05 06:18:23 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-dbdf5ca8-78e0-4fdd-8384-82907916a987 tempest-VolumesSnapshotTestJSON-1364937772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (736b9801-cdc2-4a8b-ba74-53f41741f6f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:18:23 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-dbdf5ca8-78e0-4fdd-8384-82907916a987 tempest-VolumesSnapshotTestJSON-1364937772 None] Flow 'volume_create_manager' (0b8ca54b-8a3c-45f7-a034-c1a1d5138329) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:18:23 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-dbdf5ca8-78e0-4fdd-8384-82907916a987 tempest-VolumesSnapshotTestJSON-1364937772 None] Created volume successfully. Aug 05 06:18:23 devstack sudo[96808]: pam_unix(sudo:session): session closed for user root Aug 05 06:18:23 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-b88a6995-d3dc-469f-bfbf-d4503d699927 tempest-GroupSnapshotsTest-1900443889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce" returned: 0 in 0.369s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:18:23 devstack cinder-volume[88695]: DEBUG cinder.manager [None req-b88a6995-d3dc-469f-bfbf-d4503d699927 tempest-GroupSnapshotsTest-1900443889 None] Notifying Schedulers of capabilities ... {{(pid=88695) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 06:18:23 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-b88a6995-d3dc-469f-bfbf-d4503d699927 tempest-GroupSnapshotsTest-1900443889 None] Delete group completed successfully. Aug 05 06:18:23 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-0cb4c8d4-4253-42fe-9d72-e719e3408516 tempest-VolumesSnapshotTestJSON-1364937772 None] Acquiring lock "cinder-e1c19266-9b97-4257-91ae-59532d518a58-delete_volume" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:18:23 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-0cb4c8d4-4253-42fe-9d72-e719e3408516 tempest-VolumesSnapshotTestJSON-1364937772 None] Lock "cinder-e1c19266-9b97-4257-91ae-59532d518a58-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:18:23 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-0cb4c8d4-4253-42fe-9d72-e719e3408516 tempest-VolumesSnapshotTestJSON-1364937772 None] Acquiring lock "cinder-quobyte-e1c19266-9b97-4257-91ae-59532d518a58" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:18:23 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-0cb4c8d4-4253-42fe-9d72-e719e3408516 tempest-VolumesSnapshotTestJSON-1364937772 None] Lock "cinder-quobyte-e1c19266-9b97-4257-91ae-59532d518a58" acquired by "delete_volume" :: waited 0.038s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:18:24 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4045cfd-36ac-4c0a-8733-a36a7cf442c3]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:18:24 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-0cb4c8d4-4253-42fe-9d72-e719e3408516 tempest-VolumesSnapshotTestJSON-1364937772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-e1c19266-9b97-4257-91ae-59532d518a58 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:18:24 devstack sudo[96813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-e1c19266-9b97-4257-91ae-59532d518a58 Aug 05 06:18:24 devstack sudo[96813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:18:24 devstack sudo[96813]: pam_unix(sudo:session): session closed for user root Aug 05 06:18:24 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-6587c119-13ea-4296-9b21-b0f0f00a5b7c tempest-GroupSnapshotsTest-1900443889 None] Group tempest-GroupSnapshotsTest-Group-1673274712: creating Aug 05 06:18:24 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-0cb4c8d4-4253-42fe-9d72-e719e3408516 tempest-VolumesSnapshotTestJSON-1364937772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-e1c19266-9b97-4257-91ae-59532d518a58" returned: 0 in 0.518s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:18:24 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-0cb4c8d4-4253-42fe-9d72-e719e3408516 tempest-VolumesSnapshotTestJSON-1364937772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-e1c19266-9b97-4257-91ae-59532d518a58 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:18:24 devstack sudo[96818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-e1c19266-9b97-4257-91ae-59532d518a58 Aug 05 06:18:24 devstack sudo[96818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:18:24 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-6587c119-13ea-4296-9b21-b0f0f00a5b7c tempest-GroupSnapshotsTest-1900443889 None] Group tempest-GroupSnapshotsTest-Group-1673274712: created successfully Aug 05 06:18:24 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-6587c119-13ea-4296-9b21-b0f0f00a5b7c tempest-GroupSnapshotsTest-1900443889 None] Create group completed successfully. Aug 05 06:18:24 devstack sudo[96818]: pam_unix(sudo:session): session closed for user root Aug 05 06:18:24 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-0cb4c8d4-4253-42fe-9d72-e719e3408516 tempest-VolumesSnapshotTestJSON-1364937772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-e1c19266-9b97-4257-91ae-59532d518a58" returned: 0 in 0.349s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:18:24 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-0cb4c8d4-4253-42fe-9d72-e719e3408516 tempest-VolumesSnapshotTestJSON-1364937772 None] Lock "cinder-quobyte-e1c19266-9b97-4257-91ae-59532d518a58" released by "delete_volume" :: held 0.953s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:18:25 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-0cb4c8d4-4253-42fe-9d72-e719e3408516 tempest-VolumesSnapshotTestJSON-1364937772 None] Created reservations ['b8ba7977-fdab-4a57-a744-b4e7c778f707', 'dd134144-47ad-4e7d-bcdc-2b3aa8ce0e07', '427e61a3-929a-443b-a65e-f9d33d9d85aa', '9b33e0d7-bc01-4e88-8a8c-cad2f9c5429b'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:18:25 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-0cb4c8d4-4253-42fe-9d72-e719e3408516 tempest-VolumesSnapshotTestJSON-1364937772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:18:25 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-0cb4c8d4-4253-42fe-9d72-e719e3408516 tempest-VolumesSnapshotTestJSON-1364937772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:18:25 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-0cb4c8d4-4253-42fe-9d72-e719e3408516 tempest-VolumesSnapshotTestJSON-1364937772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:18:25 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-0cb4c8d4-4253-42fe-9d72-e719e3408516 tempest-VolumesSnapshotTestJSON-1364937772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:18:25 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-0cb4c8d4-4253-42fe-9d72-e719e3408516 tempest-VolumesSnapshotTestJSON-1364937772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:18:25 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-0cb4c8d4-4253-42fe-9d72-e719e3408516 tempest-VolumesSnapshotTestJSON-1364937772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:18:25 devstack sudo[96822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce Aug 05 06:18:25 devstack sudo[96822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:18:25 devstack sudo[96822]: pam_unix(sudo:session): session closed for user root Aug 05 06:18:25 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-0cb4c8d4-4253-42fe-9d72-e719e3408516 tempest-VolumesSnapshotTestJSON-1364937772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce" returned: 0 in 0.309s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:18:25 devstack cinder-volume[88695]: DEBUG cinder.manager [None req-0cb4c8d4-4253-42fe-9d72-e719e3408516 tempest-VolumesSnapshotTestJSON-1364937772 None] Notifying Schedulers of capabilities ... {{(pid=88695) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 06:18:25 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-0cb4c8d4-4253-42fe-9d72-e719e3408516 tempest-VolumesSnapshotTestJSON-1364937772 None] Deleted volume successfully. Aug 05 06:18:25 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-0cb4c8d4-4253-42fe-9d72-e719e3408516 tempest-VolumesSnapshotTestJSON-1364937772 None] Lock "cinder-e1c19266-9b97-4257-91ae-59532d518a58-delete_volume" released by "delete_volume" :: held 1.626s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:18:26 devstack cinder-volume[88695]: DEBUG cinder.volume.flows.manager.create_volume [None req-140b32e6-d5da-49fb-a2ec-a3be241996c9 tempest-GroupSnapshotsTest-1900443889 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88695) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 06:18:26 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-140b32e6-d5da-49fb-a2ec-a3be241996c9 tempest-GroupSnapshotsTest-1900443889 None] Flow 'volume_create_manager' (4bcb640d-11b0-4b4e-9851-5178f8c5e1fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:18:26 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-140b32e6-d5da-49fb-a2ec-a3be241996c9 tempest-GroupSnapshotsTest-1900443889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2aafa48a-f5a9-40c5-adf8-2cc6505033a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:18:26 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-140b32e6-d5da-49fb-a2ec-a3be241996c9 tempest-GroupSnapshotsTest-1900443889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2aafa48a-f5a9-40c5-adf8-2cc6505033a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:18:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2038840321',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a530197d-419c-4285-a7b5-86dc72a67288,host='devstack@QuobyteHD#QuobyteHD',id=b37bec96-52f0-42ba-85e8-fd64f53043af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='646f9e7e464f47f988d81ced7f2a0ee5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:18:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:18:26Z,use_quota=True,user_id='314aad5bb7ff4695a905f4a939e5b490',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8909c7b1-5340-4a1f-9e2c-a98676d7a101),volume_type_id=8909c7b1-5340-4a1f-9e2c-a98676d7a101)' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:18:26 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-140b32e6-d5da-49fb-a2ec-a3be241996c9 tempest-GroupSnapshotsTest-1900443889 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92ca36be-60eb-4138-bee7-4fe1ff732dca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:18:26 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-140b32e6-d5da-49fb-a2ec-a3be241996c9 tempest-GroupSnapshotsTest-1900443889 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92ca36be-60eb-4138-bee7-4fe1ff732dca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:18:26 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-140b32e6-d5da-49fb-a2ec-a3be241996c9 tempest-GroupSnapshotsTest-1900443889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a3c20a5-6b2c-44c0-9344-439a86cfb47e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:18:26 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-140b32e6-d5da-49fb-a2ec-a3be241996c9 tempest-GroupSnapshotsTest-1900443889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a3c20a5-6b2c-44c0-9344-439a86cfb47e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b37bec96-52f0-42ba-85e8-fd64f53043af', 'volume_name': 'volume-b37bec96-52f0-42ba-85e8-fd64f53043af', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:18:26 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-140b32e6-d5da-49fb-a2ec-a3be241996c9 tempest-GroupSnapshotsTest-1900443889 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65c4dea1-9534-421b-a2f2-35291fcf7f75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:18:26 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-140b32e6-d5da-49fb-a2ec-a3be241996c9 tempest-GroupSnapshotsTest-1900443889 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65c4dea1-9534-421b-a2f2-35291fcf7f75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:18:26 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-140b32e6-d5da-49fb-a2ec-a3be241996c9 tempest-GroupSnapshotsTest-1900443889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4d6b3fd-9cfd-4663-a8f2-d3442bf6e34c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:18:26 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-140b32e6-d5da-49fb-a2ec-a3be241996c9 tempest-GroupSnapshotsTest-1900443889 None] Volume b37bec96-52f0-42ba-85e8-fd64f53043af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b37bec96-52f0-42ba-85e8-fd64f53043af', 'volume_size': 1} Aug 05 06:18:26 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-140b32e6-d5da-49fb-a2ec-a3be241996c9 tempest-GroupSnapshotsTest-1900443889 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:18:26 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-140b32e6-d5da-49fb-a2ec-a3be241996c9 tempest-GroupSnapshotsTest-1900443889 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:18:26 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-140b32e6-d5da-49fb-a2ec-a3be241996c9 tempest-GroupSnapshotsTest-1900443889 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=a530197d-419c-4285-a7b5-86dc72a67288,created_at=2026-08-05T04:18:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2038840321',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a530197d-419c-4285-a7b5-86dc72a67288,host='devstack@QuobyteHD#QuobyteHD',id=b37bec96-52f0-42ba-85e8-fd64f53043af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='646f9e7e464f47f988d81ced7f2a0ee5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:18:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:18:26Z,use_quota=True,user_id='314aad5bb7ff4695a905f4a939e5b490',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8909c7b1-5340-4a1f-9e2c-a98676d7a101),volume_type_id=8909c7b1-5340-4a1f-9e2c-a98676d7a101)}" {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 06:18:26 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-140b32e6-d5da-49fb-a2ec-a3be241996c9 tempest-GroupSnapshotsTest-1900443889 None] Creating volume b37bec96-52f0-42ba-85e8-fd64f53043af {{(pid=88695) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 06:18:26 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-140b32e6-d5da-49fb-a2ec-a3be241996c9 tempest-GroupSnapshotsTest-1900443889 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:18:26 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-140b32e6-d5da-49fb-a2ec-a3be241996c9 tempest-GroupSnapshotsTest-1900443889 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:18:26 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-140b32e6-d5da-49fb-a2ec-a3be241996c9 tempest-GroupSnapshotsTest-1900443889 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:18:26 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-140b32e6-d5da-49fb-a2ec-a3be241996c9 tempest-GroupSnapshotsTest-1900443889 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:18:26 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-140b32e6-d5da-49fb-a2ec-a3be241996c9 tempest-GroupSnapshotsTest-1900443889 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:18:26 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-140b32e6-d5da-49fb-a2ec-a3be241996c9 tempest-GroupSnapshotsTest-1900443889 None] Selected osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 as target Quobyte volume. {{(pid=88695) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 06:18:26 devstack cinder-volume[88695]: INFO cinder.volume.drivers.remotefs [None req-140b32e6-d5da-49fb-a2ec-a3be241996c9 tempest-GroupSnapshotsTest-1900443889 None] casted to osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 Aug 05 06:18:26 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-140b32e6-d5da-49fb-a2ec-a3be241996c9 tempest-GroupSnapshotsTest-1900443889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-b37bec96-52f0-42ba-85e8-fd64f53043af 1073741824 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:18:26 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-b148aead-3cd0-42fc-9f31-ed44e6d6e440 tempest-VolumesSnapshotTestJSON-1364937772 None] Acquiring lock "cinder-c3e443f7-f1bb-4dae-8958-5f59eb96d927-delete_snapshot" by "delete_snapshot" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:18:26 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-b148aead-3cd0-42fc-9f31-ed44e6d6e440 tempest-VolumesSnapshotTestJSON-1364937772 None] Lock "cinder-c3e443f7-f1bb-4dae-8958-5f59eb96d927-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:18:26 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-b148aead-3cd0-42fc-9f31-ed44e6d6e440 tempest-VolumesSnapshotTestJSON-1364937772 None] Acquiring lock "cinder-quobyte-9ab0b058-7dd3-499c-9824-bdb6e6ee4619" by "delete_snapshot" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:18:26 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-b148aead-3cd0-42fc-9f31-ed44e6d6e440 tempest-VolumesSnapshotTestJSON-1364937772 None] Lock "cinder-quobyte-9ab0b058-7dd3-499c-9824-bdb6e6ee4619" acquired by "delete_snapshot" :: waited 0.039s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:18:26 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-b148aead-3cd0-42fc-9f31-ed44e6d6e440 tempest-VolumesSnapshotTestJSON-1364937772 None] Acquiring lock "cinder-quobyte-c3e443f7-f1bb-4dae-8958-5f59eb96d927" by "_delete_snapshot" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:18:26 devstack sudo[96825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-b37bec96-52f0-42ba-85e8-fd64f53043af 1073741824 Aug 05 06:18:26 devstack sudo[96825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:18:26 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-b148aead-3cd0-42fc-9f31-ed44e6d6e440 tempest-VolumesSnapshotTestJSON-1364937772 None] Lock "cinder-quobyte-c3e443f7-f1bb-4dae-8958-5f59eb96d927" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:18:26 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-b148aead-3cd0-42fc-9f31-ed44e6d6e440 tempest-VolumesSnapshotTestJSON-1364937772 None] Deleting offline snapshot c3e443f7-f1bb-4dae-8958-5f59eb96d927 of volume 9ab0b058-7dd3-499c-9824-bdb6e6ee4619 {{(pid=88695) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 06:18:26 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-b148aead-3cd0-42fc-9f31-ed44e6d6e440 tempest-VolumesSnapshotTestJSON-1364937772 None] snapshot_file for this snap is: volume-9ab0b058-7dd3-499c-9824-bdb6e6ee4619.c3e443f7-f1bb-4dae-8958-5f59eb96d927 {{(pid=88695) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 06:18:26 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[26c67dc1-b684-4ab3-bd59-098e23fce524]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:18:26 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-b148aead-3cd0-42fc-9f31-ed44e6d6e440 tempest-VolumesSnapshotTestJSON-1364937772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9ab0b058-7dd3-499c-9824-bdb6e6ee4619.c3e443f7-f1bb-4dae-8958-5f59eb96d927 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:18:26 devstack sudo[96827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9ab0b058-7dd3-499c-9824-bdb6e6ee4619.c3e443f7-f1bb-4dae-8958-5f59eb96d927 Aug 05 06:18:26 devstack sudo[96827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:18:27 devstack sudo[96825]: pam_unix(sudo:session): session closed for user root Aug 05 06:18:27 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-140b32e6-d5da-49fb-a2ec-a3be241996c9 tempest-GroupSnapshotsTest-1900443889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-b37bec96-52f0-42ba-85e8-fd64f53043af 1073741824" returned: 0 in 0.663s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:18:27 devstack sudo[96827]: pam_unix(sudo:session): session closed for user root Aug 05 06:18:27 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-b148aead-3cd0-42fc-9f31-ed44e6d6e440 tempest-VolumesSnapshotTestJSON-1364937772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9ab0b058-7dd3-499c-9824-bdb6e6ee4619.c3e443f7-f1bb-4dae-8958-5f59eb96d927" returned: 0 in 0.504s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:18:27 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-b148aead-3cd0-42fc-9f31-ed44e6d6e440 tempest-VolumesSnapshotTestJSON-1364937772 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9ab0b058-7dd3-499c-9824-bdb6e6ee4619(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88695) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 06:18:27 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cc449ec-48d3-4763-abb6-19bcbfc3a9c2]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:18:27 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-b148aead-3cd0-42fc-9f31-ed44e6d6e440 tempest-VolumesSnapshotTestJSON-1364937772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9ab0b058-7dd3-499c-9824-bdb6e6ee4619 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:18:27 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-140b32e6-d5da-49fb-a2ec-a3be241996c9 tempest-GroupSnapshotsTest-1900443889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-b37bec96-52f0-42ba-85e8-fd64f53043af {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:18:27 devstack sudo[96837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-b37bec96-52f0-42ba-85e8-fd64f53043af Aug 05 06:18:27 devstack sudo[96837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:18:27 devstack sudo[96836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9ab0b058-7dd3-499c-9824-bdb6e6ee4619 Aug 05 06:18:27 devstack sudo[96836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:18:27 devstack sudo[96837]: pam_unix(sudo:session): session closed for user root Aug 05 06:18:27 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-140b32e6-d5da-49fb-a2ec-a3be241996c9 tempest-GroupSnapshotsTest-1900443889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-b37bec96-52f0-42ba-85e8-fd64f53043af" returned: 0 in 0.382s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:18:27 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-140b32e6-d5da-49fb-a2ec-a3be241996c9 tempest-GroupSnapshotsTest-1900443889 None] <== create_volume: return (1143ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'} {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 06:18:27 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-140b32e6-d5da-49fb-a2ec-a3be241996c9 tempest-GroupSnapshotsTest-1900443889 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.147s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:18:27 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-140b32e6-d5da-49fb-a2ec-a3be241996c9 tempest-GroupSnapshotsTest-1900443889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4d6b3fd-9cfd-4663-a8f2-d3442bf6e34c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b37bec96-52f0-42ba-85e8-fd64f53043af', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:18:27 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-140b32e6-d5da-49fb-a2ec-a3be241996c9 tempest-GroupSnapshotsTest-1900443889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97382220-fa8e-4a91-b2e3-fa78afcaeeaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:18:27 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-140b32e6-d5da-49fb-a2ec-a3be241996c9 tempest-GroupSnapshotsTest-1900443889 None] Volume volume-b37bec96-52f0-42ba-85e8-fd64f53043af (b37bec96-52f0-42ba-85e8-fd64f53043af): created successfully Aug 05 06:18:27 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-140b32e6-d5da-49fb-a2ec-a3be241996c9 tempest-GroupSnapshotsTest-1900443889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97382220-fa8e-4a91-b2e3-fa78afcaeeaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:18:27 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-140b32e6-d5da-49fb-a2ec-a3be241996c9 tempest-GroupSnapshotsTest-1900443889 None] Flow 'volume_create_manager' (4bcb640d-11b0-4b4e-9851-5178f8c5e1fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:18:27 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-140b32e6-d5da-49fb-a2ec-a3be241996c9 tempest-GroupSnapshotsTest-1900443889 None] Created volume successfully. Aug 05 06:18:28 devstack sudo[96836]: pam_unix(sudo:session): session closed for user root Aug 05 06:18:28 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-b148aead-3cd0-42fc-9f31-ed44e6d6e440 tempest-VolumesSnapshotTestJSON-1364937772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9ab0b058-7dd3-499c-9824-bdb6e6ee4619" returned: 0 in 0.824s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:18:28 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-b148aead-3cd0-42fc-9f31-ed44e6d6e440 tempest-VolumesSnapshotTestJSON-1364937772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9ab0b058-7dd3-499c-9824-bdb6e6ee4619.c3e443f7-f1bb-4dae-8958-5f59eb96d927 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:18:28 devstack sudo[96845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9ab0b058-7dd3-499c-9824-bdb6e6ee4619.c3e443f7-f1bb-4dae-8958-5f59eb96d927 Aug 05 06:18:28 devstack sudo[96845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:18:28 devstack sudo[96845]: pam_unix(sudo:session): session closed for user root Aug 05 06:18:28 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-b148aead-3cd0-42fc-9f31-ed44e6d6e440 tempest-VolumesSnapshotTestJSON-1364937772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9ab0b058-7dd3-499c-9824-bdb6e6ee4619.c3e443f7-f1bb-4dae-8958-5f59eb96d927" returned: 0 in 0.367s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:18:28 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-b148aead-3cd0-42fc-9f31-ed44e6d6e440 tempest-VolumesSnapshotTestJSON-1364937772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9ab0b058-7dd3-499c-9824-bdb6e6ee4619.c3e443f7-f1bb-4dae-8958-5f59eb96d927 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:18:28 devstack sudo[96851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9ab0b058-7dd3-499c-9824-bdb6e6ee4619.c3e443f7-f1bb-4dae-8958-5f59eb96d927 Aug 05 06:18:28 devstack sudo[96851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:18:28 devstack sudo[96851]: pam_unix(sudo:session): session closed for user root Aug 05 06:18:28 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-b148aead-3cd0-42fc-9f31-ed44e6d6e440 tempest-VolumesSnapshotTestJSON-1364937772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9ab0b058-7dd3-499c-9824-bdb6e6ee4619.c3e443f7-f1bb-4dae-8958-5f59eb96d927" returned: 0 in 0.360s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:18:28 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-b148aead-3cd0-42fc-9f31-ed44e6d6e440 tempest-VolumesSnapshotTestJSON-1364937772 None] Lock "cinder-quobyte-c3e443f7-f1bb-4dae-8958-5f59eb96d927" released by "_delete_snapshot" :: held 2.196s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:18:28 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-b148aead-3cd0-42fc-9f31-ed44e6d6e440 tempest-VolumesSnapshotTestJSON-1364937772 None] Lock "cinder-quobyte-9ab0b058-7dd3-499c-9824-bdb6e6ee4619" released by "delete_snapshot" :: held 2.231s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:18:28 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-b148aead-3cd0-42fc-9f31-ed44e6d6e440 tempest-VolumesSnapshotTestJSON-1364937772 None] Created reservations ['043b69fb-26bc-4f61-b317-99dcefb0fbd2', '251df288-8a10-491b-8093-347303e4f11c', 'f68e5c51-f40d-4190-bc42-403e523bad81', '10ff431f-9b99-4013-9ba8-9b7e76a8752c'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:18:28 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-b148aead-3cd0-42fc-9f31-ed44e6d6e440 tempest-VolumesSnapshotTestJSON-1364937772 None] Delete snapshot completed successfully. Aug 05 06:18:29 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-b148aead-3cd0-42fc-9f31-ed44e6d6e440 tempest-VolumesSnapshotTestJSON-1364937772 None] Lock "cinder-c3e443f7-f1bb-4dae-8958-5f59eb96d927-delete_snapshot" released by "delete_snapshot" :: held 2.434s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:18:29 devstack cinder-volume[88695]: DEBUG cinder.volume.flows.manager.create_volume [None req-d84e7c7b-cf98-4803-8771-d3d1c8669131 tempest-GroupSnapshotsTest-1900443889 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88695) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 06:18:29 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-d84e7c7b-cf98-4803-8771-d3d1c8669131 tempest-GroupSnapshotsTest-1900443889 None] Flow 'volume_create_manager' (d7c60ab3-86f7-4553-909e-dd4ad28a47d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:18:29 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-d84e7c7b-cf98-4803-8771-d3d1c8669131 tempest-GroupSnapshotsTest-1900443889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02ca6dd7-d146-42b3-8d26-edf04ef8b1a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:18:29 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-d84e7c7b-cf98-4803-8771-d3d1c8669131 tempest-GroupSnapshotsTest-1900443889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02ca6dd7-d146-42b3-8d26-edf04ef8b1a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:18:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-778844704',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a530197d-419c-4285-a7b5-86dc72a67288,host='devstack@QuobyteHD#QuobyteHD',id=92f6d647-ac2f-4679-98c3-eae4fedcb935,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='646f9e7e464f47f988d81ced7f2a0ee5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:18:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:18:30Z,use_quota=True,user_id='314aad5bb7ff4695a905f4a939e5b490',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8909c7b1-5340-4a1f-9e2c-a98676d7a101),volume_type_id=8909c7b1-5340-4a1f-9e2c-a98676d7a101)' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:18:29 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-d84e7c7b-cf98-4803-8771-d3d1c8669131 tempest-GroupSnapshotsTest-1900443889 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b32482f-e0ca-4dba-a703-5f5792a3a20f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:18:29 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-d84e7c7b-cf98-4803-8771-d3d1c8669131 tempest-GroupSnapshotsTest-1900443889 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b32482f-e0ca-4dba-a703-5f5792a3a20f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:18:29 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-d84e7c7b-cf98-4803-8771-d3d1c8669131 tempest-GroupSnapshotsTest-1900443889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14b7b9cf-b169-4642-a25e-b05118167dbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:18:29 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-d84e7c7b-cf98-4803-8771-d3d1c8669131 tempest-GroupSnapshotsTest-1900443889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14b7b9cf-b169-4642-a25e-b05118167dbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '92f6d647-ac2f-4679-98c3-eae4fedcb935', 'volume_name': 'volume-92f6d647-ac2f-4679-98c3-eae4fedcb935', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:18:29 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-d84e7c7b-cf98-4803-8771-d3d1c8669131 tempest-GroupSnapshotsTest-1900443889 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ec1219d-81e8-4d7e-a0a4-b543e58a8c63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:18:29 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-d84e7c7b-cf98-4803-8771-d3d1c8669131 tempest-GroupSnapshotsTest-1900443889 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ec1219d-81e8-4d7e-a0a4-b543e58a8c63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:18:29 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-d84e7c7b-cf98-4803-8771-d3d1c8669131 tempest-GroupSnapshotsTest-1900443889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (565d5ddb-a433-4a1a-b545-2bceda48fd8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:18:29 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-d84e7c7b-cf98-4803-8771-d3d1c8669131 tempest-GroupSnapshotsTest-1900443889 None] Volume 92f6d647-ac2f-4679-98c3-eae4fedcb935: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-92f6d647-ac2f-4679-98c3-eae4fedcb935', 'volume_size': 1} Aug 05 06:18:29 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-d84e7c7b-cf98-4803-8771-d3d1c8669131 tempest-GroupSnapshotsTest-1900443889 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:18:29 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-d84e7c7b-cf98-4803-8771-d3d1c8669131 tempest-GroupSnapshotsTest-1900443889 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:18:29 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-d84e7c7b-cf98-4803-8771-d3d1c8669131 tempest-GroupSnapshotsTest-1900443889 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=a530197d-419c-4285-a7b5-86dc72a67288,created_at=2026-08-05T04:18:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-778844704',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a530197d-419c-4285-a7b5-86dc72a67288,host='devstack@QuobyteHD#QuobyteHD',id=92f6d647-ac2f-4679-98c3-eae4fedcb935,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='646f9e7e464f47f988d81ced7f2a0ee5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:18:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:18:30Z,use_quota=True,user_id='314aad5bb7ff4695a905f4a939e5b490',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8909c7b1-5340-4a1f-9e2c-a98676d7a101),volume_type_id=8909c7b1-5340-4a1f-9e2c-a98676d7a101)}" {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 06:18:29 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-d84e7c7b-cf98-4803-8771-d3d1c8669131 tempest-GroupSnapshotsTest-1900443889 None] Creating volume 92f6d647-ac2f-4679-98c3-eae4fedcb935 {{(pid=88695) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 06:18:29 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-d84e7c7b-cf98-4803-8771-d3d1c8669131 tempest-GroupSnapshotsTest-1900443889 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:18:29 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-d84e7c7b-cf98-4803-8771-d3d1c8669131 tempest-GroupSnapshotsTest-1900443889 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:18:29 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-d84e7c7b-cf98-4803-8771-d3d1c8669131 tempest-GroupSnapshotsTest-1900443889 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:18:29 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-d84e7c7b-cf98-4803-8771-d3d1c8669131 tempest-GroupSnapshotsTest-1900443889 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:18:29 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-d84e7c7b-cf98-4803-8771-d3d1c8669131 tempest-GroupSnapshotsTest-1900443889 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:18:29 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-d84e7c7b-cf98-4803-8771-d3d1c8669131 tempest-GroupSnapshotsTest-1900443889 None] Selected osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 as target Quobyte volume. {{(pid=88695) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 06:18:29 devstack cinder-volume[88695]: INFO cinder.volume.drivers.remotefs [None req-d84e7c7b-cf98-4803-8771-d3d1c8669131 tempest-GroupSnapshotsTest-1900443889 None] casted to osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 Aug 05 06:18:29 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-d84e7c7b-cf98-4803-8771-d3d1c8669131 tempest-GroupSnapshotsTest-1900443889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-92f6d647-ac2f-4679-98c3-eae4fedcb935 1073741824 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:18:29 devstack sudo[96854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-92f6d647-ac2f-4679-98c3-eae4fedcb935 1073741824 Aug 05 06:18:29 devstack sudo[96854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:18:30 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-9a2ceece-01b7-4089-8fd3-e60b3e3a06c9 tempest-VolumesSnapshotTestJSON-1364937772 None] Acquiring lock "cinder-9ab0b058-7dd3-499c-9824-bdb6e6ee4619-delete_volume" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:18:30 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-9a2ceece-01b7-4089-8fd3-e60b3e3a06c9 tempest-VolumesSnapshotTestJSON-1364937772 None] Lock "cinder-9ab0b058-7dd3-499c-9824-bdb6e6ee4619-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:18:30 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-9a2ceece-01b7-4089-8fd3-e60b3e3a06c9 tempest-VolumesSnapshotTestJSON-1364937772 None] Acquiring lock "cinder-quobyte-9ab0b058-7dd3-499c-9824-bdb6e6ee4619" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:18:30 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-9a2ceece-01b7-4089-8fd3-e60b3e3a06c9 tempest-VolumesSnapshotTestJSON-1364937772 None] Lock "cinder-quobyte-9ab0b058-7dd3-499c-9824-bdb6e6ee4619" acquired by "delete_volume" :: waited 0.019s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:18:30 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[55e0a948-6e0a-4d96-bb41-6375643b34af]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:18:30 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-9a2ceece-01b7-4089-8fd3-e60b3e3a06c9 tempest-VolumesSnapshotTestJSON-1364937772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9ab0b058-7dd3-499c-9824-bdb6e6ee4619 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:18:30 devstack sudo[96854]: pam_unix(sudo:session): session closed for user root Aug 05 06:18:30 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-d84e7c7b-cf98-4803-8771-d3d1c8669131 tempest-GroupSnapshotsTest-1900443889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-92f6d647-ac2f-4679-98c3-eae4fedcb935 1073741824" returned: 0 in 0.484s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:18:30 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-d84e7c7b-cf98-4803-8771-d3d1c8669131 tempest-GroupSnapshotsTest-1900443889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-92f6d647-ac2f-4679-98c3-eae4fedcb935 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:18:30 devstack sudo[96861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-92f6d647-ac2f-4679-98c3-eae4fedcb935 Aug 05 06:18:30 devstack sudo[96861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:18:30 devstack sudo[96860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9ab0b058-7dd3-499c-9824-bdb6e6ee4619 Aug 05 06:18:30 devstack sudo[96860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:18:30 devstack sudo[96861]: pam_unix(sudo:session): session closed for user root Aug 05 06:18:30 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-d84e7c7b-cf98-4803-8771-d3d1c8669131 tempest-GroupSnapshotsTest-1900443889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-92f6d647-ac2f-4679-98c3-eae4fedcb935" returned: 0 in 0.252s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:18:30 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-d84e7c7b-cf98-4803-8771-d3d1c8669131 tempest-GroupSnapshotsTest-1900443889 None] <== create_volume: return (786ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'} {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 06:18:30 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-d84e7c7b-cf98-4803-8771-d3d1c8669131 tempest-GroupSnapshotsTest-1900443889 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.788s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:18:30 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-d84e7c7b-cf98-4803-8771-d3d1c8669131 tempest-GroupSnapshotsTest-1900443889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (565d5ddb-a433-4a1a-b545-2bceda48fd8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92f6d647-ac2f-4679-98c3-eae4fedcb935', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:18:30 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-d84e7c7b-cf98-4803-8771-d3d1c8669131 tempest-GroupSnapshotsTest-1900443889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c61c5569-f96e-4474-af65-cd24edf4ed13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:18:30 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-d84e7c7b-cf98-4803-8771-d3d1c8669131 tempest-GroupSnapshotsTest-1900443889 None] Volume volume-92f6d647-ac2f-4679-98c3-eae4fedcb935 (92f6d647-ac2f-4679-98c3-eae4fedcb935): created successfully Aug 05 06:18:30 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-d84e7c7b-cf98-4803-8771-d3d1c8669131 tempest-GroupSnapshotsTest-1900443889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c61c5569-f96e-4474-af65-cd24edf4ed13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:18:30 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-d84e7c7b-cf98-4803-8771-d3d1c8669131 tempest-GroupSnapshotsTest-1900443889 None] Flow 'volume_create_manager' (d7c60ab3-86f7-4553-909e-dd4ad28a47d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:18:30 devstack sudo[96860]: pam_unix(sudo:session): session closed for user root Aug 05 06:18:30 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-9a2ceece-01b7-4089-8fd3-e60b3e3a06c9 tempest-VolumesSnapshotTestJSON-1364937772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9ab0b058-7dd3-499c-9824-bdb6e6ee4619" returned: 0 in 0.402s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:18:30 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-9a2ceece-01b7-4089-8fd3-e60b3e3a06c9 tempest-VolumesSnapshotTestJSON-1364937772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9ab0b058-7dd3-499c-9824-bdb6e6ee4619 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:18:30 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-d84e7c7b-cf98-4803-8771-d3d1c8669131 tempest-GroupSnapshotsTest-1900443889 None] Created volume successfully. Aug 05 06:18:30 devstack sudo[96868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9ab0b058-7dd3-499c-9824-bdb6e6ee4619 Aug 05 06:18:30 devstack sudo[96868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:18:31 devstack sudo[96868]: pam_unix(sudo:session): session closed for user root Aug 05 06:18:31 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-9a2ceece-01b7-4089-8fd3-e60b3e3a06c9 tempest-VolumesSnapshotTestJSON-1364937772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9ab0b058-7dd3-499c-9824-bdb6e6ee4619" returned: 0 in 0.303s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:18:31 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-9a2ceece-01b7-4089-8fd3-e60b3e3a06c9 tempest-VolumesSnapshotTestJSON-1364937772 None] Lock "cinder-quobyte-9ab0b058-7dd3-499c-9824-bdb6e6ee4619" released by "delete_volume" :: held 0.781s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:18:31 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-9a2ceece-01b7-4089-8fd3-e60b3e3a06c9 tempest-VolumesSnapshotTestJSON-1364937772 None] Created reservations ['9d4957b2-7f1e-4d53-8da0-84d447d46c84', '3e13f444-a5da-4204-813d-c7685b6155bb', '662c3952-4794-464b-bdd6-f1ed5ad2c969', '7af436ca-eaaa-455f-885a-3aa4e09118d0'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:18:31 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-5a3f9956-e151-4986-981d-fb9bb5b6d7a9 tempest-GroupSnapshotsTest-1900443889 None] Update group completed successfully. Aug 05 06:18:31 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-9a2ceece-01b7-4089-8fd3-e60b3e3a06c9 tempest-VolumesSnapshotTestJSON-1364937772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:18:31 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-9a2ceece-01b7-4089-8fd3-e60b3e3a06c9 tempest-VolumesSnapshotTestJSON-1364937772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:18:31 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-9a2ceece-01b7-4089-8fd3-e60b3e3a06c9 tempest-VolumesSnapshotTestJSON-1364937772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:18:31 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-9a2ceece-01b7-4089-8fd3-e60b3e3a06c9 tempest-VolumesSnapshotTestJSON-1364937772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:18:31 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-9a2ceece-01b7-4089-8fd3-e60b3e3a06c9 tempest-VolumesSnapshotTestJSON-1364937772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:18:31 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-9a2ceece-01b7-4089-8fd3-e60b3e3a06c9 tempest-VolumesSnapshotTestJSON-1364937772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:18:31 devstack sudo[96871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce Aug 05 06:18:31 devstack sudo[96871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:18:31 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-4bc00669-2ec9-4f8a-a897-4495e620cc8f tempest-VolumesSnapshotTestJSON-1364937772 None] Acquiring lock "cinder-7a9920a5-aeef-475d-a471-a4e48a5c7932-delete_volume" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:18:31 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-4bc00669-2ec9-4f8a-a897-4495e620cc8f tempest-VolumesSnapshotTestJSON-1364937772 None] Lock "cinder-7a9920a5-aeef-475d-a471-a4e48a5c7932-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:18:31 devstack sudo[96871]: pam_unix(sudo:session): session closed for user root Aug 05 06:18:31 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-9a2ceece-01b7-4089-8fd3-e60b3e3a06c9 tempest-VolumesSnapshotTestJSON-1364937772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce" returned: 0 in 0.303s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:18:31 devstack cinder-volume[88695]: DEBUG cinder.manager [None req-9a2ceece-01b7-4089-8fd3-e60b3e3a06c9 tempest-VolumesSnapshotTestJSON-1364937772 None] Notifying Schedulers of capabilities ... {{(pid=88695) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 06:18:31 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-9a2ceece-01b7-4089-8fd3-e60b3e3a06c9 tempest-VolumesSnapshotTestJSON-1364937772 None] Deleted volume successfully. Aug 05 06:18:31 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-4bc00669-2ec9-4f8a-a897-4495e620cc8f tempest-VolumesSnapshotTestJSON-1364937772 None] Acquiring lock "cinder-quobyte-7a9920a5-aeef-475d-a471-a4e48a5c7932" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:18:31 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-9a2ceece-01b7-4089-8fd3-e60b3e3a06c9 tempest-VolumesSnapshotTestJSON-1364937772 None] Lock "cinder-9ab0b058-7dd3-499c-9824-bdb6e6ee4619-delete_volume" released by "delete_volume" :: held 1.346s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:18:31 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-4bc00669-2ec9-4f8a-a897-4495e620cc8f tempest-VolumesSnapshotTestJSON-1364937772 None] Lock "cinder-quobyte-7a9920a5-aeef-475d-a471-a4e48a5c7932" acquired by "delete_volume" :: waited 0.020s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:18:31 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fc8f9e9-b774-4515-b0ed-aeac36358768]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:18:31 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-4bc00669-2ec9-4f8a-a897-4495e620cc8f tempest-VolumesSnapshotTestJSON-1364937772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7a9920a5-aeef-475d-a471-a4e48a5c7932 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:18:31 devstack sudo[96874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7a9920a5-aeef-475d-a471-a4e48a5c7932 Aug 05 06:18:31 devstack sudo[96874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:18:32 devstack sudo[96874]: pam_unix(sudo:session): session closed for user root Aug 05 06:18:32 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-4bc00669-2ec9-4f8a-a897-4495e620cc8f tempest-VolumesSnapshotTestJSON-1364937772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7a9920a5-aeef-475d-a471-a4e48a5c7932" returned: 0 in 0.397s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:18:32 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-4bc00669-2ec9-4f8a-a897-4495e620cc8f tempest-VolumesSnapshotTestJSON-1364937772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7a9920a5-aeef-475d-a471-a4e48a5c7932 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:18:32 devstack sudo[96879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7a9920a5-aeef-475d-a471-a4e48a5c7932 Aug 05 06:18:32 devstack sudo[96879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:18:32 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-f33d8aa7-b876-48c7-a0ab-9424891d2673 tempest-GroupSnapshotsTest-1900443889 None] Update group completed successfully. Aug 05 06:18:32 devstack sudo[96879]: pam_unix(sudo:session): session closed for user root Aug 05 06:18:32 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-4bc00669-2ec9-4f8a-a897-4495e620cc8f tempest-VolumesSnapshotTestJSON-1364937772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7a9920a5-aeef-475d-a471-a4e48a5c7932" returned: 0 in 0.340s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:18:32 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-4bc00669-2ec9-4f8a-a897-4495e620cc8f tempest-VolumesSnapshotTestJSON-1364937772 None] Lock "cinder-quobyte-7a9920a5-aeef-475d-a471-a4e48a5c7932" released by "delete_volume" :: held 0.806s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:18:32 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-4bc00669-2ec9-4f8a-a897-4495e620cc8f tempest-VolumesSnapshotTestJSON-1364937772 None] Created reservations ['4b35b5a4-81c9-46b8-adf9-b88be5bd938c', 'd8446f68-2816-456e-9d7d-bce57a6ff0c8', '5f7fa83d-d076-4d80-8222-08c5be031885', 'dbe96e2a-9182-47c0-af45-51bf9cce9f0c'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:18:32 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-4bc00669-2ec9-4f8a-a897-4495e620cc8f tempest-VolumesSnapshotTestJSON-1364937772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:18:32 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-4bc00669-2ec9-4f8a-a897-4495e620cc8f tempest-VolumesSnapshotTestJSON-1364937772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:18:32 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-4bc00669-2ec9-4f8a-a897-4495e620cc8f tempest-VolumesSnapshotTestJSON-1364937772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:18:32 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-4bc00669-2ec9-4f8a-a897-4495e620cc8f tempest-VolumesSnapshotTestJSON-1364937772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:18:32 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-4bc00669-2ec9-4f8a-a897-4495e620cc8f tempest-VolumesSnapshotTestJSON-1364937772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:18:32 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-4bc00669-2ec9-4f8a-a897-4495e620cc8f tempest-VolumesSnapshotTestJSON-1364937772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:18:32 devstack sudo[96905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce Aug 05 06:18:32 devstack sudo[96905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:18:32 devstack sudo[96905]: pam_unix(sudo:session): session closed for user root Aug 05 06:18:32 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-4bc00669-2ec9-4f8a-a897-4495e620cc8f tempest-VolumesSnapshotTestJSON-1364937772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce" returned: 0 in 0.262s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:18:32 devstack cinder-volume[88695]: DEBUG cinder.manager [None req-4bc00669-2ec9-4f8a-a897-4495e620cc8f tempest-VolumesSnapshotTestJSON-1364937772 None] Notifying Schedulers of capabilities ... {{(pid=88695) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 06:18:32 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-4bc00669-2ec9-4f8a-a897-4495e620cc8f tempest-VolumesSnapshotTestJSON-1364937772 None] Deleted volume successfully. Aug 05 06:18:32 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-4bc00669-2ec9-4f8a-a897-4495e620cc8f tempest-VolumesSnapshotTestJSON-1364937772 None] Lock "cinder-7a9920a5-aeef-475d-a471-a4e48a5c7932-delete_volume" released by "delete_volume" :: held 1.329s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:18:33 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-de0cf3ca-e115-4ded-9174-6f8cb6c2d438 tempest-GroupSnapshotsTest-1900443889 None] Update group completed successfully. Aug 05 06:18:34 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-cc07dde4-7663-494b-85fa-53e121ceb6ac tempest-GroupSnapshotsTest-1900443889 None] Update group completed successfully. Aug 05 06:18:36 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-bad34d8e-bb09-4da5-b555-c7f3ea4109b3 tempest-GroupSnapshotsTest-1900443889 None] GroupSnapshot f6efc1f3-878b-4030-9261-597746ebbe49: creating. Aug 05 06:18:36 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-bad34d8e-bb09-4da5-b555-c7f3ea4109b3 tempest-GroupSnapshotsTest-1900443889 None] Group snapshot f6efc1f3-878b-4030-9261-597746ebbe49: creating. {{(pid=88695) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Aug 05 06:18:36 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-bad34d8e-bb09-4da5-b555-c7f3ea4109b3 tempest-GroupSnapshotsTest-1900443889 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:18:36 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-bad34d8e-bb09-4da5-b555-c7f3ea4109b3 tempest-GroupSnapshotsTest-1900443889 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.005s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:18:36 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-bad34d8e-bb09-4da5-b555-c7f3ea4109b3 tempest-GroupSnapshotsTest-1900443889 None] Creating offline snapshot 63be9329-e27b-4a71-8723-ef4510dd09ee of volume 92f6d647-ac2f-4679-98c3-eae4fedcb935 {{(pid=88695) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 06:18:36 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a2093de-5b0f-47a2-a234-2cf43f58c721]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:18:36 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-bad34d8e-bb09-4da5-b555-c7f3ea4109b3 tempest-GroupSnapshotsTest-1900443889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-92f6d647-ac2f-4679-98c3-eae4fedcb935 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:18:36 devstack sudo[96946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-92f6d647-ac2f-4679-98c3-eae4fedcb935 Aug 05 06:18:36 devstack sudo[96946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:18:36 devstack sudo[96946]: pam_unix(sudo:session): session closed for user root Aug 05 06:18:36 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-bad34d8e-bb09-4da5-b555-c7f3ea4109b3 tempest-GroupSnapshotsTest-1900443889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-92f6d647-ac2f-4679-98c3-eae4fedcb935" returned: 0 in 0.391s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:18:36 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-bad34d8e-bb09-4da5-b555-c7f3ea4109b3 tempest-GroupSnapshotsTest-1900443889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-92f6d647-ac2f-4679-98c3-eae4fedcb935,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-92f6d647-ac2f-4679-98c3-eae4fedcb935.63be9329-e27b-4a71-8723-ef4510dd09ee 1G {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:18:36 devstack sudo[96951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-92f6d647-ac2f-4679-98c3-eae4fedcb935,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-92f6d647-ac2f-4679-98c3-eae4fedcb935.63be9329-e27b-4a71-8723-ef4510dd09ee 1G Aug 05 06:18:36 devstack sudo[96951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:18:37 devstack sudo[96951]: pam_unix(sudo:session): session closed for user root Aug 05 06:18:37 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-bad34d8e-bb09-4da5-b555-c7f3ea4109b3 tempest-GroupSnapshotsTest-1900443889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-92f6d647-ac2f-4679-98c3-eae4fedcb935,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-92f6d647-ac2f-4679-98c3-eae4fedcb935.63be9329-e27b-4a71-8723-ef4510dd09ee 1G" returned: 0 in 0.411s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:18:37 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-bad34d8e-bb09-4da5-b555-c7f3ea4109b3 tempest-GroupSnapshotsTest-1900443889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-92f6d647-ac2f-4679-98c3-eae4fedcb935 -F qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-92f6d647-ac2f-4679-98c3-eae4fedcb935.63be9329-e27b-4a71-8723-ef4510dd09ee {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:18:37 devstack sudo[96957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-92f6d647-ac2f-4679-98c3-eae4fedcb935 -F qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-92f6d647-ac2f-4679-98c3-eae4fedcb935.63be9329-e27b-4a71-8723-ef4510dd09ee Aug 05 06:18:37 devstack sudo[96957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:18:37 devstack sudo[96957]: pam_unix(sudo:session): session closed for user root Aug 05 06:18:37 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-bad34d8e-bb09-4da5-b555-c7f3ea4109b3 tempest-GroupSnapshotsTest-1900443889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-92f6d647-ac2f-4679-98c3-eae4fedcb935 -F qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-92f6d647-ac2f-4679-98c3-eae4fedcb935.63be9329-e27b-4a71-8723-ef4510dd09ee" returned: 0 in 0.302s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:18:37 devstack cinder-volume[88695]: WARNING cinder.volume.drivers.remotefs [None req-bad34d8e-bb09-4da5-b555-c7f3ea4109b3 tempest-GroupSnapshotsTest-1900443889 None] /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-92f6d647-ac2f-4679-98c3-eae4fedcb935.63be9329-e27b-4a71-8723-ef4510dd09ee is being set with open permissions: ugo+rw: NotImplementedError Aug 05 06:18:37 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-bad34d8e-bb09-4da5-b555-c7f3ea4109b3 tempest-GroupSnapshotsTest-1900443889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-92f6d647-ac2f-4679-98c3-eae4fedcb935.63be9329-e27b-4a71-8723-ef4510dd09ee {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:18:37 devstack sudo[96963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-92f6d647-ac2f-4679-98c3-eae4fedcb935.63be9329-e27b-4a71-8723-ef4510dd09ee Aug 05 06:18:37 devstack sudo[96963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:18:37 devstack sudo[96963]: pam_unix(sudo:session): session closed for user root Aug 05 06:18:37 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-bad34d8e-bb09-4da5-b555-c7f3ea4109b3 tempest-GroupSnapshotsTest-1900443889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-92f6d647-ac2f-4679-98c3-eae4fedcb935.63be9329-e27b-4a71-8723-ef4510dd09ee" returned: 0 in 0.246s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:18:37 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-bad34d8e-bb09-4da5-b555-c7f3ea4109b3 tempest-GroupSnapshotsTest-1900443889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-92f6d647-ac2f-4679-98c3-eae4fedcb935.info {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:18:37 devstack sudo[96967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-92f6d647-ac2f-4679-98c3-eae4fedcb935.info Aug 05 06:18:37 devstack sudo[96967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:18:38 devstack sudo[96967]: pam_unix(sudo:session): session closed for user root Aug 05 06:18:38 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-bad34d8e-bb09-4da5-b555-c7f3ea4109b3 tempest-GroupSnapshotsTest-1900443889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-92f6d647-ac2f-4679-98c3-eae4fedcb935.info" returned: 0 in 0.269s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:18:38 devstack cinder-volume[88695]: WARNING cinder.volume.drivers.remotefs [None req-bad34d8e-bb09-4da5-b555-c7f3ea4109b3 tempest-GroupSnapshotsTest-1900443889 None] /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-92f6d647-ac2f-4679-98c3-eae4fedcb935.info is being set with open permissions: ugo+rw: NotImplementedError Aug 05 06:18:38 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-bad34d8e-bb09-4da5-b555-c7f3ea4109b3 tempest-GroupSnapshotsTest-1900443889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-92f6d647-ac2f-4679-98c3-eae4fedcb935.info {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:18:38 devstack sudo[96970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-92f6d647-ac2f-4679-98c3-eae4fedcb935.info Aug 05 06:18:38 devstack sudo[96970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:18:38 devstack sudo[96970]: pam_unix(sudo:session): session closed for user root Aug 05 06:18:38 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-bad34d8e-bb09-4da5-b555-c7f3ea4109b3 tempest-GroupSnapshotsTest-1900443889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-92f6d647-ac2f-4679-98c3-eae4fedcb935.info" returned: 0 in 0.247s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:18:38 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-bad34d8e-bb09-4da5-b555-c7f3ea4109b3 tempest-GroupSnapshotsTest-1900443889 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.953s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:18:38 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-bad34d8e-bb09-4da5-b555-c7f3ea4109b3 tempest-GroupSnapshotsTest-1900443889 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:18:38 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-bad34d8e-bb09-4da5-b555-c7f3ea4109b3 tempest-GroupSnapshotsTest-1900443889 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:18:38 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-bad34d8e-bb09-4da5-b555-c7f3ea4109b3 tempest-GroupSnapshotsTest-1900443889 None] Creating offline snapshot a3dbd292-0fd5-4670-ae5b-73b3c5561c48 of volume b37bec96-52f0-42ba-85e8-fd64f53043af {{(pid=88695) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 06:18:38 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[13a268c4-3fdc-4cef-bade-29f51e35743d]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:18:38 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-bad34d8e-bb09-4da5-b555-c7f3ea4109b3 tempest-GroupSnapshotsTest-1900443889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-b37bec96-52f0-42ba-85e8-fd64f53043af {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:18:38 devstack sudo[96973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-b37bec96-52f0-42ba-85e8-fd64f53043af Aug 05 06:18:38 devstack sudo[96973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:18:38 devstack cinder-volume[88695]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7c4fd05-405d-4916-962c-970e3f06f982 tempest-VolumesSnapshotListTestJSON-1568202637 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88695) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 06:18:38 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-f7c4fd05-405d-4916-962c-970e3f06f982 tempest-VolumesSnapshotListTestJSON-1568202637 None] Flow 'volume_create_manager' (bb11fa34-908f-4542-a88f-e03d144528bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:18:38 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-f7c4fd05-405d-4916-962c-970e3f06f982 tempest-VolumesSnapshotListTestJSON-1568202637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3599dc7e-4313-4c46-b4d0-76d771dc34bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:18:38 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-f7c4fd05-405d-4916-962c-970e3f06f982 tempest-VolumesSnapshotListTestJSON-1568202637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3599dc7e-4313-4c46-b4d0-76d771dc34bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:18:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1511487333',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d75d6f9-bbee-4d87-b27c-07f15453aeff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53adac14e92a41719d0898331c34d919',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:18:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:18:38Z,use_quota=True,user_id='567e6620aadb4a20b7fceeee89cc22e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:18:38 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-f7c4fd05-405d-4916-962c-970e3f06f982 tempest-VolumesSnapshotListTestJSON-1568202637 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0e4288b-52af-44d1-a1aa-c56030fe42bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:18:38 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-f7c4fd05-405d-4916-962c-970e3f06f982 tempest-VolumesSnapshotListTestJSON-1568202637 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0e4288b-52af-44d1-a1aa-c56030fe42bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:18:38 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-f7c4fd05-405d-4916-962c-970e3f06f982 tempest-VolumesSnapshotListTestJSON-1568202637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a755587-7e11-4d74-be9c-aaf45be159c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:18:38 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-f7c4fd05-405d-4916-962c-970e3f06f982 tempest-VolumesSnapshotListTestJSON-1568202637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a755587-7e11-4d74-be9c-aaf45be159c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d75d6f9-bbee-4d87-b27c-07f15453aeff', 'volume_name': 'volume-7d75d6f9-bbee-4d87-b27c-07f15453aeff', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:18:38 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-f7c4fd05-405d-4916-962c-970e3f06f982 tempest-VolumesSnapshotListTestJSON-1568202637 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8601c798-d792-41d5-ae8b-9c4c27bb3fc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:18:38 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-f7c4fd05-405d-4916-962c-970e3f06f982 tempest-VolumesSnapshotListTestJSON-1568202637 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8601c798-d792-41d5-ae8b-9c4c27bb3fc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:18:38 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-f7c4fd05-405d-4916-962c-970e3f06f982 tempest-VolumesSnapshotListTestJSON-1568202637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebaf168e-acf3-405b-a04e-c36141ca5fd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:18:38 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-f7c4fd05-405d-4916-962c-970e3f06f982 tempest-VolumesSnapshotListTestJSON-1568202637 None] Volume 7d75d6f9-bbee-4d87-b27c-07f15453aeff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d75d6f9-bbee-4d87-b27c-07f15453aeff', 'volume_size': 1} Aug 05 06:18:38 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-f7c4fd05-405d-4916-962c-970e3f06f982 tempest-VolumesSnapshotListTestJSON-1568202637 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:18:38 devstack sudo[96973]: pam_unix(sudo:session): session closed for user root Aug 05 06:18:38 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-bad34d8e-bb09-4da5-b555-c7f3ea4109b3 tempest-GroupSnapshotsTest-1900443889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-b37bec96-52f0-42ba-85e8-fd64f53043af" returned: 0 in 0.379s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:18:38 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-bad34d8e-bb09-4da5-b555-c7f3ea4109b3 tempest-GroupSnapshotsTest-1900443889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-b37bec96-52f0-42ba-85e8-fd64f53043af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-b37bec96-52f0-42ba-85e8-fd64f53043af.a3dbd292-0fd5-4670-ae5b-73b3c5561c48 1G {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:18:38 devstack sudo[96978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-b37bec96-52f0-42ba-85e8-fd64f53043af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-b37bec96-52f0-42ba-85e8-fd64f53043af.a3dbd292-0fd5-4670-ae5b-73b3c5561c48 1G Aug 05 06:18:38 devstack sudo[96978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:18:39 devstack sudo[96978]: pam_unix(sudo:session): session closed for user root Aug 05 06:18:39 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-bad34d8e-bb09-4da5-b555-c7f3ea4109b3 tempest-GroupSnapshotsTest-1900443889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-b37bec96-52f0-42ba-85e8-fd64f53043af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-b37bec96-52f0-42ba-85e8-fd64f53043af.a3dbd292-0fd5-4670-ae5b-73b3c5561c48 1G" returned: 0 in 0.386s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:18:39 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-bad34d8e-bb09-4da5-b555-c7f3ea4109b3 tempest-GroupSnapshotsTest-1900443889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b37bec96-52f0-42ba-85e8-fd64f53043af -F qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-b37bec96-52f0-42ba-85e8-fd64f53043af.a3dbd292-0fd5-4670-ae5b-73b3c5561c48 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:18:39 devstack sudo[96983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b37bec96-52f0-42ba-85e8-fd64f53043af -F qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-b37bec96-52f0-42ba-85e8-fd64f53043af.a3dbd292-0fd5-4670-ae5b-73b3c5561c48 Aug 05 06:18:39 devstack sudo[96983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:18:39 devstack sudo[96983]: pam_unix(sudo:session): session closed for user root Aug 05 06:18:39 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-bad34d8e-bb09-4da5-b555-c7f3ea4109b3 tempest-GroupSnapshotsTest-1900443889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b37bec96-52f0-42ba-85e8-fd64f53043af -F qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-b37bec96-52f0-42ba-85e8-fd64f53043af.a3dbd292-0fd5-4670-ae5b-73b3c5561c48" returned: 0 in 0.299s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:18:39 devstack cinder-volume[88695]: WARNING cinder.volume.drivers.remotefs [None req-bad34d8e-bb09-4da5-b555-c7f3ea4109b3 tempest-GroupSnapshotsTest-1900443889 None] /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-b37bec96-52f0-42ba-85e8-fd64f53043af.a3dbd292-0fd5-4670-ae5b-73b3c5561c48 is being set with open permissions: ugo+rw: NotImplementedError Aug 05 06:18:39 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-bad34d8e-bb09-4da5-b555-c7f3ea4109b3 tempest-GroupSnapshotsTest-1900443889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-b37bec96-52f0-42ba-85e8-fd64f53043af.a3dbd292-0fd5-4670-ae5b-73b3c5561c48 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:18:39 devstack sudo[96988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-b37bec96-52f0-42ba-85e8-fd64f53043af.a3dbd292-0fd5-4670-ae5b-73b3c5561c48 Aug 05 06:18:39 devstack sudo[96988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:18:39 devstack sudo[96988]: pam_unix(sudo:session): session closed for user root Aug 05 06:18:39 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-bad34d8e-bb09-4da5-b555-c7f3ea4109b3 tempest-GroupSnapshotsTest-1900443889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-b37bec96-52f0-42ba-85e8-fd64f53043af.a3dbd292-0fd5-4670-ae5b-73b3c5561c48" returned: 0 in 0.269s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:18:39 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-bad34d8e-bb09-4da5-b555-c7f3ea4109b3 tempest-GroupSnapshotsTest-1900443889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-b37bec96-52f0-42ba-85e8-fd64f53043af.info {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:18:39 devstack sudo[96991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-b37bec96-52f0-42ba-85e8-fd64f53043af.info Aug 05 06:18:39 devstack sudo[96991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:18:40 devstack sudo[96991]: pam_unix(sudo:session): session closed for user root Aug 05 06:18:40 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-bad34d8e-bb09-4da5-b555-c7f3ea4109b3 tempest-GroupSnapshotsTest-1900443889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-b37bec96-52f0-42ba-85e8-fd64f53043af.info" returned: 0 in 0.274s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:18:40 devstack cinder-volume[88695]: WARNING cinder.volume.drivers.remotefs [None req-bad34d8e-bb09-4da5-b555-c7f3ea4109b3 tempest-GroupSnapshotsTest-1900443889 None] /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-b37bec96-52f0-42ba-85e8-fd64f53043af.info is being set with open permissions: ugo+rw: NotImplementedError Aug 05 06:18:40 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-bad34d8e-bb09-4da5-b555-c7f3ea4109b3 tempest-GroupSnapshotsTest-1900443889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-b37bec96-52f0-42ba-85e8-fd64f53043af.info {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:18:40 devstack sudo[96994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-b37bec96-52f0-42ba-85e8-fd64f53043af.info Aug 05 06:18:40 devstack sudo[96994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:18:40 devstack sudo[96994]: pam_unix(sudo:session): session closed for user root Aug 05 06:18:40 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-bad34d8e-bb09-4da5-b555-c7f3ea4109b3 tempest-GroupSnapshotsTest-1900443889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-b37bec96-52f0-42ba-85e8-fd64f53043af.info" returned: 0 in 0.266s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:18:40 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-bad34d8e-bb09-4da5-b555-c7f3ea4109b3 tempest-GroupSnapshotsTest-1900443889 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.966s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:18:40 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-f7c4fd05-405d-4916-962c-970e3f06f982 tempest-VolumesSnapshotListTestJSON-1568202637 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.685s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:18:40 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-f7c4fd05-405d-4916-962c-970e3f06f982 tempest-VolumesSnapshotListTestJSON-1568202637 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:18:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1511487333',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d75d6f9-bbee-4d87-b27c-07f15453aeff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53adac14e92a41719d0898331c34d919',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:18:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:18:38Z,use_quota=True,user_id='567e6620aadb4a20b7fceeee89cc22e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)}" {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 06:18:40 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-f7c4fd05-405d-4916-962c-970e3f06f982 tempest-VolumesSnapshotListTestJSON-1568202637 None] Creating volume 7d75d6f9-bbee-4d87-b27c-07f15453aeff {{(pid=88695) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 06:18:40 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-f7c4fd05-405d-4916-962c-970e3f06f982 tempest-VolumesSnapshotListTestJSON-1568202637 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:18:40 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-f7c4fd05-405d-4916-962c-970e3f06f982 tempest-VolumesSnapshotListTestJSON-1568202637 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:18:40 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-f7c4fd05-405d-4916-962c-970e3f06f982 tempest-VolumesSnapshotListTestJSON-1568202637 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:18:40 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-f7c4fd05-405d-4916-962c-970e3f06f982 tempest-VolumesSnapshotListTestJSON-1568202637 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:18:40 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-f7c4fd05-405d-4916-962c-970e3f06f982 tempest-VolumesSnapshotListTestJSON-1568202637 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:18:40 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-f7c4fd05-405d-4916-962c-970e3f06f982 tempest-VolumesSnapshotListTestJSON-1568202637 None] Selected osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 as target Quobyte volume. {{(pid=88695) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 06:18:40 devstack cinder-volume[88695]: INFO cinder.volume.drivers.remotefs [None req-f7c4fd05-405d-4916-962c-970e3f06f982 tempest-VolumesSnapshotListTestJSON-1568202637 None] casted to osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 Aug 05 06:18:40 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-f7c4fd05-405d-4916-962c-970e3f06f982 tempest-VolumesSnapshotListTestJSON-1568202637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7d75d6f9-bbee-4d87-b27c-07f15453aeff 1073741824 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:18:40 devstack sudo[96997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7d75d6f9-bbee-4d87-b27c-07f15453aeff 1073741824 Aug 05 06:18:40 devstack sudo[96997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:18:40 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-bad34d8e-bb09-4da5-b555-c7f3ea4109b3 tempest-GroupSnapshotsTest-1900443889 None] group_snapshot f6efc1f3-878b-4030-9261-597746ebbe49: created successfully Aug 05 06:18:40 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-b008cd80-0c9b-4636-9f15-04731df35a9a tempest-GroupSnapshotsTest-1900443889 None] group_snapshot f6efc1f3-878b-4030-9261-597746ebbe49: deleting Aug 05 06:18:40 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-b008cd80-0c9b-4636-9f15-04731df35a9a tempest-GroupSnapshotsTest-1900443889 None] group_snapshot f6efc1f3-878b-4030-9261-597746ebbe49: deleting {{(pid=88695) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Aug 05 06:18:40 devstack sudo[96997]: pam_unix(sudo:session): session closed for user root Aug 05 06:18:40 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-b008cd80-0c9b-4636-9f15-04731df35a9a tempest-GroupSnapshotsTest-1900443889 None] Acquiring lock "cinder-quobyte-92f6d647-ac2f-4679-98c3-eae4fedcb935" by "delete_snapshot" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:18:40 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-f7c4fd05-405d-4916-962c-970e3f06f982 tempest-VolumesSnapshotListTestJSON-1568202637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7d75d6f9-bbee-4d87-b27c-07f15453aeff 1073741824" returned: 0 in 0.544s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:18:40 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-b008cd80-0c9b-4636-9f15-04731df35a9a tempest-GroupSnapshotsTest-1900443889 None] Lock "cinder-quobyte-92f6d647-ac2f-4679-98c3-eae4fedcb935" acquired by "delete_snapshot" :: waited 0.026s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:18:40 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-b008cd80-0c9b-4636-9f15-04731df35a9a tempest-GroupSnapshotsTest-1900443889 None] Acquiring lock "cinder-quobyte-63be9329-e27b-4a71-8723-ef4510dd09ee" by "_delete_snapshot" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:18:40 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-b008cd80-0c9b-4636-9f15-04731df35a9a tempest-GroupSnapshotsTest-1900443889 None] Lock "cinder-quobyte-63be9329-e27b-4a71-8723-ef4510dd09ee" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:18:40 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-b008cd80-0c9b-4636-9f15-04731df35a9a tempest-GroupSnapshotsTest-1900443889 None] Deleting offline snapshot 63be9329-e27b-4a71-8723-ef4510dd09ee of volume 92f6d647-ac2f-4679-98c3-eae4fedcb935 {{(pid=88695) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 06:18:40 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-b008cd80-0c9b-4636-9f15-04731df35a9a tempest-GroupSnapshotsTest-1900443889 None] snapshot_file for this snap is: volume-92f6d647-ac2f-4679-98c3-eae4fedcb935.63be9329-e27b-4a71-8723-ef4510dd09ee {{(pid=88695) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 06:18:40 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-f7c4fd05-405d-4916-962c-970e3f06f982 tempest-VolumesSnapshotListTestJSON-1568202637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7d75d6f9-bbee-4d87-b27c-07f15453aeff {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:18:40 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[c54b3b82-3d69-467e-ab0e-03e1ab4bf8e0]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:18:40 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-b008cd80-0c9b-4636-9f15-04731df35a9a tempest-GroupSnapshotsTest-1900443889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-92f6d647-ac2f-4679-98c3-eae4fedcb935.63be9329-e27b-4a71-8723-ef4510dd09ee {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:18:40 devstack sudo[97006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7d75d6f9-bbee-4d87-b27c-07f15453aeff Aug 05 06:18:40 devstack sudo[97006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:18:41 devstack sudo[97007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-92f6d647-ac2f-4679-98c3-eae4fedcb935.63be9329-e27b-4a71-8723-ef4510dd09ee Aug 05 06:18:41 devstack sudo[97007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:18:41 devstack sudo[97006]: pam_unix(sudo:session): session closed for user root Aug 05 06:18:41 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-f7c4fd05-405d-4916-962c-970e3f06f982 tempest-VolumesSnapshotListTestJSON-1568202637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7d75d6f9-bbee-4d87-b27c-07f15453aeff" returned: 0 in 0.295s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:18:41 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-f7c4fd05-405d-4916-962c-970e3f06f982 tempest-VolumesSnapshotListTestJSON-1568202637 None] <== create_volume: return (919ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'} {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 06:18:41 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-f7c4fd05-405d-4916-962c-970e3f06f982 tempest-VolumesSnapshotListTestJSON-1568202637 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.923s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:18:41 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-f7c4fd05-405d-4916-962c-970e3f06f982 tempest-VolumesSnapshotListTestJSON-1568202637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebaf168e-acf3-405b-a04e-c36141ca5fd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d75d6f9-bbee-4d87-b27c-07f15453aeff', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:18:41 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-f7c4fd05-405d-4916-962c-970e3f06f982 tempest-VolumesSnapshotListTestJSON-1568202637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b5322d0-e00b-4106-87ec-99739f4feb50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:18:41 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-f7c4fd05-405d-4916-962c-970e3f06f982 tempest-VolumesSnapshotListTestJSON-1568202637 None] Volume volume-7d75d6f9-bbee-4d87-b27c-07f15453aeff (7d75d6f9-bbee-4d87-b27c-07f15453aeff): created successfully Aug 05 06:18:41 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-f7c4fd05-405d-4916-962c-970e3f06f982 tempest-VolumesSnapshotListTestJSON-1568202637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b5322d0-e00b-4106-87ec-99739f4feb50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:18:41 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-f7c4fd05-405d-4916-962c-970e3f06f982 tempest-VolumesSnapshotListTestJSON-1568202637 None] Flow 'volume_create_manager' (bb11fa34-908f-4542-a88f-e03d144528bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:18:41 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-f7c4fd05-405d-4916-962c-970e3f06f982 tempest-VolumesSnapshotListTestJSON-1568202637 None] Created volume successfully. Aug 05 06:18:41 devstack sudo[97007]: pam_unix(sudo:session): session closed for user root Aug 05 06:18:41 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-b008cd80-0c9b-4636-9f15-04731df35a9a tempest-GroupSnapshotsTest-1900443889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-92f6d647-ac2f-4679-98c3-eae4fedcb935.63be9329-e27b-4a71-8723-ef4510dd09ee" returned: 0 in 0.482s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:18:41 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-b008cd80-0c9b-4636-9f15-04731df35a9a tempest-GroupSnapshotsTest-1900443889 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-92f6d647-ac2f-4679-98c3-eae4fedcb935(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88695) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 06:18:41 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[b88b807e-aeae-491e-a502-c5f35765a52c]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:18:41 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-b008cd80-0c9b-4636-9f15-04731df35a9a tempest-GroupSnapshotsTest-1900443889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-92f6d647-ac2f-4679-98c3-eae4fedcb935 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:18:41 devstack sudo[97015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-92f6d647-ac2f-4679-98c3-eae4fedcb935 Aug 05 06:18:41 devstack sudo[97015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:18:41 devstack sudo[97015]: pam_unix(sudo:session): session closed for user root Aug 05 06:18:41 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-b008cd80-0c9b-4636-9f15-04731df35a9a tempest-GroupSnapshotsTest-1900443889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-92f6d647-ac2f-4679-98c3-eae4fedcb935" returned: 0 in 0.411s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:18:41 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-b008cd80-0c9b-4636-9f15-04731df35a9a tempest-GroupSnapshotsTest-1900443889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-92f6d647-ac2f-4679-98c3-eae4fedcb935.63be9329-e27b-4a71-8723-ef4510dd09ee {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:18:41 devstack sudo[97020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-92f6d647-ac2f-4679-98c3-eae4fedcb935.63be9329-e27b-4a71-8723-ef4510dd09ee Aug 05 06:18:41 devstack sudo[97020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:18:41 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-ce6c207c-f60d-4492-8d23-3571decd24ac tempest-VolumesSnapshotListTestJSON-1568202637 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:18:41 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-ce6c207c-f60d-4492-8d23-3571decd24ac tempest-VolumesSnapshotListTestJSON-1568202637 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:18:41 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-ce6c207c-f60d-4492-8d23-3571decd24ac tempest-VolumesSnapshotListTestJSON-1568202637 None] Creating offline snapshot 9d7ccf49-9ddc-4165-a4a6-57e2ae484159 of volume 7d75d6f9-bbee-4d87-b27c-07f15453aeff {{(pid=88695) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 06:18:41 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[54b78ad9-c051-4452-b055-422d97ce633f]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:18:41 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-ce6c207c-f60d-4492-8d23-3571decd24ac tempest-VolumesSnapshotListTestJSON-1568202637 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7d75d6f9-bbee-4d87-b27c-07f15453aeff {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:18:42 devstack sudo[97022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7d75d6f9-bbee-4d87-b27c-07f15453aeff Aug 05 06:18:42 devstack sudo[97022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:18:42 devstack sudo[97020]: pam_unix(sudo:session): session closed for user root Aug 05 06:18:42 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-b008cd80-0c9b-4636-9f15-04731df35a9a tempest-GroupSnapshotsTest-1900443889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-92f6d647-ac2f-4679-98c3-eae4fedcb935.63be9329-e27b-4a71-8723-ef4510dd09ee" returned: 0 in 0.353s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:18:42 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-b008cd80-0c9b-4636-9f15-04731df35a9a tempest-GroupSnapshotsTest-1900443889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-92f6d647-ac2f-4679-98c3-eae4fedcb935.63be9329-e27b-4a71-8723-ef4510dd09ee {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:18:42 devstack sudo[97027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-92f6d647-ac2f-4679-98c3-eae4fedcb935.63be9329-e27b-4a71-8723-ef4510dd09ee Aug 05 06:18:42 devstack sudo[97027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:18:42 devstack sudo[97022]: pam_unix(sudo:session): session closed for user root Aug 05 06:18:42 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-ce6c207c-f60d-4492-8d23-3571decd24ac tempest-VolumesSnapshotListTestJSON-1568202637 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7d75d6f9-bbee-4d87-b27c-07f15453aeff" returned: 0 in 0.401s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:18:42 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-ce6c207c-f60d-4492-8d23-3571decd24ac tempest-VolumesSnapshotListTestJSON-1568202637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7d75d6f9-bbee-4d87-b27c-07f15453aeff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7d75d6f9-bbee-4d87-b27c-07f15453aeff.9d7ccf49-9ddc-4165-a4a6-57e2ae484159 1G {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:18:42 devstack sudo[97032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7d75d6f9-bbee-4d87-b27c-07f15453aeff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7d75d6f9-bbee-4d87-b27c-07f15453aeff.9d7ccf49-9ddc-4165-a4a6-57e2ae484159 1G Aug 05 06:18:42 devstack sudo[97032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:18:42 devstack sudo[97027]: pam_unix(sudo:session): session closed for user root Aug 05 06:18:42 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-b008cd80-0c9b-4636-9f15-04731df35a9a tempest-GroupSnapshotsTest-1900443889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-92f6d647-ac2f-4679-98c3-eae4fedcb935.63be9329-e27b-4a71-8723-ef4510dd09ee" returned: 0 in 0.249s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:18:42 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-b008cd80-0c9b-4636-9f15-04731df35a9a tempest-GroupSnapshotsTest-1900443889 None] Lock "cinder-quobyte-63be9329-e27b-4a71-8723-ef4510dd09ee" released by "_delete_snapshot" :: held 1.604s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:18:42 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-b008cd80-0c9b-4636-9f15-04731df35a9a tempest-GroupSnapshotsTest-1900443889 None] Lock "cinder-quobyte-92f6d647-ac2f-4679-98c3-eae4fedcb935" released by "delete_snapshot" :: held 1.633s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:18:42 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-b008cd80-0c9b-4636-9f15-04731df35a9a tempest-GroupSnapshotsTest-1900443889 None] Acquiring lock "cinder-quobyte-b37bec96-52f0-42ba-85e8-fd64f53043af" by "delete_snapshot" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:18:42 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-b008cd80-0c9b-4636-9f15-04731df35a9a tempest-GroupSnapshotsTest-1900443889 None] Lock "cinder-quobyte-b37bec96-52f0-42ba-85e8-fd64f53043af" acquired by "delete_snapshot" :: waited 0.015s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:18:42 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-b008cd80-0c9b-4636-9f15-04731df35a9a tempest-GroupSnapshotsTest-1900443889 None] Acquiring lock "cinder-quobyte-a3dbd292-0fd5-4670-ae5b-73b3c5561c48" by "_delete_snapshot" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:18:42 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-b008cd80-0c9b-4636-9f15-04731df35a9a tempest-GroupSnapshotsTest-1900443889 None] Lock "cinder-quobyte-a3dbd292-0fd5-4670-ae5b-73b3c5561c48" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:18:42 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-b008cd80-0c9b-4636-9f15-04731df35a9a tempest-GroupSnapshotsTest-1900443889 None] Deleting offline snapshot a3dbd292-0fd5-4670-ae5b-73b3c5561c48 of volume b37bec96-52f0-42ba-85e8-fd64f53043af {{(pid=88695) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 06:18:42 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-b008cd80-0c9b-4636-9f15-04731df35a9a tempest-GroupSnapshotsTest-1900443889 None] snapshot_file for this snap is: volume-b37bec96-52f0-42ba-85e8-fd64f53043af.a3dbd292-0fd5-4670-ae5b-73b3c5561c48 {{(pid=88695) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 06:18:42 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[749e14de-16fa-47c1-88f5-6c4b0dd90639]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:18:42 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-b008cd80-0c9b-4636-9f15-04731df35a9a tempest-GroupSnapshotsTest-1900443889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-b37bec96-52f0-42ba-85e8-fd64f53043af.a3dbd292-0fd5-4670-ae5b-73b3c5561c48 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:18:42 devstack sudo[97037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-b37bec96-52f0-42ba-85e8-fd64f53043af.a3dbd292-0fd5-4670-ae5b-73b3c5561c48 Aug 05 06:18:42 devstack sudo[97037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:18:42 devstack sudo[97032]: pam_unix(sudo:session): session closed for user root Aug 05 06:18:42 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-ce6c207c-f60d-4492-8d23-3571decd24ac tempest-VolumesSnapshotListTestJSON-1568202637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7d75d6f9-bbee-4d87-b27c-07f15453aeff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7d75d6f9-bbee-4d87-b27c-07f15453aeff.9d7ccf49-9ddc-4165-a4a6-57e2ae484159 1G" returned: 0 in 0.409s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:18:42 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-ce6c207c-f60d-4492-8d23-3571decd24ac tempest-VolumesSnapshotListTestJSON-1568202637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d75d6f9-bbee-4d87-b27c-07f15453aeff -F qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7d75d6f9-bbee-4d87-b27c-07f15453aeff.9d7ccf49-9ddc-4165-a4a6-57e2ae484159 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:18:42 devstack sudo[97041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d75d6f9-bbee-4d87-b27c-07f15453aeff -F qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7d75d6f9-bbee-4d87-b27c-07f15453aeff.9d7ccf49-9ddc-4165-a4a6-57e2ae484159 Aug 05 06:18:42 devstack sudo[97041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:18:42 devstack sudo[97037]: pam_unix(sudo:session): session closed for user root Aug 05 06:18:42 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-b008cd80-0c9b-4636-9f15-04731df35a9a tempest-GroupSnapshotsTest-1900443889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-b37bec96-52f0-42ba-85e8-fd64f53043af.a3dbd292-0fd5-4670-ae5b-73b3c5561c48" returned: 0 in 0.394s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:18:42 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-b008cd80-0c9b-4636-9f15-04731df35a9a tempest-GroupSnapshotsTest-1900443889 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b37bec96-52f0-42ba-85e8-fd64f53043af(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88695) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 06:18:43 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[5068ec39-f457-49fa-94b2-1b97424d2bc2]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:18:43 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-b008cd80-0c9b-4636-9f15-04731df35a9a tempest-GroupSnapshotsTest-1900443889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-b37bec96-52f0-42ba-85e8-fd64f53043af {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:18:43 devstack sudo[97041]: pam_unix(sudo:session): session closed for user root Aug 05 06:18:43 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-ce6c207c-f60d-4492-8d23-3571decd24ac tempest-VolumesSnapshotListTestJSON-1568202637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d75d6f9-bbee-4d87-b27c-07f15453aeff -F qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7d75d6f9-bbee-4d87-b27c-07f15453aeff.9d7ccf49-9ddc-4165-a4a6-57e2ae484159" returned: 0 in 0.312s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:18:43 devstack cinder-volume[88695]: WARNING cinder.volume.drivers.remotefs [None req-ce6c207c-f60d-4492-8d23-3571decd24ac tempest-VolumesSnapshotListTestJSON-1568202637 None] /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7d75d6f9-bbee-4d87-b27c-07f15453aeff.9d7ccf49-9ddc-4165-a4a6-57e2ae484159 is being set with open permissions: ugo+rw Aug 05 06:18:43 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-ce6c207c-f60d-4492-8d23-3571decd24ac tempest-VolumesSnapshotListTestJSON-1568202637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7d75d6f9-bbee-4d87-b27c-07f15453aeff.9d7ccf49-9ddc-4165-a4a6-57e2ae484159 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:18:43 devstack sudo[97050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7d75d6f9-bbee-4d87-b27c-07f15453aeff.9d7ccf49-9ddc-4165-a4a6-57e2ae484159 Aug 05 06:18:43 devstack sudo[97050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:18:43 devstack sudo[97049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-b37bec96-52f0-42ba-85e8-fd64f53043af Aug 05 06:18:43 devstack sudo[97049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:18:43 devstack sudo[97050]: pam_unix(sudo:session): session closed for user root Aug 05 06:18:43 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-ce6c207c-f60d-4492-8d23-3571decd24ac tempest-VolumesSnapshotListTestJSON-1568202637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7d75d6f9-bbee-4d87-b27c-07f15453aeff.9d7ccf49-9ddc-4165-a4a6-57e2ae484159" returned: 0 in 0.246s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:18:43 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-ce6c207c-f60d-4492-8d23-3571decd24ac tempest-VolumesSnapshotListTestJSON-1568202637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7d75d6f9-bbee-4d87-b27c-07f15453aeff.info {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:18:43 devstack sudo[97058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7d75d6f9-bbee-4d87-b27c-07f15453aeff.info Aug 05 06:18:43 devstack sudo[97058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:18:43 devstack sudo[97049]: pam_unix(sudo:session): session closed for user root Aug 05 06:18:43 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-b008cd80-0c9b-4636-9f15-04731df35a9a tempest-GroupSnapshotsTest-1900443889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-b37bec96-52f0-42ba-85e8-fd64f53043af" returned: 0 in 0.382s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:18:43 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-b008cd80-0c9b-4636-9f15-04731df35a9a tempest-GroupSnapshotsTest-1900443889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-b37bec96-52f0-42ba-85e8-fd64f53043af.a3dbd292-0fd5-4670-ae5b-73b3c5561c48 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:18:43 devstack sudo[97060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-b37bec96-52f0-42ba-85e8-fd64f53043af.a3dbd292-0fd5-4670-ae5b-73b3c5561c48 Aug 05 06:18:43 devstack sudo[97060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:18:43 devstack sudo[97058]: pam_unix(sudo:session): session closed for user root Aug 05 06:18:43 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-ce6c207c-f60d-4492-8d23-3571decd24ac tempest-VolumesSnapshotListTestJSON-1568202637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7d75d6f9-bbee-4d87-b27c-07f15453aeff.info" returned: 0 in 0.247s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:18:43 devstack cinder-volume[88695]: WARNING cinder.volume.drivers.remotefs [None req-ce6c207c-f60d-4492-8d23-3571decd24ac tempest-VolumesSnapshotListTestJSON-1568202637 None] /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7d75d6f9-bbee-4d87-b27c-07f15453aeff.info is being set with open permissions: ugo+rw Aug 05 06:18:43 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-ce6c207c-f60d-4492-8d23-3571decd24ac tempest-VolumesSnapshotListTestJSON-1568202637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7d75d6f9-bbee-4d87-b27c-07f15453aeff.info {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:18:43 devstack sudo[97065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7d75d6f9-bbee-4d87-b27c-07f15453aeff.info Aug 05 06:18:43 devstack sudo[97065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:18:43 devstack sudo[97060]: pam_unix(sudo:session): session closed for user root Aug 05 06:18:43 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-b008cd80-0c9b-4636-9f15-04731df35a9a tempest-GroupSnapshotsTest-1900443889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-b37bec96-52f0-42ba-85e8-fd64f53043af.a3dbd292-0fd5-4670-ae5b-73b3c5561c48" returned: 0 in 0.354s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:18:43 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-b008cd80-0c9b-4636-9f15-04731df35a9a tempest-GroupSnapshotsTest-1900443889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-b37bec96-52f0-42ba-85e8-fd64f53043af.a3dbd292-0fd5-4670-ae5b-73b3c5561c48 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:18:43 devstack sudo[97069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-b37bec96-52f0-42ba-85e8-fd64f53043af.a3dbd292-0fd5-4670-ae5b-73b3c5561c48 Aug 05 06:18:43 devstack sudo[97069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:18:43 devstack sudo[97065]: pam_unix(sudo:session): session closed for user root Aug 05 06:18:43 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-ce6c207c-f60d-4492-8d23-3571decd24ac tempest-VolumesSnapshotListTestJSON-1568202637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7d75d6f9-bbee-4d87-b27c-07f15453aeff.info" returned: 0 in 0.247s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:18:43 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-ce6c207c-f60d-4492-8d23-3571decd24ac tempest-VolumesSnapshotListTestJSON-1568202637 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.952s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:18:43 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-ce6c207c-f60d-4492-8d23-3571decd24ac tempest-VolumesSnapshotListTestJSON-1568202637 None] Create snapshot completed successfully Aug 05 06:18:44 devstack sudo[97069]: pam_unix(sudo:session): session closed for user root Aug 05 06:18:44 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-b008cd80-0c9b-4636-9f15-04731df35a9a tempest-GroupSnapshotsTest-1900443889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-b37bec96-52f0-42ba-85e8-fd64f53043af.a3dbd292-0fd5-4670-ae5b-73b3c5561c48" returned: 0 in 0.264s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:18:44 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-b008cd80-0c9b-4636-9f15-04731df35a9a tempest-GroupSnapshotsTest-1900443889 None] Lock "cinder-quobyte-a3dbd292-0fd5-4670-ae5b-73b3c5561c48" released by "_delete_snapshot" :: held 1.487s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:18:44 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-b008cd80-0c9b-4636-9f15-04731df35a9a tempest-GroupSnapshotsTest-1900443889 None] Lock "cinder-quobyte-b37bec96-52f0-42ba-85e8-fd64f53043af" released by "delete_snapshot" :: held 1.512s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:18:44 devstack cinder-volume[88695]: WARNING cinder.quota [None req-b008cd80-0c9b-4636-9f15-04731df35a9a tempest-GroupSnapshotsTest-1900443889 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1054597091 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1054597091, it is now deprecated. Please use the default quota class for default quota. Aug 05 06:18:44 devstack cinder-volume[88695]: WARNING cinder.quota [None req-b008cd80-0c9b-4636-9f15-04731df35a9a tempest-GroupSnapshotsTest-1900443889 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1054597091 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1054597091, it is now deprecated. Please use the default quota class for default quota. Aug 05 06:18:44 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-b008cd80-0c9b-4636-9f15-04731df35a9a tempest-GroupSnapshotsTest-1900443889 None] Created reservations ['52da58fc-a06d-4bc1-8535-abb5869e95f0', '2a1bd7bd-9077-4499-9297-c5e83b51f9dd', 'c930a5f2-6526-493d-a8f9-abc407f49fcc', 'e993880f-8ccb-4d30-bf56-617c16aa6f6f'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:18:44 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-15ad7b66-50d8-46b5-a820-5a5baed6b3db tempest-VolumesSnapshotListTestJSON-1568202637 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:18:44 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-15ad7b66-50d8-46b5-a820-5a5baed6b3db tempest-VolumesSnapshotListTestJSON-1568202637 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:18:44 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-15ad7b66-50d8-46b5-a820-5a5baed6b3db tempest-VolumesSnapshotListTestJSON-1568202637 None] Creating offline snapshot c297dc36-c821-47be-983e-a1bdaea4f009 of volume 7d75d6f9-bbee-4d87-b27c-07f15453aeff {{(pid=88695) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 06:18:44 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[01a5e287-fd1b-45d9-a470-f84a0a516ad1]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:18:44 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-15ad7b66-50d8-46b5-a820-5a5baed6b3db tempest-VolumesSnapshotListTestJSON-1568202637 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7d75d6f9-bbee-4d87-b27c-07f15453aeff.9d7ccf49-9ddc-4165-a4a6-57e2ae484159 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:18:44 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-b008cd80-0c9b-4636-9f15-04731df35a9a tempest-GroupSnapshotsTest-1900443889 None] Created reservations ['bf64f17c-f2f8-405c-a4be-71d50af865dd', '21d08601-3424-4b12-9936-596a75f82601', '9b19da7d-0e08-4659-89d0-f9590c804d6f', '902f2233-3d81-44d7-8b6f-ed19fa181d44'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:18:44 devstack sudo[97077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7d75d6f9-bbee-4d87-b27c-07f15453aeff.9d7ccf49-9ddc-4165-a4a6-57e2ae484159 Aug 05 06:18:44 devstack sudo[97077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:18:44 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-b008cd80-0c9b-4636-9f15-04731df35a9a tempest-GroupSnapshotsTest-1900443889 None] group_snapshot f6efc1f3-878b-4030-9261-597746ebbe49: deleted successfully Aug 05 06:18:44 devstack sudo[97077]: pam_unix(sudo:session): session closed for user root Aug 05 06:18:44 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-15ad7b66-50d8-46b5-a820-5a5baed6b3db tempest-VolumesSnapshotListTestJSON-1568202637 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7d75d6f9-bbee-4d87-b27c-07f15453aeff.9d7ccf49-9ddc-4165-a4a6-57e2ae484159" returned: 0 in 0.400s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:18:44 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-15ad7b66-50d8-46b5-a820-5a5baed6b3db tempest-VolumesSnapshotListTestJSON-1568202637 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7d75d6f9-bbee-4d87-b27c-07f15453aeff(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88695) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 06:18:44 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-15ad7b66-50d8-46b5-a820-5a5baed6b3db tempest-VolumesSnapshotListTestJSON-1568202637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7d75d6f9-bbee-4d87-b27c-07f15453aeff.9d7ccf49-9ddc-4165-a4a6-57e2ae484159,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7d75d6f9-bbee-4d87-b27c-07f15453aeff.c297dc36-c821-47be-983e-a1bdaea4f009 1G {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:18:44 devstack sudo[97084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7d75d6f9-bbee-4d87-b27c-07f15453aeff.9d7ccf49-9ddc-4165-a4a6-57e2ae484159,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7d75d6f9-bbee-4d87-b27c-07f15453aeff.c297dc36-c821-47be-983e-a1bdaea4f009 1G Aug 05 06:18:44 devstack sudo[97084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:18:45 devstack cinder-volume[88695]: DEBUG cinder.volume.flows.manager.create_volume [None req-901c4a8b-0e3b-40cc-a568-312b370de7e9 tempest-AttachVolumeTestJSON-139946988 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88695) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 06:18:45 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-901c4a8b-0e3b-40cc-a568-312b370de7e9 tempest-AttachVolumeTestJSON-139946988 None] Flow 'volume_create_manager' (92a54684-0e96-4a1c-88ac-5d87bb149ef8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:18:45 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-901c4a8b-0e3b-40cc-a568-312b370de7e9 tempest-AttachVolumeTestJSON-139946988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8351b01-3dc3-4316-abde-2a39378a224a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:18:45 devstack sudo[97084]: pam_unix(sudo:session): session closed for user root Aug 05 06:18:45 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-15ad7b66-50d8-46b5-a820-5a5baed6b3db tempest-VolumesSnapshotListTestJSON-1568202637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7d75d6f9-bbee-4d87-b27c-07f15453aeff.9d7ccf49-9ddc-4165-a4a6-57e2ae484159,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7d75d6f9-bbee-4d87-b27c-07f15453aeff.c297dc36-c821-47be-983e-a1bdaea4f009 1G" returned: 0 in 0.447s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:18:45 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-15ad7b66-50d8-46b5-a820-5a5baed6b3db tempest-VolumesSnapshotListTestJSON-1568202637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d75d6f9-bbee-4d87-b27c-07f15453aeff.9d7ccf49-9ddc-4165-a4a6-57e2ae484159 -F qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7d75d6f9-bbee-4d87-b27c-07f15453aeff.c297dc36-c821-47be-983e-a1bdaea4f009 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:18:45 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-901c4a8b-0e3b-40cc-a568-312b370de7e9 tempest-AttachVolumeTestJSON-139946988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8351b01-3dc3-4316-abde-2a39378a224a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:18:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1841043555',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27eca293-8612-4cf4-8a80-c64442697811,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e536bd020a264041b6d2d86d08701cf6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:18:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:18:45Z,use_quota=True,user_id='4c2ed75d0ae44fd7bf0cb6098706f74f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:18:45 devstack sudo[97090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d75d6f9-bbee-4d87-b27c-07f15453aeff.9d7ccf49-9ddc-4165-a4a6-57e2ae484159 -F qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7d75d6f9-bbee-4d87-b27c-07f15453aeff.c297dc36-c821-47be-983e-a1bdaea4f009 Aug 05 06:18:45 devstack sudo[97090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:18:45 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-901c4a8b-0e3b-40cc-a568-312b370de7e9 tempest-AttachVolumeTestJSON-139946988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb2baedd-410e-4f17-b55c-c630d99037cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:18:45 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-901c4a8b-0e3b-40cc-a568-312b370de7e9 tempest-AttachVolumeTestJSON-139946988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb2baedd-410e-4f17-b55c-c630d99037cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:18:45 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-901c4a8b-0e3b-40cc-a568-312b370de7e9 tempest-AttachVolumeTestJSON-139946988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7884f51-b0f8-421b-9850-0676d0931734) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:18:45 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-901c4a8b-0e3b-40cc-a568-312b370de7e9 tempest-AttachVolumeTestJSON-139946988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7884f51-b0f8-421b-9850-0676d0931734) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '27eca293-8612-4cf4-8a80-c64442697811', 'volume_name': 'volume-27eca293-8612-4cf4-8a80-c64442697811', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:18:45 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-901c4a8b-0e3b-40cc-a568-312b370de7e9 tempest-AttachVolumeTestJSON-139946988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3841422c-77f7-4904-ac3a-f90d9590a530) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:18:45 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-901c4a8b-0e3b-40cc-a568-312b370de7e9 tempest-AttachVolumeTestJSON-139946988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3841422c-77f7-4904-ac3a-f90d9590a530) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:18:45 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-901c4a8b-0e3b-40cc-a568-312b370de7e9 tempest-AttachVolumeTestJSON-139946988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0640be80-e1c9-4025-a548-2d5a447d9478) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:18:45 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-901c4a8b-0e3b-40cc-a568-312b370de7e9 tempest-AttachVolumeTestJSON-139946988 None] Volume 27eca293-8612-4cf4-8a80-c64442697811: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-27eca293-8612-4cf4-8a80-c64442697811', 'volume_size': 1} Aug 05 06:18:45 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-901c4a8b-0e3b-40cc-a568-312b370de7e9 tempest-AttachVolumeTestJSON-139946988 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:18:45 devstack sudo[97090]: pam_unix(sudo:session): session closed for user root Aug 05 06:18:45 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-15ad7b66-50d8-46b5-a820-5a5baed6b3db tempest-VolumesSnapshotListTestJSON-1568202637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d75d6f9-bbee-4d87-b27c-07f15453aeff.9d7ccf49-9ddc-4165-a4a6-57e2ae484159 -F qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7d75d6f9-bbee-4d87-b27c-07f15453aeff.c297dc36-c821-47be-983e-a1bdaea4f009" returned: 0 in 0.302s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:18:45 devstack cinder-volume[88695]: WARNING cinder.volume.drivers.remotefs [None req-15ad7b66-50d8-46b5-a820-5a5baed6b3db tempest-VolumesSnapshotListTestJSON-1568202637 None] /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7d75d6f9-bbee-4d87-b27c-07f15453aeff.c297dc36-c821-47be-983e-a1bdaea4f009 is being set with open permissions: ugo+rw Aug 05 06:18:45 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-15ad7b66-50d8-46b5-a820-5a5baed6b3db tempest-VolumesSnapshotListTestJSON-1568202637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7d75d6f9-bbee-4d87-b27c-07f15453aeff.c297dc36-c821-47be-983e-a1bdaea4f009 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:18:45 devstack sudo[97095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7d75d6f9-bbee-4d87-b27c-07f15453aeff.c297dc36-c821-47be-983e-a1bdaea4f009 Aug 05 06:18:45 devstack sudo[97095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:18:45 devstack sudo[97095]: pam_unix(sudo:session): session closed for user root Aug 05 06:18:45 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-15ad7b66-50d8-46b5-a820-5a5baed6b3db tempest-VolumesSnapshotListTestJSON-1568202637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7d75d6f9-bbee-4d87-b27c-07f15453aeff.c297dc36-c821-47be-983e-a1bdaea4f009" returned: 0 in 0.245s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:18:45 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-15ad7b66-50d8-46b5-a820-5a5baed6b3db tempest-VolumesSnapshotListTestJSON-1568202637 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.511s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:18:45 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-901c4a8b-0e3b-40cc-a568-312b370de7e9 tempest-AttachVolumeTestJSON-139946988 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.525s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:18:45 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-901c4a8b-0e3b-40cc-a568-312b370de7e9 tempest-AttachVolumeTestJSON-139946988 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:18:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1841043555',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27eca293-8612-4cf4-8a80-c64442697811,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e536bd020a264041b6d2d86d08701cf6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:18:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:18:45Z,use_quota=True,user_id='4c2ed75d0ae44fd7bf0cb6098706f74f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)}" {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 06:18:45 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-901c4a8b-0e3b-40cc-a568-312b370de7e9 tempest-AttachVolumeTestJSON-139946988 None] Creating volume 27eca293-8612-4cf4-8a80-c64442697811 {{(pid=88695) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 06:18:45 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-901c4a8b-0e3b-40cc-a568-312b370de7e9 tempest-AttachVolumeTestJSON-139946988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:18:45 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-901c4a8b-0e3b-40cc-a568-312b370de7e9 tempest-AttachVolumeTestJSON-139946988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:18:45 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-901c4a8b-0e3b-40cc-a568-312b370de7e9 tempest-AttachVolumeTestJSON-139946988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:18:45 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-901c4a8b-0e3b-40cc-a568-312b370de7e9 tempest-AttachVolumeTestJSON-139946988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:18:45 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-901c4a8b-0e3b-40cc-a568-312b370de7e9 tempest-AttachVolumeTestJSON-139946988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:18:45 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-901c4a8b-0e3b-40cc-a568-312b370de7e9 tempest-AttachVolumeTestJSON-139946988 None] Selected osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 as target Quobyte volume. {{(pid=88695) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 06:18:45 devstack cinder-volume[88695]: INFO cinder.volume.drivers.remotefs [None req-901c4a8b-0e3b-40cc-a568-312b370de7e9 tempest-AttachVolumeTestJSON-139946988 None] casted to osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 Aug 05 06:18:45 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-901c4a8b-0e3b-40cc-a568-312b370de7e9 tempest-AttachVolumeTestJSON-139946988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-27eca293-8612-4cf4-8a80-c64442697811 1073741824 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:18:45 devstack sudo[97098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-27eca293-8612-4cf4-8a80-c64442697811 1073741824 Aug 05 06:18:45 devstack sudo[97098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:18:45 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-a7caa871-bfe3-4626-b909-a32959ad9a16 tempest-GroupSnapshotsTest-1900443889 None] Acquiring lock "cinder-quobyte-92f6d647-ac2f-4679-98c3-eae4fedcb935" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:18:45 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-15ad7b66-50d8-46b5-a820-5a5baed6b3db tempest-VolumesSnapshotListTestJSON-1568202637 None] Create snapshot completed successfully Aug 05 06:18:45 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-a7caa871-bfe3-4626-b909-a32959ad9a16 tempest-GroupSnapshotsTest-1900443889 None] Lock "cinder-quobyte-92f6d647-ac2f-4679-98c3-eae4fedcb935" acquired by "delete_volume" :: waited 0.028s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:18:45 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[65db84c3-dba5-4ac1-8546-d438136c27b2]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:18:45 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-a7caa871-bfe3-4626-b909-a32959ad9a16 tempest-GroupSnapshotsTest-1900443889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-92f6d647-ac2f-4679-98c3-eae4fedcb935 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:18:45 devstack sudo[97100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-92f6d647-ac2f-4679-98c3-eae4fedcb935 Aug 05 06:18:45 devstack sudo[97100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:18:46 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-901c4a8b-0e3b-40cc-a568-312b370de7e9 tempest-AttachVolumeTestJSON-139946988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-27eca293-8612-4cf4-8a80-c64442697811 1073741824" returned: 0 in 0.511s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:18:46 devstack sudo[97098]: pam_unix(sudo:session): session closed for user root Aug 05 06:18:46 devstack sudo[97100]: pam_unix(sudo:session): session closed for user root Aug 05 06:18:46 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-a7caa871-bfe3-4626-b909-a32959ad9a16 tempest-GroupSnapshotsTest-1900443889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-92f6d647-ac2f-4679-98c3-eae4fedcb935" returned: 0 in 0.402s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:18:46 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-a7caa871-bfe3-4626-b909-a32959ad9a16 tempest-GroupSnapshotsTest-1900443889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-92f6d647-ac2f-4679-98c3-eae4fedcb935 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:18:46 devstack sudo[97108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-92f6d647-ac2f-4679-98c3-eae4fedcb935 Aug 05 06:18:46 devstack sudo[97108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:18:46 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-901c4a8b-0e3b-40cc-a568-312b370de7e9 tempest-AttachVolumeTestJSON-139946988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-27eca293-8612-4cf4-8a80-c64442697811 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:18:46 devstack sudo[97110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-27eca293-8612-4cf4-8a80-c64442697811 Aug 05 06:18:46 devstack sudo[97110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:18:46 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-5cc1a27f-ae32-4ff6-9c78-ccea4bce3073 tempest-VolumesSnapshotListTestJSON-1568202637 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:18:46 devstack sudo[97108]: pam_unix(sudo:session): session closed for user root Aug 05 06:18:46 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-a7caa871-bfe3-4626-b909-a32959ad9a16 tempest-GroupSnapshotsTest-1900443889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-92f6d647-ac2f-4679-98c3-eae4fedcb935" returned: 0 in 0.268s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:18:46 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-a7caa871-bfe3-4626-b909-a32959ad9a16 tempest-GroupSnapshotsTest-1900443889 None] Lock "cinder-quobyte-92f6d647-ac2f-4679-98c3-eae4fedcb935" released by "delete_volume" :: held 0.745s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:18:46 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-a7caa871-bfe3-4626-b909-a32959ad9a16 tempest-GroupSnapshotsTest-1900443889 None] Acquiring lock "cinder-quobyte-b37bec96-52f0-42ba-85e8-fd64f53043af" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:18:46 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-a7caa871-bfe3-4626-b909-a32959ad9a16 tempest-GroupSnapshotsTest-1900443889 None] Lock "cinder-quobyte-b37bec96-52f0-42ba-85e8-fd64f53043af" acquired by "delete_volume" :: waited 0.015s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:18:46 devstack sudo[97110]: pam_unix(sudo:session): session closed for user root Aug 05 06:18:46 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-901c4a8b-0e3b-40cc-a568-312b370de7e9 tempest-AttachVolumeTestJSON-139946988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-27eca293-8612-4cf4-8a80-c64442697811" returned: 0 in 0.304s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:18:46 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-901c4a8b-0e3b-40cc-a568-312b370de7e9 tempest-AttachVolumeTestJSON-139946988 None] <== create_volume: return (881ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'} {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 06:18:46 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-901c4a8b-0e3b-40cc-a568-312b370de7e9 tempest-AttachVolumeTestJSON-139946988 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.884s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:18:46 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-5cc1a27f-ae32-4ff6-9c78-ccea4bce3073 tempest-VolumesSnapshotListTestJSON-1568202637 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.120s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:18:46 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[bea6c583-a97b-48ad-8c31-cdfe93f09edc]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:18:46 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-a7caa871-bfe3-4626-b909-a32959ad9a16 tempest-GroupSnapshotsTest-1900443889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-b37bec96-52f0-42ba-85e8-fd64f53043af {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:18:46 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-901c4a8b-0e3b-40cc-a568-312b370de7e9 tempest-AttachVolumeTestJSON-139946988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0640be80-e1c9-4025-a548-2d5a447d9478) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-27eca293-8612-4cf4-8a80-c64442697811', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:18:46 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-901c4a8b-0e3b-40cc-a568-312b370de7e9 tempest-AttachVolumeTestJSON-139946988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (500bd7a4-6bf9-4891-94d5-16104debb202) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:18:46 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-5cc1a27f-ae32-4ff6-9c78-ccea4bce3073 tempest-VolumesSnapshotListTestJSON-1568202637 None] Creating offline snapshot 1d3ccb0e-dcbd-456d-8fb9-f9b47a1d0cce of volume 7d75d6f9-bbee-4d87-b27c-07f15453aeff {{(pid=88695) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 06:18:46 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-901c4a8b-0e3b-40cc-a568-312b370de7e9 tempest-AttachVolumeTestJSON-139946988 None] Volume volume-27eca293-8612-4cf4-8a80-c64442697811 (27eca293-8612-4cf4-8a80-c64442697811): created successfully Aug 05 06:18:46 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-901c4a8b-0e3b-40cc-a568-312b370de7e9 tempest-AttachVolumeTestJSON-139946988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (500bd7a4-6bf9-4891-94d5-16104debb202) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:18:46 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-901c4a8b-0e3b-40cc-a568-312b370de7e9 tempest-AttachVolumeTestJSON-139946988 None] Flow 'volume_create_manager' (92a54684-0e96-4a1c-88ac-5d87bb149ef8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:18:46 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[5736f47e-9d2d-469b-bea6-bcf4fefed145]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:18:46 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-5cc1a27f-ae32-4ff6-9c78-ccea4bce3073 tempest-VolumesSnapshotListTestJSON-1568202637 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7d75d6f9-bbee-4d87-b27c-07f15453aeff.c297dc36-c821-47be-983e-a1bdaea4f009 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:18:46 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-901c4a8b-0e3b-40cc-a568-312b370de7e9 tempest-AttachVolumeTestJSON-139946988 None] Created volume successfully. Aug 05 06:18:46 devstack sudo[97114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-b37bec96-52f0-42ba-85e8-fd64f53043af Aug 05 06:18:46 devstack sudo[97114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:18:46 devstack sudo[97115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7d75d6f9-bbee-4d87-b27c-07f15453aeff.c297dc36-c821-47be-983e-a1bdaea4f009 Aug 05 06:18:46 devstack sudo[97115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:18:47 devstack sudo[97114]: pam_unix(sudo:session): session closed for user root Aug 05 06:18:47 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-a7caa871-bfe3-4626-b909-a32959ad9a16 tempest-GroupSnapshotsTest-1900443889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-b37bec96-52f0-42ba-85e8-fd64f53043af" returned: 0 in 0.432s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:18:47 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-a7caa871-bfe3-4626-b909-a32959ad9a16 tempest-GroupSnapshotsTest-1900443889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-b37bec96-52f0-42ba-85e8-fd64f53043af {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:18:47 devstack sudo[97123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-b37bec96-52f0-42ba-85e8-fd64f53043af Aug 05 06:18:47 devstack sudo[97123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:18:47 devstack sudo[97115]: pam_unix(sudo:session): session closed for user root Aug 05 06:18:47 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-5cc1a27f-ae32-4ff6-9c78-ccea4bce3073 tempest-VolumesSnapshotListTestJSON-1568202637 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7d75d6f9-bbee-4d87-b27c-07f15453aeff.c297dc36-c821-47be-983e-a1bdaea4f009" returned: 0 in 0.395s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:18:47 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-5cc1a27f-ae32-4ff6-9c78-ccea4bce3073 tempest-VolumesSnapshotListTestJSON-1568202637 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7d75d6f9-bbee-4d87-b27c-07f15453aeff(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88695) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 06:18:47 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-5cc1a27f-ae32-4ff6-9c78-ccea4bce3073 tempest-VolumesSnapshotListTestJSON-1568202637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7d75d6f9-bbee-4d87-b27c-07f15453aeff.c297dc36-c821-47be-983e-a1bdaea4f009,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7d75d6f9-bbee-4d87-b27c-07f15453aeff.1d3ccb0e-dcbd-456d-8fb9-f9b47a1d0cce 1G {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:18:47 devstack sudo[97126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7d75d6f9-bbee-4d87-b27c-07f15453aeff.c297dc36-c821-47be-983e-a1bdaea4f009,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7d75d6f9-bbee-4d87-b27c-07f15453aeff.1d3ccb0e-dcbd-456d-8fb9-f9b47a1d0cce 1G Aug 05 06:18:47 devstack sudo[97126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:18:47 devstack sudo[97123]: pam_unix(sudo:session): session closed for user root Aug 05 06:18:47 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-a7caa871-bfe3-4626-b909-a32959ad9a16 tempest-GroupSnapshotsTest-1900443889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-b37bec96-52f0-42ba-85e8-fd64f53043af" returned: 0 in 0.310s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:18:47 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-a7caa871-bfe3-4626-b909-a32959ad9a16 tempest-GroupSnapshotsTest-1900443889 None] Lock "cinder-quobyte-b37bec96-52f0-42ba-85e8-fd64f53043af" released by "delete_volume" :: held 0.806s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:18:47 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-a7caa871-bfe3-4626-b909-a32959ad9a16 tempest-GroupSnapshotsTest-1900443889 None] Created reservations ['490b8322-369c-4170-b107-b2c3eccd54ad'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:18:47 devstack cinder-volume[88695]: WARNING cinder.quota [None req-a7caa871-bfe3-4626-b909-a32959ad9a16 tempest-GroupSnapshotsTest-1900443889 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1054597091 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1054597091, it is now deprecated. Please use the default quota class for default quota. Aug 05 06:18:47 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-a7caa871-bfe3-4626-b909-a32959ad9a16 tempest-GroupSnapshotsTest-1900443889 None] Created reservations ['54e2c2a3-2d8d-4fa5-a8d5-5de0df65fe98', 'c410f3cf-8e9f-40ab-9554-03f73f51be64', 'b80f0927-13dd-4569-adee-4077f386141a', 'ae63ad56-af2d-499d-863f-dddaddc30408'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:18:47 devstack sudo[97126]: pam_unix(sudo:session): session closed for user root Aug 05 06:18:47 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-5cc1a27f-ae32-4ff6-9c78-ccea4bce3073 tempest-VolumesSnapshotListTestJSON-1568202637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7d75d6f9-bbee-4d87-b27c-07f15453aeff.c297dc36-c821-47be-983e-a1bdaea4f009,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7d75d6f9-bbee-4d87-b27c-07f15453aeff.1d3ccb0e-dcbd-456d-8fb9-f9b47a1d0cce 1G" returned: 0 in 0.591s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:18:47 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-5cc1a27f-ae32-4ff6-9c78-ccea4bce3073 tempest-VolumesSnapshotListTestJSON-1568202637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d75d6f9-bbee-4d87-b27c-07f15453aeff.c297dc36-c821-47be-983e-a1bdaea4f009 -F qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7d75d6f9-bbee-4d87-b27c-07f15453aeff.1d3ccb0e-dcbd-456d-8fb9-f9b47a1d0cce {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:18:47 devstack sudo[97140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d75d6f9-bbee-4d87-b27c-07f15453aeff.c297dc36-c821-47be-983e-a1bdaea4f009 -F qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7d75d6f9-bbee-4d87-b27c-07f15453aeff.1d3ccb0e-dcbd-456d-8fb9-f9b47a1d0cce Aug 05 06:18:47 devstack sudo[97140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:18:47 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-a7caa871-bfe3-4626-b909-a32959ad9a16 tempest-GroupSnapshotsTest-1900443889 None] Created reservations ['5fc367c5-7b39-4aec-aac2-6c2b693f5bbb', 'b01d87a8-c684-4f74-b722-1a4738497c6d', '34206028-81a9-4d93-98bf-05c4e6bd6f6a', 'bf3dd875-f986-439f-b3ba-4940b47e5864'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:18:47 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-a7caa871-bfe3-4626-b909-a32959ad9a16 tempest-GroupSnapshotsTest-1900443889 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:18:47 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-a7caa871-bfe3-4626-b909-a32959ad9a16 tempest-GroupSnapshotsTest-1900443889 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:18:47 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-a7caa871-bfe3-4626-b909-a32959ad9a16 tempest-GroupSnapshotsTest-1900443889 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:18:47 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-a7caa871-bfe3-4626-b909-a32959ad9a16 tempest-GroupSnapshotsTest-1900443889 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:18:47 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-a7caa871-bfe3-4626-b909-a32959ad9a16 tempest-GroupSnapshotsTest-1900443889 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:18:47 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-a7caa871-bfe3-4626-b909-a32959ad9a16 tempest-GroupSnapshotsTest-1900443889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:18:47 devstack sudo[97149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce Aug 05 06:18:47 devstack sudo[97149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:18:47 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [req-017f3780-e3f5-4172-bf1c-f939595b5155 req-d7e328ec-91d6-4976-a162-e31bf2d2f447 tempest-AttachVolumeTestJSON-139946988 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:18:48 devstack sudo[97140]: pam_unix(sudo:session): session closed for user root Aug 05 06:18:48 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-5cc1a27f-ae32-4ff6-9c78-ccea4bce3073 tempest-VolumesSnapshotListTestJSON-1568202637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d75d6f9-bbee-4d87-b27c-07f15453aeff.c297dc36-c821-47be-983e-a1bdaea4f009 -F qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7d75d6f9-bbee-4d87-b27c-07f15453aeff.1d3ccb0e-dcbd-456d-8fb9-f9b47a1d0cce" returned: 0 in 0.327s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:18:48 devstack cinder-volume[88695]: WARNING cinder.volume.drivers.remotefs [None req-5cc1a27f-ae32-4ff6-9c78-ccea4bce3073 tempest-VolumesSnapshotListTestJSON-1568202637 None] /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7d75d6f9-bbee-4d87-b27c-07f15453aeff.1d3ccb0e-dcbd-456d-8fb9-f9b47a1d0cce is being set with open permissions: ugo+rw Aug 05 06:18:48 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-5cc1a27f-ae32-4ff6-9c78-ccea4bce3073 tempest-VolumesSnapshotListTestJSON-1568202637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7d75d6f9-bbee-4d87-b27c-07f15453aeff.1d3ccb0e-dcbd-456d-8fb9-f9b47a1d0cce {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:18:48 devstack sudo[97154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7d75d6f9-bbee-4d87-b27c-07f15453aeff.1d3ccb0e-dcbd-456d-8fb9-f9b47a1d0cce Aug 05 06:18:48 devstack sudo[97154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:18:48 devstack sudo[97149]: pam_unix(sudo:session): session closed for user root Aug 05 06:18:48 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-a7caa871-bfe3-4626-b909-a32959ad9a16 tempest-GroupSnapshotsTest-1900443889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce" returned: 0 in 0.286s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:18:48 devstack cinder-volume[88695]: DEBUG cinder.manager [None req-a7caa871-bfe3-4626-b909-a32959ad9a16 tempest-GroupSnapshotsTest-1900443889 None] Notifying Schedulers of capabilities ... {{(pid=88695) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 06:18:48 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-a7caa871-bfe3-4626-b909-a32959ad9a16 tempest-GroupSnapshotsTest-1900443889 None] Delete group completed successfully. Aug 05 06:18:48 devstack sudo[97154]: pam_unix(sudo:session): session closed for user root Aug 05 06:18:48 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-5cc1a27f-ae32-4ff6-9c78-ccea4bce3073 tempest-VolumesSnapshotListTestJSON-1568202637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7d75d6f9-bbee-4d87-b27c-07f15453aeff.1d3ccb0e-dcbd-456d-8fb9-f9b47a1d0cce" returned: 0 in 0.288s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:18:48 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-5cc1a27f-ae32-4ff6-9c78-ccea4bce3073 tempest-VolumesSnapshotListTestJSON-1568202637 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.745s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:18:48 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [req-017f3780-e3f5-4172-bf1c-f939595b5155 req-d7e328ec-91d6-4976-a162-e31bf2d2f447 tempest-AttachVolumeTestJSON-139946988 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.417s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:18:48 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [req-017f3780-e3f5-4172-bf1c-f939595b5155 req-d7e328ec-91d6-4976-a162-e31bf2d2f447 tempest-AttachVolumeTestJSON-139946988 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:18:48 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-5cc1a27f-ae32-4ff6-9c78-ccea4bce3073 tempest-VolumesSnapshotListTestJSON-1568202637 None] Create snapshot completed successfully Aug 05 06:18:48 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [req-017f3780-e3f5-4172-bf1c-f939595b5155 req-d7e328ec-91d6-4976-a162-e31bf2d2f447 tempest-AttachVolumeTestJSON-139946988 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087', 'name': 'volume-27eca293-8612-4cf4-8a80-c64442697811', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3eaf2766-debf-4e8d-9570-586c5feb1da3', 'enforce_multipath': True} {{(pid=88695) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 05 06:18:48 devstack cinder-volume[88695]: INFO cinder.volume.manager [req-017f3780-e3f5-4172-bf1c-f939595b5155 req-d7e328ec-91d6-4976-a162-e31bf2d2f447 tempest-AttachVolumeTestJSON-139946988 None] attachment_update completed successfully. Aug 05 06:18:48 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-b4be6bc5-ac22-45d9-adf9-d12b0b9ff759 tempest-GroupSnapshotsTest-1900443889 None] Group tempest-GroupSnapshotsTest-Group-103367273: creating Aug 05 06:18:48 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-b4be6bc5-ac22-45d9-adf9-d12b0b9ff759 tempest-GroupSnapshotsTest-1900443889 None] Group tempest-GroupSnapshotsTest-Group-103367273: created successfully Aug 05 06:18:48 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-b4be6bc5-ac22-45d9-adf9-d12b0b9ff759 tempest-GroupSnapshotsTest-1900443889 None] Create group completed successfully. Aug 05 06:18:49 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-b77a5875-a176-4f54-992c-1c9a91af2af9 tempest-VolumesSnapshotListTestJSON-1568202637 None] Acquiring lock "cinder-1d3ccb0e-dcbd-456d-8fb9-f9b47a1d0cce-delete_snapshot" by "delete_snapshot" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:18:49 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-b77a5875-a176-4f54-992c-1c9a91af2af9 tempest-VolumesSnapshotListTestJSON-1568202637 None] Lock "cinder-1d3ccb0e-dcbd-456d-8fb9-f9b47a1d0cce-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:18:49 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-b77a5875-a176-4f54-992c-1c9a91af2af9 tempest-VolumesSnapshotListTestJSON-1568202637 None] Acquiring lock "cinder-quobyte-7d75d6f9-bbee-4d87-b27c-07f15453aeff" by "delete_snapshot" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:18:49 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-b77a5875-a176-4f54-992c-1c9a91af2af9 tempest-VolumesSnapshotListTestJSON-1568202637 None] Lock "cinder-quobyte-7d75d6f9-bbee-4d87-b27c-07f15453aeff" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:18:49 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-b77a5875-a176-4f54-992c-1c9a91af2af9 tempest-VolumesSnapshotListTestJSON-1568202637 None] Acquiring lock "cinder-quobyte-1d3ccb0e-dcbd-456d-8fb9-f9b47a1d0cce" by "_delete_snapshot" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:18:49 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-b77a5875-a176-4f54-992c-1c9a91af2af9 tempest-VolumesSnapshotListTestJSON-1568202637 None] Lock "cinder-quobyte-1d3ccb0e-dcbd-456d-8fb9-f9b47a1d0cce" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:18:49 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-b77a5875-a176-4f54-992c-1c9a91af2af9 tempest-VolumesSnapshotListTestJSON-1568202637 None] Deleting offline snapshot 1d3ccb0e-dcbd-456d-8fb9-f9b47a1d0cce of volume 7d75d6f9-bbee-4d87-b27c-07f15453aeff {{(pid=88695) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 06:18:49 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-b77a5875-a176-4f54-992c-1c9a91af2af9 tempest-VolumesSnapshotListTestJSON-1568202637 None] snapshot_file for this snap is: volume-7d75d6f9-bbee-4d87-b27c-07f15453aeff.1d3ccb0e-dcbd-456d-8fb9-f9b47a1d0cce {{(pid=88695) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 06:18:49 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[bee7e6d2-e3c3-4faf-9d46-1b22c4f98b30]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:18:49 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-b77a5875-a176-4f54-992c-1c9a91af2af9 tempest-VolumesSnapshotListTestJSON-1568202637 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7d75d6f9-bbee-4d87-b27c-07f15453aeff.1d3ccb0e-dcbd-456d-8fb9-f9b47a1d0cce {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:18:49 devstack sudo[97543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7d75d6f9-bbee-4d87-b27c-07f15453aeff.1d3ccb0e-dcbd-456d-8fb9-f9b47a1d0cce Aug 05 06:18:49 devstack sudo[97543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:18:49 devstack sudo[97543]: pam_unix(sudo:session): session closed for user root Aug 05 06:18:49 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-b77a5875-a176-4f54-992c-1c9a91af2af9 tempest-VolumesSnapshotListTestJSON-1568202637 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7d75d6f9-bbee-4d87-b27c-07f15453aeff.1d3ccb0e-dcbd-456d-8fb9-f9b47a1d0cce" returned: 0 in 0.386s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:18:49 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-b77a5875-a176-4f54-992c-1c9a91af2af9 tempest-VolumesSnapshotListTestJSON-1568202637 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7d75d6f9-bbee-4d87-b27c-07f15453aeff(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88695) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 06:18:50 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0b4063f-caa0-420d-8575-b64a227ac4e7]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:18:50 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-b77a5875-a176-4f54-992c-1c9a91af2af9 tempest-VolumesSnapshotListTestJSON-1568202637 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7d75d6f9-bbee-4d87-b27c-07f15453aeff.c297dc36-c821-47be-983e-a1bdaea4f009 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:18:50 devstack sudo[97549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7d75d6f9-bbee-4d87-b27c-07f15453aeff.c297dc36-c821-47be-983e-a1bdaea4f009 Aug 05 06:18:50 devstack sudo[97549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:18:50 devstack cinder-volume[88695]: DEBUG cinder.volume.flows.manager.create_volume [None req-16ee5693-730b-4570-af55-9af45857cdc0 tempest-GroupSnapshotsTest-1900443889 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88695) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 06:18:50 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-16ee5693-730b-4570-af55-9af45857cdc0 tempest-GroupSnapshotsTest-1900443889 None] Flow 'volume_create_manager' (35037b28-9648-4e57-916b-310c40f6c7bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:18:50 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-16ee5693-730b-4570-af55-9af45857cdc0 tempest-GroupSnapshotsTest-1900443889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1abe5aa3-8aeb-4736-9b94-c5c86d202f29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:18:50 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-16ee5693-730b-4570-af55-9af45857cdc0 tempest-GroupSnapshotsTest-1900443889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1abe5aa3-8aeb-4736-9b94-c5c86d202f29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:18:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-751391125',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f1f11cd4-9fda-4e1b-b8f3-a9acdebb725c,host='devstack@QuobyteHD#QuobyteHD',id=8609a278-2412-4ed0-96bc-df3f87ff0c8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='646f9e7e464f47f988d81ced7f2a0ee5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:18:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:18:50Z,use_quota=True,user_id='314aad5bb7ff4695a905f4a939e5b490',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c616887a-20e3-4b01-bcde-00074e24910d),volume_type_id=c616887a-20e3-4b01-bcde-00074e24910d)' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:18:50 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-16ee5693-730b-4570-af55-9af45857cdc0 tempest-GroupSnapshotsTest-1900443889 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e4743f4-990c-4e4b-ac22-081709eebdf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:18:50 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-16ee5693-730b-4570-af55-9af45857cdc0 tempest-GroupSnapshotsTest-1900443889 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e4743f4-990c-4e4b-ac22-081709eebdf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:18:50 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-16ee5693-730b-4570-af55-9af45857cdc0 tempest-GroupSnapshotsTest-1900443889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21348383-cc28-4907-ae49-82037551f10a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:18:50 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-16ee5693-730b-4570-af55-9af45857cdc0 tempest-GroupSnapshotsTest-1900443889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21348383-cc28-4907-ae49-82037551f10a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8609a278-2412-4ed0-96bc-df3f87ff0c8d', 'volume_name': 'volume-8609a278-2412-4ed0-96bc-df3f87ff0c8d', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:18:50 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-16ee5693-730b-4570-af55-9af45857cdc0 tempest-GroupSnapshotsTest-1900443889 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b7bfc94-466f-42b1-aefe-65c79509bdd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:18:50 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-16ee5693-730b-4570-af55-9af45857cdc0 tempest-GroupSnapshotsTest-1900443889 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b7bfc94-466f-42b1-aefe-65c79509bdd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:18:50 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-16ee5693-730b-4570-af55-9af45857cdc0 tempest-GroupSnapshotsTest-1900443889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d297f0d-974a-4c32-a0ae-2426b8cfcddc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:18:50 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-16ee5693-730b-4570-af55-9af45857cdc0 tempest-GroupSnapshotsTest-1900443889 None] Volume 8609a278-2412-4ed0-96bc-df3f87ff0c8d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8609a278-2412-4ed0-96bc-df3f87ff0c8d', 'volume_size': 1} Aug 05 06:18:50 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-16ee5693-730b-4570-af55-9af45857cdc0 tempest-GroupSnapshotsTest-1900443889 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:18:50 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-16ee5693-730b-4570-af55-9af45857cdc0 tempest-GroupSnapshotsTest-1900443889 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:18:50 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-16ee5693-730b-4570-af55-9af45857cdc0 tempest-GroupSnapshotsTest-1900443889 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=f1f11cd4-9fda-4e1b-b8f3-a9acdebb725c,created_at=2026-08-05T04:18:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-751391125',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f1f11cd4-9fda-4e1b-b8f3-a9acdebb725c,host='devstack@QuobyteHD#QuobyteHD',id=8609a278-2412-4ed0-96bc-df3f87ff0c8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='646f9e7e464f47f988d81ced7f2a0ee5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:18:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:18:50Z,use_quota=True,user_id='314aad5bb7ff4695a905f4a939e5b490',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c616887a-20e3-4b01-bcde-00074e24910d),volume_type_id=c616887a-20e3-4b01-bcde-00074e24910d)}" {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 06:18:50 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-16ee5693-730b-4570-af55-9af45857cdc0 tempest-GroupSnapshotsTest-1900443889 None] Creating volume 8609a278-2412-4ed0-96bc-df3f87ff0c8d {{(pid=88695) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 06:18:50 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-16ee5693-730b-4570-af55-9af45857cdc0 tempest-GroupSnapshotsTest-1900443889 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:18:50 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-16ee5693-730b-4570-af55-9af45857cdc0 tempest-GroupSnapshotsTest-1900443889 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:18:50 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-16ee5693-730b-4570-af55-9af45857cdc0 tempest-GroupSnapshotsTest-1900443889 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:18:50 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-16ee5693-730b-4570-af55-9af45857cdc0 tempest-GroupSnapshotsTest-1900443889 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:18:50 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-16ee5693-730b-4570-af55-9af45857cdc0 tempest-GroupSnapshotsTest-1900443889 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:18:50 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-16ee5693-730b-4570-af55-9af45857cdc0 tempest-GroupSnapshotsTest-1900443889 None] Selected osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 as target Quobyte volume. {{(pid=88695) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 06:18:50 devstack cinder-volume[88695]: INFO cinder.volume.drivers.remotefs [None req-16ee5693-730b-4570-af55-9af45857cdc0 tempest-GroupSnapshotsTest-1900443889 None] casted to osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 Aug 05 06:18:50 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-16ee5693-730b-4570-af55-9af45857cdc0 tempest-GroupSnapshotsTest-1900443889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8609a278-2412-4ed0-96bc-df3f87ff0c8d 1073741824 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:18:50 devstack sudo[97563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8609a278-2412-4ed0-96bc-df3f87ff0c8d 1073741824 Aug 05 06:18:50 devstack sudo[97563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:18:50 devstack sudo[97549]: pam_unix(sudo:session): session closed for user root Aug 05 06:18:50 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-b77a5875-a176-4f54-992c-1c9a91af2af9 tempest-VolumesSnapshotListTestJSON-1568202637 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7d75d6f9-bbee-4d87-b27c-07f15453aeff.c297dc36-c821-47be-983e-a1bdaea4f009" returned: 0 in 0.572s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:18:50 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-b77a5875-a176-4f54-992c-1c9a91af2af9 tempest-VolumesSnapshotListTestJSON-1568202637 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7d75d6f9-bbee-4d87-b27c-07f15453aeff(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88695) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 06:18:50 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-b77a5875-a176-4f54-992c-1c9a91af2af9 tempest-VolumesSnapshotListTestJSON-1568202637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7d75d6f9-bbee-4d87-b27c-07f15453aeff.1d3ccb0e-dcbd-456d-8fb9-f9b47a1d0cce {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:18:50 devstack sudo[97567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7d75d6f9-bbee-4d87-b27c-07f15453aeff.1d3ccb0e-dcbd-456d-8fb9-f9b47a1d0cce Aug 05 06:18:50 devstack sudo[97567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:18:51 devstack sudo[97563]: pam_unix(sudo:session): session closed for user root Aug 05 06:18:51 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-16ee5693-730b-4570-af55-9af45857cdc0 tempest-GroupSnapshotsTest-1900443889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8609a278-2412-4ed0-96bc-df3f87ff0c8d 1073741824" returned: 0 in 0.484s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:18:51 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-16ee5693-730b-4570-af55-9af45857cdc0 tempest-GroupSnapshotsTest-1900443889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8609a278-2412-4ed0-96bc-df3f87ff0c8d {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:18:51 devstack sudo[97567]: pam_unix(sudo:session): session closed for user root Aug 05 06:18:51 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-b77a5875-a176-4f54-992c-1c9a91af2af9 tempest-VolumesSnapshotListTestJSON-1568202637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7d75d6f9-bbee-4d87-b27c-07f15453aeff.1d3ccb0e-dcbd-456d-8fb9-f9b47a1d0cce" returned: 0 in 0.455s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:18:51 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-b77a5875-a176-4f54-992c-1c9a91af2af9 tempest-VolumesSnapshotListTestJSON-1568202637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7d75d6f9-bbee-4d87-b27c-07f15453aeff.1d3ccb0e-dcbd-456d-8fb9-f9b47a1d0cce {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:18:51 devstack sudo[97581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8609a278-2412-4ed0-96bc-df3f87ff0c8d Aug 05 06:18:51 devstack sudo[97581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:18:51 devstack sudo[97582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7d75d6f9-bbee-4d87-b27c-07f15453aeff.1d3ccb0e-dcbd-456d-8fb9-f9b47a1d0cce Aug 05 06:18:51 devstack sudo[97582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:18:51 devstack sudo[97581]: pam_unix(sudo:session): session closed for user root Aug 05 06:18:51 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-16ee5693-730b-4570-af55-9af45857cdc0 tempest-GroupSnapshotsTest-1900443889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8609a278-2412-4ed0-96bc-df3f87ff0c8d" returned: 0 in 0.253s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:18:51 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-16ee5693-730b-4570-af55-9af45857cdc0 tempest-GroupSnapshotsTest-1900443889 None] <== create_volume: return (792ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'} {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 06:18:51 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-16ee5693-730b-4570-af55-9af45857cdc0 tempest-GroupSnapshotsTest-1900443889 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.795s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:18:51 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-16ee5693-730b-4570-af55-9af45857cdc0 tempest-GroupSnapshotsTest-1900443889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d297f0d-974a-4c32-a0ae-2426b8cfcddc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8609a278-2412-4ed0-96bc-df3f87ff0c8d', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:18:51 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-16ee5693-730b-4570-af55-9af45857cdc0 tempest-GroupSnapshotsTest-1900443889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f733193-5bb1-4544-a508-a1790655484a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:18:51 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-16ee5693-730b-4570-af55-9af45857cdc0 tempest-GroupSnapshotsTest-1900443889 None] Volume volume-8609a278-2412-4ed0-96bc-df3f87ff0c8d (8609a278-2412-4ed0-96bc-df3f87ff0c8d): created successfully Aug 05 06:18:51 devstack sudo[97582]: pam_unix(sudo:session): session closed for user root Aug 05 06:18:51 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-16ee5693-730b-4570-af55-9af45857cdc0 tempest-GroupSnapshotsTest-1900443889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f733193-5bb1-4544-a508-a1790655484a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:18:51 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-16ee5693-730b-4570-af55-9af45857cdc0 tempest-GroupSnapshotsTest-1900443889 None] Flow 'volume_create_manager' (35037b28-9648-4e57-916b-310c40f6c7bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:18:51 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-b77a5875-a176-4f54-992c-1c9a91af2af9 tempest-VolumesSnapshotListTestJSON-1568202637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7d75d6f9-bbee-4d87-b27c-07f15453aeff.1d3ccb0e-dcbd-456d-8fb9-f9b47a1d0cce" returned: 0 in 0.282s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:18:51 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-16ee5693-730b-4570-af55-9af45857cdc0 tempest-GroupSnapshotsTest-1900443889 None] Created volume successfully. Aug 05 06:18:51 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-b77a5875-a176-4f54-992c-1c9a91af2af9 tempest-VolumesSnapshotListTestJSON-1568202637 None] Lock "cinder-quobyte-1d3ccb0e-dcbd-456d-8fb9-f9b47a1d0cce" released by "_delete_snapshot" :: held 1.808s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:18:51 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-b77a5875-a176-4f54-992c-1c9a91af2af9 tempest-VolumesSnapshotListTestJSON-1568202637 None] Lock "cinder-quobyte-7d75d6f9-bbee-4d87-b27c-07f15453aeff" released by "delete_snapshot" :: held 1.838s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:18:51 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-b77a5875-a176-4f54-992c-1c9a91af2af9 tempest-VolumesSnapshotListTestJSON-1568202637 None] Created reservations ['28374411-ac3c-4cf1-a1f1-fe90c43a951c', '971a2874-c9b0-4ab7-8732-08b9249ed7a4', '0b227b8d-a1b8-4097-b52d-9380ce55a258', '5e90319a-d1f9-4707-9b0c-454bd1ee509f'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:18:51 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-b77a5875-a176-4f54-992c-1c9a91af2af9 tempest-VolumesSnapshotListTestJSON-1568202637 None] Delete snapshot completed successfully. Aug 05 06:18:51 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-b77a5875-a176-4f54-992c-1c9a91af2af9 tempest-VolumesSnapshotListTestJSON-1568202637 None] Lock "cinder-1d3ccb0e-dcbd-456d-8fb9-f9b47a1d0cce-delete_snapshot" released by "delete_snapshot" :: held 1.972s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:18:51 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-06ad372e-49b4-45d8-9769-b2c57581acb7 tempest-VolumesSnapshotListTestJSON-1568202637 None] Acquiring lock "cinder-c297dc36-c821-47be-983e-a1bdaea4f009-delete_snapshot" by "delete_snapshot" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:18:51 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-06ad372e-49b4-45d8-9769-b2c57581acb7 tempest-VolumesSnapshotListTestJSON-1568202637 None] Lock "cinder-c297dc36-c821-47be-983e-a1bdaea4f009-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:18:51 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-06ad372e-49b4-45d8-9769-b2c57581acb7 tempest-VolumesSnapshotListTestJSON-1568202637 None] Acquiring lock "cinder-quobyte-7d75d6f9-bbee-4d87-b27c-07f15453aeff" by "delete_snapshot" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:18:51 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-06ad372e-49b4-45d8-9769-b2c57581acb7 tempest-VolumesSnapshotListTestJSON-1568202637 None] Lock "cinder-quobyte-7d75d6f9-bbee-4d87-b27c-07f15453aeff" acquired by "delete_snapshot" :: waited 0.024s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:18:51 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-06ad372e-49b4-45d8-9769-b2c57581acb7 tempest-VolumesSnapshotListTestJSON-1568202637 None] Acquiring lock "cinder-quobyte-c297dc36-c821-47be-983e-a1bdaea4f009" by "_delete_snapshot" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:18:51 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-06ad372e-49b4-45d8-9769-b2c57581acb7 tempest-VolumesSnapshotListTestJSON-1568202637 None] Lock "cinder-quobyte-c297dc36-c821-47be-983e-a1bdaea4f009" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:18:51 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-06ad372e-49b4-45d8-9769-b2c57581acb7 tempest-VolumesSnapshotListTestJSON-1568202637 None] Deleting offline snapshot c297dc36-c821-47be-983e-a1bdaea4f009 of volume 7d75d6f9-bbee-4d87-b27c-07f15453aeff {{(pid=88695) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 06:18:51 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-06ad372e-49b4-45d8-9769-b2c57581acb7 tempest-VolumesSnapshotListTestJSON-1568202637 None] snapshot_file for this snap is: volume-7d75d6f9-bbee-4d87-b27c-07f15453aeff.c297dc36-c821-47be-983e-a1bdaea4f009 {{(pid=88695) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 06:18:51 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[787b37cd-9ad4-478c-9973-6a908a6910c9]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:18:51 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-06ad372e-49b4-45d8-9769-b2c57581acb7 tempest-VolumesSnapshotListTestJSON-1568202637 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7d75d6f9-bbee-4d87-b27c-07f15453aeff.c297dc36-c821-47be-983e-a1bdaea4f009 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:18:51 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-f293bcd9-b9e6-4372-9444-3ab339cd8ac7 tempest-GroupSnapshotsTest-1900443889 None] GroupSnapshot 83790607-a002-40a0-9e49-e14a44785aa8: creating. Aug 05 06:18:51 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-f293bcd9-b9e6-4372-9444-3ab339cd8ac7 tempest-GroupSnapshotsTest-1900443889 None] Group snapshot 83790607-a002-40a0-9e49-e14a44785aa8: creating. {{(pid=88695) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Aug 05 06:18:51 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-f293bcd9-b9e6-4372-9444-3ab339cd8ac7 tempest-GroupSnapshotsTest-1900443889 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:18:51 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-f293bcd9-b9e6-4372-9444-3ab339cd8ac7 tempest-GroupSnapshotsTest-1900443889 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:18:51 devstack sudo[97587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7d75d6f9-bbee-4d87-b27c-07f15453aeff.c297dc36-c821-47be-983e-a1bdaea4f009 Aug 05 06:18:51 devstack sudo[97587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:18:51 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-f293bcd9-b9e6-4372-9444-3ab339cd8ac7 tempest-GroupSnapshotsTest-1900443889 None] Creating offline snapshot 4054078d-0fc9-4f04-9d8f-431117c32978 of volume 8609a278-2412-4ed0-96bc-df3f87ff0c8d {{(pid=88695) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 06:18:52 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[71ad49d8-4d3a-48ec-be60-a8338afd85ca]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:18:52 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-f293bcd9-b9e6-4372-9444-3ab339cd8ac7 tempest-GroupSnapshotsTest-1900443889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8609a278-2412-4ed0-96bc-df3f87ff0c8d {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:18:52 devstack sudo[97590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8609a278-2412-4ed0-96bc-df3f87ff0c8d Aug 05 06:18:52 devstack sudo[97590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:18:52 devstack sudo[97587]: pam_unix(sudo:session): session closed for user root Aug 05 06:18:52 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-06ad372e-49b4-45d8-9769-b2c57581acb7 tempest-VolumesSnapshotListTestJSON-1568202637 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7d75d6f9-bbee-4d87-b27c-07f15453aeff.c297dc36-c821-47be-983e-a1bdaea4f009" returned: 0 in 0.465s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:18:52 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-06ad372e-49b4-45d8-9769-b2c57581acb7 tempest-VolumesSnapshotListTestJSON-1568202637 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7d75d6f9-bbee-4d87-b27c-07f15453aeff(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88695) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 06:18:52 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[89c5fabc-bcb5-4cfb-81e6-ec1bc95847ba]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:18:52 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-06ad372e-49b4-45d8-9769-b2c57581acb7 tempest-VolumesSnapshotListTestJSON-1568202637 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7d75d6f9-bbee-4d87-b27c-07f15453aeff.9d7ccf49-9ddc-4165-a4a6-57e2ae484159 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:18:52 devstack sudo[97595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7d75d6f9-bbee-4d87-b27c-07f15453aeff.9d7ccf49-9ddc-4165-a4a6-57e2ae484159 Aug 05 06:18:52 devstack sudo[97595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:18:52 devstack sudo[97590]: pam_unix(sudo:session): session closed for user root Aug 05 06:18:52 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-f293bcd9-b9e6-4372-9444-3ab339cd8ac7 tempest-GroupSnapshotsTest-1900443889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8609a278-2412-4ed0-96bc-df3f87ff0c8d" returned: 0 in 0.470s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:18:52 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-f293bcd9-b9e6-4372-9444-3ab339cd8ac7 tempest-GroupSnapshotsTest-1900443889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8609a278-2412-4ed0-96bc-df3f87ff0c8d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8609a278-2412-4ed0-96bc-df3f87ff0c8d.4054078d-0fc9-4f04-9d8f-431117c32978 1G {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:18:52 devstack sudo[97600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8609a278-2412-4ed0-96bc-df3f87ff0c8d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8609a278-2412-4ed0-96bc-df3f87ff0c8d.4054078d-0fc9-4f04-9d8f-431117c32978 1G Aug 05 06:18:52 devstack sudo[97600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:18:52 devstack sudo[97595]: pam_unix(sudo:session): session closed for user root Aug 05 06:18:52 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-06ad372e-49b4-45d8-9769-b2c57581acb7 tempest-VolumesSnapshotListTestJSON-1568202637 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7d75d6f9-bbee-4d87-b27c-07f15453aeff.9d7ccf49-9ddc-4165-a4a6-57e2ae484159" returned: 0 in 0.411s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:18:52 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-06ad372e-49b4-45d8-9769-b2c57581acb7 tempest-VolumesSnapshotListTestJSON-1568202637 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7d75d6f9-bbee-4d87-b27c-07f15453aeff(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88695) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 06:18:52 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-06ad372e-49b4-45d8-9769-b2c57581acb7 tempest-VolumesSnapshotListTestJSON-1568202637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7d75d6f9-bbee-4d87-b27c-07f15453aeff.c297dc36-c821-47be-983e-a1bdaea4f009 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:18:52 devstack sudo[97609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7d75d6f9-bbee-4d87-b27c-07f15453aeff.c297dc36-c821-47be-983e-a1bdaea4f009 Aug 05 06:18:52 devstack sudo[97609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:18:53 devstack sudo[97600]: pam_unix(sudo:session): session closed for user root Aug 05 06:18:53 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-f293bcd9-b9e6-4372-9444-3ab339cd8ac7 tempest-GroupSnapshotsTest-1900443889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8609a278-2412-4ed0-96bc-df3f87ff0c8d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8609a278-2412-4ed0-96bc-df3f87ff0c8d.4054078d-0fc9-4f04-9d8f-431117c32978 1G" returned: 0 in 0.644s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:18:53 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-f293bcd9-b9e6-4372-9444-3ab339cd8ac7 tempest-GroupSnapshotsTest-1900443889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8609a278-2412-4ed0-96bc-df3f87ff0c8d -F qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8609a278-2412-4ed0-96bc-df3f87ff0c8d.4054078d-0fc9-4f04-9d8f-431117c32978 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:18:53 devstack sudo[97654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8609a278-2412-4ed0-96bc-df3f87ff0c8d -F qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8609a278-2412-4ed0-96bc-df3f87ff0c8d.4054078d-0fc9-4f04-9d8f-431117c32978 Aug 05 06:18:53 devstack sudo[97654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:18:53 devstack sudo[97609]: pam_unix(sudo:session): session closed for user root Aug 05 06:18:53 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-06ad372e-49b4-45d8-9769-b2c57581acb7 tempest-VolumesSnapshotListTestJSON-1568202637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7d75d6f9-bbee-4d87-b27c-07f15453aeff.c297dc36-c821-47be-983e-a1bdaea4f009" returned: 0 in 0.679s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:18:53 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-06ad372e-49b4-45d8-9769-b2c57581acb7 tempest-VolumesSnapshotListTestJSON-1568202637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7d75d6f9-bbee-4d87-b27c-07f15453aeff.c297dc36-c821-47be-983e-a1bdaea4f009 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:18:53 devstack sudo[97725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7d75d6f9-bbee-4d87-b27c-07f15453aeff.c297dc36-c821-47be-983e-a1bdaea4f009 Aug 05 06:18:53 devstack sudo[97725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:18:53 devstack sudo[97654]: pam_unix(sudo:session): session closed for user root Aug 05 06:18:53 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-f293bcd9-b9e6-4372-9444-3ab339cd8ac7 tempest-GroupSnapshotsTest-1900443889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8609a278-2412-4ed0-96bc-df3f87ff0c8d -F qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8609a278-2412-4ed0-96bc-df3f87ff0c8d.4054078d-0fc9-4f04-9d8f-431117c32978" returned: 0 in 0.493s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:18:53 devstack cinder-volume[88695]: WARNING cinder.volume.drivers.remotefs [None req-f293bcd9-b9e6-4372-9444-3ab339cd8ac7 tempest-GroupSnapshotsTest-1900443889 None] /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8609a278-2412-4ed0-96bc-df3f87ff0c8d.4054078d-0fc9-4f04-9d8f-431117c32978 is being set with open permissions: ugo+rw: NotImplementedError Aug 05 06:18:53 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-f293bcd9-b9e6-4372-9444-3ab339cd8ac7 tempest-GroupSnapshotsTest-1900443889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8609a278-2412-4ed0-96bc-df3f87ff0c8d.4054078d-0fc9-4f04-9d8f-431117c32978 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:18:53 devstack sudo[97729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8609a278-2412-4ed0-96bc-df3f87ff0c8d.4054078d-0fc9-4f04-9d8f-431117c32978 Aug 05 06:18:53 devstack sudo[97729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:18:53 devstack sudo[97725]: pam_unix(sudo:session): session closed for user root Aug 05 06:18:53 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-06ad372e-49b4-45d8-9769-b2c57581acb7 tempest-VolumesSnapshotListTestJSON-1568202637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7d75d6f9-bbee-4d87-b27c-07f15453aeff.c297dc36-c821-47be-983e-a1bdaea4f009" returned: 0 in 0.348s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:18:53 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-06ad372e-49b4-45d8-9769-b2c57581acb7 tempest-VolumesSnapshotListTestJSON-1568202637 None] Lock "cinder-quobyte-c297dc36-c821-47be-983e-a1bdaea4f009" released by "_delete_snapshot" :: held 2.035s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:18:53 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-06ad372e-49b4-45d8-9769-b2c57581acb7 tempest-VolumesSnapshotListTestJSON-1568202637 None] Lock "cinder-quobyte-7d75d6f9-bbee-4d87-b27c-07f15453aeff" released by "delete_snapshot" :: held 2.064s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:18:53 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-06ad372e-49b4-45d8-9769-b2c57581acb7 tempest-VolumesSnapshotListTestJSON-1568202637 None] Created reservations ['fe696f4e-3115-44c2-8afe-4ebcb6ada09d', '73f9a5da-e112-4edd-a6f4-dde1534189d2', 'e42bf7ed-5dc3-4e1b-afbf-5f0f2ce3ceb8', 'f78f4955-b55d-4968-8a61-19f2891e0c2f'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:18:53 devstack sudo[97729]: pam_unix(sudo:session): session closed for user root Aug 05 06:18:53 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-f293bcd9-b9e6-4372-9444-3ab339cd8ac7 tempest-GroupSnapshotsTest-1900443889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8609a278-2412-4ed0-96bc-df3f87ff0c8d.4054078d-0fc9-4f04-9d8f-431117c32978" returned: 0 in 0.298s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:18:53 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-f293bcd9-b9e6-4372-9444-3ab339cd8ac7 tempest-GroupSnapshotsTest-1900443889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8609a278-2412-4ed0-96bc-df3f87ff0c8d.info {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:18:53 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-06ad372e-49b4-45d8-9769-b2c57581acb7 tempest-VolumesSnapshotListTestJSON-1568202637 None] Delete snapshot completed successfully. Aug 05 06:18:53 devstack sudo[97741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8609a278-2412-4ed0-96bc-df3f87ff0c8d.info Aug 05 06:18:53 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-06ad372e-49b4-45d8-9769-b2c57581acb7 tempest-VolumesSnapshotListTestJSON-1568202637 None] Lock "cinder-c297dc36-c821-47be-983e-a1bdaea4f009-delete_snapshot" released by "delete_snapshot" :: held 2.252s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:18:53 devstack sudo[97741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:18:54 devstack sudo[97741]: pam_unix(sudo:session): session closed for user root Aug 05 06:18:54 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-f293bcd9-b9e6-4372-9444-3ab339cd8ac7 tempest-GroupSnapshotsTest-1900443889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8609a278-2412-4ed0-96bc-df3f87ff0c8d.info" returned: 0 in 0.281s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:18:54 devstack cinder-volume[88695]: WARNING cinder.volume.drivers.remotefs [None req-f293bcd9-b9e6-4372-9444-3ab339cd8ac7 tempest-GroupSnapshotsTest-1900443889 None] /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8609a278-2412-4ed0-96bc-df3f87ff0c8d.info is being set with open permissions: ugo+rw: NotImplementedError Aug 05 06:18:54 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-f293bcd9-b9e6-4372-9444-3ab339cd8ac7 tempest-GroupSnapshotsTest-1900443889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8609a278-2412-4ed0-96bc-df3f87ff0c8d.info {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:18:54 devstack sudo[97754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8609a278-2412-4ed0-96bc-df3f87ff0c8d.info Aug 05 06:18:54 devstack sudo[97754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:18:54 devstack sudo[97754]: pam_unix(sudo:session): session closed for user root Aug 05 06:18:54 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-f293bcd9-b9e6-4372-9444-3ab339cd8ac7 tempest-GroupSnapshotsTest-1900443889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8609a278-2412-4ed0-96bc-df3f87ff0c8d.info" returned: 0 in 0.403s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:18:54 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-f293bcd9-b9e6-4372-9444-3ab339cd8ac7 tempest-GroupSnapshotsTest-1900443889 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.714s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:18:54 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-f293bcd9-b9e6-4372-9444-3ab339cd8ac7 tempest-GroupSnapshotsTest-1900443889 None] group_snapshot 83790607-a002-40a0-9e49-e14a44785aa8: created successfully Aug 05 06:18:55 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-4106a742-f2cf-413c-a377-5509e0f1b327 tempest-VolumesSnapshotListTestJSON-1568202637 None] Acquiring lock "cinder-9d7ccf49-9ddc-4165-a4a6-57e2ae484159-delete_snapshot" by "delete_snapshot" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:18:55 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-4106a742-f2cf-413c-a377-5509e0f1b327 tempest-VolumesSnapshotListTestJSON-1568202637 None] Lock "cinder-9d7ccf49-9ddc-4165-a4a6-57e2ae484159-delete_snapshot" acquired by "delete_snapshot" :: waited 0.052s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:18:55 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-4106a742-f2cf-413c-a377-5509e0f1b327 tempest-VolumesSnapshotListTestJSON-1568202637 None] Acquiring lock "cinder-quobyte-7d75d6f9-bbee-4d87-b27c-07f15453aeff" by "delete_snapshot" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:18:55 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-4106a742-f2cf-413c-a377-5509e0f1b327 tempest-VolumesSnapshotListTestJSON-1568202637 None] Lock "cinder-quobyte-7d75d6f9-bbee-4d87-b27c-07f15453aeff" acquired by "delete_snapshot" :: waited 0.022s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:18:55 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-4106a742-f2cf-413c-a377-5509e0f1b327 tempest-VolumesSnapshotListTestJSON-1568202637 None] Acquiring lock "cinder-quobyte-9d7ccf49-9ddc-4165-a4a6-57e2ae484159" by "_delete_snapshot" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:18:55 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-4106a742-f2cf-413c-a377-5509e0f1b327 tempest-VolumesSnapshotListTestJSON-1568202637 None] Lock "cinder-quobyte-9d7ccf49-9ddc-4165-a4a6-57e2ae484159" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:18:55 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-4106a742-f2cf-413c-a377-5509e0f1b327 tempest-VolumesSnapshotListTestJSON-1568202637 None] Deleting offline snapshot 9d7ccf49-9ddc-4165-a4a6-57e2ae484159 of volume 7d75d6f9-bbee-4d87-b27c-07f15453aeff {{(pid=88695) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 06:18:55 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-4106a742-f2cf-413c-a377-5509e0f1b327 tempest-VolumesSnapshotListTestJSON-1568202637 None] snapshot_file for this snap is: volume-7d75d6f9-bbee-4d87-b27c-07f15453aeff.9d7ccf49-9ddc-4165-a4a6-57e2ae484159 {{(pid=88695) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 06:18:55 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[78488ff9-5798-4019-ac22-7b03c530bf88]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:18:55 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-4106a742-f2cf-413c-a377-5509e0f1b327 tempest-VolumesSnapshotListTestJSON-1568202637 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7d75d6f9-bbee-4d87-b27c-07f15453aeff.9d7ccf49-9ddc-4165-a4a6-57e2ae484159 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:18:55 devstack sudo[98122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7d75d6f9-bbee-4d87-b27c-07f15453aeff.9d7ccf49-9ddc-4165-a4a6-57e2ae484159 Aug 05 06:18:55 devstack sudo[98122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:18:55 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-531d8e0f-8d69-4c36-81d5-ec2fcafd1c18 tempest-GroupSnapshotsTest-1900443889 None] group_snapshot 83790607-a002-40a0-9e49-e14a44785aa8: deleting Aug 05 06:18:55 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-531d8e0f-8d69-4c36-81d5-ec2fcafd1c18 tempest-GroupSnapshotsTest-1900443889 None] group_snapshot 83790607-a002-40a0-9e49-e14a44785aa8: deleting {{(pid=88695) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Aug 05 06:18:55 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-531d8e0f-8d69-4c36-81d5-ec2fcafd1c18 tempest-GroupSnapshotsTest-1900443889 None] Acquiring lock "cinder-quobyte-8609a278-2412-4ed0-96bc-df3f87ff0c8d" by "delete_snapshot" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:18:55 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-531d8e0f-8d69-4c36-81d5-ec2fcafd1c18 tempest-GroupSnapshotsTest-1900443889 None] Lock "cinder-quobyte-8609a278-2412-4ed0-96bc-df3f87ff0c8d" acquired by "delete_snapshot" :: waited 0.015s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:18:55 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-531d8e0f-8d69-4c36-81d5-ec2fcafd1c18 tempest-GroupSnapshotsTest-1900443889 None] Acquiring lock "cinder-quobyte-4054078d-0fc9-4f04-9d8f-431117c32978" by "_delete_snapshot" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:18:55 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-531d8e0f-8d69-4c36-81d5-ec2fcafd1c18 tempest-GroupSnapshotsTest-1900443889 None] Lock "cinder-quobyte-4054078d-0fc9-4f04-9d8f-431117c32978" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:18:55 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-531d8e0f-8d69-4c36-81d5-ec2fcafd1c18 tempest-GroupSnapshotsTest-1900443889 None] Deleting offline snapshot 4054078d-0fc9-4f04-9d8f-431117c32978 of volume 8609a278-2412-4ed0-96bc-df3f87ff0c8d {{(pid=88695) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 06:18:55 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-531d8e0f-8d69-4c36-81d5-ec2fcafd1c18 tempest-GroupSnapshotsTest-1900443889 None] snapshot_file for this snap is: volume-8609a278-2412-4ed0-96bc-df3f87ff0c8d.4054078d-0fc9-4f04-9d8f-431117c32978 {{(pid=88695) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 06:18:55 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[b460b23b-537c-414a-8234-05fe80cce9d2]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:18:55 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-531d8e0f-8d69-4c36-81d5-ec2fcafd1c18 tempest-GroupSnapshotsTest-1900443889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8609a278-2412-4ed0-96bc-df3f87ff0c8d.4054078d-0fc9-4f04-9d8f-431117c32978 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:18:55 devstack sudo[98133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8609a278-2412-4ed0-96bc-df3f87ff0c8d.4054078d-0fc9-4f04-9d8f-431117c32978 Aug 05 06:18:55 devstack sudo[98133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:18:55 devstack sudo[98122]: pam_unix(sudo:session): session closed for user root Aug 05 06:18:55 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-4106a742-f2cf-413c-a377-5509e0f1b327 tempest-VolumesSnapshotListTestJSON-1568202637 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7d75d6f9-bbee-4d87-b27c-07f15453aeff.9d7ccf49-9ddc-4165-a4a6-57e2ae484159" returned: 0 in 0.488s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:18:55 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-4106a742-f2cf-413c-a377-5509e0f1b327 tempest-VolumesSnapshotListTestJSON-1568202637 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7d75d6f9-bbee-4d87-b27c-07f15453aeff(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88695) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 06:18:55 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[761d4b61-a069-4806-b7ba-406effbbb0fd]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:18:55 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-4106a742-f2cf-413c-a377-5509e0f1b327 tempest-VolumesSnapshotListTestJSON-1568202637 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7d75d6f9-bbee-4d87-b27c-07f15453aeff {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:18:55 devstack sudo[98143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7d75d6f9-bbee-4d87-b27c-07f15453aeff Aug 05 06:18:55 devstack sudo[98143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:18:55 devstack sudo[98133]: pam_unix(sudo:session): session closed for user root Aug 05 06:18:55 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-531d8e0f-8d69-4c36-81d5-ec2fcafd1c18 tempest-GroupSnapshotsTest-1900443889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8609a278-2412-4ed0-96bc-df3f87ff0c8d.4054078d-0fc9-4f04-9d8f-431117c32978" returned: 0 in 0.406s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:18:55 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-531d8e0f-8d69-4c36-81d5-ec2fcafd1c18 tempest-GroupSnapshotsTest-1900443889 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8609a278-2412-4ed0-96bc-df3f87ff0c8d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88695) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 06:18:55 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[e04b59e9-72aa-4ed0-9687-e6534a4bc461]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:18:55 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-531d8e0f-8d69-4c36-81d5-ec2fcafd1c18 tempest-GroupSnapshotsTest-1900443889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8609a278-2412-4ed0-96bc-df3f87ff0c8d {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:18:56 devstack sudo[98157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8609a278-2412-4ed0-96bc-df3f87ff0c8d Aug 05 06:18:56 devstack sudo[98157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:18:56 devstack sudo[98143]: pam_unix(sudo:session): session closed for user root Aug 05 06:18:56 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-4106a742-f2cf-413c-a377-5509e0f1b327 tempest-VolumesSnapshotListTestJSON-1568202637 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7d75d6f9-bbee-4d87-b27c-07f15453aeff" returned: 0 in 0.455s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:18:56 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-4106a742-f2cf-413c-a377-5509e0f1b327 tempest-VolumesSnapshotListTestJSON-1568202637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7d75d6f9-bbee-4d87-b27c-07f15453aeff.9d7ccf49-9ddc-4165-a4a6-57e2ae484159 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:18:56 devstack sudo[98162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7d75d6f9-bbee-4d87-b27c-07f15453aeff.9d7ccf49-9ddc-4165-a4a6-57e2ae484159 Aug 05 06:18:56 devstack sudo[98162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:18:56 devstack sudo[98157]: pam_unix(sudo:session): session closed for user root Aug 05 06:18:56 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-531d8e0f-8d69-4c36-81d5-ec2fcafd1c18 tempest-GroupSnapshotsTest-1900443889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8609a278-2412-4ed0-96bc-df3f87ff0c8d" returned: 0 in 0.452s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:18:56 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-531d8e0f-8d69-4c36-81d5-ec2fcafd1c18 tempest-GroupSnapshotsTest-1900443889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8609a278-2412-4ed0-96bc-df3f87ff0c8d.4054078d-0fc9-4f04-9d8f-431117c32978 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:18:56 devstack sudo[98167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8609a278-2412-4ed0-96bc-df3f87ff0c8d.4054078d-0fc9-4f04-9d8f-431117c32978 Aug 05 06:18:56 devstack sudo[98167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:18:56 devstack sudo[98162]: pam_unix(sudo:session): session closed for user root Aug 05 06:18:56 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-4106a742-f2cf-413c-a377-5509e0f1b327 tempest-VolumesSnapshotListTestJSON-1568202637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7d75d6f9-bbee-4d87-b27c-07f15453aeff.9d7ccf49-9ddc-4165-a4a6-57e2ae484159" returned: 0 in 0.435s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:18:56 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-4106a742-f2cf-413c-a377-5509e0f1b327 tempest-VolumesSnapshotListTestJSON-1568202637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7d75d6f9-bbee-4d87-b27c-07f15453aeff.9d7ccf49-9ddc-4165-a4a6-57e2ae484159 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:18:56 devstack sudo[98172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7d75d6f9-bbee-4d87-b27c-07f15453aeff.9d7ccf49-9ddc-4165-a4a6-57e2ae484159 Aug 05 06:18:56 devstack sudo[98172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:18:56 devstack sudo[98167]: pam_unix(sudo:session): session closed for user root Aug 05 06:18:56 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-531d8e0f-8d69-4c36-81d5-ec2fcafd1c18 tempest-GroupSnapshotsTest-1900443889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8609a278-2412-4ed0-96bc-df3f87ff0c8d.4054078d-0fc9-4f04-9d8f-431117c32978" returned: 0 in 0.500s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:18:56 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-531d8e0f-8d69-4c36-81d5-ec2fcafd1c18 tempest-GroupSnapshotsTest-1900443889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8609a278-2412-4ed0-96bc-df3f87ff0c8d.4054078d-0fc9-4f04-9d8f-431117c32978 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:18:56 devstack sudo[98172]: pam_unix(sudo:session): session closed for user root Aug 05 06:18:56 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-4106a742-f2cf-413c-a377-5509e0f1b327 tempest-VolumesSnapshotListTestJSON-1568202637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7d75d6f9-bbee-4d87-b27c-07f15453aeff.9d7ccf49-9ddc-4165-a4a6-57e2ae484159" returned: 0 in 0.368s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:18:57 devstack sudo[98184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8609a278-2412-4ed0-96bc-df3f87ff0c8d.4054078d-0fc9-4f04-9d8f-431117c32978 Aug 05 06:18:57 devstack sudo[98184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:18:57 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-4106a742-f2cf-413c-a377-5509e0f1b327 tempest-VolumesSnapshotListTestJSON-1568202637 None] Lock "cinder-quobyte-9d7ccf49-9ddc-4165-a4a6-57e2ae484159" released by "_delete_snapshot" :: held 1.940s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:18:57 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-4106a742-f2cf-413c-a377-5509e0f1b327 tempest-VolumesSnapshotListTestJSON-1568202637 None] Lock "cinder-quobyte-7d75d6f9-bbee-4d87-b27c-07f15453aeff" released by "delete_snapshot" :: held 1.986s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:18:57 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-4106a742-f2cf-413c-a377-5509e0f1b327 tempest-VolumesSnapshotListTestJSON-1568202637 None] Created reservations ['ff84d9a8-3e47-41a0-b5a1-91fe56af0905', '907cc964-8178-4ffe-9475-3a513bbfd106', 'e6638c50-59eb-41eb-ad6e-a36af5f71d52', '18100fc6-9cbf-45c9-8e7c-9325d1613ba2'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:18:57 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-4106a742-f2cf-413c-a377-5509e0f1b327 tempest-VolumesSnapshotListTestJSON-1568202637 None] Delete snapshot completed successfully. Aug 05 06:18:57 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-4106a742-f2cf-413c-a377-5509e0f1b327 tempest-VolumesSnapshotListTestJSON-1568202637 None] Lock "cinder-9d7ccf49-9ddc-4165-a4a6-57e2ae484159-delete_snapshot" released by "delete_snapshot" :: held 2.271s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:18:57 devstack sudo[98184]: pam_unix(sudo:session): session closed for user root Aug 05 06:18:57 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-531d8e0f-8d69-4c36-81d5-ec2fcafd1c18 tempest-GroupSnapshotsTest-1900443889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8609a278-2412-4ed0-96bc-df3f87ff0c8d.4054078d-0fc9-4f04-9d8f-431117c32978" returned: 0 in 0.447s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:18:57 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-531d8e0f-8d69-4c36-81d5-ec2fcafd1c18 tempest-GroupSnapshotsTest-1900443889 None] Lock "cinder-quobyte-4054078d-0fc9-4f04-9d8f-431117c32978" released by "_delete_snapshot" :: held 1.953s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:18:57 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-531d8e0f-8d69-4c36-81d5-ec2fcafd1c18 tempest-GroupSnapshotsTest-1900443889 None] Lock "cinder-quobyte-8609a278-2412-4ed0-96bc-df3f87ff0c8d" released by "delete_snapshot" :: held 1.987s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:18:57 devstack cinder-volume[88695]: WARNING cinder.quota [None req-531d8e0f-8d69-4c36-81d5-ec2fcafd1c18 tempest-GroupSnapshotsTest-1900443889 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-679509138 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-679509138, it is now deprecated. Please use the default quota class for default quota. Aug 05 06:18:57 devstack cinder-volume[88695]: WARNING cinder.quota [None req-531d8e0f-8d69-4c36-81d5-ec2fcafd1c18 tempest-GroupSnapshotsTest-1900443889 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-679509138 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-679509138, it is now deprecated. Please use the default quota class for default quota. Aug 05 06:18:57 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-531d8e0f-8d69-4c36-81d5-ec2fcafd1c18 tempest-GroupSnapshotsTest-1900443889 None] Created reservations ['21c4ee76-18f5-4da0-8229-f4e1945388df', '69752840-af3c-466f-af40-4a6a45085eb1', 'd23b2145-836f-491f-ad5e-de9ba829b05c', 'e97bb39d-c086-4448-a268-de4df2bba66e'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:18:57 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-531d8e0f-8d69-4c36-81d5-ec2fcafd1c18 tempest-GroupSnapshotsTest-1900443889 None] group_snapshot 83790607-a002-40a0-9e49-e14a44785aa8: deleted successfully Aug 05 06:18:58 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-9d683fef-d6e4-453f-9c3c-8e11c7abb718 tempest-GroupSnapshotsTest-1900443889 None] Acquiring lock "cinder-quobyte-8609a278-2412-4ed0-96bc-df3f87ff0c8d" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:18:58 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-9d683fef-d6e4-453f-9c3c-8e11c7abb718 tempest-GroupSnapshotsTest-1900443889 None] Lock "cinder-quobyte-8609a278-2412-4ed0-96bc-df3f87ff0c8d" acquired by "delete_volume" :: waited 0.027s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:18:58 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2cf6e3d-fffc-4a0d-9799-95b5a3c0ff73]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:18:58 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-9d683fef-d6e4-453f-9c3c-8e11c7abb718 tempest-GroupSnapshotsTest-1900443889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8609a278-2412-4ed0-96bc-df3f87ff0c8d {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:18:58 devstack sudo[98195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8609a278-2412-4ed0-96bc-df3f87ff0c8d Aug 05 06:18:58 devstack sudo[98195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:18:58 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-02dd735d-211b-4e89-8746-d7f88079dead tempest-VolumesSnapshotListTestJSON-1568202637 None] Acquiring lock "cinder-7d75d6f9-bbee-4d87-b27c-07f15453aeff-delete_volume" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:18:58 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-02dd735d-211b-4e89-8746-d7f88079dead tempest-VolumesSnapshotListTestJSON-1568202637 None] Lock "cinder-7d75d6f9-bbee-4d87-b27c-07f15453aeff-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:18:58 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-02dd735d-211b-4e89-8746-d7f88079dead tempest-VolumesSnapshotListTestJSON-1568202637 None] Acquiring lock "cinder-quobyte-7d75d6f9-bbee-4d87-b27c-07f15453aeff" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:18:58 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-02dd735d-211b-4e89-8746-d7f88079dead tempest-VolumesSnapshotListTestJSON-1568202637 None] Lock "cinder-quobyte-7d75d6f9-bbee-4d87-b27c-07f15453aeff" acquired by "delete_volume" :: waited 0.018s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:18:58 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab2633f3-d2fb-447f-8c1c-a3f43bffc34e]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:18:58 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-02dd735d-211b-4e89-8746-d7f88079dead tempest-VolumesSnapshotListTestJSON-1568202637 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7d75d6f9-bbee-4d87-b27c-07f15453aeff {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:18:58 devstack sudo[98195]: pam_unix(sudo:session): session closed for user root Aug 05 06:18:58 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-9d683fef-d6e4-453f-9c3c-8e11c7abb718 tempest-GroupSnapshotsTest-1900443889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8609a278-2412-4ed0-96bc-df3f87ff0c8d" returned: 0 in 0.451s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:18:58 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-9d683fef-d6e4-453f-9c3c-8e11c7abb718 tempest-GroupSnapshotsTest-1900443889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8609a278-2412-4ed0-96bc-df3f87ff0c8d {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:18:58 devstack sudo[98201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8609a278-2412-4ed0-96bc-df3f87ff0c8d Aug 05 06:18:58 devstack sudo[98201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:18:58 devstack sudo[98199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7d75d6f9-bbee-4d87-b27c-07f15453aeff Aug 05 06:18:58 devstack sudo[98199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:18:58 devstack sudo[98201]: pam_unix(sudo:session): session closed for user root Aug 05 06:18:58 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-9d683fef-d6e4-453f-9c3c-8e11c7abb718 tempest-GroupSnapshotsTest-1900443889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8609a278-2412-4ed0-96bc-df3f87ff0c8d" returned: 0 in 0.287s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:18:58 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-9d683fef-d6e4-453f-9c3c-8e11c7abb718 tempest-GroupSnapshotsTest-1900443889 None] Lock "cinder-quobyte-8609a278-2412-4ed0-96bc-df3f87ff0c8d" released by "delete_volume" :: held 0.799s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:18:58 devstack sudo[98199]: pam_unix(sudo:session): session closed for user root Aug 05 06:18:58 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-02dd735d-211b-4e89-8746-d7f88079dead tempest-VolumesSnapshotListTestJSON-1568202637 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7d75d6f9-bbee-4d87-b27c-07f15453aeff" returned: 0 in 0.413s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:18:58 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-02dd735d-211b-4e89-8746-d7f88079dead tempest-VolumesSnapshotListTestJSON-1568202637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7d75d6f9-bbee-4d87-b27c-07f15453aeff {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:18:58 devstack sudo[98208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7d75d6f9-bbee-4d87-b27c-07f15453aeff Aug 05 06:18:58 devstack sudo[98208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:18:58 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-9d683fef-d6e4-453f-9c3c-8e11c7abb718 tempest-GroupSnapshotsTest-1900443889 None] Created reservations ['45248040-a8d8-4adf-aa10-da22129bd7d1'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:18:59 devstack cinder-volume[88695]: WARNING cinder.quota [None req-9d683fef-d6e4-453f-9c3c-8e11c7abb718 tempest-GroupSnapshotsTest-1900443889 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-679509138 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-679509138, it is now deprecated. Please use the default quota class for default quota. Aug 05 06:18:59 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-9d683fef-d6e4-453f-9c3c-8e11c7abb718 tempest-GroupSnapshotsTest-1900443889 None] Created reservations ['9b42b91a-f77f-48e6-8b1f-9a99d1e54b06', '643eec24-7d94-417d-8dcf-e1f9a72bc2a0', 'aacef42e-355d-45e6-912d-ac157791df40', '2cd40b64-87d0-4ed3-b797-399f5e65d0ab'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:18:59 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-9d683fef-d6e4-453f-9c3c-8e11c7abb718 tempest-GroupSnapshotsTest-1900443889 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:18:59 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-9d683fef-d6e4-453f-9c3c-8e11c7abb718 tempest-GroupSnapshotsTest-1900443889 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:18:59 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-9d683fef-d6e4-453f-9c3c-8e11c7abb718 tempest-GroupSnapshotsTest-1900443889 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:18:59 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-9d683fef-d6e4-453f-9c3c-8e11c7abb718 tempest-GroupSnapshotsTest-1900443889 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:18:59 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-9d683fef-d6e4-453f-9c3c-8e11c7abb718 tempest-GroupSnapshotsTest-1900443889 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:18:59 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-9d683fef-d6e4-453f-9c3c-8e11c7abb718 tempest-GroupSnapshotsTest-1900443889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:18:59 devstack sudo[98210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce Aug 05 06:18:59 devstack sudo[98210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:18:59 devstack sudo[98208]: pam_unix(sudo:session): session closed for user root Aug 05 06:18:59 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-02dd735d-211b-4e89-8746-d7f88079dead tempest-VolumesSnapshotListTestJSON-1568202637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7d75d6f9-bbee-4d87-b27c-07f15453aeff" returned: 0 in 0.286s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:18:59 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-02dd735d-211b-4e89-8746-d7f88079dead tempest-VolumesSnapshotListTestJSON-1568202637 None] Lock "cinder-quobyte-7d75d6f9-bbee-4d87-b27c-07f15453aeff" released by "delete_volume" :: held 0.783s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:18:59 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-02dd735d-211b-4e89-8746-d7f88079dead tempest-VolumesSnapshotListTestJSON-1568202637 None] Created reservations ['914f901f-c969-4dff-83c6-a41b4b98c1c9', 'c9eca9e7-3363-452b-88a4-5e4c6937aaf9', 'b02f7507-9e69-4666-ba01-576e790ccffa', '581b7efe-45e2-4698-b37f-50bbd4b9acd2'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:18:59 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-02dd735d-211b-4e89-8746-d7f88079dead tempest-VolumesSnapshotListTestJSON-1568202637 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:18:59 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-02dd735d-211b-4e89-8746-d7f88079dead tempest-VolumesSnapshotListTestJSON-1568202637 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:18:59 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-02dd735d-211b-4e89-8746-d7f88079dead tempest-VolumesSnapshotListTestJSON-1568202637 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:18:59 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-02dd735d-211b-4e89-8746-d7f88079dead tempest-VolumesSnapshotListTestJSON-1568202637 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:18:59 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-02dd735d-211b-4e89-8746-d7f88079dead tempest-VolumesSnapshotListTestJSON-1568202637 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:18:59 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-02dd735d-211b-4e89-8746-d7f88079dead tempest-VolumesSnapshotListTestJSON-1568202637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:18:59 devstack sudo[98210]: pam_unix(sudo:session): session closed for user root Aug 05 06:18:59 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-9d683fef-d6e4-453f-9c3c-8e11c7abb718 tempest-GroupSnapshotsTest-1900443889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce" returned: 0 in 0.320s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:18:59 devstack cinder-volume[88695]: DEBUG cinder.manager [None req-9d683fef-d6e4-453f-9c3c-8e11c7abb718 tempest-GroupSnapshotsTest-1900443889 None] Notifying Schedulers of capabilities ... {{(pid=88695) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 06:18:59 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-9d683fef-d6e4-453f-9c3c-8e11c7abb718 tempest-GroupSnapshotsTest-1900443889 None] Delete group completed successfully. Aug 05 06:18:59 devstack sudo[98214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce Aug 05 06:18:59 devstack sudo[98214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:18:59 devstack sudo[98214]: pam_unix(sudo:session): session closed for user root Aug 05 06:18:59 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-02dd735d-211b-4e89-8746-d7f88079dead tempest-VolumesSnapshotListTestJSON-1568202637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce" returned: 0 in 0.364s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:18:59 devstack cinder-volume[88695]: DEBUG cinder.manager [None req-02dd735d-211b-4e89-8746-d7f88079dead tempest-VolumesSnapshotListTestJSON-1568202637 None] Notifying Schedulers of capabilities ... {{(pid=88695) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 06:18:59 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-02dd735d-211b-4e89-8746-d7f88079dead tempest-VolumesSnapshotListTestJSON-1568202637 None] Deleted volume successfully. Aug 05 06:18:59 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-02dd735d-211b-4e89-8746-d7f88079dead tempest-VolumesSnapshotListTestJSON-1568202637 None] Lock "cinder-7d75d6f9-bbee-4d87-b27c-07f15453aeff-delete_volume" released by "delete_volume" :: held 1.461s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:19:00 devstack cinder-volume[88695]: DEBUG oslo_service.periodic_task [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88695) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 06:19:00 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:19:00 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:19:00 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:19:00 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:19:00 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:19:00 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:19:00 devstack sudo[98217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce Aug 05 06:19:00 devstack sudo[98217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:19:00 devstack sudo[98217]: pam_unix(sudo:session): session closed for user root Aug 05 06:19:00 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce" returned: 0 in 0.369s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:19:00 devstack cinder-volume[88695]: DEBUG cinder.manager [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] Notifying Schedulers of capabilities ... {{(pid=88695) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 06:19:00 devstack cinder-volume[88695]: DEBUG oslo_service.periodic_task [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] Running periodic task VolumeManager._thread_info {{(pid=88695) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 06:19:00 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] thread count: 28 {{(pid=88695) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 05 06:19:00 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] thread info: [<_MainThread(MainThread, started 134469211893888)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88695) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 05 06:19:05 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-67bbc2d5-66f2-4dd5-a164-d5020873c5dc tempest-GroupSnapshotsV319Test-1904898740 None] Group tempest-GroupSnapshotsV319Test-Group-1752960742: creating Aug 05 06:19:05 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-67bbc2d5-66f2-4dd5-a164-d5020873c5dc tempest-GroupSnapshotsV319Test-1904898740 None] Group tempest-GroupSnapshotsV319Test-Group-1752960742: created successfully Aug 05 06:19:05 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-67bbc2d5-66f2-4dd5-a164-d5020873c5dc tempest-GroupSnapshotsV319Test-1904898740 None] Create group completed successfully. Aug 05 06:19:07 devstack cinder-volume[88695]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab870e9d-d1a3-4cf1-9335-b4e6ae25ff7d tempest-GroupSnapshotsV319Test-1904898740 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88695) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 06:19:07 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-ab870e9d-d1a3-4cf1-9335-b4e6ae25ff7d tempest-GroupSnapshotsV319Test-1904898740 None] Flow 'volume_create_manager' (4e361581-2d34-46fb-a78b-805d0a1e1e08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:19:07 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-ab870e9d-d1a3-4cf1-9335-b4e6ae25ff7d tempest-GroupSnapshotsV319Test-1904898740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc265d6b-ee3a-45ee-b057-d1dfa10028de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:19:07 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-ab870e9d-d1a3-4cf1-9335-b4e6ae25ff7d tempest-GroupSnapshotsV319Test-1904898740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc265d6b-ee3a-45ee-b057-d1dfa10028de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:19:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-30576764',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a5a625dc-1216-4c01-ac8c-77e5842b6a62,host='devstack@QuobyteHD#QuobyteHD',id=fbef1c93-7082-4236-981d-c9178ae94696,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23a2791609564013ae60c807ccf357e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:19:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:19:07Z,use_quota=True,user_id='317ea23d8e914a5eb59dd898bbc12c45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a3e8011a-6160-4e67-b143-e7de61af9671),volume_type_id=a3e8011a-6160-4e67-b143-e7de61af9671)' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:19:07 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-ab870e9d-d1a3-4cf1-9335-b4e6ae25ff7d tempest-GroupSnapshotsV319Test-1904898740 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c4c309e-4bc6-46a7-94db-abdfc734b6c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:19:07 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-ab870e9d-d1a3-4cf1-9335-b4e6ae25ff7d tempest-GroupSnapshotsV319Test-1904898740 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c4c309e-4bc6-46a7-94db-abdfc734b6c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:19:07 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-ab870e9d-d1a3-4cf1-9335-b4e6ae25ff7d tempest-GroupSnapshotsV319Test-1904898740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (205b0622-8536-4006-a7ff-5c9cd41ec3b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:19:07 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-ab870e9d-d1a3-4cf1-9335-b4e6ae25ff7d tempest-GroupSnapshotsV319Test-1904898740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (205b0622-8536-4006-a7ff-5c9cd41ec3b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fbef1c93-7082-4236-981d-c9178ae94696', 'volume_name': 'volume-fbef1c93-7082-4236-981d-c9178ae94696', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:19:07 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-ab870e9d-d1a3-4cf1-9335-b4e6ae25ff7d tempest-GroupSnapshotsV319Test-1904898740 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a16a0a9-96a4-4db8-b5bd-9e475d3483f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:19:07 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-ab870e9d-d1a3-4cf1-9335-b4e6ae25ff7d tempest-GroupSnapshotsV319Test-1904898740 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a16a0a9-96a4-4db8-b5bd-9e475d3483f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:19:07 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-ab870e9d-d1a3-4cf1-9335-b4e6ae25ff7d tempest-GroupSnapshotsV319Test-1904898740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b210be7b-99a4-4249-9962-da5d4cfdcc8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:19:07 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-ab870e9d-d1a3-4cf1-9335-b4e6ae25ff7d tempest-GroupSnapshotsV319Test-1904898740 None] Volume fbef1c93-7082-4236-981d-c9178ae94696: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fbef1c93-7082-4236-981d-c9178ae94696', 'volume_size': 1} Aug 05 06:19:07 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-ab870e9d-d1a3-4cf1-9335-b4e6ae25ff7d tempest-GroupSnapshotsV319Test-1904898740 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:19:07 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-ab870e9d-d1a3-4cf1-9335-b4e6ae25ff7d tempest-GroupSnapshotsV319Test-1904898740 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:19:07 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-ab870e9d-d1a3-4cf1-9335-b4e6ae25ff7d tempest-GroupSnapshotsV319Test-1904898740 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=a5a625dc-1216-4c01-ac8c-77e5842b6a62,created_at=2026-08-05T04:19:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-30576764',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a5a625dc-1216-4c01-ac8c-77e5842b6a62,host='devstack@QuobyteHD#QuobyteHD',id=fbef1c93-7082-4236-981d-c9178ae94696,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23a2791609564013ae60c807ccf357e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:19:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:19:07Z,use_quota=True,user_id='317ea23d8e914a5eb59dd898bbc12c45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a3e8011a-6160-4e67-b143-e7de61af9671),volume_type_id=a3e8011a-6160-4e67-b143-e7de61af9671)}" {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 06:19:07 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-ab870e9d-d1a3-4cf1-9335-b4e6ae25ff7d tempest-GroupSnapshotsV319Test-1904898740 None] Creating volume fbef1c93-7082-4236-981d-c9178ae94696 {{(pid=88695) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 06:19:07 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-ab870e9d-d1a3-4cf1-9335-b4e6ae25ff7d tempest-GroupSnapshotsV319Test-1904898740 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:19:07 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-ab870e9d-d1a3-4cf1-9335-b4e6ae25ff7d tempest-GroupSnapshotsV319Test-1904898740 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:19:07 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-ab870e9d-d1a3-4cf1-9335-b4e6ae25ff7d tempest-GroupSnapshotsV319Test-1904898740 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:19:07 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-ab870e9d-d1a3-4cf1-9335-b4e6ae25ff7d tempest-GroupSnapshotsV319Test-1904898740 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:19:07 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-ab870e9d-d1a3-4cf1-9335-b4e6ae25ff7d tempest-GroupSnapshotsV319Test-1904898740 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:19:07 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-ab870e9d-d1a3-4cf1-9335-b4e6ae25ff7d tempest-GroupSnapshotsV319Test-1904898740 None] Selected osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 as target Quobyte volume. {{(pid=88695) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 06:19:07 devstack cinder-volume[88695]: INFO cinder.volume.drivers.remotefs [None req-ab870e9d-d1a3-4cf1-9335-b4e6ae25ff7d tempest-GroupSnapshotsV319Test-1904898740 None] casted to osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 Aug 05 06:19:07 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-ab870e9d-d1a3-4cf1-9335-b4e6ae25ff7d tempest-GroupSnapshotsV319Test-1904898740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-fbef1c93-7082-4236-981d-c9178ae94696 1073741824 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:19:07 devstack sudo[98220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-fbef1c93-7082-4236-981d-c9178ae94696 1073741824 Aug 05 06:19:07 devstack sudo[98220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:19:07 devstack sudo[98220]: pam_unix(sudo:session): session closed for user root Aug 05 06:19:07 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-ab870e9d-d1a3-4cf1-9335-b4e6ae25ff7d tempest-GroupSnapshotsV319Test-1904898740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-fbef1c93-7082-4236-981d-c9178ae94696 1073741824" returned: 0 in 0.651s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:19:08 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-ab870e9d-d1a3-4cf1-9335-b4e6ae25ff7d tempest-GroupSnapshotsV319Test-1904898740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-fbef1c93-7082-4236-981d-c9178ae94696 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:19:08 devstack sudo[98227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-fbef1c93-7082-4236-981d-c9178ae94696 Aug 05 06:19:08 devstack sudo[98227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:19:08 devstack sudo[98227]: pam_unix(sudo:session): session closed for user root Aug 05 06:19:08 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-ab870e9d-d1a3-4cf1-9335-b4e6ae25ff7d tempest-GroupSnapshotsV319Test-1904898740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-fbef1c93-7082-4236-981d-c9178ae94696" returned: 0 in 0.309s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:19:08 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-ab870e9d-d1a3-4cf1-9335-b4e6ae25ff7d tempest-GroupSnapshotsV319Test-1904898740 None] <== create_volume: return (1018ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'} {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 06:19:08 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-ab870e9d-d1a3-4cf1-9335-b4e6ae25ff7d tempest-GroupSnapshotsV319Test-1904898740 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.020s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:19:08 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-ab870e9d-d1a3-4cf1-9335-b4e6ae25ff7d tempest-GroupSnapshotsV319Test-1904898740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b210be7b-99a4-4249-9962-da5d4cfdcc8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fbef1c93-7082-4236-981d-c9178ae94696', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:19:08 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-ab870e9d-d1a3-4cf1-9335-b4e6ae25ff7d tempest-GroupSnapshotsV319Test-1904898740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2f1601e-6327-48d4-bb6c-cce175abc914) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:19:08 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-ab870e9d-d1a3-4cf1-9335-b4e6ae25ff7d tempest-GroupSnapshotsV319Test-1904898740 None] Volume volume-fbef1c93-7082-4236-981d-c9178ae94696 (fbef1c93-7082-4236-981d-c9178ae94696): created successfully Aug 05 06:19:08 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-ab870e9d-d1a3-4cf1-9335-b4e6ae25ff7d tempest-GroupSnapshotsV319Test-1904898740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2f1601e-6327-48d4-bb6c-cce175abc914) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:19:08 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-ab870e9d-d1a3-4cf1-9335-b4e6ae25ff7d tempest-GroupSnapshotsV319Test-1904898740 None] Flow 'volume_create_manager' (4e361581-2d34-46fb-a78b-805d0a1e1e08) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:19:08 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-ab870e9d-d1a3-4cf1-9335-b4e6ae25ff7d tempest-GroupSnapshotsV319Test-1904898740 None] Created volume successfully. Aug 05 06:19:10 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-40a8abe0-b01d-4171-820b-7221b7987f62 tempest-GroupSnapshotsV319Test-1904898740 None] GroupSnapshot 9288db09-62a3-48f4-afea-22e646ead540: creating. Aug 05 06:19:10 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-40a8abe0-b01d-4171-820b-7221b7987f62 tempest-GroupSnapshotsV319Test-1904898740 None] Group snapshot 9288db09-62a3-48f4-afea-22e646ead540: creating. {{(pid=88695) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Aug 05 06:19:10 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-40a8abe0-b01d-4171-820b-7221b7987f62 tempest-GroupSnapshotsV319Test-1904898740 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:19:10 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-40a8abe0-b01d-4171-820b-7221b7987f62 tempest-GroupSnapshotsV319Test-1904898740 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:19:10 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-40a8abe0-b01d-4171-820b-7221b7987f62 tempest-GroupSnapshotsV319Test-1904898740 None] Creating offline snapshot 5a9a4757-23dd-483a-9674-e9bc9c83bbde of volume fbef1c93-7082-4236-981d-c9178ae94696 {{(pid=88695) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 06:19:10 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b287974-e052-4af7-a847-b8ce4dfb4c99]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:19:10 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-40a8abe0-b01d-4171-820b-7221b7987f62 tempest-GroupSnapshotsV319Test-1904898740 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-fbef1c93-7082-4236-981d-c9178ae94696 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:19:10 devstack sudo[98239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-fbef1c93-7082-4236-981d-c9178ae94696 Aug 05 06:19:10 devstack sudo[98239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:19:10 devstack sudo[98239]: pam_unix(sudo:session): session closed for user root Aug 05 06:19:10 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-40a8abe0-b01d-4171-820b-7221b7987f62 tempest-GroupSnapshotsV319Test-1904898740 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-fbef1c93-7082-4236-981d-c9178ae94696" returned: 0 in 0.411s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:19:10 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-40a8abe0-b01d-4171-820b-7221b7987f62 tempest-GroupSnapshotsV319Test-1904898740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-fbef1c93-7082-4236-981d-c9178ae94696,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-fbef1c93-7082-4236-981d-c9178ae94696.5a9a4757-23dd-483a-9674-e9bc9c83bbde 1G {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:19:10 devstack sudo[98245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-fbef1c93-7082-4236-981d-c9178ae94696,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-fbef1c93-7082-4236-981d-c9178ae94696.5a9a4757-23dd-483a-9674-e9bc9c83bbde 1G Aug 05 06:19:10 devstack sudo[98245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:19:11 devstack sudo[98245]: pam_unix(sudo:session): session closed for user root Aug 05 06:19:11 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-40a8abe0-b01d-4171-820b-7221b7987f62 tempest-GroupSnapshotsV319Test-1904898740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-fbef1c93-7082-4236-981d-c9178ae94696,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-fbef1c93-7082-4236-981d-c9178ae94696.5a9a4757-23dd-483a-9674-e9bc9c83bbde 1G" returned: 0 in 0.452s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:19:11 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-40a8abe0-b01d-4171-820b-7221b7987f62 tempest-GroupSnapshotsV319Test-1904898740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fbef1c93-7082-4236-981d-c9178ae94696 -F qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-fbef1c93-7082-4236-981d-c9178ae94696.5a9a4757-23dd-483a-9674-e9bc9c83bbde {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:19:11 devstack sudo[98251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fbef1c93-7082-4236-981d-c9178ae94696 -F qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-fbef1c93-7082-4236-981d-c9178ae94696.5a9a4757-23dd-483a-9674-e9bc9c83bbde Aug 05 06:19:11 devstack sudo[98251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:19:11 devstack sudo[98251]: pam_unix(sudo:session): session closed for user root Aug 05 06:19:11 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-40a8abe0-b01d-4171-820b-7221b7987f62 tempest-GroupSnapshotsV319Test-1904898740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fbef1c93-7082-4236-981d-c9178ae94696 -F qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-fbef1c93-7082-4236-981d-c9178ae94696.5a9a4757-23dd-483a-9674-e9bc9c83bbde" returned: 0 in 0.346s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:19:11 devstack cinder-volume[88695]: WARNING cinder.volume.drivers.remotefs [None req-40a8abe0-b01d-4171-820b-7221b7987f62 tempest-GroupSnapshotsV319Test-1904898740 None] /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-fbef1c93-7082-4236-981d-c9178ae94696.5a9a4757-23dd-483a-9674-e9bc9c83bbde is being set with open permissions: ugo+rw: NotImplementedError Aug 05 06:19:11 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-40a8abe0-b01d-4171-820b-7221b7987f62 tempest-GroupSnapshotsV319Test-1904898740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-fbef1c93-7082-4236-981d-c9178ae94696.5a9a4757-23dd-483a-9674-e9bc9c83bbde {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:19:11 devstack sudo[98257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-fbef1c93-7082-4236-981d-c9178ae94696.5a9a4757-23dd-483a-9674-e9bc9c83bbde Aug 05 06:19:11 devstack sudo[98257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:19:11 devstack sudo[98257]: pam_unix(sudo:session): session closed for user root Aug 05 06:19:11 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-40a8abe0-b01d-4171-820b-7221b7987f62 tempest-GroupSnapshotsV319Test-1904898740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-fbef1c93-7082-4236-981d-c9178ae94696.5a9a4757-23dd-483a-9674-e9bc9c83bbde" returned: 0 in 0.396s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:19:11 devstack cinder-volume[88695]: DEBUG dbcounter [-] [88695] Writing DB stats cinder:INSERT=50,cinder:SELECT=179,cinder:UPDATE=183,cinder:DELETE=7 {{(pid=88695) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 06:19:11 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-40a8abe0-b01d-4171-820b-7221b7987f62 tempest-GroupSnapshotsV319Test-1904898740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-fbef1c93-7082-4236-981d-c9178ae94696.info {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:19:11 devstack sudo[98260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-fbef1c93-7082-4236-981d-c9178ae94696.info Aug 05 06:19:11 devstack sudo[98260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:19:12 devstack sudo[98260]: pam_unix(sudo:session): session closed for user root Aug 05 06:19:12 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-40a8abe0-b01d-4171-820b-7221b7987f62 tempest-GroupSnapshotsV319Test-1904898740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-fbef1c93-7082-4236-981d-c9178ae94696.info" returned: 0 in 0.283s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:19:12 devstack cinder-volume[88695]: WARNING cinder.volume.drivers.remotefs [None req-40a8abe0-b01d-4171-820b-7221b7987f62 tempest-GroupSnapshotsV319Test-1904898740 None] /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-fbef1c93-7082-4236-981d-c9178ae94696.info is being set with open permissions: ugo+rw: NotImplementedError Aug 05 06:19:12 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-40a8abe0-b01d-4171-820b-7221b7987f62 tempest-GroupSnapshotsV319Test-1904898740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-fbef1c93-7082-4236-981d-c9178ae94696.info {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:19:12 devstack sudo[98263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-fbef1c93-7082-4236-981d-c9178ae94696.info Aug 05 06:19:12 devstack sudo[98263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:19:12 devstack sudo[98263]: pam_unix(sudo:session): session closed for user root Aug 05 06:19:12 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-40a8abe0-b01d-4171-820b-7221b7987f62 tempest-GroupSnapshotsV319Test-1904898740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-fbef1c93-7082-4236-981d-c9178ae94696.info" returned: 0 in 0.257s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:19:12 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-40a8abe0-b01d-4171-820b-7221b7987f62 tempest-GroupSnapshotsV319Test-1904898740 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.245s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:19:12 devstack cinder-volume[88695]: DEBUG dbcounter [-] [88695] Writing DB stats cinder:DELETE=9,cinder:UPDATE=178,cinder:SELECT=161,cinder:INSERT=44 {{(pid=88695) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 06:19:12 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-40a8abe0-b01d-4171-820b-7221b7987f62 tempest-GroupSnapshotsV319Test-1904898740 None] group_snapshot 9288db09-62a3-48f4-afea-22e646ead540: created successfully Aug 05 06:19:13 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-a6538bd4-3235-4759-b5cc-c0423c263975 tempest-GroupSnapshotsV319Test-1904898740 None] group_snapshot 9288db09-62a3-48f4-afea-22e646ead540: deleting Aug 05 06:19:13 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-a6538bd4-3235-4759-b5cc-c0423c263975 tempest-GroupSnapshotsV319Test-1904898740 None] group_snapshot 9288db09-62a3-48f4-afea-22e646ead540: deleting {{(pid=88695) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Aug 05 06:19:13 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-a6538bd4-3235-4759-b5cc-c0423c263975 tempest-GroupSnapshotsV319Test-1904898740 None] Acquiring lock "cinder-quobyte-fbef1c93-7082-4236-981d-c9178ae94696" by "delete_snapshot" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:19:13 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-a6538bd4-3235-4759-b5cc-c0423c263975 tempest-GroupSnapshotsV319Test-1904898740 None] Lock "cinder-quobyte-fbef1c93-7082-4236-981d-c9178ae94696" acquired by "delete_snapshot" :: waited 0.021s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:19:13 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-a6538bd4-3235-4759-b5cc-c0423c263975 tempest-GroupSnapshotsV319Test-1904898740 None] Acquiring lock "cinder-quobyte-5a9a4757-23dd-483a-9674-e9bc9c83bbde" by "_delete_snapshot" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:19:13 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-a6538bd4-3235-4759-b5cc-c0423c263975 tempest-GroupSnapshotsV319Test-1904898740 None] Lock "cinder-quobyte-5a9a4757-23dd-483a-9674-e9bc9c83bbde" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:19:13 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-a6538bd4-3235-4759-b5cc-c0423c263975 tempest-GroupSnapshotsV319Test-1904898740 None] Deleting offline snapshot 5a9a4757-23dd-483a-9674-e9bc9c83bbde of volume fbef1c93-7082-4236-981d-c9178ae94696 {{(pid=88695) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 06:19:13 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-a6538bd4-3235-4759-b5cc-c0423c263975 tempest-GroupSnapshotsV319Test-1904898740 None] snapshot_file for this snap is: volume-fbef1c93-7082-4236-981d-c9178ae94696.5a9a4757-23dd-483a-9674-e9bc9c83bbde {{(pid=88695) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 06:19:13 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6fea41d-0cda-4a84-afe4-97565818966d]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:19:13 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-a6538bd4-3235-4759-b5cc-c0423c263975 tempest-GroupSnapshotsV319Test-1904898740 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-fbef1c93-7082-4236-981d-c9178ae94696.5a9a4757-23dd-483a-9674-e9bc9c83bbde {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:19:13 devstack sudo[98291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-fbef1c93-7082-4236-981d-c9178ae94696.5a9a4757-23dd-483a-9674-e9bc9c83bbde Aug 05 06:19:13 devstack sudo[98291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:19:14 devstack sudo[98291]: pam_unix(sudo:session): session closed for user root Aug 05 06:19:14 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-a6538bd4-3235-4759-b5cc-c0423c263975 tempest-GroupSnapshotsV319Test-1904898740 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-fbef1c93-7082-4236-981d-c9178ae94696.5a9a4757-23dd-483a-9674-e9bc9c83bbde" returned: 0 in 0.379s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:19:14 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-a6538bd4-3235-4759-b5cc-c0423c263975 tempest-GroupSnapshotsV319Test-1904898740 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fbef1c93-7082-4236-981d-c9178ae94696(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88695) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 06:19:14 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[df3981fc-8526-4632-8a49-b43e70b1344e]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:19:14 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-a6538bd4-3235-4759-b5cc-c0423c263975 tempest-GroupSnapshotsV319Test-1904898740 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-fbef1c93-7082-4236-981d-c9178ae94696 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:19:14 devstack sudo[98297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-fbef1c93-7082-4236-981d-c9178ae94696 Aug 05 06:19:14 devstack sudo[98297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:19:14 devstack sudo[98297]: pam_unix(sudo:session): session closed for user root Aug 05 06:19:14 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-a6538bd4-3235-4759-b5cc-c0423c263975 tempest-GroupSnapshotsV319Test-1904898740 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-fbef1c93-7082-4236-981d-c9178ae94696" returned: 0 in 0.366s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:19:14 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-a6538bd4-3235-4759-b5cc-c0423c263975 tempest-GroupSnapshotsV319Test-1904898740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-fbef1c93-7082-4236-981d-c9178ae94696.5a9a4757-23dd-483a-9674-e9bc9c83bbde {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:19:14 devstack sudo[98302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-fbef1c93-7082-4236-981d-c9178ae94696.5a9a4757-23dd-483a-9674-e9bc9c83bbde Aug 05 06:19:14 devstack sudo[98302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:19:15 devstack sudo[98302]: pam_unix(sudo:session): session closed for user root Aug 05 06:19:15 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-a6538bd4-3235-4759-b5cc-c0423c263975 tempest-GroupSnapshotsV319Test-1904898740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-fbef1c93-7082-4236-981d-c9178ae94696.5a9a4757-23dd-483a-9674-e9bc9c83bbde" returned: 0 in 0.372s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:19:15 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-a6538bd4-3235-4759-b5cc-c0423c263975 tempest-GroupSnapshotsV319Test-1904898740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-fbef1c93-7082-4236-981d-c9178ae94696.5a9a4757-23dd-483a-9674-e9bc9c83bbde {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:19:15 devstack sudo[98307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-fbef1c93-7082-4236-981d-c9178ae94696.5a9a4757-23dd-483a-9674-e9bc9c83bbde Aug 05 06:19:15 devstack sudo[98307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:19:15 devstack sudo[98307]: pam_unix(sudo:session): session closed for user root Aug 05 06:19:15 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-a6538bd4-3235-4759-b5cc-c0423c263975 tempest-GroupSnapshotsV319Test-1904898740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-fbef1c93-7082-4236-981d-c9178ae94696.5a9a4757-23dd-483a-9674-e9bc9c83bbde" returned: 0 in 0.253s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:19:15 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-a6538bd4-3235-4759-b5cc-c0423c263975 tempest-GroupSnapshotsV319Test-1904898740 None] Lock "cinder-quobyte-5a9a4757-23dd-483a-9674-e9bc9c83bbde" released by "_delete_snapshot" :: held 1.487s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:19:15 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-a6538bd4-3235-4759-b5cc-c0423c263975 tempest-GroupSnapshotsV319Test-1904898740 None] Lock "cinder-quobyte-fbef1c93-7082-4236-981d-c9178ae94696" released by "delete_snapshot" :: held 1.513s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:19:15 devstack cinder-volume[88695]: WARNING cinder.quota [None req-a6538bd4-3235-4759-b5cc-c0423c263975 tempest-GroupSnapshotsV319Test-1904898740 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1923012778 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1923012778, it is now deprecated. Please use the default quota class for default quota. Aug 05 06:19:15 devstack cinder-volume[88695]: WARNING cinder.quota [None req-a6538bd4-3235-4759-b5cc-c0423c263975 tempest-GroupSnapshotsV319Test-1904898740 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1923012778 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1923012778, it is now deprecated. Please use the default quota class for default quota. Aug 05 06:19:15 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-a6538bd4-3235-4759-b5cc-c0423c263975 tempest-GroupSnapshotsV319Test-1904898740 None] Created reservations ['9dd5df21-e40d-43f7-8f3d-63f0b64ad940', '50f1bdcf-e52f-4f5c-96da-72ececa63cfe', '963f4167-ff71-4c6c-8dd8-1dd9b3407b64', 'ad7456bb-c9b0-4cb5-9c1e-bd5036a35897'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:19:15 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-a6538bd4-3235-4759-b5cc-c0423c263975 tempest-GroupSnapshotsV319Test-1904898740 None] group_snapshot 9288db09-62a3-48f4-afea-22e646ead540: deleted successfully Aug 05 06:19:16 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-3010cc2e-8df1-40e4-b7af-bd0111cc913f tempest-GroupSnapshotsV319Test-1904898740 None] Acquiring lock "cinder-quobyte-fbef1c93-7082-4236-981d-c9178ae94696" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:19:16 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-3010cc2e-8df1-40e4-b7af-bd0111cc913f tempest-GroupSnapshotsV319Test-1904898740 None] Lock "cinder-quobyte-fbef1c93-7082-4236-981d-c9178ae94696" acquired by "delete_volume" :: waited 0.026s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:19:16 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[e78132a0-a208-4b4e-ab82-9f2976c32af1]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:19:16 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-3010cc2e-8df1-40e4-b7af-bd0111cc913f tempest-GroupSnapshotsV319Test-1904898740 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-fbef1c93-7082-4236-981d-c9178ae94696 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:19:16 devstack sudo[98310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-fbef1c93-7082-4236-981d-c9178ae94696 Aug 05 06:19:16 devstack sudo[98310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:19:16 devstack sudo[98310]: pam_unix(sudo:session): session closed for user root Aug 05 06:19:16 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-3010cc2e-8df1-40e4-b7af-bd0111cc913f tempest-GroupSnapshotsV319Test-1904898740 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-fbef1c93-7082-4236-981d-c9178ae94696" returned: 0 in 0.541s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:19:16 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-3010cc2e-8df1-40e4-b7af-bd0111cc913f tempest-GroupSnapshotsV319Test-1904898740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-fbef1c93-7082-4236-981d-c9178ae94696 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:19:17 devstack sudo[98315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-fbef1c93-7082-4236-981d-c9178ae94696 Aug 05 06:19:17 devstack sudo[98315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:19:17 devstack sudo[98315]: pam_unix(sudo:session): session closed for user root Aug 05 06:19:17 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-3010cc2e-8df1-40e4-b7af-bd0111cc913f tempest-GroupSnapshotsV319Test-1904898740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-fbef1c93-7082-4236-981d-c9178ae94696" returned: 0 in 0.311s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:19:17 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-3010cc2e-8df1-40e4-b7af-bd0111cc913f tempest-GroupSnapshotsV319Test-1904898740 None] Lock "cinder-quobyte-fbef1c93-7082-4236-981d-c9178ae94696" released by "delete_volume" :: held 0.978s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:19:17 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-3010cc2e-8df1-40e4-b7af-bd0111cc913f tempest-GroupSnapshotsV319Test-1904898740 None] Created reservations ['1e072478-224b-426d-a257-497b9008e6e4'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:19:17 devstack cinder-volume[88695]: WARNING cinder.quota [None req-3010cc2e-8df1-40e4-b7af-bd0111cc913f tempest-GroupSnapshotsV319Test-1904898740 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1923012778 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1923012778, it is now deprecated. Please use the default quota class for default quota. Aug 05 06:19:17 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-3010cc2e-8df1-40e4-b7af-bd0111cc913f tempest-GroupSnapshotsV319Test-1904898740 None] Created reservations ['8bf33a69-b4eb-47be-9b07-c2811147bd0d', '1fa1517e-4b75-42bc-8f01-2c6728e786f9', '6ed57fc8-0477-42a5-b93c-a5b6ff1c0dca', '406c90ab-3729-42b8-a39f-a5cd108e64f8'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:19:17 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-3010cc2e-8df1-40e4-b7af-bd0111cc913f tempest-GroupSnapshotsV319Test-1904898740 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:19:17 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-3010cc2e-8df1-40e4-b7af-bd0111cc913f tempest-GroupSnapshotsV319Test-1904898740 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:19:17 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-3010cc2e-8df1-40e4-b7af-bd0111cc913f tempest-GroupSnapshotsV319Test-1904898740 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:19:17 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-3010cc2e-8df1-40e4-b7af-bd0111cc913f tempest-GroupSnapshotsV319Test-1904898740 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:19:17 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-3010cc2e-8df1-40e4-b7af-bd0111cc913f tempest-GroupSnapshotsV319Test-1904898740 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:19:17 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-3010cc2e-8df1-40e4-b7af-bd0111cc913f tempest-GroupSnapshotsV319Test-1904898740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:19:17 devstack sudo[98320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce Aug 05 06:19:17 devstack sudo[98320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:19:18 devstack sudo[98320]: pam_unix(sudo:session): session closed for user root Aug 05 06:19:18 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-3010cc2e-8df1-40e4-b7af-bd0111cc913f tempest-GroupSnapshotsV319Test-1904898740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce" returned: 0 in 0.437s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:19:18 devstack cinder-volume[88695]: DEBUG cinder.manager [None req-3010cc2e-8df1-40e4-b7af-bd0111cc913f tempest-GroupSnapshotsV319Test-1904898740 None] Notifying Schedulers of capabilities ... {{(pid=88695) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 06:19:18 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-3010cc2e-8df1-40e4-b7af-bd0111cc913f tempest-GroupSnapshotsV319Test-1904898740 None] Delete group completed successfully. Aug 05 06:19:18 devstack cinder-volume[88695]: INFO cinder.volume.manager [req-af25bc17-bd69-4ef9-a5da-af35c9c08ef5 req-60626a9a-4b95-42d1-a363-6d2d802bc533 tempest-AttachVolumeTestJSON-139946988 None] Terminate volume connection completed successfully. Aug 05 06:19:18 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [req-af25bc17-bd69-4ef9-a5da-af35c9c08ef5 req-60626a9a-4b95-42d1-a363-6d2d802bc533 tempest-AttachVolumeTestJSON-139946988 None] Deleting attachment 3eaf2766-debf-4e8d-9570-586c5feb1da3. {{(pid=88695) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 05 06:19:27 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-de9412f5-1201-4b82-ba94-4b46f99b72a0 tempest-GroupsV320Test-1304839259 None] Group tempest-GroupsV320Test-Group-623031609: creating Aug 05 06:19:27 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-de9412f5-1201-4b82-ba94-4b46f99b72a0 tempest-GroupsV320Test-1304839259 None] Group tempest-GroupsV320Test-Group-623031609: created successfully Aug 05 06:19:27 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-de9412f5-1201-4b82-ba94-4b46f99b72a0 tempest-GroupsV320Test-1304839259 None] Create group completed successfully. Aug 05 06:19:29 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-9a7bb065-2c19-4f62-a0f7-17521844770a tempest-GroupsV320Test-1304839259 None] Created reservations ['8bee27b5-84fc-48e9-8a08-38302d915b8f'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:19:29 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-9a7bb065-2c19-4f62-a0f7-17521844770a tempest-GroupsV320Test-1304839259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:19:29 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-9a7bb065-2c19-4f62-a0f7-17521844770a tempest-GroupsV320Test-1304839259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:19:29 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-9a7bb065-2c19-4f62-a0f7-17521844770a tempest-GroupsV320Test-1304839259 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:19:29 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-9a7bb065-2c19-4f62-a0f7-17521844770a tempest-GroupsV320Test-1304839259 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:19:29 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-9a7bb065-2c19-4f62-a0f7-17521844770a tempest-GroupsV320Test-1304839259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:19:29 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-9a7bb065-2c19-4f62-a0f7-17521844770a tempest-GroupsV320Test-1304839259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:19:29 devstack sudo[98471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce Aug 05 06:19:29 devstack sudo[98471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:19:29 devstack sudo[98471]: pam_unix(sudo:session): session closed for user root Aug 05 06:19:29 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-9a7bb065-2c19-4f62-a0f7-17521844770a tempest-GroupsV320Test-1304839259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce" returned: 0 in 0.299s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:19:29 devstack cinder-volume[88695]: DEBUG cinder.manager [None req-9a7bb065-2c19-4f62-a0f7-17521844770a tempest-GroupsV320Test-1304839259 None] Notifying Schedulers of capabilities ... {{(pid=88695) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 06:19:29 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-9a7bb065-2c19-4f62-a0f7-17521844770a tempest-GroupsV320Test-1304839259 None] Delete group completed successfully. Aug 05 06:19:38 devstack cinder-volume[88695]: DEBUG cinder.volume.flows.manager.create_volume [None req-6497c903-f4b2-4a5e-9b7c-2e9c81ed6673 tempest-TestMinimumBasicScenario-688539206 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88695) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 06:19:38 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-6497c903-f4b2-4a5e-9b7c-2e9c81ed6673 tempest-TestMinimumBasicScenario-688539206 None] Flow 'volume_create_manager' (64678cf2-c9a4-4b81-877c-a2accc3ff2a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:19:38 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-6497c903-f4b2-4a5e-9b7c-2e9c81ed6673 tempest-TestMinimumBasicScenario-688539206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3865df79-8558-4af3-8ac9-633d6240c700) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:19:38 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-6497c903-f4b2-4a5e-9b7c-2e9c81ed6673 tempest-TestMinimumBasicScenario-688539206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3865df79-8558-4af3-8ac9-633d6240c700) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:19:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1274754361',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31717a8d-e3b6-40cd-bc01-f48bff4e2e02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e762b11a12404d9290a4a7f86dee5391',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:19:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:19:38Z,use_quota=True,user_id='808fc57160bf43cc8aa41c7997c6a921',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:19:38 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-6497c903-f4b2-4a5e-9b7c-2e9c81ed6673 tempest-TestMinimumBasicScenario-688539206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8093f869-8f80-47cc-a783-0fbf694982ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:19:38 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-6497c903-f4b2-4a5e-9b7c-2e9c81ed6673 tempest-TestMinimumBasicScenario-688539206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8093f869-8f80-47cc-a783-0fbf694982ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:19:38 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-6497c903-f4b2-4a5e-9b7c-2e9c81ed6673 tempest-TestMinimumBasicScenario-688539206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38a216e6-e8d7-4699-aef1-2bdfb2ab0cb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:19:38 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-6497c903-f4b2-4a5e-9b7c-2e9c81ed6673 tempest-TestMinimumBasicScenario-688539206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38a216e6-e8d7-4699-aef1-2bdfb2ab0cb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '31717a8d-e3b6-40cd-bc01-f48bff4e2e02', 'volume_name': 'volume-31717a8d-e3b6-40cd-bc01-f48bff4e2e02', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:19:38 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-6497c903-f4b2-4a5e-9b7c-2e9c81ed6673 tempest-TestMinimumBasicScenario-688539206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d212f49-3253-48b5-9980-d10c63e4fed6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:19:38 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-6497c903-f4b2-4a5e-9b7c-2e9c81ed6673 tempest-TestMinimumBasicScenario-688539206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d212f49-3253-48b5-9980-d10c63e4fed6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:19:38 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-6497c903-f4b2-4a5e-9b7c-2e9c81ed6673 tempest-TestMinimumBasicScenario-688539206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55a45a03-482c-4603-8c8e-5a807a135196) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:19:38 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-6497c903-f4b2-4a5e-9b7c-2e9c81ed6673 tempest-TestMinimumBasicScenario-688539206 None] Volume 31717a8d-e3b6-40cd-bc01-f48bff4e2e02: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-31717a8d-e3b6-40cd-bc01-f48bff4e2e02', 'volume_size': 1} Aug 05 06:19:38 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-6497c903-f4b2-4a5e-9b7c-2e9c81ed6673 tempest-TestMinimumBasicScenario-688539206 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:19:38 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-6497c903-f4b2-4a5e-9b7c-2e9c81ed6673 tempest-TestMinimumBasicScenario-688539206 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:19:38 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-6497c903-f4b2-4a5e-9b7c-2e9c81ed6673 tempest-TestMinimumBasicScenario-688539206 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:19:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1274754361',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31717a8d-e3b6-40cd-bc01-f48bff4e2e02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e762b11a12404d9290a4a7f86dee5391',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:19:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:19:38Z,use_quota=True,user_id='808fc57160bf43cc8aa41c7997c6a921',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)}" {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 06:19:38 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-6497c903-f4b2-4a5e-9b7c-2e9c81ed6673 tempest-TestMinimumBasicScenario-688539206 None] Creating volume 31717a8d-e3b6-40cd-bc01-f48bff4e2e02 {{(pid=88695) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 06:19:38 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-6497c903-f4b2-4a5e-9b7c-2e9c81ed6673 tempest-TestMinimumBasicScenario-688539206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:19:38 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-6497c903-f4b2-4a5e-9b7c-2e9c81ed6673 tempest-TestMinimumBasicScenario-688539206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:19:38 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-6497c903-f4b2-4a5e-9b7c-2e9c81ed6673 tempest-TestMinimumBasicScenario-688539206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:19:38 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-6497c903-f4b2-4a5e-9b7c-2e9c81ed6673 tempest-TestMinimumBasicScenario-688539206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:19:38 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-6497c903-f4b2-4a5e-9b7c-2e9c81ed6673 tempest-TestMinimumBasicScenario-688539206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:19:38 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-6497c903-f4b2-4a5e-9b7c-2e9c81ed6673 tempest-TestMinimumBasicScenario-688539206 None] Selected osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 as target Quobyte volume. {{(pid=88695) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 06:19:38 devstack cinder-volume[88695]: INFO cinder.volume.drivers.remotefs [None req-6497c903-f4b2-4a5e-9b7c-2e9c81ed6673 tempest-TestMinimumBasicScenario-688539206 None] casted to osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 Aug 05 06:19:38 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-6497c903-f4b2-4a5e-9b7c-2e9c81ed6673 tempest-TestMinimumBasicScenario-688539206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-31717a8d-e3b6-40cd-bc01-f48bff4e2e02 1073741824 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:19:38 devstack sudo[98616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-31717a8d-e3b6-40cd-bc01-f48bff4e2e02 1073741824 Aug 05 06:19:38 devstack sudo[98616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:19:38 devstack sudo[98616]: pam_unix(sudo:session): session closed for user root Aug 05 06:19:38 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-6497c903-f4b2-4a5e-9b7c-2e9c81ed6673 tempest-TestMinimumBasicScenario-688539206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-31717a8d-e3b6-40cd-bc01-f48bff4e2e02 1073741824" returned: 0 in 0.650s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:19:38 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-6497c903-f4b2-4a5e-9b7c-2e9c81ed6673 tempest-TestMinimumBasicScenario-688539206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-31717a8d-e3b6-40cd-bc01-f48bff4e2e02 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:19:38 devstack sudo[98622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-31717a8d-e3b6-40cd-bc01-f48bff4e2e02 Aug 05 06:19:38 devstack sudo[98622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:19:39 devstack sudo[98622]: pam_unix(sudo:session): session closed for user root Aug 05 06:19:39 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-6497c903-f4b2-4a5e-9b7c-2e9c81ed6673 tempest-TestMinimumBasicScenario-688539206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-31717a8d-e3b6-40cd-bc01-f48bff4e2e02" returned: 0 in 0.335s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:19:39 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-6497c903-f4b2-4a5e-9b7c-2e9c81ed6673 tempest-TestMinimumBasicScenario-688539206 None] <== create_volume: return (1040ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'} {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 06:19:39 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-6497c903-f4b2-4a5e-9b7c-2e9c81ed6673 tempest-TestMinimumBasicScenario-688539206 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.043s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:19:39 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-6497c903-f4b2-4a5e-9b7c-2e9c81ed6673 tempest-TestMinimumBasicScenario-688539206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55a45a03-482c-4603-8c8e-5a807a135196) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31717a8d-e3b6-40cd-bc01-f48bff4e2e02', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:19:39 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-6497c903-f4b2-4a5e-9b7c-2e9c81ed6673 tempest-TestMinimumBasicScenario-688539206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d6ee033-526a-423c-a3d0-a9e3fb2ea51d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:19:39 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-6497c903-f4b2-4a5e-9b7c-2e9c81ed6673 tempest-TestMinimumBasicScenario-688539206 None] Volume volume-31717a8d-e3b6-40cd-bc01-f48bff4e2e02 (31717a8d-e3b6-40cd-bc01-f48bff4e2e02): created successfully Aug 05 06:19:39 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-6497c903-f4b2-4a5e-9b7c-2e9c81ed6673 tempest-TestMinimumBasicScenario-688539206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d6ee033-526a-423c-a3d0-a9e3fb2ea51d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:19:39 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-6497c903-f4b2-4a5e-9b7c-2e9c81ed6673 tempest-TestMinimumBasicScenario-688539206 None] Flow 'volume_create_manager' (64678cf2-c9a4-4b81-877c-a2accc3ff2a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:19:39 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-6497c903-f4b2-4a5e-9b7c-2e9c81ed6673 tempest-TestMinimumBasicScenario-688539206 None] Created volume successfully. Aug 05 06:19:41 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [req-02aa0894-00c5-457a-87db-54ef37036398 req-180c8d58-8192-4a95-9ef2-bba3596418a1 tempest-TestMinimumBasicScenario-688539206 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:19:41 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [req-02aa0894-00c5-457a-87db-54ef37036398 req-180c8d58-8192-4a95-9ef2-bba3596418a1 tempest-TestMinimumBasicScenario-688539206 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:19:41 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [req-02aa0894-00c5-457a-87db-54ef37036398 req-180c8d58-8192-4a95-9ef2-bba3596418a1 tempest-TestMinimumBasicScenario-688539206 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:19:41 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [req-02aa0894-00c5-457a-87db-54ef37036398 req-180c8d58-8192-4a95-9ef2-bba3596418a1 tempest-TestMinimumBasicScenario-688539206 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087', 'name': 'volume-31717a8d-e3b6-40cd-bc01-f48bff4e2e02', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '190bce3b-83e0-4e80-a93d-019e5289b489', 'enforce_multipath': True} {{(pid=88695) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 05 06:19:41 devstack cinder-volume[88695]: INFO cinder.volume.manager [req-02aa0894-00c5-457a-87db-54ef37036398 req-180c8d58-8192-4a95-9ef2-bba3596418a1 tempest-TestMinimumBasicScenario-688539206 None] attachment_update completed successfully. Aug 05 06:19:59 devstack cinder-volume[88695]: DEBUG dbcounter [-] [88695] Writing DB stats cinder:SELECT=37,cinder:UPDATE=24,cinder:INSERT=6 {{(pid=88695) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 06:19:59 devstack cinder-volume[88695]: DEBUG dbcounter [-] [88695] Writing DB stats cinder:SELECT=32,cinder:UPDATE=29,cinder:INSERT=5,cinder:DELETE=1 {{(pid=88695) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 06:20:00 devstack cinder-volume[88695]: DEBUG oslo_service.periodic_task [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88695) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 06:20:00 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:20:00 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:20:00 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:20:00 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:20:00 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.057s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:20:00 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:20:00 devstack sudo[99131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce Aug 05 06:20:00 devstack sudo[99131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:20:00 devstack sudo[99131]: pam_unix(sudo:session): session closed for user root Aug 05 06:20:00 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce" returned: 0 in 0.367s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:20:00 devstack cinder-volume[88695]: DEBUG cinder.manager [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] Notifying Schedulers of capabilities ... {{(pid=88695) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 06:20:00 devstack cinder-volume[88695]: DEBUG oslo_service.periodic_task [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] Running periodic task VolumeManager._thread_info {{(pid=88695) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 06:20:00 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] thread count: 28 {{(pid=88695) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 05 06:20:00 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] thread info: [<_MainThread(MainThread, started 134469211893888)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88695) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 05 06:20:10 devstack cinder-volume[88695]: DEBUG cinder.volume.flows.manager.create_volume [None req-3bc0de64-754e-4138-b160-766144f0dea7 tempest-VolumesListAdminTestJSON-1926843183 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88695) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 06:20:10 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-3bc0de64-754e-4138-b160-766144f0dea7 tempest-VolumesListAdminTestJSON-1926843183 None] Flow 'volume_create_manager' (b3a4a2df-7637-4f9c-b65a-d169c849c3a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:20:10 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-3bc0de64-754e-4138-b160-766144f0dea7 tempest-VolumesListAdminTestJSON-1926843183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (965f5cf5-5d8a-453f-8b5a-04beee6a5ef2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:20:10 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-3bc0de64-754e-4138-b160-766144f0dea7 tempest-VolumesListAdminTestJSON-1926843183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (965f5cf5-5d8a-453f-8b5a-04beee6a5ef2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:20:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-291369777',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31b899ee-8415-4252-b2e3-a6440f83854a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3728bd43b02a48f6bfef6121fa48af05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:20:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:20:10Z,use_quota=True,user_id='d47a098aab2048d4bfda86ed23024c9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:20:10 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-3bc0de64-754e-4138-b160-766144f0dea7 tempest-VolumesListAdminTestJSON-1926843183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (437c6484-32a5-41f8-93eb-8ba53b2d6720) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:20:10 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-3bc0de64-754e-4138-b160-766144f0dea7 tempest-VolumesListAdminTestJSON-1926843183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (437c6484-32a5-41f8-93eb-8ba53b2d6720) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:20:10 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-3bc0de64-754e-4138-b160-766144f0dea7 tempest-VolumesListAdminTestJSON-1926843183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c8f2349-fb61-406e-86e7-c30a4128e226) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:20:10 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-3bc0de64-754e-4138-b160-766144f0dea7 tempest-VolumesListAdminTestJSON-1926843183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c8f2349-fb61-406e-86e7-c30a4128e226) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '31b899ee-8415-4252-b2e3-a6440f83854a', 'volume_name': 'volume-31b899ee-8415-4252-b2e3-a6440f83854a', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:20:10 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-3bc0de64-754e-4138-b160-766144f0dea7 tempest-VolumesListAdminTestJSON-1926843183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e007903c-97c0-4d40-a123-7865a31275db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:20:10 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-3bc0de64-754e-4138-b160-766144f0dea7 tempest-VolumesListAdminTestJSON-1926843183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e007903c-97c0-4d40-a123-7865a31275db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:20:10 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-3bc0de64-754e-4138-b160-766144f0dea7 tempest-VolumesListAdminTestJSON-1926843183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f935faf-12af-4a09-9031-7d882752eade) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:20:10 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-3bc0de64-754e-4138-b160-766144f0dea7 tempest-VolumesListAdminTestJSON-1926843183 None] Volume 31b899ee-8415-4252-b2e3-a6440f83854a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-31b899ee-8415-4252-b2e3-a6440f83854a', 'volume_size': 1} Aug 05 06:20:10 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-3bc0de64-754e-4138-b160-766144f0dea7 tempest-VolumesListAdminTestJSON-1926843183 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:20:10 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-3bc0de64-754e-4138-b160-766144f0dea7 tempest-VolumesListAdminTestJSON-1926843183 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:20:10 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-3bc0de64-754e-4138-b160-766144f0dea7 tempest-VolumesListAdminTestJSON-1926843183 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:20:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-291369777',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31b899ee-8415-4252-b2e3-a6440f83854a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3728bd43b02a48f6bfef6121fa48af05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:20:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:20:10Z,use_quota=True,user_id='d47a098aab2048d4bfda86ed23024c9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)}" {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 06:20:10 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-3bc0de64-754e-4138-b160-766144f0dea7 tempest-VolumesListAdminTestJSON-1926843183 None] Creating volume 31b899ee-8415-4252-b2e3-a6440f83854a {{(pid=88695) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 06:20:10 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-3bc0de64-754e-4138-b160-766144f0dea7 tempest-VolumesListAdminTestJSON-1926843183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:20:10 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-3bc0de64-754e-4138-b160-766144f0dea7 tempest-VolumesListAdminTestJSON-1926843183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:20:10 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-3bc0de64-754e-4138-b160-766144f0dea7 tempest-VolumesListAdminTestJSON-1926843183 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:20:10 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-3bc0de64-754e-4138-b160-766144f0dea7 tempest-VolumesListAdminTestJSON-1926843183 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:20:10 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-3bc0de64-754e-4138-b160-766144f0dea7 tempest-VolumesListAdminTestJSON-1926843183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:20:10 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-3bc0de64-754e-4138-b160-766144f0dea7 tempest-VolumesListAdminTestJSON-1926843183 None] Selected osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 as target Quobyte volume. {{(pid=88695) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 06:20:10 devstack cinder-volume[88695]: INFO cinder.volume.drivers.remotefs [None req-3bc0de64-754e-4138-b160-766144f0dea7 tempest-VolumesListAdminTestJSON-1926843183 None] casted to osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 Aug 05 06:20:10 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-3bc0de64-754e-4138-b160-766144f0dea7 tempest-VolumesListAdminTestJSON-1926843183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-31b899ee-8415-4252-b2e3-a6440f83854a 1073741824 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:20:10 devstack sudo[99293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-31b899ee-8415-4252-b2e3-a6440f83854a 1073741824 Aug 05 06:20:10 devstack sudo[99293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:20:10 devstack sudo[99293]: pam_unix(sudo:session): session closed for user root Aug 05 06:20:10 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-3bc0de64-754e-4138-b160-766144f0dea7 tempest-VolumesListAdminTestJSON-1926843183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-31b899ee-8415-4252-b2e3-a6440f83854a 1073741824" returned: 0 in 0.426s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:20:10 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-3bc0de64-754e-4138-b160-766144f0dea7 tempest-VolumesListAdminTestJSON-1926843183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-31b899ee-8415-4252-b2e3-a6440f83854a {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:20:10 devstack sudo[99298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-31b899ee-8415-4252-b2e3-a6440f83854a Aug 05 06:20:10 devstack sudo[99298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:20:11 devstack sudo[99298]: pam_unix(sudo:session): session closed for user root Aug 05 06:20:11 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-3bc0de64-754e-4138-b160-766144f0dea7 tempest-VolumesListAdminTestJSON-1926843183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-31b899ee-8415-4252-b2e3-a6440f83854a" returned: 0 in 0.254s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:20:11 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-3bc0de64-754e-4138-b160-766144f0dea7 tempest-VolumesListAdminTestJSON-1926843183 None] <== create_volume: return (728ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'} {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 06:20:11 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-3bc0de64-754e-4138-b160-766144f0dea7 tempest-VolumesListAdminTestJSON-1926843183 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.731s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:20:11 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-3bc0de64-754e-4138-b160-766144f0dea7 tempest-VolumesListAdminTestJSON-1926843183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f935faf-12af-4a09-9031-7d882752eade) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31b899ee-8415-4252-b2e3-a6440f83854a', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:20:11 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-3bc0de64-754e-4138-b160-766144f0dea7 tempest-VolumesListAdminTestJSON-1926843183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c51adbfa-a9f4-4e40-b441-8cdb398b8c68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:20:11 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-3bc0de64-754e-4138-b160-766144f0dea7 tempest-VolumesListAdminTestJSON-1926843183 None] Volume volume-31b899ee-8415-4252-b2e3-a6440f83854a (31b899ee-8415-4252-b2e3-a6440f83854a): created successfully Aug 05 06:20:11 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-3bc0de64-754e-4138-b160-766144f0dea7 tempest-VolumesListAdminTestJSON-1926843183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c51adbfa-a9f4-4e40-b441-8cdb398b8c68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:20:11 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-3bc0de64-754e-4138-b160-766144f0dea7 tempest-VolumesListAdminTestJSON-1926843183 None] Flow 'volume_create_manager' (b3a4a2df-7637-4f9c-b65a-d169c849c3a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:20:11 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-3bc0de64-754e-4138-b160-766144f0dea7 tempest-VolumesListAdminTestJSON-1926843183 None] Created volume successfully. Aug 05 06:20:13 devstack cinder-volume[88695]: DEBUG cinder.volume.flows.manager.create_volume [None req-dfdc133e-06d3-404d-bac1-352c584b55d6 tempest-VolumesListAdminTestJSON-1926843183 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88695) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 06:20:13 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-dfdc133e-06d3-404d-bac1-352c584b55d6 tempest-VolumesListAdminTestJSON-1926843183 None] Flow 'volume_create_manager' (a8f7de31-02dc-4b55-968e-0827ab44f252) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:20:13 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-dfdc133e-06d3-404d-bac1-352c584b55d6 tempest-VolumesListAdminTestJSON-1926843183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0dcc47d-c24d-4836-a7f6-4b1512c1a688) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:20:13 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-dfdc133e-06d3-404d-bac1-352c584b55d6 tempest-VolumesListAdminTestJSON-1926843183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0dcc47d-c24d-4836-a7f6-4b1512c1a688) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:20:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1187377184',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=780f028d-2dc4-4ae9-9b71-926131ef2622,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3728bd43b02a48f6bfef6121fa48af05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:20:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:20:13Z,use_quota=True,user_id='d47a098aab2048d4bfda86ed23024c9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:20:13 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-dfdc133e-06d3-404d-bac1-352c584b55d6 tempest-VolumesListAdminTestJSON-1926843183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd3b0986-497c-41c0-9727-ea8f5780fe60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:20:13 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-dfdc133e-06d3-404d-bac1-352c584b55d6 tempest-VolumesListAdminTestJSON-1926843183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd3b0986-497c-41c0-9727-ea8f5780fe60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:20:13 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-dfdc133e-06d3-404d-bac1-352c584b55d6 tempest-VolumesListAdminTestJSON-1926843183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1be9a395-aa78-4e03-beea-445d73ebe27b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:20:13 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-dfdc133e-06d3-404d-bac1-352c584b55d6 tempest-VolumesListAdminTestJSON-1926843183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1be9a395-aa78-4e03-beea-445d73ebe27b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '780f028d-2dc4-4ae9-9b71-926131ef2622', 'volume_name': 'volume-780f028d-2dc4-4ae9-9b71-926131ef2622', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:20:13 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-dfdc133e-06d3-404d-bac1-352c584b55d6 tempest-VolumesListAdminTestJSON-1926843183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a51e42dd-041d-4249-b527-08361731319b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:20:13 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-dfdc133e-06d3-404d-bac1-352c584b55d6 tempest-VolumesListAdminTestJSON-1926843183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a51e42dd-041d-4249-b527-08361731319b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:20:13 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-dfdc133e-06d3-404d-bac1-352c584b55d6 tempest-VolumesListAdminTestJSON-1926843183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bab248d4-424d-441a-a25f-75b769c4ff94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:20:13 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-dfdc133e-06d3-404d-bac1-352c584b55d6 tempest-VolumesListAdminTestJSON-1926843183 None] Volume 780f028d-2dc4-4ae9-9b71-926131ef2622: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-780f028d-2dc4-4ae9-9b71-926131ef2622', 'volume_size': 1} Aug 05 06:20:13 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-dfdc133e-06d3-404d-bac1-352c584b55d6 tempest-VolumesListAdminTestJSON-1926843183 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:20:13 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-dfdc133e-06d3-404d-bac1-352c584b55d6 tempest-VolumesListAdminTestJSON-1926843183 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:20:13 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-dfdc133e-06d3-404d-bac1-352c584b55d6 tempest-VolumesListAdminTestJSON-1926843183 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:20:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1187377184',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=780f028d-2dc4-4ae9-9b71-926131ef2622,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3728bd43b02a48f6bfef6121fa48af05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:20:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:20:13Z,use_quota=True,user_id='d47a098aab2048d4bfda86ed23024c9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)}" {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 06:20:13 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-dfdc133e-06d3-404d-bac1-352c584b55d6 tempest-VolumesListAdminTestJSON-1926843183 None] Creating volume 780f028d-2dc4-4ae9-9b71-926131ef2622 {{(pid=88695) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 06:20:13 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-dfdc133e-06d3-404d-bac1-352c584b55d6 tempest-VolumesListAdminTestJSON-1926843183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:20:13 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-dfdc133e-06d3-404d-bac1-352c584b55d6 tempest-VolumesListAdminTestJSON-1926843183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:20:13 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-dfdc133e-06d3-404d-bac1-352c584b55d6 tempest-VolumesListAdminTestJSON-1926843183 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:20:13 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-dfdc133e-06d3-404d-bac1-352c584b55d6 tempest-VolumesListAdminTestJSON-1926843183 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:20:13 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-dfdc133e-06d3-404d-bac1-352c584b55d6 tempest-VolumesListAdminTestJSON-1926843183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:20:13 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-dfdc133e-06d3-404d-bac1-352c584b55d6 tempest-VolumesListAdminTestJSON-1926843183 None] Selected osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 as target Quobyte volume. {{(pid=88695) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 06:20:13 devstack cinder-volume[88695]: INFO cinder.volume.drivers.remotefs [None req-dfdc133e-06d3-404d-bac1-352c584b55d6 tempest-VolumesListAdminTestJSON-1926843183 None] casted to osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 Aug 05 06:20:13 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-dfdc133e-06d3-404d-bac1-352c584b55d6 tempest-VolumesListAdminTestJSON-1926843183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-780f028d-2dc4-4ae9-9b71-926131ef2622 1073741824 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:20:13 devstack sudo[99301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-780f028d-2dc4-4ae9-9b71-926131ef2622 1073741824 Aug 05 06:20:13 devstack sudo[99301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:20:13 devstack sudo[99301]: pam_unix(sudo:session): session closed for user root Aug 05 06:20:13 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-dfdc133e-06d3-404d-bac1-352c584b55d6 tempest-VolumesListAdminTestJSON-1926843183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-780f028d-2dc4-4ae9-9b71-926131ef2622 1073741824" returned: 0 in 0.464s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:20:13 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-dfdc133e-06d3-404d-bac1-352c584b55d6 tempest-VolumesListAdminTestJSON-1926843183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-780f028d-2dc4-4ae9-9b71-926131ef2622 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:20:13 devstack sudo[99307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-780f028d-2dc4-4ae9-9b71-926131ef2622 Aug 05 06:20:13 devstack sudo[99307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:20:13 devstack sudo[99307]: pam_unix(sudo:session): session closed for user root Aug 05 06:20:13 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-dfdc133e-06d3-404d-bac1-352c584b55d6 tempest-VolumesListAdminTestJSON-1926843183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-780f028d-2dc4-4ae9-9b71-926131ef2622" returned: 0 in 0.270s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:20:13 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-dfdc133e-06d3-404d-bac1-352c584b55d6 tempest-VolumesListAdminTestJSON-1926843183 None] <== create_volume: return (794ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'} {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 06:20:13 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-dfdc133e-06d3-404d-bac1-352c584b55d6 tempest-VolumesListAdminTestJSON-1926843183 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.797s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:20:13 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-dfdc133e-06d3-404d-bac1-352c584b55d6 tempest-VolumesListAdminTestJSON-1926843183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bab248d4-424d-441a-a25f-75b769c4ff94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-780f028d-2dc4-4ae9-9b71-926131ef2622', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:20:13 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-dfdc133e-06d3-404d-bac1-352c584b55d6 tempest-VolumesListAdminTestJSON-1926843183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45955556-4b10-4f12-95bc-7636a76d06b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:20:14 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-dfdc133e-06d3-404d-bac1-352c584b55d6 tempest-VolumesListAdminTestJSON-1926843183 None] Volume volume-780f028d-2dc4-4ae9-9b71-926131ef2622 (780f028d-2dc4-4ae9-9b71-926131ef2622): created successfully Aug 05 06:20:14 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-dfdc133e-06d3-404d-bac1-352c584b55d6 tempest-VolumesListAdminTestJSON-1926843183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45955556-4b10-4f12-95bc-7636a76d06b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:20:14 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-dfdc133e-06d3-404d-bac1-352c584b55d6 tempest-VolumesListAdminTestJSON-1926843183 None] Flow 'volume_create_manager' (a8f7de31-02dc-4b55-968e-0827ab44f252) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:20:14 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-dfdc133e-06d3-404d-bac1-352c584b55d6 tempest-VolumesListAdminTestJSON-1926843183 None] Created volume successfully. Aug 05 06:20:15 devstack cinder-volume[88695]: DEBUG cinder.volume.flows.manager.create_volume [None req-336b6a93-da51-4e95-ade7-ad70a63fc3da tempest-VolumesListAdminTestJSON-1926843183 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88695) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 06:20:15 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-336b6a93-da51-4e95-ade7-ad70a63fc3da tempest-VolumesListAdminTestJSON-1926843183 None] Flow 'volume_create_manager' (aa2cb8a9-bc32-45fb-a7d6-ce0c50faebb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:20:15 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-336b6a93-da51-4e95-ade7-ad70a63fc3da tempest-VolumesListAdminTestJSON-1926843183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (046f0efd-747a-4cdb-b7aa-e589ce8ba611) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:20:15 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-336b6a93-da51-4e95-ade7-ad70a63fc3da tempest-VolumesListAdminTestJSON-1926843183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (046f0efd-747a-4cdb-b7aa-e589ce8ba611) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:20:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-368509263',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8b01534-d0a4-4b71-8699-4361fb7910ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3728bd43b02a48f6bfef6121fa48af05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:20:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:20:16Z,use_quota=True,user_id='d47a098aab2048d4bfda86ed23024c9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:20:15 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-336b6a93-da51-4e95-ade7-ad70a63fc3da tempest-VolumesListAdminTestJSON-1926843183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4cf0d0b2-4c35-403e-8ca7-d85b5dfe99f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:20:15 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-336b6a93-da51-4e95-ade7-ad70a63fc3da tempest-VolumesListAdminTestJSON-1926843183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4cf0d0b2-4c35-403e-8ca7-d85b5dfe99f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:20:15 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-336b6a93-da51-4e95-ade7-ad70a63fc3da tempest-VolumesListAdminTestJSON-1926843183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d167c5c8-bd73-45f2-93c6-f3e6d838ff7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:20:15 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-336b6a93-da51-4e95-ade7-ad70a63fc3da tempest-VolumesListAdminTestJSON-1926843183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d167c5c8-bd73-45f2-93c6-f3e6d838ff7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd8b01534-d0a4-4b71-8699-4361fb7910ce', 'volume_name': 'volume-d8b01534-d0a4-4b71-8699-4361fb7910ce', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:20:15 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-336b6a93-da51-4e95-ade7-ad70a63fc3da tempest-VolumesListAdminTestJSON-1926843183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4101bb78-fa77-4e7e-8053-97cb0fbe4dbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:20:15 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-336b6a93-da51-4e95-ade7-ad70a63fc3da tempest-VolumesListAdminTestJSON-1926843183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4101bb78-fa77-4e7e-8053-97cb0fbe4dbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:20:15 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-336b6a93-da51-4e95-ade7-ad70a63fc3da tempest-VolumesListAdminTestJSON-1926843183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (408364b4-65cd-4ea2-83a0-8412af05b93d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:20:15 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-336b6a93-da51-4e95-ade7-ad70a63fc3da tempest-VolumesListAdminTestJSON-1926843183 None] Volume d8b01534-d0a4-4b71-8699-4361fb7910ce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d8b01534-d0a4-4b71-8699-4361fb7910ce', 'volume_size': 1} Aug 05 06:20:15 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-336b6a93-da51-4e95-ade7-ad70a63fc3da tempest-VolumesListAdminTestJSON-1926843183 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:20:15 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-336b6a93-da51-4e95-ade7-ad70a63fc3da tempest-VolumesListAdminTestJSON-1926843183 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:20:15 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-336b6a93-da51-4e95-ade7-ad70a63fc3da tempest-VolumesListAdminTestJSON-1926843183 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:20:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-368509263',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8b01534-d0a4-4b71-8699-4361fb7910ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3728bd43b02a48f6bfef6121fa48af05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:20:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:20:16Z,use_quota=True,user_id='d47a098aab2048d4bfda86ed23024c9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)}" {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 06:20:15 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-336b6a93-da51-4e95-ade7-ad70a63fc3da tempest-VolumesListAdminTestJSON-1926843183 None] Creating volume d8b01534-d0a4-4b71-8699-4361fb7910ce {{(pid=88695) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 06:20:15 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-336b6a93-da51-4e95-ade7-ad70a63fc3da tempest-VolumesListAdminTestJSON-1926843183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:20:15 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-336b6a93-da51-4e95-ade7-ad70a63fc3da tempest-VolumesListAdminTestJSON-1926843183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:20:15 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-336b6a93-da51-4e95-ade7-ad70a63fc3da tempest-VolumesListAdminTestJSON-1926843183 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:20:15 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-336b6a93-da51-4e95-ade7-ad70a63fc3da tempest-VolumesListAdminTestJSON-1926843183 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:20:15 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-336b6a93-da51-4e95-ade7-ad70a63fc3da tempest-VolumesListAdminTestJSON-1926843183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:20:15 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-336b6a93-da51-4e95-ade7-ad70a63fc3da tempest-VolumesListAdminTestJSON-1926843183 None] Selected osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 as target Quobyte volume. {{(pid=88695) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 06:20:15 devstack cinder-volume[88695]: INFO cinder.volume.drivers.remotefs [None req-336b6a93-da51-4e95-ade7-ad70a63fc3da tempest-VolumesListAdminTestJSON-1926843183 None] casted to osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 Aug 05 06:20:15 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-336b6a93-da51-4e95-ade7-ad70a63fc3da tempest-VolumesListAdminTestJSON-1926843183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-d8b01534-d0a4-4b71-8699-4361fb7910ce 1073741824 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:20:15 devstack sudo[99310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-d8b01534-d0a4-4b71-8699-4361fb7910ce 1073741824 Aug 05 06:20:15 devstack sudo[99310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:20:16 devstack sudo[99310]: pam_unix(sudo:session): session closed for user root Aug 05 06:20:16 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-336b6a93-da51-4e95-ade7-ad70a63fc3da tempest-VolumesListAdminTestJSON-1926843183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-d8b01534-d0a4-4b71-8699-4361fb7910ce 1073741824" returned: 0 in 0.417s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:20:16 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-336b6a93-da51-4e95-ade7-ad70a63fc3da tempest-VolumesListAdminTestJSON-1926843183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-d8b01534-d0a4-4b71-8699-4361fb7910ce {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:20:16 devstack sudo[99315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-d8b01534-d0a4-4b71-8699-4361fb7910ce Aug 05 06:20:16 devstack sudo[99315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:20:16 devstack sudo[99315]: pam_unix(sudo:session): session closed for user root Aug 05 06:20:16 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-336b6a93-da51-4e95-ade7-ad70a63fc3da tempest-VolumesListAdminTestJSON-1926843183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-d8b01534-d0a4-4b71-8699-4361fb7910ce" returned: 0 in 0.255s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:20:16 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-336b6a93-da51-4e95-ade7-ad70a63fc3da tempest-VolumesListAdminTestJSON-1926843183 None] <== create_volume: return (715ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'} {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 06:20:16 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-336b6a93-da51-4e95-ade7-ad70a63fc3da tempest-VolumesListAdminTestJSON-1926843183 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.717s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:20:16 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-336b6a93-da51-4e95-ade7-ad70a63fc3da tempest-VolumesListAdminTestJSON-1926843183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (408364b4-65cd-4ea2-83a0-8412af05b93d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8b01534-d0a4-4b71-8699-4361fb7910ce', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:20:16 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-336b6a93-da51-4e95-ade7-ad70a63fc3da tempest-VolumesListAdminTestJSON-1926843183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9544f302-114d-4dc7-a2bc-8da0932a962b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:20:16 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-336b6a93-da51-4e95-ade7-ad70a63fc3da tempest-VolumesListAdminTestJSON-1926843183 None] Volume volume-d8b01534-d0a4-4b71-8699-4361fb7910ce (d8b01534-d0a4-4b71-8699-4361fb7910ce): created successfully Aug 05 06:20:16 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-336b6a93-da51-4e95-ade7-ad70a63fc3da tempest-VolumesListAdminTestJSON-1926843183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9544f302-114d-4dc7-a2bc-8da0932a962b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:20:16 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-336b6a93-da51-4e95-ade7-ad70a63fc3da tempest-VolumesListAdminTestJSON-1926843183 None] Flow 'volume_create_manager' (aa2cb8a9-bc32-45fb-a7d6-ce0c50faebb5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:20:16 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-336b6a93-da51-4e95-ade7-ad70a63fc3da tempest-VolumesListAdminTestJSON-1926843183 None] Created volume successfully. Aug 05 06:20:17 devstack cinder-volume[88695]: DEBUG cinder.volume.flows.manager.create_volume [None req-ccc69cf8-3a50-48c8-91f0-128c43157219 tempest-VolumesListAdminTestJSON-1526284614 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88695) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 06:20:17 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-ccc69cf8-3a50-48c8-91f0-128c43157219 tempest-VolumesListAdminTestJSON-1526284614 None] Flow 'volume_create_manager' (73a36f5f-f57d-4ffa-bff9-e47bb71b58f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:20:17 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-ccc69cf8-3a50-48c8-91f0-128c43157219 tempest-VolumesListAdminTestJSON-1526284614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6dcf1623-0a4a-4d65-a9e1-e312ddaccd01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:20:17 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-ccc69cf8-3a50-48c8-91f0-128c43157219 tempest-VolumesListAdminTestJSON-1526284614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6dcf1623-0a4a-4d65-a9e1-e312ddaccd01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:20:17Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=013fb279-e522-47c1-8246-48acb5a01e4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8ee7a926c6347bd806f5945347313f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:20:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:20:17Z,use_quota=True,user_id='0ada6a7e090744c8b20cfef8077b3c95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:20:17 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-ccc69cf8-3a50-48c8-91f0-128c43157219 tempest-VolumesListAdminTestJSON-1526284614 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (edbf0f32-f8b3-40fb-ad65-dcb005809be9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:20:17 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-ccc69cf8-3a50-48c8-91f0-128c43157219 tempest-VolumesListAdminTestJSON-1526284614 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (edbf0f32-f8b3-40fb-ad65-dcb005809be9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:20:17 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-ccc69cf8-3a50-48c8-91f0-128c43157219 tempest-VolumesListAdminTestJSON-1526284614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32c30ef0-0b33-4c79-bae2-850e6b79b951) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:20:17 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-ccc69cf8-3a50-48c8-91f0-128c43157219 tempest-VolumesListAdminTestJSON-1526284614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32c30ef0-0b33-4c79-bae2-850e6b79b951) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '013fb279-e522-47c1-8246-48acb5a01e4a', 'volume_name': 'volume-013fb279-e522-47c1-8246-48acb5a01e4a', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:20:17 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-ccc69cf8-3a50-48c8-91f0-128c43157219 tempest-VolumesListAdminTestJSON-1526284614 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2edfb0e-efbd-4ac0-9636-8b63d44a7344) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:20:17 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-ccc69cf8-3a50-48c8-91f0-128c43157219 tempest-VolumesListAdminTestJSON-1526284614 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2edfb0e-efbd-4ac0-9636-8b63d44a7344) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:20:17 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-ccc69cf8-3a50-48c8-91f0-128c43157219 tempest-VolumesListAdminTestJSON-1526284614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92495f10-cd81-42ea-8521-2d5b8c37ff46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:20:17 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-ccc69cf8-3a50-48c8-91f0-128c43157219 tempest-VolumesListAdminTestJSON-1526284614 None] Volume 013fb279-e522-47c1-8246-48acb5a01e4a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-013fb279-e522-47c1-8246-48acb5a01e4a', 'volume_size': 1} Aug 05 06:20:17 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-ccc69cf8-3a50-48c8-91f0-128c43157219 tempest-VolumesListAdminTestJSON-1526284614 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:20:17 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-ccc69cf8-3a50-48c8-91f0-128c43157219 tempest-VolumesListAdminTestJSON-1526284614 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:20:17 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-ccc69cf8-3a50-48c8-91f0-128c43157219 tempest-VolumesListAdminTestJSON-1526284614 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:20:17Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=013fb279-e522-47c1-8246-48acb5a01e4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8ee7a926c6347bd806f5945347313f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:20:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:20:17Z,use_quota=True,user_id='0ada6a7e090744c8b20cfef8077b3c95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)}" {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 06:20:17 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-ccc69cf8-3a50-48c8-91f0-128c43157219 tempest-VolumesListAdminTestJSON-1526284614 None] Creating volume 013fb279-e522-47c1-8246-48acb5a01e4a {{(pid=88695) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 06:20:17 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-ccc69cf8-3a50-48c8-91f0-128c43157219 tempest-VolumesListAdminTestJSON-1526284614 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:20:17 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-ccc69cf8-3a50-48c8-91f0-128c43157219 tempest-VolumesListAdminTestJSON-1526284614 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:20:17 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-ccc69cf8-3a50-48c8-91f0-128c43157219 tempest-VolumesListAdminTestJSON-1526284614 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:20:17 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-ccc69cf8-3a50-48c8-91f0-128c43157219 tempest-VolumesListAdminTestJSON-1526284614 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:20:17 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-ccc69cf8-3a50-48c8-91f0-128c43157219 tempest-VolumesListAdminTestJSON-1526284614 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:20:17 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-ccc69cf8-3a50-48c8-91f0-128c43157219 tempest-VolumesListAdminTestJSON-1526284614 None] Selected osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 as target Quobyte volume. {{(pid=88695) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 06:20:17 devstack cinder-volume[88695]: INFO cinder.volume.drivers.remotefs [None req-ccc69cf8-3a50-48c8-91f0-128c43157219 tempest-VolumesListAdminTestJSON-1526284614 None] casted to osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 Aug 05 06:20:17 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-ccc69cf8-3a50-48c8-91f0-128c43157219 tempest-VolumesListAdminTestJSON-1526284614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-013fb279-e522-47c1-8246-48acb5a01e4a 1073741824 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:20:17 devstack sudo[99337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-013fb279-e522-47c1-8246-48acb5a01e4a 1073741824 Aug 05 06:20:17 devstack sudo[99337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:20:18 devstack sudo[99337]: pam_unix(sudo:session): session closed for user root Aug 05 06:20:18 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-ccc69cf8-3a50-48c8-91f0-128c43157219 tempest-VolumesListAdminTestJSON-1526284614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-013fb279-e522-47c1-8246-48acb5a01e4a 1073741824" returned: 0 in 0.456s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:20:18 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-ccc69cf8-3a50-48c8-91f0-128c43157219 tempest-VolumesListAdminTestJSON-1526284614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-013fb279-e522-47c1-8246-48acb5a01e4a {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:20:18 devstack sudo[99343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-013fb279-e522-47c1-8246-48acb5a01e4a Aug 05 06:20:18 devstack sudo[99343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:20:18 devstack sudo[99343]: pam_unix(sudo:session): session closed for user root Aug 05 06:20:18 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-ccc69cf8-3a50-48c8-91f0-128c43157219 tempest-VolumesListAdminTestJSON-1526284614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-013fb279-e522-47c1-8246-48acb5a01e4a" returned: 0 in 0.274s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:20:18 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-ccc69cf8-3a50-48c8-91f0-128c43157219 tempest-VolumesListAdminTestJSON-1526284614 None] <== create_volume: return (774ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'} {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 06:20:18 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-ccc69cf8-3a50-48c8-91f0-128c43157219 tempest-VolumesListAdminTestJSON-1526284614 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.777s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:20:18 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-ccc69cf8-3a50-48c8-91f0-128c43157219 tempest-VolumesListAdminTestJSON-1526284614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92495f10-cd81-42ea-8521-2d5b8c37ff46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-013fb279-e522-47c1-8246-48acb5a01e4a', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:20:18 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-ccc69cf8-3a50-48c8-91f0-128c43157219 tempest-VolumesListAdminTestJSON-1526284614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5077cb4-4010-4ae0-a965-885a324291aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:20:18 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-ccc69cf8-3a50-48c8-91f0-128c43157219 tempest-VolumesListAdminTestJSON-1526284614 None] Volume volume-013fb279-e522-47c1-8246-48acb5a01e4a (013fb279-e522-47c1-8246-48acb5a01e4a): created successfully Aug 05 06:20:18 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-ccc69cf8-3a50-48c8-91f0-128c43157219 tempest-VolumesListAdminTestJSON-1526284614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5077cb4-4010-4ae0-a965-885a324291aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:20:18 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-ccc69cf8-3a50-48c8-91f0-128c43157219 tempest-VolumesListAdminTestJSON-1526284614 None] Flow 'volume_create_manager' (73a36f5f-f57d-4ffa-bff9-e47bb71b58f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:20:18 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-ccc69cf8-3a50-48c8-91f0-128c43157219 tempest-VolumesListAdminTestJSON-1526284614 None] Created volume successfully. Aug 05 06:20:19 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-fc97b153-1003-47e5-9c1f-2d88cb03691d tempest-VolumesListAdminTestJSON-1526284614 None] Acquiring lock "cinder-013fb279-e522-47c1-8246-48acb5a01e4a-delete_volume" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:20:19 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-fc97b153-1003-47e5-9c1f-2d88cb03691d tempest-VolumesListAdminTestJSON-1526284614 None] Lock "cinder-013fb279-e522-47c1-8246-48acb5a01e4a-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:20:19 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-fc97b153-1003-47e5-9c1f-2d88cb03691d tempest-VolumesListAdminTestJSON-1526284614 None] Acquiring lock "cinder-quobyte-013fb279-e522-47c1-8246-48acb5a01e4a" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:20:19 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-fc97b153-1003-47e5-9c1f-2d88cb03691d tempest-VolumesListAdminTestJSON-1526284614 None] Lock "cinder-quobyte-013fb279-e522-47c1-8246-48acb5a01e4a" acquired by "delete_volume" :: waited 0.017s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:20:19 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc9ffc66-91f2-4ff8-baf6-06a2a11e3040]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:20:19 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-fc97b153-1003-47e5-9c1f-2d88cb03691d tempest-VolumesListAdminTestJSON-1526284614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-013fb279-e522-47c1-8246-48acb5a01e4a {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:20:19 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-68373d81-7ea4-4578-ab36-d4eb98613501 tempest-VolumesListAdminTestJSON-1926843183 None] Acquiring lock "cinder-d8b01534-d0a4-4b71-8699-4361fb7910ce-delete_volume" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:20:19 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-68373d81-7ea4-4578-ab36-d4eb98613501 tempest-VolumesListAdminTestJSON-1926843183 None] Lock "cinder-d8b01534-d0a4-4b71-8699-4361fb7910ce-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:20:19 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-68373d81-7ea4-4578-ab36-d4eb98613501 tempest-VolumesListAdminTestJSON-1926843183 None] Acquiring lock "cinder-quobyte-d8b01534-d0a4-4b71-8699-4361fb7910ce" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:20:19 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-68373d81-7ea4-4578-ab36-d4eb98613501 tempest-VolumesListAdminTestJSON-1926843183 None] Lock "cinder-quobyte-d8b01534-d0a4-4b71-8699-4361fb7910ce" acquired by "delete_volume" :: waited 0.015s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:20:19 devstack sudo[99346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-013fb279-e522-47c1-8246-48acb5a01e4a Aug 05 06:20:19 devstack sudo[99346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:20:19 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ada6a34-4698-4a5e-90f8-b6eadf03c316]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:20:19 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-68373d81-7ea4-4578-ab36-d4eb98613501 tempest-VolumesListAdminTestJSON-1926843183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-d8b01534-d0a4-4b71-8699-4361fb7910ce {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:20:20 devstack sudo[99348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-d8b01534-d0a4-4b71-8699-4361fb7910ce Aug 05 06:20:20 devstack sudo[99348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:20:20 devstack sudo[99346]: pam_unix(sudo:session): session closed for user root Aug 05 06:20:20 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-fc97b153-1003-47e5-9c1f-2d88cb03691d tempest-VolumesListAdminTestJSON-1526284614 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-013fb279-e522-47c1-8246-48acb5a01e4a" returned: 0 in 0.384s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:20:20 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-fc97b153-1003-47e5-9c1f-2d88cb03691d tempest-VolumesListAdminTestJSON-1526284614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-013fb279-e522-47c1-8246-48acb5a01e4a {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:20:20 devstack sudo[99353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-013fb279-e522-47c1-8246-48acb5a01e4a Aug 05 06:20:20 devstack sudo[99353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:20:20 devstack sudo[99348]: pam_unix(sudo:session): session closed for user root Aug 05 06:20:20 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-68373d81-7ea4-4578-ab36-d4eb98613501 tempest-VolumesListAdminTestJSON-1926843183 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-d8b01534-d0a4-4b71-8699-4361fb7910ce" returned: 0 in 0.388s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:20:20 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-68373d81-7ea4-4578-ab36-d4eb98613501 tempest-VolumesListAdminTestJSON-1926843183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-d8b01534-d0a4-4b71-8699-4361fb7910ce {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:20:20 devstack sudo[99358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-d8b01534-d0a4-4b71-8699-4361fb7910ce Aug 05 06:20:20 devstack sudo[99358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:20:20 devstack sudo[99353]: pam_unix(sudo:session): session closed for user root Aug 05 06:20:20 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-fc97b153-1003-47e5-9c1f-2d88cb03691d tempest-VolumesListAdminTestJSON-1526284614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-013fb279-e522-47c1-8246-48acb5a01e4a" returned: 0 in 0.262s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:20:20 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-fc97b153-1003-47e5-9c1f-2d88cb03691d tempest-VolumesListAdminTestJSON-1526284614 None] Lock "cinder-quobyte-013fb279-e522-47c1-8246-48acb5a01e4a" released by "delete_volume" :: held 0.700s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:20:20 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-fc97b153-1003-47e5-9c1f-2d88cb03691d tempest-VolumesListAdminTestJSON-1526284614 None] Created reservations ['f0540a71-3ee6-4da5-bf77-d9146471661e', '5b40d52f-0bbf-4607-a4eb-ff2e680c6146', 'd1ef5a56-f4b9-4a77-aa6c-b7f5f905b46e', '8ec4cd86-a8ad-4638-b34f-38f073ec06de'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:20:20 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-fc97b153-1003-47e5-9c1f-2d88cb03691d tempest-VolumesListAdminTestJSON-1526284614 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:20:20 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-fc97b153-1003-47e5-9c1f-2d88cb03691d tempest-VolumesListAdminTestJSON-1526284614 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:20:20 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-fc97b153-1003-47e5-9c1f-2d88cb03691d tempest-VolumesListAdminTestJSON-1526284614 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:20:20 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-fc97b153-1003-47e5-9c1f-2d88cb03691d tempest-VolumesListAdminTestJSON-1526284614 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:20:20 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-fc97b153-1003-47e5-9c1f-2d88cb03691d tempest-VolumesListAdminTestJSON-1526284614 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:20:20 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-fc97b153-1003-47e5-9c1f-2d88cb03691d tempest-VolumesListAdminTestJSON-1526284614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:20:20 devstack sudo[99358]: pam_unix(sudo:session): session closed for user root Aug 05 06:20:20 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-68373d81-7ea4-4578-ab36-d4eb98613501 tempest-VolumesListAdminTestJSON-1926843183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-d8b01534-d0a4-4b71-8699-4361fb7910ce" returned: 0 in 0.279s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:20:20 devstack sudo[99362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce Aug 05 06:20:20 devstack sudo[99362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:20:20 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-68373d81-7ea4-4578-ab36-d4eb98613501 tempest-VolumesListAdminTestJSON-1926843183 None] Lock "cinder-quobyte-d8b01534-d0a4-4b71-8699-4361fb7910ce" released by "delete_volume" :: held 0.713s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:20:20 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-68373d81-7ea4-4578-ab36-d4eb98613501 tempest-VolumesListAdminTestJSON-1926843183 None] Created reservations ['03ee8285-63e8-4aa8-926c-10cd709b869f', '35e697fc-ce45-46fb-9e19-1810d0f64858', 'ab16f631-d7b1-45e1-99eb-1b9620e0da39', 'b814ab37-2ed3-4247-ac5d-44c4c2b305bf'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:20:20 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-68373d81-7ea4-4578-ab36-d4eb98613501 tempest-VolumesListAdminTestJSON-1926843183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:20:20 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-68373d81-7ea4-4578-ab36-d4eb98613501 tempest-VolumesListAdminTestJSON-1926843183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:20:20 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-68373d81-7ea4-4578-ab36-d4eb98613501 tempest-VolumesListAdminTestJSON-1926843183 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:20:20 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-68373d81-7ea4-4578-ab36-d4eb98613501 tempest-VolumesListAdminTestJSON-1926843183 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:20:20 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-68373d81-7ea4-4578-ab36-d4eb98613501 tempest-VolumesListAdminTestJSON-1926843183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:20:20 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-68373d81-7ea4-4578-ab36-d4eb98613501 tempest-VolumesListAdminTestJSON-1926843183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:20:20 devstack sudo[99364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce Aug 05 06:20:20 devstack sudo[99364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:20:20 devstack sudo[99362]: pam_unix(sudo:session): session closed for user root Aug 05 06:20:20 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-fc97b153-1003-47e5-9c1f-2d88cb03691d tempest-VolumesListAdminTestJSON-1526284614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce" returned: 0 in 0.277s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:20:20 devstack cinder-volume[88695]: DEBUG cinder.manager [None req-fc97b153-1003-47e5-9c1f-2d88cb03691d tempest-VolumesListAdminTestJSON-1526284614 None] Notifying Schedulers of capabilities ... {{(pid=88695) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 06:20:20 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-fc97b153-1003-47e5-9c1f-2d88cb03691d tempest-VolumesListAdminTestJSON-1526284614 None] Deleted volume successfully. Aug 05 06:20:20 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-fc97b153-1003-47e5-9c1f-2d88cb03691d tempest-VolumesListAdminTestJSON-1526284614 None] Lock "cinder-013fb279-e522-47c1-8246-48acb5a01e4a-delete_volume" released by "delete_volume" :: held 1.189s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:20:20 devstack sudo[99364]: pam_unix(sudo:session): session closed for user root Aug 05 06:20:20 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-68373d81-7ea4-4578-ab36-d4eb98613501 tempest-VolumesListAdminTestJSON-1926843183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce" returned: 0 in 0.266s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:20:20 devstack cinder-volume[88695]: DEBUG cinder.manager [None req-68373d81-7ea4-4578-ab36-d4eb98613501 tempest-VolumesListAdminTestJSON-1926843183 None] Notifying Schedulers of capabilities ... {{(pid=88695) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 06:20:20 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-68373d81-7ea4-4578-ab36-d4eb98613501 tempest-VolumesListAdminTestJSON-1926843183 None] Deleted volume successfully. Aug 05 06:20:21 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-68373d81-7ea4-4578-ab36-d4eb98613501 tempest-VolumesListAdminTestJSON-1926843183 None] Lock "cinder-d8b01534-d0a4-4b71-8699-4361fb7910ce-delete_volume" released by "delete_volume" :: held 1.172s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:20:21 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-33405652-c7a8-43a7-aac4-dcc4d6d0e565 tempest-VolumesListAdminTestJSON-1926843183 None] Acquiring lock "cinder-780f028d-2dc4-4ae9-9b71-926131ef2622-delete_volume" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:20:21 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-33405652-c7a8-43a7-aac4-dcc4d6d0e565 tempest-VolumesListAdminTestJSON-1926843183 None] Lock "cinder-780f028d-2dc4-4ae9-9b71-926131ef2622-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:20:21 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-33405652-c7a8-43a7-aac4-dcc4d6d0e565 tempest-VolumesListAdminTestJSON-1926843183 None] Acquiring lock "cinder-quobyte-780f028d-2dc4-4ae9-9b71-926131ef2622" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:20:21 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-33405652-c7a8-43a7-aac4-dcc4d6d0e565 tempest-VolumesListAdminTestJSON-1926843183 None] Lock "cinder-quobyte-780f028d-2dc4-4ae9-9b71-926131ef2622" acquired by "delete_volume" :: waited 0.016s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:20:21 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[32c306a0-7418-4df3-a1a3-5a6adfccb03e]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:20:21 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-33405652-c7a8-43a7-aac4-dcc4d6d0e565 tempest-VolumesListAdminTestJSON-1926843183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-780f028d-2dc4-4ae9-9b71-926131ef2622 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:20:21 devstack sudo[99368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-780f028d-2dc4-4ae9-9b71-926131ef2622 Aug 05 06:20:21 devstack sudo[99368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:20:21 devstack sudo[99368]: pam_unix(sudo:session): session closed for user root Aug 05 06:20:21 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-33405652-c7a8-43a7-aac4-dcc4d6d0e565 tempest-VolumesListAdminTestJSON-1926843183 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-780f028d-2dc4-4ae9-9b71-926131ef2622" returned: 0 in 0.364s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:20:21 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-33405652-c7a8-43a7-aac4-dcc4d6d0e565 tempest-VolumesListAdminTestJSON-1926843183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-780f028d-2dc4-4ae9-9b71-926131ef2622 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:20:21 devstack sudo[99373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-780f028d-2dc4-4ae9-9b71-926131ef2622 Aug 05 06:20:21 devstack sudo[99373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:20:21 devstack sudo[99373]: pam_unix(sudo:session): session closed for user root Aug 05 06:20:21 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-33405652-c7a8-43a7-aac4-dcc4d6d0e565 tempest-VolumesListAdminTestJSON-1926843183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-780f028d-2dc4-4ae9-9b71-926131ef2622" returned: 0 in 0.256s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:20:21 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-33405652-c7a8-43a7-aac4-dcc4d6d0e565 tempest-VolumesListAdminTestJSON-1926843183 None] Lock "cinder-quobyte-780f028d-2dc4-4ae9-9b71-926131ef2622" released by "delete_volume" :: held 0.656s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:20:21 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-33405652-c7a8-43a7-aac4-dcc4d6d0e565 tempest-VolumesListAdminTestJSON-1926843183 None] Created reservations ['c9df164f-d396-477a-a41d-f4adc9ebb0ff', '0c23681a-2f08-4a7b-a3af-30fa4288070f', 'e728814a-882a-40c1-96fd-a63178996014', '1d1105bc-c68f-4bf2-bef2-e1bf4fe4a621'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:20:21 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-33405652-c7a8-43a7-aac4-dcc4d6d0e565 tempest-VolumesListAdminTestJSON-1926843183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:20:21 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-33405652-c7a8-43a7-aac4-dcc4d6d0e565 tempest-VolumesListAdminTestJSON-1926843183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:20:21 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-33405652-c7a8-43a7-aac4-dcc4d6d0e565 tempest-VolumesListAdminTestJSON-1926843183 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:20:21 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-33405652-c7a8-43a7-aac4-dcc4d6d0e565 tempest-VolumesListAdminTestJSON-1926843183 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:20:21 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-33405652-c7a8-43a7-aac4-dcc4d6d0e565 tempest-VolumesListAdminTestJSON-1926843183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:20:21 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-33405652-c7a8-43a7-aac4-dcc4d6d0e565 tempest-VolumesListAdminTestJSON-1926843183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:20:21 devstack sudo[99376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce Aug 05 06:20:21 devstack sudo[99376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:20:22 devstack sudo[99376]: pam_unix(sudo:session): session closed for user root Aug 05 06:20:22 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-33405652-c7a8-43a7-aac4-dcc4d6d0e565 tempest-VolumesListAdminTestJSON-1926843183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce" returned: 0 in 0.254s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:20:22 devstack cinder-volume[88695]: DEBUG cinder.manager [None req-33405652-c7a8-43a7-aac4-dcc4d6d0e565 tempest-VolumesListAdminTestJSON-1926843183 None] Notifying Schedulers of capabilities ... {{(pid=88695) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 06:20:22 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-33405652-c7a8-43a7-aac4-dcc4d6d0e565 tempest-VolumesListAdminTestJSON-1926843183 None] Deleted volume successfully. Aug 05 06:20:22 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-33405652-c7a8-43a7-aac4-dcc4d6d0e565 tempest-VolumesListAdminTestJSON-1926843183 None] Lock "cinder-780f028d-2dc4-4ae9-9b71-926131ef2622-delete_volume" released by "delete_volume" :: held 1.099s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:20:22 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-fe548538-1dd5-49a7-ba31-4d58701ab104 tempest-VolumesListAdminTestJSON-1926843183 None] Acquiring lock "cinder-31b899ee-8415-4252-b2e3-a6440f83854a-delete_volume" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:20:22 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-fe548538-1dd5-49a7-ba31-4d58701ab104 tempest-VolumesListAdminTestJSON-1926843183 None] Lock "cinder-31b899ee-8415-4252-b2e3-a6440f83854a-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:20:22 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-fe548538-1dd5-49a7-ba31-4d58701ab104 tempest-VolumesListAdminTestJSON-1926843183 None] Acquiring lock "cinder-quobyte-31b899ee-8415-4252-b2e3-a6440f83854a" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:20:22 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-fe548538-1dd5-49a7-ba31-4d58701ab104 tempest-VolumesListAdminTestJSON-1926843183 None] Lock "cinder-quobyte-31b899ee-8415-4252-b2e3-a6440f83854a" acquired by "delete_volume" :: waited 0.019s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:20:22 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd44b92d-d93b-4c6b-a2c4-1f4ccae3b6e1]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:20:22 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-fe548538-1dd5-49a7-ba31-4d58701ab104 tempest-VolumesListAdminTestJSON-1926843183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-31b899ee-8415-4252-b2e3-a6440f83854a {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:20:22 devstack sudo[99379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-31b899ee-8415-4252-b2e3-a6440f83854a Aug 05 06:20:22 devstack sudo[99379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:20:22 devstack sudo[99379]: pam_unix(sudo:session): session closed for user root Aug 05 06:20:22 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-fe548538-1dd5-49a7-ba31-4d58701ab104 tempest-VolumesListAdminTestJSON-1926843183 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-31b899ee-8415-4252-b2e3-a6440f83854a" returned: 0 in 0.397s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:20:22 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-fe548538-1dd5-49a7-ba31-4d58701ab104 tempest-VolumesListAdminTestJSON-1926843183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-31b899ee-8415-4252-b2e3-a6440f83854a {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:20:22 devstack sudo[99384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-31b899ee-8415-4252-b2e3-a6440f83854a Aug 05 06:20:22 devstack sudo[99384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:20:23 devstack sudo[99384]: pam_unix(sudo:session): session closed for user root Aug 05 06:20:23 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-fe548538-1dd5-49a7-ba31-4d58701ab104 tempest-VolumesListAdminTestJSON-1926843183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-31b899ee-8415-4252-b2e3-a6440f83854a" returned: 0 in 0.261s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:20:23 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-fe548538-1dd5-49a7-ba31-4d58701ab104 tempest-VolumesListAdminTestJSON-1926843183 None] Lock "cinder-quobyte-31b899ee-8415-4252-b2e3-a6440f83854a" released by "delete_volume" :: held 0.695s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:20:23 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-fe548538-1dd5-49a7-ba31-4d58701ab104 tempest-VolumesListAdminTestJSON-1926843183 None] Created reservations ['9d961e2b-5c9d-435b-8c4d-4a80372af7ec', '6fda6ed0-ca0a-49d8-8ce8-9d7fed67b3f0', 'b6eb8030-a16c-4278-b25f-4e5b5130fe8a', 'd25c502e-9ad6-47b3-b4a5-36ca8eb67905'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:20:23 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-fe548538-1dd5-49a7-ba31-4d58701ab104 tempest-VolumesListAdminTestJSON-1926843183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:20:23 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-fe548538-1dd5-49a7-ba31-4d58701ab104 tempest-VolumesListAdminTestJSON-1926843183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:20:23 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-fe548538-1dd5-49a7-ba31-4d58701ab104 tempest-VolumesListAdminTestJSON-1926843183 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:20:23 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-fe548538-1dd5-49a7-ba31-4d58701ab104 tempest-VolumesListAdminTestJSON-1926843183 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:20:23 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-fe548538-1dd5-49a7-ba31-4d58701ab104 tempest-VolumesListAdminTestJSON-1926843183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:20:23 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-fe548538-1dd5-49a7-ba31-4d58701ab104 tempest-VolumesListAdminTestJSON-1926843183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:20:23 devstack sudo[99387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce Aug 05 06:20:23 devstack sudo[99387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:20:23 devstack sudo[99387]: pam_unix(sudo:session): session closed for user root Aug 05 06:20:23 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-fe548538-1dd5-49a7-ba31-4d58701ab104 tempest-VolumesListAdminTestJSON-1926843183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce" returned: 0 in 0.253s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:20:23 devstack cinder-volume[88695]: DEBUG cinder.manager [None req-fe548538-1dd5-49a7-ba31-4d58701ab104 tempest-VolumesListAdminTestJSON-1926843183 None] Notifying Schedulers of capabilities ... {{(pid=88695) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 06:20:23 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-fe548538-1dd5-49a7-ba31-4d58701ab104 tempest-VolumesListAdminTestJSON-1926843183 None] Deleted volume successfully. Aug 05 06:20:23 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-fe548538-1dd5-49a7-ba31-4d58701ab104 tempest-VolumesListAdminTestJSON-1926843183 None] Lock "cinder-31b899ee-8415-4252-b2e3-a6440f83854a-delete_volume" released by "delete_volume" :: held 1.165s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:20:27 devstack cinder-volume[88695]: DEBUG cinder.volume.flows.manager.create_volume [None req-d71e7a1c-e16f-45e1-bc7b-f3acb4d2bb22 tempest-VolumesMetadataTest-326448313 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88695) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 06:20:27 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-d71e7a1c-e16f-45e1-bc7b-f3acb4d2bb22 tempest-VolumesMetadataTest-326448313 None] Flow 'volume_create_manager' (738ebd70-98ec-4362-b83a-2547d60bbbdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:20:27 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-d71e7a1c-e16f-45e1-bc7b-f3acb4d2bb22 tempest-VolumesMetadataTest-326448313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5080f605-9526-4a14-86f8-24cc2cf6f519) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:20:27 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-d71e7a1c-e16f-45e1-bc7b-f3acb4d2bb22 tempest-VolumesMetadataTest-326448313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5080f605-9526-4a14-86f8-24cc2cf6f519) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:20:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1545456536',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22fffec5-646f-437f-8079-dda8f06841cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b2c28f6958f4beab2afacea1550a138',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:20:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:20:28Z,use_quota=True,user_id='668f8230be644670bd56f9f8e51edd68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:20:27 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-d71e7a1c-e16f-45e1-bc7b-f3acb4d2bb22 tempest-VolumesMetadataTest-326448313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2215c298-4176-4aae-9484-274d7739390d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:20:27 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-d71e7a1c-e16f-45e1-bc7b-f3acb4d2bb22 tempest-VolumesMetadataTest-326448313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2215c298-4176-4aae-9484-274d7739390d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:20:27 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-d71e7a1c-e16f-45e1-bc7b-f3acb4d2bb22 tempest-VolumesMetadataTest-326448313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbe751b0-d9de-4553-be90-bb67232b0be9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:20:27 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-d71e7a1c-e16f-45e1-bc7b-f3acb4d2bb22 tempest-VolumesMetadataTest-326448313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbe751b0-d9de-4553-be90-bb67232b0be9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '22fffec5-646f-437f-8079-dda8f06841cd', 'volume_name': 'volume-22fffec5-646f-437f-8079-dda8f06841cd', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:20:27 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-d71e7a1c-e16f-45e1-bc7b-f3acb4d2bb22 tempest-VolumesMetadataTest-326448313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (887e0763-e8eb-4082-81d1-292d332cbc63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:20:27 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-d71e7a1c-e16f-45e1-bc7b-f3acb4d2bb22 tempest-VolumesMetadataTest-326448313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (887e0763-e8eb-4082-81d1-292d332cbc63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:20:27 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-d71e7a1c-e16f-45e1-bc7b-f3acb4d2bb22 tempest-VolumesMetadataTest-326448313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9c0a458-3814-42e0-bce0-6ee76e8a41a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:20:27 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-d71e7a1c-e16f-45e1-bc7b-f3acb4d2bb22 tempest-VolumesMetadataTest-326448313 None] Volume 22fffec5-646f-437f-8079-dda8f06841cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-22fffec5-646f-437f-8079-dda8f06841cd', 'volume_size': 1} Aug 05 06:20:27 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-d71e7a1c-e16f-45e1-bc7b-f3acb4d2bb22 tempest-VolumesMetadataTest-326448313 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:20:27 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-d71e7a1c-e16f-45e1-bc7b-f3acb4d2bb22 tempest-VolumesMetadataTest-326448313 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:20:27 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-d71e7a1c-e16f-45e1-bc7b-f3acb4d2bb22 tempest-VolumesMetadataTest-326448313 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:20:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1545456536',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22fffec5-646f-437f-8079-dda8f06841cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b2c28f6958f4beab2afacea1550a138',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:20:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:20:28Z,use_quota=True,user_id='668f8230be644670bd56f9f8e51edd68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)}" {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 06:20:27 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-d71e7a1c-e16f-45e1-bc7b-f3acb4d2bb22 tempest-VolumesMetadataTest-326448313 None] Creating volume 22fffec5-646f-437f-8079-dda8f06841cd {{(pid=88695) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 06:20:27 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-d71e7a1c-e16f-45e1-bc7b-f3acb4d2bb22 tempest-VolumesMetadataTest-326448313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:20:27 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-d71e7a1c-e16f-45e1-bc7b-f3acb4d2bb22 tempest-VolumesMetadataTest-326448313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:20:27 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-d71e7a1c-e16f-45e1-bc7b-f3acb4d2bb22 tempest-VolumesMetadataTest-326448313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:20:27 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-d71e7a1c-e16f-45e1-bc7b-f3acb4d2bb22 tempest-VolumesMetadataTest-326448313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:20:27 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-d71e7a1c-e16f-45e1-bc7b-f3acb4d2bb22 tempest-VolumesMetadataTest-326448313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:20:27 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-d71e7a1c-e16f-45e1-bc7b-f3acb4d2bb22 tempest-VolumesMetadataTest-326448313 None] Selected osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 as target Quobyte volume. {{(pid=88695) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 06:20:27 devstack cinder-volume[88695]: INFO cinder.volume.drivers.remotefs [None req-d71e7a1c-e16f-45e1-bc7b-f3acb4d2bb22 tempest-VolumesMetadataTest-326448313 None] casted to osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 Aug 05 06:20:27 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-d71e7a1c-e16f-45e1-bc7b-f3acb4d2bb22 tempest-VolumesMetadataTest-326448313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-22fffec5-646f-437f-8079-dda8f06841cd 1073741824 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:20:27 devstack sudo[99397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-22fffec5-646f-437f-8079-dda8f06841cd 1073741824 Aug 05 06:20:27 devstack sudo[99397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:20:27 devstack cinder-volume[88695]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3e5550f-c827-4d85-addf-cbfb0b6176e9 tempest-AttachVolumeTestJSON-139946988 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88695) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 06:20:27 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-e3e5550f-c827-4d85-addf-cbfb0b6176e9 tempest-AttachVolumeTestJSON-139946988 None] Flow 'volume_create_manager' (296fd34b-fb2a-4ea9-ae79-e36c2f646662) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:20:27 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-e3e5550f-c827-4d85-addf-cbfb0b6176e9 tempest-AttachVolumeTestJSON-139946988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9083fc8c-8d61-4251-81be-f15218c90fca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:20:27 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-e3e5550f-c827-4d85-addf-cbfb0b6176e9 tempest-AttachVolumeTestJSON-139946988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9083fc8c-8d61-4251-81be-f15218c90fca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:20:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-577889873',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0b81468-0f25-4c98-896d-5945e1510fbf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e536bd020a264041b6d2d86d08701cf6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:20:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:20:28Z,use_quota=True,user_id='4c2ed75d0ae44fd7bf0cb6098706f74f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:20:27 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-e3e5550f-c827-4d85-addf-cbfb0b6176e9 tempest-AttachVolumeTestJSON-139946988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78d1dd29-e033-4972-a888-47bc0d209f62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:20:27 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-e3e5550f-c827-4d85-addf-cbfb0b6176e9 tempest-AttachVolumeTestJSON-139946988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78d1dd29-e033-4972-a888-47bc0d209f62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:20:27 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-e3e5550f-c827-4d85-addf-cbfb0b6176e9 tempest-AttachVolumeTestJSON-139946988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31dcb06c-2707-4a92-a21c-18454ab03918) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:20:27 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-e3e5550f-c827-4d85-addf-cbfb0b6176e9 tempest-AttachVolumeTestJSON-139946988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31dcb06c-2707-4a92-a21c-18454ab03918) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd0b81468-0f25-4c98-896d-5945e1510fbf', 'volume_name': 'volume-d0b81468-0f25-4c98-896d-5945e1510fbf', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:20:27 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-e3e5550f-c827-4d85-addf-cbfb0b6176e9 tempest-AttachVolumeTestJSON-139946988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df50ddbb-4328-4c7e-8919-905e57081d4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:20:27 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-e3e5550f-c827-4d85-addf-cbfb0b6176e9 tempest-AttachVolumeTestJSON-139946988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df50ddbb-4328-4c7e-8919-905e57081d4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:20:27 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-e3e5550f-c827-4d85-addf-cbfb0b6176e9 tempest-AttachVolumeTestJSON-139946988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7583ff7b-72d7-4550-a65e-ff2b123334da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:20:27 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-e3e5550f-c827-4d85-addf-cbfb0b6176e9 tempest-AttachVolumeTestJSON-139946988 None] Volume d0b81468-0f25-4c98-896d-5945e1510fbf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d0b81468-0f25-4c98-896d-5945e1510fbf', 'volume_size': 1} Aug 05 06:20:27 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-e3e5550f-c827-4d85-addf-cbfb0b6176e9 tempest-AttachVolumeTestJSON-139946988 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:20:28 devstack sudo[99397]: pam_unix(sudo:session): session closed for user root Aug 05 06:20:28 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-d71e7a1c-e16f-45e1-bc7b-f3acb4d2bb22 tempest-VolumesMetadataTest-326448313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-22fffec5-646f-437f-8079-dda8f06841cd 1073741824" returned: 0 in 0.497s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:20:28 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-d71e7a1c-e16f-45e1-bc7b-f3acb4d2bb22 tempest-VolumesMetadataTest-326448313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-22fffec5-646f-437f-8079-dda8f06841cd {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:20:28 devstack sudo[99404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-22fffec5-646f-437f-8079-dda8f06841cd Aug 05 06:20:28 devstack sudo[99404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:20:28 devstack sudo[99404]: pam_unix(sudo:session): session closed for user root Aug 05 06:20:28 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-d71e7a1c-e16f-45e1-bc7b-f3acb4d2bb22 tempest-VolumesMetadataTest-326448313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-22fffec5-646f-437f-8079-dda8f06841cd" returned: 0 in 0.290s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:20:28 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-d71e7a1c-e16f-45e1-bc7b-f3acb4d2bb22 tempest-VolumesMetadataTest-326448313 None] <== create_volume: return (829ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'} {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 06:20:28 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-d71e7a1c-e16f-45e1-bc7b-f3acb4d2bb22 tempest-VolumesMetadataTest-326448313 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.831s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:20:28 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-e3e5550f-c827-4d85-addf-cbfb0b6176e9 tempest-AttachVolumeTestJSON-139946988 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.587s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:20:28 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-e3e5550f-c827-4d85-addf-cbfb0b6176e9 tempest-AttachVolumeTestJSON-139946988 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:20:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-577889873',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0b81468-0f25-4c98-896d-5945e1510fbf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e536bd020a264041b6d2d86d08701cf6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:20:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:20:28Z,use_quota=True,user_id='4c2ed75d0ae44fd7bf0cb6098706f74f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)}" {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 06:20:28 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-e3e5550f-c827-4d85-addf-cbfb0b6176e9 tempest-AttachVolumeTestJSON-139946988 None] Creating volume d0b81468-0f25-4c98-896d-5945e1510fbf {{(pid=88695) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 06:20:28 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-e3e5550f-c827-4d85-addf-cbfb0b6176e9 tempest-AttachVolumeTestJSON-139946988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:20:28 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-e3e5550f-c827-4d85-addf-cbfb0b6176e9 tempest-AttachVolumeTestJSON-139946988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:20:28 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-e3e5550f-c827-4d85-addf-cbfb0b6176e9 tempest-AttachVolumeTestJSON-139946988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:20:28 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-e3e5550f-c827-4d85-addf-cbfb0b6176e9 tempest-AttachVolumeTestJSON-139946988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:20:28 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-e3e5550f-c827-4d85-addf-cbfb0b6176e9 tempest-AttachVolumeTestJSON-139946988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:20:28 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-e3e5550f-c827-4d85-addf-cbfb0b6176e9 tempest-AttachVolumeTestJSON-139946988 None] Selected osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 as target Quobyte volume. {{(pid=88695) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 06:20:28 devstack cinder-volume[88695]: INFO cinder.volume.drivers.remotefs [None req-e3e5550f-c827-4d85-addf-cbfb0b6176e9 tempest-AttachVolumeTestJSON-139946988 None] casted to osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 Aug 05 06:20:28 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-e3e5550f-c827-4d85-addf-cbfb0b6176e9 tempest-AttachVolumeTestJSON-139946988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-d0b81468-0f25-4c98-896d-5945e1510fbf 1073741824 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:20:28 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-d71e7a1c-e16f-45e1-bc7b-f3acb4d2bb22 tempest-VolumesMetadataTest-326448313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9c0a458-3814-42e0-bce0-6ee76e8a41a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-22fffec5-646f-437f-8079-dda8f06841cd', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:20:28 devstack sudo[99408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-d0b81468-0f25-4c98-896d-5945e1510fbf 1073741824 Aug 05 06:20:28 devstack sudo[99408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:20:28 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-d71e7a1c-e16f-45e1-bc7b-f3acb4d2bb22 tempest-VolumesMetadataTest-326448313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9eeea43c-ce4e-41dc-ab4a-e363cc73b02b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:20:28 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-d71e7a1c-e16f-45e1-bc7b-f3acb4d2bb22 tempest-VolumesMetadataTest-326448313 None] Volume volume-22fffec5-646f-437f-8079-dda8f06841cd (22fffec5-646f-437f-8079-dda8f06841cd): created successfully Aug 05 06:20:28 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-d71e7a1c-e16f-45e1-bc7b-f3acb4d2bb22 tempest-VolumesMetadataTest-326448313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9eeea43c-ce4e-41dc-ab4a-e363cc73b02b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:20:28 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-d71e7a1c-e16f-45e1-bc7b-f3acb4d2bb22 tempest-VolumesMetadataTest-326448313 None] Flow 'volume_create_manager' (738ebd70-98ec-4362-b83a-2547d60bbbdc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:20:28 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-d71e7a1c-e16f-45e1-bc7b-f3acb4d2bb22 tempest-VolumesMetadataTest-326448313 None] Created volume successfully. Aug 05 06:20:29 devstack sudo[99408]: pam_unix(sudo:session): session closed for user root Aug 05 06:20:29 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-e3e5550f-c827-4d85-addf-cbfb0b6176e9 tempest-AttachVolumeTestJSON-139946988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-d0b81468-0f25-4c98-896d-5945e1510fbf 1073741824" returned: 0 in 0.545s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:20:29 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-e3e5550f-c827-4d85-addf-cbfb0b6176e9 tempest-AttachVolumeTestJSON-139946988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-d0b81468-0f25-4c98-896d-5945e1510fbf {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:20:29 devstack sudo[99414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-d0b81468-0f25-4c98-896d-5945e1510fbf Aug 05 06:20:29 devstack sudo[99414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:20:29 devstack sudo[99414]: pam_unix(sudo:session): session closed for user root Aug 05 06:20:29 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-e3e5550f-c827-4d85-addf-cbfb0b6176e9 tempest-AttachVolumeTestJSON-139946988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-d0b81468-0f25-4c98-896d-5945e1510fbf" returned: 0 in 0.280s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:20:29 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-e3e5550f-c827-4d85-addf-cbfb0b6176e9 tempest-AttachVolumeTestJSON-139946988 None] <== create_volume: return (876ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'} {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 06:20:29 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-e3e5550f-c827-4d85-addf-cbfb0b6176e9 tempest-AttachVolumeTestJSON-139946988 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.881s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:20:29 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-e3e5550f-c827-4d85-addf-cbfb0b6176e9 tempest-AttachVolumeTestJSON-139946988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7583ff7b-72d7-4550-a65e-ff2b123334da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d0b81468-0f25-4c98-896d-5945e1510fbf', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:20:29 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-e3e5550f-c827-4d85-addf-cbfb0b6176e9 tempest-AttachVolumeTestJSON-139946988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af61bf8f-d6a2-4e03-a473-60ba893ff3d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:20:29 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-e3e5550f-c827-4d85-addf-cbfb0b6176e9 tempest-AttachVolumeTestJSON-139946988 None] Volume volume-d0b81468-0f25-4c98-896d-5945e1510fbf (d0b81468-0f25-4c98-896d-5945e1510fbf): created successfully Aug 05 06:20:29 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-e3e5550f-c827-4d85-addf-cbfb0b6176e9 tempest-AttachVolumeTestJSON-139946988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af61bf8f-d6a2-4e03-a473-60ba893ff3d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:20:29 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-e3e5550f-c827-4d85-addf-cbfb0b6176e9 tempest-AttachVolumeTestJSON-139946988 None] Flow 'volume_create_manager' (296fd34b-fb2a-4ea9-ae79-e36c2f646662) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:20:29 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-e3e5550f-c827-4d85-addf-cbfb0b6176e9 tempest-AttachVolumeTestJSON-139946988 None] Created volume successfully. Aug 05 06:20:30 devstack cinder-volume[88695]: INFO cinder.volume.manager [req-73392893-fbdb-4a76-af63-bf94a71f233f req-84cf35e3-ddf5-467a-b4f1-2d8b40af1b04 tempest-TestMinimumBasicScenario-688539206 None] Terminate volume connection completed successfully. Aug 05 06:20:30 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [req-73392893-fbdb-4a76-af63-bf94a71f233f req-84cf35e3-ddf5-467a-b4f1-2d8b40af1b04 tempest-TestMinimumBasicScenario-688539206 None] Deleting attachment 190bce3b-83e0-4e80-a93d-019e5289b489. {{(pid=88695) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 05 06:20:30 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-23822126-347a-4cac-9e0a-7351cb987e2e tempest-VolumesMetadataTest-326448313 None] Acquiring lock "cinder-22fffec5-646f-437f-8079-dda8f06841cd-delete_volume" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:20:30 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-23822126-347a-4cac-9e0a-7351cb987e2e tempest-VolumesMetadataTest-326448313 None] Lock "cinder-22fffec5-646f-437f-8079-dda8f06841cd-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:20:30 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-23822126-347a-4cac-9e0a-7351cb987e2e tempest-VolumesMetadataTest-326448313 None] Acquiring lock "cinder-quobyte-22fffec5-646f-437f-8079-dda8f06841cd" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:20:30 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-23822126-347a-4cac-9e0a-7351cb987e2e tempest-VolumesMetadataTest-326448313 None] Lock "cinder-quobyte-22fffec5-646f-437f-8079-dda8f06841cd" acquired by "delete_volume" :: waited 0.026s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:20:30 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a15017a-7461-4d7d-b6e7-e5668183f5be]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:20:30 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-23822126-347a-4cac-9e0a-7351cb987e2e tempest-VolumesMetadataTest-326448313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-22fffec5-646f-437f-8079-dda8f06841cd {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:20:30 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [req-01ef378b-be34-4b0e-ab8a-f3d439ddf6f6 req-978dbe74-ceb5-4f64-a3dd-480e6a676f24 tempest-AttachVolumeTestJSON-139946988 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:20:30 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [req-01ef378b-be34-4b0e-ab8a-f3d439ddf6f6 req-978dbe74-ceb5-4f64-a3dd-480e6a676f24 tempest-AttachVolumeTestJSON-139946988 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:20:30 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [req-01ef378b-be34-4b0e-ab8a-f3d439ddf6f6 req-978dbe74-ceb5-4f64-a3dd-480e6a676f24 tempest-AttachVolumeTestJSON-139946988 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:20:30 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [req-01ef378b-be34-4b0e-ab8a-f3d439ddf6f6 req-978dbe74-ceb5-4f64-a3dd-480e6a676f24 tempest-AttachVolumeTestJSON-139946988 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087', 'name': 'volume-d0b81468-0f25-4c98-896d-5945e1510fbf', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5842c58f-444b-4bc6-bef2-bb21898f8e84', 'enforce_multipath': True} {{(pid=88695) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 05 06:20:30 devstack sudo[99437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-22fffec5-646f-437f-8079-dda8f06841cd Aug 05 06:20:30 devstack sudo[99437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:20:31 devstack cinder-volume[88695]: INFO cinder.volume.manager [req-01ef378b-be34-4b0e-ab8a-f3d439ddf6f6 req-978dbe74-ceb5-4f64-a3dd-480e6a676f24 tempest-AttachVolumeTestJSON-139946988 None] attachment_update completed successfully. Aug 05 06:20:31 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-937f38c4-a0db-4277-b19a-19331caceec8 tempest-TestMinimumBasicScenario-688539206 None] Acquiring lock "cinder-31717a8d-e3b6-40cd-bc01-f48bff4e2e02-delete_volume" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:20:31 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-937f38c4-a0db-4277-b19a-19331caceec8 tempest-TestMinimumBasicScenario-688539206 None] Lock "cinder-31717a8d-e3b6-40cd-bc01-f48bff4e2e02-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:20:31 devstack sudo[99437]: pam_unix(sudo:session): session closed for user root Aug 05 06:20:31 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-937f38c4-a0db-4277-b19a-19331caceec8 tempest-TestMinimumBasicScenario-688539206 None] Acquiring lock "cinder-quobyte-31717a8d-e3b6-40cd-bc01-f48bff4e2e02" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:20:31 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-23822126-347a-4cac-9e0a-7351cb987e2e tempest-VolumesMetadataTest-326448313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-22fffec5-646f-437f-8079-dda8f06841cd" returned: 0 in 0.428s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:20:31 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-23822126-347a-4cac-9e0a-7351cb987e2e tempest-VolumesMetadataTest-326448313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-22fffec5-646f-437f-8079-dda8f06841cd {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:20:31 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-937f38c4-a0db-4277-b19a-19331caceec8 tempest-TestMinimumBasicScenario-688539206 None] Lock "cinder-quobyte-31717a8d-e3b6-40cd-bc01-f48bff4e2e02" acquired by "delete_volume" :: waited 0.030s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:20:31 devstack sudo[99506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-22fffec5-646f-437f-8079-dda8f06841cd Aug 05 06:20:31 devstack sudo[99506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:20:31 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aa99c88-b7c1-45a3-8a21-d5620cbc0774]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:20:31 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-937f38c4-a0db-4277-b19a-19331caceec8 tempest-TestMinimumBasicScenario-688539206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-31717a8d-e3b6-40cd-bc01-f48bff4e2e02 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:20:31 devstack sudo[99511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-31717a8d-e3b6-40cd-bc01-f48bff4e2e02 Aug 05 06:20:31 devstack sudo[99511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:20:31 devstack sudo[99506]: pam_unix(sudo:session): session closed for user root Aug 05 06:20:31 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-23822126-347a-4cac-9e0a-7351cb987e2e tempest-VolumesMetadataTest-326448313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-22fffec5-646f-437f-8079-dda8f06841cd" returned: 0 in 0.285s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:20:31 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-23822126-347a-4cac-9e0a-7351cb987e2e tempest-VolumesMetadataTest-326448313 None] Lock "cinder-quobyte-22fffec5-646f-437f-8079-dda8f06841cd" released by "delete_volume" :: held 0.761s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:20:31 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-23822126-347a-4cac-9e0a-7351cb987e2e tempest-VolumesMetadataTest-326448313 None] Created reservations ['f8753e8c-3997-49c8-844d-b1e7ced05261', 'b9b928bd-fadc-4b60-95f2-6e382260bcee', '66633494-4b38-455c-b8e8-1650c856cdf9', '3ed40908-c0d1-4a9a-8e8c-69d998896dd1'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:20:31 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-23822126-347a-4cac-9e0a-7351cb987e2e tempest-VolumesMetadataTest-326448313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:20:31 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-23822126-347a-4cac-9e0a-7351cb987e2e tempest-VolumesMetadataTest-326448313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:20:31 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-23822126-347a-4cac-9e0a-7351cb987e2e tempest-VolumesMetadataTest-326448313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:20:31 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-23822126-347a-4cac-9e0a-7351cb987e2e tempest-VolumesMetadataTest-326448313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:20:31 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-23822126-347a-4cac-9e0a-7351cb987e2e tempest-VolumesMetadataTest-326448313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:20:31 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-23822126-347a-4cac-9e0a-7351cb987e2e tempest-VolumesMetadataTest-326448313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:20:31 devstack sudo[99511]: pam_unix(sudo:session): session closed for user root Aug 05 06:20:31 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-937f38c4-a0db-4277-b19a-19331caceec8 tempest-TestMinimumBasicScenario-688539206 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-31717a8d-e3b6-40cd-bc01-f48bff4e2e02" returned: 0 in 0.424s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:20:31 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-937f38c4-a0db-4277-b19a-19331caceec8 tempest-TestMinimumBasicScenario-688539206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-31717a8d-e3b6-40cd-bc01-f48bff4e2e02 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:20:31 devstack sudo[99834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce Aug 05 06:20:31 devstack sudo[99834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:20:31 devstack sudo[99836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-31717a8d-e3b6-40cd-bc01-f48bff4e2e02 Aug 05 06:20:31 devstack sudo[99836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:20:32 devstack sudo[99836]: pam_unix(sudo:session): session closed for user root Aug 05 06:20:32 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-937f38c4-a0db-4277-b19a-19331caceec8 tempest-TestMinimumBasicScenario-688539206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-31717a8d-e3b6-40cd-bc01-f48bff4e2e02" returned: 0 in 0.331s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:20:32 devstack sudo[99834]: pam_unix(sudo:session): session closed for user root Aug 05 06:20:32 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-23822126-347a-4cac-9e0a-7351cb987e2e tempest-VolumesMetadataTest-326448313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce" returned: 0 in 0.373s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:20:32 devstack cinder-volume[88695]: DEBUG cinder.manager [None req-23822126-347a-4cac-9e0a-7351cb987e2e tempest-VolumesMetadataTest-326448313 None] Notifying Schedulers of capabilities ... {{(pid=88695) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 06:20:32 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-23822126-347a-4cac-9e0a-7351cb987e2e tempest-VolumesMetadataTest-326448313 None] Deleted volume successfully. Aug 05 06:20:32 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-937f38c4-a0db-4277-b19a-19331caceec8 tempest-TestMinimumBasicScenario-688539206 None] Lock "cinder-quobyte-31717a8d-e3b6-40cd-bc01-f48bff4e2e02" released by "delete_volume" :: held 0.830s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:20:32 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-23822126-347a-4cac-9e0a-7351cb987e2e tempest-VolumesMetadataTest-326448313 None] Lock "cinder-22fffec5-646f-437f-8079-dda8f06841cd-delete_volume" released by "delete_volume" :: held 1.416s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:20:32 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-937f38c4-a0db-4277-b19a-19331caceec8 tempest-TestMinimumBasicScenario-688539206 None] Created reservations ['44183464-ee1e-4e99-8bfb-5632ff7a392f', 'ef521642-b888-43af-b65c-2fa758aeda60', '97f4d0d2-b48f-4611-8147-b31f29920379', '27046abb-f52b-4c16-b3d3-9c6339bd6a4c'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:20:32 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-937f38c4-a0db-4277-b19a-19331caceec8 tempest-TestMinimumBasicScenario-688539206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:20:32 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-937f38c4-a0db-4277-b19a-19331caceec8 tempest-TestMinimumBasicScenario-688539206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:20:32 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-937f38c4-a0db-4277-b19a-19331caceec8 tempest-TestMinimumBasicScenario-688539206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:20:32 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-937f38c4-a0db-4277-b19a-19331caceec8 tempest-TestMinimumBasicScenario-688539206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:20:32 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-937f38c4-a0db-4277-b19a-19331caceec8 tempest-TestMinimumBasicScenario-688539206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:20:32 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-937f38c4-a0db-4277-b19a-19331caceec8 tempest-TestMinimumBasicScenario-688539206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:20:32 devstack sudo[99840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce Aug 05 06:20:32 devstack sudo[99840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:20:32 devstack sudo[99840]: pam_unix(sudo:session): session closed for user root Aug 05 06:20:32 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-937f38c4-a0db-4277-b19a-19331caceec8 tempest-TestMinimumBasicScenario-688539206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce" returned: 0 in 0.353s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:20:32 devstack cinder-volume[88695]: DEBUG cinder.manager [None req-937f38c4-a0db-4277-b19a-19331caceec8 tempest-TestMinimumBasicScenario-688539206 None] Notifying Schedulers of capabilities ... {{(pid=88695) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 06:20:32 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-937f38c4-a0db-4277-b19a-19331caceec8 tempest-TestMinimumBasicScenario-688539206 None] Deleted volume successfully. Aug 05 06:20:32 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-937f38c4-a0db-4277-b19a-19331caceec8 tempest-TestMinimumBasicScenario-688539206 None] Lock "cinder-31717a8d-e3b6-40cd-bc01-f48bff4e2e02-delete_volume" released by "delete_volume" :: held 1.461s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:20:33 devstack cinder-volume[88695]: DEBUG cinder.volume.flows.manager.create_volume [None req-64b6d1eb-4976-4a8c-bf14-8e44ecaa37ba tempest-AttachVolumeTestJSON-139946988 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88695) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 06:20:33 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-64b6d1eb-4976-4a8c-bf14-8e44ecaa37ba tempest-AttachVolumeTestJSON-139946988 None] Flow 'volume_create_manager' (98d3ba15-2ff2-425b-bc43-e55c48e5e438) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:20:33 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-64b6d1eb-4976-4a8c-bf14-8e44ecaa37ba tempest-AttachVolumeTestJSON-139946988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1606c3b-85fb-48cc-894f-132246e22763) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:20:33 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-64b6d1eb-4976-4a8c-bf14-8e44ecaa37ba tempest-AttachVolumeTestJSON-139946988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1606c3b-85fb-48cc-894f-132246e22763) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:20:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1797415183',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5236af9a-2031-474b-a8bd-9aa87db82a92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e536bd020a264041b6d2d86d08701cf6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:20:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:20:34Z,use_quota=True,user_id='4c2ed75d0ae44fd7bf0cb6098706f74f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:20:33 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-64b6d1eb-4976-4a8c-bf14-8e44ecaa37ba tempest-AttachVolumeTestJSON-139946988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ebe66ce-d8f4-4e21-9aa4-62a609d37348) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:20:33 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-64b6d1eb-4976-4a8c-bf14-8e44ecaa37ba tempest-AttachVolumeTestJSON-139946988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ebe66ce-d8f4-4e21-9aa4-62a609d37348) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:20:33 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-64b6d1eb-4976-4a8c-bf14-8e44ecaa37ba tempest-AttachVolumeTestJSON-139946988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d45116a9-ee26-4525-ac73-6b2018272805) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:20:33 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-64b6d1eb-4976-4a8c-bf14-8e44ecaa37ba tempest-AttachVolumeTestJSON-139946988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d45116a9-ee26-4525-ac73-6b2018272805) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5236af9a-2031-474b-a8bd-9aa87db82a92', 'volume_name': 'volume-5236af9a-2031-474b-a8bd-9aa87db82a92', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:20:33 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-64b6d1eb-4976-4a8c-bf14-8e44ecaa37ba tempest-AttachVolumeTestJSON-139946988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d7a0f2a-41ab-465b-b32e-f8814e757906) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:20:33 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-64b6d1eb-4976-4a8c-bf14-8e44ecaa37ba tempest-AttachVolumeTestJSON-139946988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d7a0f2a-41ab-465b-b32e-f8814e757906) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:20:33 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-64b6d1eb-4976-4a8c-bf14-8e44ecaa37ba tempest-AttachVolumeTestJSON-139946988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97fbddbb-f9b4-46d3-b0b1-c47168a8acaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:20:33 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-64b6d1eb-4976-4a8c-bf14-8e44ecaa37ba tempest-AttachVolumeTestJSON-139946988 None] Volume 5236af9a-2031-474b-a8bd-9aa87db82a92: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5236af9a-2031-474b-a8bd-9aa87db82a92', 'volume_size': 1} Aug 05 06:20:33 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-64b6d1eb-4976-4a8c-bf14-8e44ecaa37ba tempest-AttachVolumeTestJSON-139946988 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:20:33 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-64b6d1eb-4976-4a8c-bf14-8e44ecaa37ba tempest-AttachVolumeTestJSON-139946988 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:20:33 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-64b6d1eb-4976-4a8c-bf14-8e44ecaa37ba tempest-AttachVolumeTestJSON-139946988 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:20:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1797415183',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5236af9a-2031-474b-a8bd-9aa87db82a92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e536bd020a264041b6d2d86d08701cf6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:20:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:20:34Z,use_quota=True,user_id='4c2ed75d0ae44fd7bf0cb6098706f74f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)}" {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 06:20:33 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-64b6d1eb-4976-4a8c-bf14-8e44ecaa37ba tempest-AttachVolumeTestJSON-139946988 None] Creating volume 5236af9a-2031-474b-a8bd-9aa87db82a92 {{(pid=88695) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 06:20:33 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-64b6d1eb-4976-4a8c-bf14-8e44ecaa37ba tempest-AttachVolumeTestJSON-139946988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:20:33 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-64b6d1eb-4976-4a8c-bf14-8e44ecaa37ba tempest-AttachVolumeTestJSON-139946988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:20:33 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-64b6d1eb-4976-4a8c-bf14-8e44ecaa37ba tempest-AttachVolumeTestJSON-139946988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:20:33 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-64b6d1eb-4976-4a8c-bf14-8e44ecaa37ba tempest-AttachVolumeTestJSON-139946988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:20:33 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-64b6d1eb-4976-4a8c-bf14-8e44ecaa37ba tempest-AttachVolumeTestJSON-139946988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:20:33 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-64b6d1eb-4976-4a8c-bf14-8e44ecaa37ba tempest-AttachVolumeTestJSON-139946988 None] Selected osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 as target Quobyte volume. {{(pid=88695) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 06:20:33 devstack cinder-volume[88695]: INFO cinder.volume.drivers.remotefs [None req-64b6d1eb-4976-4a8c-bf14-8e44ecaa37ba tempest-AttachVolumeTestJSON-139946988 None] casted to osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 Aug 05 06:20:33 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-64b6d1eb-4976-4a8c-bf14-8e44ecaa37ba tempest-AttachVolumeTestJSON-139946988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-5236af9a-2031-474b-a8bd-9aa87db82a92 1073741824 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:20:33 devstack sudo[99867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-5236af9a-2031-474b-a8bd-9aa87db82a92 1073741824 Aug 05 06:20:33 devstack sudo[99867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:20:34 devstack sudo[99867]: pam_unix(sudo:session): session closed for user root Aug 05 06:20:34 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-64b6d1eb-4976-4a8c-bf14-8e44ecaa37ba tempest-AttachVolumeTestJSON-139946988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-5236af9a-2031-474b-a8bd-9aa87db82a92 1073741824" returned: 0 in 0.605s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:20:34 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-64b6d1eb-4976-4a8c-bf14-8e44ecaa37ba tempest-AttachVolumeTestJSON-139946988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-5236af9a-2031-474b-a8bd-9aa87db82a92 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:20:34 devstack sudo[99874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-5236af9a-2031-474b-a8bd-9aa87db82a92 Aug 05 06:20:34 devstack sudo[99874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:20:34 devstack sudo[99874]: pam_unix(sudo:session): session closed for user root Aug 05 06:20:34 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-64b6d1eb-4976-4a8c-bf14-8e44ecaa37ba tempest-AttachVolumeTestJSON-139946988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-5236af9a-2031-474b-a8bd-9aa87db82a92" returned: 0 in 0.333s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:20:34 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-64b6d1eb-4976-4a8c-bf14-8e44ecaa37ba tempest-AttachVolumeTestJSON-139946988 None] <== create_volume: return (1002ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'} {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 06:20:34 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-64b6d1eb-4976-4a8c-bf14-8e44ecaa37ba tempest-AttachVolumeTestJSON-139946988 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.005s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:20:34 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-64b6d1eb-4976-4a8c-bf14-8e44ecaa37ba tempest-AttachVolumeTestJSON-139946988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97fbddbb-f9b4-46d3-b0b1-c47168a8acaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5236af9a-2031-474b-a8bd-9aa87db82a92', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:20:34 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-64b6d1eb-4976-4a8c-bf14-8e44ecaa37ba tempest-AttachVolumeTestJSON-139946988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fdce99b-4477-43e3-b506-18a753226596) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:20:34 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-64b6d1eb-4976-4a8c-bf14-8e44ecaa37ba tempest-AttachVolumeTestJSON-139946988 None] Volume volume-5236af9a-2031-474b-a8bd-9aa87db82a92 (5236af9a-2031-474b-a8bd-9aa87db82a92): created successfully Aug 05 06:20:34 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-64b6d1eb-4976-4a8c-bf14-8e44ecaa37ba tempest-AttachVolumeTestJSON-139946988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fdce99b-4477-43e3-b506-18a753226596) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:20:34 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-64b6d1eb-4976-4a8c-bf14-8e44ecaa37ba tempest-AttachVolumeTestJSON-139946988 None] Flow 'volume_create_manager' (98d3ba15-2ff2-425b-bc43-e55c48e5e438) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:20:34 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-64b6d1eb-4976-4a8c-bf14-8e44ecaa37ba tempest-AttachVolumeTestJSON-139946988 None] Created volume successfully. Aug 05 06:20:36 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [req-be0fe59d-b7a5-4501-b10f-385ee8c53246 req-e3a5c165-0310-4894-a29a-ece1db80b9d2 tempest-AttachVolumeTestJSON-139946988 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:20:36 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [req-be0fe59d-b7a5-4501-b10f-385ee8c53246 req-e3a5c165-0310-4894-a29a-ece1db80b9d2 tempest-AttachVolumeTestJSON-139946988 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:20:36 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [req-be0fe59d-b7a5-4501-b10f-385ee8c53246 req-e3a5c165-0310-4894-a29a-ece1db80b9d2 tempest-AttachVolumeTestJSON-139946988 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:20:36 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [req-be0fe59d-b7a5-4501-b10f-385ee8c53246 req-e3a5c165-0310-4894-a29a-ece1db80b9d2 tempest-AttachVolumeTestJSON-139946988 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087', 'name': 'volume-5236af9a-2031-474b-a8bd-9aa87db82a92', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b01f3574-31a4-4605-94fb-15ff41149bed', 'enforce_multipath': True} {{(pid=88695) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 05 06:20:37 devstack cinder-volume[88695]: INFO cinder.volume.manager [req-be0fe59d-b7a5-4501-b10f-385ee8c53246 req-e3a5c165-0310-4894-a29a-ece1db80b9d2 tempest-AttachVolumeTestJSON-139946988 None] attachment_update completed successfully. Aug 05 06:20:37 devstack cinder-volume[88695]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e7b6488-a3f1-4031-9864-817657cc36c6 tempest-VolumesTransfersV357Test-533825683 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88695) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 06:20:37 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-6e7b6488-a3f1-4031-9864-817657cc36c6 tempest-VolumesTransfersV357Test-533825683 None] Flow 'volume_create_manager' (2e6bd116-aae3-46c5-8756-b09abe1276ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:20:37 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-6e7b6488-a3f1-4031-9864-817657cc36c6 tempest-VolumesTransfersV357Test-533825683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec8aa3b4-1ffd-4f71-b0fd-6027180ff2ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:20:37 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-6e7b6488-a3f1-4031-9864-817657cc36c6 tempest-VolumesTransfersV357Test-533825683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec8aa3b4-1ffd-4f71-b0fd-6027180ff2ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:20:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-876826168',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=382bae61-743d-457c-91f6-bad72384fb0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b1ca7fc76c748dab227423ea23e4742',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:20:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:20:38Z,use_quota=True,user_id='3590a7c702484f68861518a3b5c513aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:20:37 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-6e7b6488-a3f1-4031-9864-817657cc36c6 tempest-VolumesTransfersV357Test-533825683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45d752ab-fe77-4e7f-a5fd-2459a7eb29d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:20:37 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-6e7b6488-a3f1-4031-9864-817657cc36c6 tempest-VolumesTransfersV357Test-533825683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45d752ab-fe77-4e7f-a5fd-2459a7eb29d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:20:37 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-6e7b6488-a3f1-4031-9864-817657cc36c6 tempest-VolumesTransfersV357Test-533825683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6b4841c-bb0e-4e36-ae30-3adcbd5ec444) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:20:37 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-6e7b6488-a3f1-4031-9864-817657cc36c6 tempest-VolumesTransfersV357Test-533825683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6b4841c-bb0e-4e36-ae30-3adcbd5ec444) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '382bae61-743d-457c-91f6-bad72384fb0a', 'volume_name': 'volume-382bae61-743d-457c-91f6-bad72384fb0a', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:20:37 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-6e7b6488-a3f1-4031-9864-817657cc36c6 tempest-VolumesTransfersV357Test-533825683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (054d9527-40c5-4e02-afe6-b242caa5dbd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:20:37 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-6e7b6488-a3f1-4031-9864-817657cc36c6 tempest-VolumesTransfersV357Test-533825683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (054d9527-40c5-4e02-afe6-b242caa5dbd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:20:37 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-6e7b6488-a3f1-4031-9864-817657cc36c6 tempest-VolumesTransfersV357Test-533825683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64aa3cf9-ae33-49c8-bfe7-b7bb2deb870f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:20:37 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-6e7b6488-a3f1-4031-9864-817657cc36c6 tempest-VolumesTransfersV357Test-533825683 None] Volume 382bae61-743d-457c-91f6-bad72384fb0a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-382bae61-743d-457c-91f6-bad72384fb0a', 'volume_size': 1} Aug 05 06:20:37 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-6e7b6488-a3f1-4031-9864-817657cc36c6 tempest-VolumesTransfersV357Test-533825683 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:20:37 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-6e7b6488-a3f1-4031-9864-817657cc36c6 tempest-VolumesTransfersV357Test-533825683 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:20:37 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-6e7b6488-a3f1-4031-9864-817657cc36c6 tempest-VolumesTransfersV357Test-533825683 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:20:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-876826168',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=382bae61-743d-457c-91f6-bad72384fb0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b1ca7fc76c748dab227423ea23e4742',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:20:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:20:38Z,use_quota=True,user_id='3590a7c702484f68861518a3b5c513aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)}" {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 06:20:37 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-6e7b6488-a3f1-4031-9864-817657cc36c6 tempest-VolumesTransfersV357Test-533825683 None] Creating volume 382bae61-743d-457c-91f6-bad72384fb0a {{(pid=88695) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 06:20:37 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-6e7b6488-a3f1-4031-9864-817657cc36c6 tempest-VolumesTransfersV357Test-533825683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:20:37 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-6e7b6488-a3f1-4031-9864-817657cc36c6 tempest-VolumesTransfersV357Test-533825683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:20:37 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-6e7b6488-a3f1-4031-9864-817657cc36c6 tempest-VolumesTransfersV357Test-533825683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:20:37 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-6e7b6488-a3f1-4031-9864-817657cc36c6 tempest-VolumesTransfersV357Test-533825683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:20:37 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-6e7b6488-a3f1-4031-9864-817657cc36c6 tempest-VolumesTransfersV357Test-533825683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:20:37 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-6e7b6488-a3f1-4031-9864-817657cc36c6 tempest-VolumesTransfersV357Test-533825683 None] Selected osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 as target Quobyte volume. {{(pid=88695) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 06:20:37 devstack cinder-volume[88695]: INFO cinder.volume.drivers.remotefs [None req-6e7b6488-a3f1-4031-9864-817657cc36c6 tempest-VolumesTransfersV357Test-533825683 None] casted to osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 Aug 05 06:20:37 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-6e7b6488-a3f1-4031-9864-817657cc36c6 tempest-VolumesTransfersV357Test-533825683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-382bae61-743d-457c-91f6-bad72384fb0a 1073741824 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:20:37 devstack sudo[99932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-382bae61-743d-457c-91f6-bad72384fb0a 1073741824 Aug 05 06:20:37 devstack sudo[99932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:20:38 devstack sudo[99932]: pam_unix(sudo:session): session closed for user root Aug 05 06:20:38 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-6e7b6488-a3f1-4031-9864-817657cc36c6 tempest-VolumesTransfersV357Test-533825683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-382bae61-743d-457c-91f6-bad72384fb0a 1073741824" returned: 0 in 0.464s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:20:38 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-6e7b6488-a3f1-4031-9864-817657cc36c6 tempest-VolumesTransfersV357Test-533825683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-382bae61-743d-457c-91f6-bad72384fb0a {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:20:38 devstack sudo[99939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-382bae61-743d-457c-91f6-bad72384fb0a Aug 05 06:20:38 devstack sudo[99939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:20:38 devstack sudo[99939]: pam_unix(sudo:session): session closed for user root Aug 05 06:20:38 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-6e7b6488-a3f1-4031-9864-817657cc36c6 tempest-VolumesTransfersV357Test-533825683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-382bae61-743d-457c-91f6-bad72384fb0a" returned: 0 in 0.248s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:20:38 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-6e7b6488-a3f1-4031-9864-817657cc36c6 tempest-VolumesTransfersV357Test-533825683 None] <== create_volume: return (766ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'} {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 06:20:38 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-6e7b6488-a3f1-4031-9864-817657cc36c6 tempest-VolumesTransfersV357Test-533825683 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.769s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:20:38 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-6e7b6488-a3f1-4031-9864-817657cc36c6 tempest-VolumesTransfersV357Test-533825683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64aa3cf9-ae33-49c8-bfe7-b7bb2deb870f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-382bae61-743d-457c-91f6-bad72384fb0a', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:20:38 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-6e7b6488-a3f1-4031-9864-817657cc36c6 tempest-VolumesTransfersV357Test-533825683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (277ce17d-2e61-470c-8819-fbdcd3e35474) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:20:38 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-6e7b6488-a3f1-4031-9864-817657cc36c6 tempest-VolumesTransfersV357Test-533825683 None] Volume volume-382bae61-743d-457c-91f6-bad72384fb0a (382bae61-743d-457c-91f6-bad72384fb0a): created successfully Aug 05 06:20:38 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-6e7b6488-a3f1-4031-9864-817657cc36c6 tempest-VolumesTransfersV357Test-533825683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (277ce17d-2e61-470c-8819-fbdcd3e35474) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:20:38 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-6e7b6488-a3f1-4031-9864-817657cc36c6 tempest-VolumesTransfersV357Test-533825683 None] Flow 'volume_create_manager' (2e6bd116-aae3-46c5-8756-b09abe1276ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:20:38 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-6e7b6488-a3f1-4031-9864-817657cc36c6 tempest-VolumesTransfersV357Test-533825683 None] Created volume successfully. Aug 05 06:20:40 devstack cinder-volume[88695]: INFO cinder.volume.manager [req-a905a78f-4e6c-4765-bfa6-ecbbbf9be2ff req-3751938b-f02b-4fcc-8b19-e4bdb7eba652 tempest-AttachVolumeTestJSON-139946988 None] Terminate volume connection completed successfully. Aug 05 06:20:40 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [req-a905a78f-4e6c-4765-bfa6-ecbbbf9be2ff req-3751938b-f02b-4fcc-8b19-e4bdb7eba652 tempest-AttachVolumeTestJSON-139946988 None] Deleting attachment 5842c58f-444b-4bc6-bef2-bb21898f8e84. {{(pid=88695) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 05 06:20:40 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-432a393f-38ba-478c-baa3-47ef948865a1 tempest-VolumesTransfersV357Test-1780119008 None] Transfer volume completed successfully. Aug 05 06:20:41 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-48394d9f-5d31-4e0f-9a67-eee408e8a37b tempest-VolumesTransfersV357Test-392860291 None] Acquiring lock "cinder-382bae61-743d-457c-91f6-bad72384fb0a-delete_volume" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:20:41 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-48394d9f-5d31-4e0f-9a67-eee408e8a37b tempest-VolumesTransfersV357Test-392860291 None] Lock "cinder-382bae61-743d-457c-91f6-bad72384fb0a-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:20:41 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-48394d9f-5d31-4e0f-9a67-eee408e8a37b tempest-VolumesTransfersV357Test-392860291 None] Acquiring lock "cinder-quobyte-382bae61-743d-457c-91f6-bad72384fb0a" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:20:41 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-48394d9f-5d31-4e0f-9a67-eee408e8a37b tempest-VolumesTransfersV357Test-392860291 None] Lock "cinder-quobyte-382bae61-743d-457c-91f6-bad72384fb0a" acquired by "delete_volume" :: waited 0.026s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:20:41 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[802b3532-e317-4cd1-b7eb-b9dd8a9670fa]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:20:41 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-48394d9f-5d31-4e0f-9a67-eee408e8a37b tempest-VolumesTransfersV357Test-392860291 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-382bae61-743d-457c-91f6-bad72384fb0a {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:20:41 devstack sudo[99953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-382bae61-743d-457c-91f6-bad72384fb0a Aug 05 06:20:41 devstack sudo[99953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:20:41 devstack cinder-volume[88695]: INFO cinder.volume.manager [req-ec65f0a0-9f47-456d-a8d3-052bd7aafe4e req-2f88f4bb-bca7-43ee-b036-e7d96fc9a7a8 tempest-AttachVolumeTestJSON-139946988 None] Terminate volume connection completed successfully. Aug 05 06:20:41 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [req-ec65f0a0-9f47-456d-a8d3-052bd7aafe4e req-2f88f4bb-bca7-43ee-b036-e7d96fc9a7a8 tempest-AttachVolumeTestJSON-139946988 None] Deleting attachment b01f3574-31a4-4605-94fb-15ff41149bed. {{(pid=88695) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 05 06:20:41 devstack sudo[99953]: pam_unix(sudo:session): session closed for user root Aug 05 06:20:41 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-48394d9f-5d31-4e0f-9a67-eee408e8a37b tempest-VolumesTransfersV357Test-392860291 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-382bae61-743d-457c-91f6-bad72384fb0a" returned: 0 in 0.409s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:20:41 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-48394d9f-5d31-4e0f-9a67-eee408e8a37b tempest-VolumesTransfersV357Test-392860291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-382bae61-743d-457c-91f6-bad72384fb0a {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:20:41 devstack sudo[99987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-382bae61-743d-457c-91f6-bad72384fb0a Aug 05 06:20:41 devstack sudo[99987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:20:41 devstack sudo[99987]: pam_unix(sudo:session): session closed for user root Aug 05 06:20:41 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-48394d9f-5d31-4e0f-9a67-eee408e8a37b tempest-VolumesTransfersV357Test-392860291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-382bae61-743d-457c-91f6-bad72384fb0a" returned: 0 in 0.298s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:20:41 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-48394d9f-5d31-4e0f-9a67-eee408e8a37b tempest-VolumesTransfersV357Test-392860291 None] Lock "cinder-quobyte-382bae61-743d-457c-91f6-bad72384fb0a" released by "delete_volume" :: held 0.753s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:20:42 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-48394d9f-5d31-4e0f-9a67-eee408e8a37b tempest-VolumesTransfersV357Test-392860291 None] Created reservations ['d73b2b2d-cd65-454b-b706-d956785c907f', 'f591fef8-c02f-48d4-b5ef-c6a291aa7d3b', 'b5f13f1b-781e-4fc2-80a5-b5717eb8c6fd', 'ba882e58-f952-4093-8b49-c5bb619ddf0d'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:20:42 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-48394d9f-5d31-4e0f-9a67-eee408e8a37b tempest-VolumesTransfersV357Test-392860291 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:20:42 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-48394d9f-5d31-4e0f-9a67-eee408e8a37b tempest-VolumesTransfersV357Test-392860291 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:20:42 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-48394d9f-5d31-4e0f-9a67-eee408e8a37b tempest-VolumesTransfersV357Test-392860291 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:20:42 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-48394d9f-5d31-4e0f-9a67-eee408e8a37b tempest-VolumesTransfersV357Test-392860291 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:20:42 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-48394d9f-5d31-4e0f-9a67-eee408e8a37b tempest-VolumesTransfersV357Test-392860291 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:20:42 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-48394d9f-5d31-4e0f-9a67-eee408e8a37b tempest-VolumesTransfersV357Test-392860291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:20:42 devstack sudo[99990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce Aug 05 06:20:42 devstack sudo[99990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:20:42 devstack sudo[99990]: pam_unix(sudo:session): session closed for user root Aug 05 06:20:42 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-48394d9f-5d31-4e0f-9a67-eee408e8a37b tempest-VolumesTransfersV357Test-392860291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce" returned: 0 in 0.293s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:20:42 devstack cinder-volume[88695]: DEBUG cinder.manager [None req-48394d9f-5d31-4e0f-9a67-eee408e8a37b tempest-VolumesTransfersV357Test-392860291 None] Notifying Schedulers of capabilities ... {{(pid=88695) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 06:20:42 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-48394d9f-5d31-4e0f-9a67-eee408e8a37b tempest-VolumesTransfersV357Test-392860291 None] Deleted volume successfully. Aug 05 06:20:42 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-48394d9f-5d31-4e0f-9a67-eee408e8a37b tempest-VolumesTransfersV357Test-392860291 None] Lock "cinder-382bae61-743d-457c-91f6-bad72384fb0a-delete_volume" released by "delete_volume" :: held 1.329s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:20:43 devstack cinder-volume[88695]: DEBUG cinder.volume.flows.manager.create_volume [None req-e407076f-1991-44b8-b417-7c06f9cc33fb tempest-VolumesTransfersV357Test-533825683 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88695) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 06:20:43 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-e407076f-1991-44b8-b417-7c06f9cc33fb tempest-VolumesTransfersV357Test-533825683 None] Flow 'volume_create_manager' (c0505b0a-61a5-4afe-8ae2-1d13c46b91d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:20:43 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-e407076f-1991-44b8-b417-7c06f9cc33fb tempest-VolumesTransfersV357Test-533825683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5927f3ca-1a43-404b-9137-6e31a40addc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:20:43 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-e407076f-1991-44b8-b417-7c06f9cc33fb tempest-VolumesTransfersV357Test-533825683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5927f3ca-1a43-404b-9137-6e31a40addc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:20:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-119551707',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=276338e1-4e3e-44f0-8bed-41b6ca3c4509,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b1ca7fc76c748dab227423ea23e4742',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:20:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:20:43Z,use_quota=True,user_id='3590a7c702484f68861518a3b5c513aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:20:43 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-e407076f-1991-44b8-b417-7c06f9cc33fb tempest-VolumesTransfersV357Test-533825683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0c6a069-b0fb-40ea-9665-9975524f8c4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:20:43 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-e407076f-1991-44b8-b417-7c06f9cc33fb tempest-VolumesTransfersV357Test-533825683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0c6a069-b0fb-40ea-9665-9975524f8c4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:20:43 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-e407076f-1991-44b8-b417-7c06f9cc33fb tempest-VolumesTransfersV357Test-533825683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d4acf6f-5ba0-4910-b05a-080f99b96c73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:20:43 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-e407076f-1991-44b8-b417-7c06f9cc33fb tempest-VolumesTransfersV357Test-533825683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d4acf6f-5ba0-4910-b05a-080f99b96c73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '276338e1-4e3e-44f0-8bed-41b6ca3c4509', 'volume_name': 'volume-276338e1-4e3e-44f0-8bed-41b6ca3c4509', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:20:43 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-e407076f-1991-44b8-b417-7c06f9cc33fb tempest-VolumesTransfersV357Test-533825683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f060340-7463-4f70-96c0-9ec4d1524d79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:20:43 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-e407076f-1991-44b8-b417-7c06f9cc33fb tempest-VolumesTransfersV357Test-533825683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f060340-7463-4f70-96c0-9ec4d1524d79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:20:43 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-e407076f-1991-44b8-b417-7c06f9cc33fb tempest-VolumesTransfersV357Test-533825683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (300cc19f-44c3-4fc1-9daa-e5c4d812dfa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:20:43 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-e407076f-1991-44b8-b417-7c06f9cc33fb tempest-VolumesTransfersV357Test-533825683 None] Volume 276338e1-4e3e-44f0-8bed-41b6ca3c4509: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-276338e1-4e3e-44f0-8bed-41b6ca3c4509', 'volume_size': 1} Aug 05 06:20:43 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-e407076f-1991-44b8-b417-7c06f9cc33fb tempest-VolumesTransfersV357Test-533825683 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:20:43 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-e407076f-1991-44b8-b417-7c06f9cc33fb tempest-VolumesTransfersV357Test-533825683 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:20:43 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-e407076f-1991-44b8-b417-7c06f9cc33fb tempest-VolumesTransfersV357Test-533825683 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:20:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-119551707',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=276338e1-4e3e-44f0-8bed-41b6ca3c4509,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b1ca7fc76c748dab227423ea23e4742',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:20:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:20:43Z,use_quota=True,user_id='3590a7c702484f68861518a3b5c513aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)}" {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 06:20:43 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-e407076f-1991-44b8-b417-7c06f9cc33fb tempest-VolumesTransfersV357Test-533825683 None] Creating volume 276338e1-4e3e-44f0-8bed-41b6ca3c4509 {{(pid=88695) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 06:20:43 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-e407076f-1991-44b8-b417-7c06f9cc33fb tempest-VolumesTransfersV357Test-533825683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:20:43 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-e407076f-1991-44b8-b417-7c06f9cc33fb tempest-VolumesTransfersV357Test-533825683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:20:43 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-e407076f-1991-44b8-b417-7c06f9cc33fb tempest-VolumesTransfersV357Test-533825683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:20:43 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-e407076f-1991-44b8-b417-7c06f9cc33fb tempest-VolumesTransfersV357Test-533825683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:20:43 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-e407076f-1991-44b8-b417-7c06f9cc33fb tempest-VolumesTransfersV357Test-533825683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:20:43 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-e407076f-1991-44b8-b417-7c06f9cc33fb tempest-VolumesTransfersV357Test-533825683 None] Selected osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 as target Quobyte volume. {{(pid=88695) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 06:20:43 devstack cinder-volume[88695]: INFO cinder.volume.drivers.remotefs [None req-e407076f-1991-44b8-b417-7c06f9cc33fb tempest-VolumesTransfersV357Test-533825683 None] casted to osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 Aug 05 06:20:43 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-e407076f-1991-44b8-b417-7c06f9cc33fb tempest-VolumesTransfersV357Test-533825683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-276338e1-4e3e-44f0-8bed-41b6ca3c4509 1073741824 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:20:43 devstack sudo[99998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-276338e1-4e3e-44f0-8bed-41b6ca3c4509 1073741824 Aug 05 06:20:43 devstack sudo[99998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:20:43 devstack sudo[99998]: pam_unix(sudo:session): session closed for user root Aug 05 06:20:43 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-e407076f-1991-44b8-b417-7c06f9cc33fb tempest-VolumesTransfersV357Test-533825683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-276338e1-4e3e-44f0-8bed-41b6ca3c4509 1073741824" returned: 0 in 0.664s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:20:43 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-e407076f-1991-44b8-b417-7c06f9cc33fb tempest-VolumesTransfersV357Test-533825683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-276338e1-4e3e-44f0-8bed-41b6ca3c4509 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:20:43 devstack sudo[100024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-276338e1-4e3e-44f0-8bed-41b6ca3c4509 Aug 05 06:20:43 devstack sudo[100024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:20:44 devstack sudo[100024]: pam_unix(sudo:session): session closed for user root Aug 05 06:20:44 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-e407076f-1991-44b8-b417-7c06f9cc33fb tempest-VolumesTransfersV357Test-533825683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-276338e1-4e3e-44f0-8bed-41b6ca3c4509" returned: 0 in 0.328s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:20:44 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-e407076f-1991-44b8-b417-7c06f9cc33fb tempest-VolumesTransfersV357Test-533825683 None] <== create_volume: return (1047ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'} {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 06:20:44 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-e407076f-1991-44b8-b417-7c06f9cc33fb tempest-VolumesTransfersV357Test-533825683 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.053s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:20:44 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-e407076f-1991-44b8-b417-7c06f9cc33fb tempest-VolumesTransfersV357Test-533825683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (300cc19f-44c3-4fc1-9daa-e5c4d812dfa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-276338e1-4e3e-44f0-8bed-41b6ca3c4509', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:20:44 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-e407076f-1991-44b8-b417-7c06f9cc33fb tempest-VolumesTransfersV357Test-533825683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f642591-d763-4af3-8942-d96a5017d4ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:20:44 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-e407076f-1991-44b8-b417-7c06f9cc33fb tempest-VolumesTransfersV357Test-533825683 None] Volume volume-276338e1-4e3e-44f0-8bed-41b6ca3c4509 (276338e1-4e3e-44f0-8bed-41b6ca3c4509): created successfully Aug 05 06:20:44 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-e407076f-1991-44b8-b417-7c06f9cc33fb tempest-VolumesTransfersV357Test-533825683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f642591-d763-4af3-8942-d96a5017d4ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:20:44 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-e407076f-1991-44b8-b417-7c06f9cc33fb tempest-VolumesTransfersV357Test-533825683 None] Flow 'volume_create_manager' (c0505b0a-61a5-4afe-8ae2-1d13c46b91d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:20:44 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-e407076f-1991-44b8-b417-7c06f9cc33fb tempest-VolumesTransfersV357Test-533825683 None] Created volume successfully. Aug 05 06:20:45 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-7d349c9a-74e5-451c-8b49-a9fb3baa257d tempest-VolumesTransfersV357Test-392860291 None] Acquiring lock "cinder-276338e1-4e3e-44f0-8bed-41b6ca3c4509-delete_volume" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:20:45 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-7d349c9a-74e5-451c-8b49-a9fb3baa257d tempest-VolumesTransfersV357Test-392860291 None] Lock "cinder-276338e1-4e3e-44f0-8bed-41b6ca3c4509-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:20:45 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-7d349c9a-74e5-451c-8b49-a9fb3baa257d tempest-VolumesTransfersV357Test-392860291 None] Acquiring lock "cinder-quobyte-276338e1-4e3e-44f0-8bed-41b6ca3c4509" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:20:45 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-7d349c9a-74e5-451c-8b49-a9fb3baa257d tempest-VolumesTransfersV357Test-392860291 None] Lock "cinder-quobyte-276338e1-4e3e-44f0-8bed-41b6ca3c4509" acquired by "delete_volume" :: waited 0.019s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:20:45 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6c8ea3f-0cc1-46db-b83d-afe051aff368]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:20:45 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-7d349c9a-74e5-451c-8b49-a9fb3baa257d tempest-VolumesTransfersV357Test-392860291 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-276338e1-4e3e-44f0-8bed-41b6ca3c4509 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:20:45 devstack sudo[100030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-276338e1-4e3e-44f0-8bed-41b6ca3c4509 Aug 05 06:20:45 devstack sudo[100030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:20:46 devstack sudo[100030]: pam_unix(sudo:session): session closed for user root Aug 05 06:20:46 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-7d349c9a-74e5-451c-8b49-a9fb3baa257d tempest-VolumesTransfersV357Test-392860291 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-276338e1-4e3e-44f0-8bed-41b6ca3c4509" returned: 0 in 0.499s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:20:46 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-7d349c9a-74e5-451c-8b49-a9fb3baa257d tempest-VolumesTransfersV357Test-392860291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-276338e1-4e3e-44f0-8bed-41b6ca3c4509 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:20:46 devstack sudo[100036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-276338e1-4e3e-44f0-8bed-41b6ca3c4509 Aug 05 06:20:46 devstack sudo[100036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:20:46 devstack sudo[100036]: pam_unix(sudo:session): session closed for user root Aug 05 06:20:46 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-7d349c9a-74e5-451c-8b49-a9fb3baa257d tempest-VolumesTransfersV357Test-392860291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-276338e1-4e3e-44f0-8bed-41b6ca3c4509" returned: 0 in 0.290s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:20:46 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-7d349c9a-74e5-451c-8b49-a9fb3baa257d tempest-VolumesTransfersV357Test-392860291 None] Lock "cinder-quobyte-276338e1-4e3e-44f0-8bed-41b6ca3c4509" released by "delete_volume" :: held 0.837s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:20:46 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-7d349c9a-74e5-451c-8b49-a9fb3baa257d tempest-VolumesTransfersV357Test-392860291 None] Created reservations ['cb171848-c98d-4862-9606-2f7e388ff36c', 'e8de70e7-e048-46ae-9a9a-6c78c1a39a8e', '47f0b71d-4ea0-44ef-a7ce-4cbe302f27a6', 'f9d9b924-5413-4fd1-bd77-896eef11abe9'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:20:46 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-7d349c9a-74e5-451c-8b49-a9fb3baa257d tempest-VolumesTransfersV357Test-392860291 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:20:46 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-7d349c9a-74e5-451c-8b49-a9fb3baa257d tempest-VolumesTransfersV357Test-392860291 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:20:46 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-7d349c9a-74e5-451c-8b49-a9fb3baa257d tempest-VolumesTransfersV357Test-392860291 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:20:46 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-7d349c9a-74e5-451c-8b49-a9fb3baa257d tempest-VolumesTransfersV357Test-392860291 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:20:46 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-7d349c9a-74e5-451c-8b49-a9fb3baa257d tempest-VolumesTransfersV357Test-392860291 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:20:46 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-7d349c9a-74e5-451c-8b49-a9fb3baa257d tempest-VolumesTransfersV357Test-392860291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:20:46 devstack sudo[100039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce Aug 05 06:20:46 devstack sudo[100039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:20:46 devstack sudo[100039]: pam_unix(sudo:session): session closed for user root Aug 05 06:20:46 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-7d349c9a-74e5-451c-8b49-a9fb3baa257d tempest-VolumesTransfersV357Test-392860291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce" returned: 0 in 0.264s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:20:46 devstack cinder-volume[88695]: DEBUG cinder.manager [None req-7d349c9a-74e5-451c-8b49-a9fb3baa257d tempest-VolumesTransfersV357Test-392860291 None] Notifying Schedulers of capabilities ... {{(pid=88695) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 06:20:46 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-7d349c9a-74e5-451c-8b49-a9fb3baa257d tempest-VolumesTransfersV357Test-392860291 None] Deleted volume successfully. Aug 05 06:20:46 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-7d349c9a-74e5-451c-8b49-a9fb3baa257d tempest-VolumesTransfersV357Test-392860291 None] Lock "cinder-276338e1-4e3e-44f0-8bed-41b6ca3c4509-delete_volume" released by "delete_volume" :: held 1.369s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:20:48 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-767f3cf2-cd0c-435b-9827-d6eb51b7314e tempest-AttachVolumeTestJSON-139946988 None] Acquiring lock "cinder-5236af9a-2031-474b-a8bd-9aa87db82a92-delete_volume" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:20:48 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-767f3cf2-cd0c-435b-9827-d6eb51b7314e tempest-AttachVolumeTestJSON-139946988 None] Lock "cinder-5236af9a-2031-474b-a8bd-9aa87db82a92-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:20:48 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-767f3cf2-cd0c-435b-9827-d6eb51b7314e tempest-AttachVolumeTestJSON-139946988 None] Acquiring lock "cinder-quobyte-5236af9a-2031-474b-a8bd-9aa87db82a92" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:20:48 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-767f3cf2-cd0c-435b-9827-d6eb51b7314e tempest-AttachVolumeTestJSON-139946988 None] Lock "cinder-quobyte-5236af9a-2031-474b-a8bd-9aa87db82a92" acquired by "delete_volume" :: waited 0.025s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:20:48 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d37fac3-2600-446d-96d2-18182eacad9a]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:20:48 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-767f3cf2-cd0c-435b-9827-d6eb51b7314e tempest-AttachVolumeTestJSON-139946988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-5236af9a-2031-474b-a8bd-9aa87db82a92 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:20:48 devstack sudo[100043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-5236af9a-2031-474b-a8bd-9aa87db82a92 Aug 05 06:20:48 devstack sudo[100043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:20:48 devstack sudo[100043]: pam_unix(sudo:session): session closed for user root Aug 05 06:20:48 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-767f3cf2-cd0c-435b-9827-d6eb51b7314e tempest-AttachVolumeTestJSON-139946988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-5236af9a-2031-474b-a8bd-9aa87db82a92" returned: 0 in 0.430s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:20:48 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-767f3cf2-cd0c-435b-9827-d6eb51b7314e tempest-AttachVolumeTestJSON-139946988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-5236af9a-2031-474b-a8bd-9aa87db82a92 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:20:48 devstack sudo[100048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-5236af9a-2031-474b-a8bd-9aa87db82a92 Aug 05 06:20:48 devstack sudo[100048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:20:49 devstack sudo[100048]: pam_unix(sudo:session): session closed for user root Aug 05 06:20:49 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-767f3cf2-cd0c-435b-9827-d6eb51b7314e tempest-AttachVolumeTestJSON-139946988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-5236af9a-2031-474b-a8bd-9aa87db82a92" returned: 0 in 0.307s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:20:49 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-767f3cf2-cd0c-435b-9827-d6eb51b7314e tempest-AttachVolumeTestJSON-139946988 None] Lock "cinder-quobyte-5236af9a-2031-474b-a8bd-9aa87db82a92" released by "delete_volume" :: held 0.793s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:20:49 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-767f3cf2-cd0c-435b-9827-d6eb51b7314e tempest-AttachVolumeTestJSON-139946988 None] Created reservations ['7db9872c-cc25-4fc6-b8d7-594fe9840679', '6f434a47-5646-4ea7-b329-808cffa40223', '9fd02286-f976-4a0a-84d5-60a442994636', '195804aa-4b41-455e-bc24-4166ea79d567'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:20:49 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-767f3cf2-cd0c-435b-9827-d6eb51b7314e tempest-AttachVolumeTestJSON-139946988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:20:49 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-767f3cf2-cd0c-435b-9827-d6eb51b7314e tempest-AttachVolumeTestJSON-139946988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:20:49 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-767f3cf2-cd0c-435b-9827-d6eb51b7314e tempest-AttachVolumeTestJSON-139946988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:20:49 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-767f3cf2-cd0c-435b-9827-d6eb51b7314e tempest-AttachVolumeTestJSON-139946988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:20:49 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-767f3cf2-cd0c-435b-9827-d6eb51b7314e tempest-AttachVolumeTestJSON-139946988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:20:49 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-767f3cf2-cd0c-435b-9827-d6eb51b7314e tempest-AttachVolumeTestJSON-139946988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:20:49 devstack sudo[100051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce Aug 05 06:20:49 devstack sudo[100051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:20:49 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-1d803622-f4f0-4e4c-ab0b-e7a92a87bef8 tempest-AttachVolumeTestJSON-139946988 None] Acquiring lock "cinder-d0b81468-0f25-4c98-896d-5945e1510fbf-delete_volume" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:20:49 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-1d803622-f4f0-4e4c-ab0b-e7a92a87bef8 tempest-AttachVolumeTestJSON-139946988 None] Lock "cinder-d0b81468-0f25-4c98-896d-5945e1510fbf-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:20:49 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-1d803622-f4f0-4e4c-ab0b-e7a92a87bef8 tempest-AttachVolumeTestJSON-139946988 None] Acquiring lock "cinder-quobyte-d0b81468-0f25-4c98-896d-5945e1510fbf" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:20:49 devstack sudo[100051]: pam_unix(sudo:session): session closed for user root Aug 05 06:20:49 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-1d803622-f4f0-4e4c-ab0b-e7a92a87bef8 tempest-AttachVolumeTestJSON-139946988 None] Lock "cinder-quobyte-d0b81468-0f25-4c98-896d-5945e1510fbf" acquired by "delete_volume" :: waited 0.048s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:20:49 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-767f3cf2-cd0c-435b-9827-d6eb51b7314e tempest-AttachVolumeTestJSON-139946988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce" returned: 0 in 0.375s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:20:49 devstack cinder-volume[88695]: DEBUG cinder.manager [None req-767f3cf2-cd0c-435b-9827-d6eb51b7314e tempest-AttachVolumeTestJSON-139946988 None] Notifying Schedulers of capabilities ... {{(pid=88695) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 06:20:49 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[98f15b9e-e836-4270-94d0-75ec830a28e4]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:20:49 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-1d803622-f4f0-4e4c-ab0b-e7a92a87bef8 tempest-AttachVolumeTestJSON-139946988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-d0b81468-0f25-4c98-896d-5945e1510fbf {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:20:49 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-767f3cf2-cd0c-435b-9827-d6eb51b7314e tempest-AttachVolumeTestJSON-139946988 None] Deleted volume successfully. Aug 05 06:20:49 devstack cinder-volume[88695]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd875a17-e92f-4055-8090-1679b7aa099f tempest-CreateVolumesFromImageTest-1734190764 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88695) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 06:20:49 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-cd875a17-e92f-4055-8090-1679b7aa099f tempest-CreateVolumesFromImageTest-1734190764 None] Flow 'volume_create_manager' (fff12b86-2941-4a88-90e4-5e28bf3d84f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:20:49 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-cd875a17-e92f-4055-8090-1679b7aa099f tempest-CreateVolumesFromImageTest-1734190764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (197ee042-4807-47a8-9d2d-66671509129c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:20:49 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-cd875a17-e92f-4055-8090-1679b7aa099f tempest-CreateVolumesFromImageTest-1734190764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (197ee042-4807-47a8-9d2d-66671509129c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:20:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1785983674',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3132cfe-94d2-4581-b6bd-71c3e6946311,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3b3778c923b4731a28dd286f7366a56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:20:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:20:50Z,use_quota=True,user_id='6ce2520e8cf84f9bb30708ffd6eed641',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:20:49 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-cd875a17-e92f-4055-8090-1679b7aa099f tempest-CreateVolumesFromImageTest-1734190764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d583ba1f-2c1b-4554-838e-5a8462b37002) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:20:49 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-cd875a17-e92f-4055-8090-1679b7aa099f tempest-CreateVolumesFromImageTest-1734190764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d583ba1f-2c1b-4554-838e-5a8462b37002) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:20:49 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-cd875a17-e92f-4055-8090-1679b7aa099f tempest-CreateVolumesFromImageTest-1734190764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca4039e3-aa23-41e4-a3de-203c5bf8e433) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:20:49 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-cd875a17-e92f-4055-8090-1679b7aa099f tempest-CreateVolumesFromImageTest-1734190764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca4039e3-aa23-41e4-a3de-203c5bf8e433) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b3132cfe-94d2-4581-b6bd-71c3e6946311', 'volume_name': 'volume-b3132cfe-94d2-4581-b6bd-71c3e6946311', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:20:49 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-cd875a17-e92f-4055-8090-1679b7aa099f tempest-CreateVolumesFromImageTest-1734190764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a70039fe-b702-4fb8-8813-b02bc8145eec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:20:49 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-cd875a17-e92f-4055-8090-1679b7aa099f tempest-CreateVolumesFromImageTest-1734190764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a70039fe-b702-4fb8-8813-b02bc8145eec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:20:49 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-cd875a17-e92f-4055-8090-1679b7aa099f tempest-CreateVolumesFromImageTest-1734190764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6367ca9a-f548-485f-8964-00c36c98ff0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:20:49 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-cd875a17-e92f-4055-8090-1679b7aa099f tempest-CreateVolumesFromImageTest-1734190764 None] Volume b3132cfe-94d2-4581-b6bd-71c3e6946311: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b3132cfe-94d2-4581-b6bd-71c3e6946311', 'volume_size': 1} Aug 05 06:20:49 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-cd875a17-e92f-4055-8090-1679b7aa099f tempest-CreateVolumesFromImageTest-1734190764 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:20:49 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-cd875a17-e92f-4055-8090-1679b7aa099f tempest-CreateVolumesFromImageTest-1734190764 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:20:49 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-cd875a17-e92f-4055-8090-1679b7aa099f tempest-CreateVolumesFromImageTest-1734190764 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:20:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1785983674',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3132cfe-94d2-4581-b6bd-71c3e6946311,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3b3778c923b4731a28dd286f7366a56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:20:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:20:50Z,use_quota=True,user_id='6ce2520e8cf84f9bb30708ffd6eed641',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)}" {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 06:20:49 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-cd875a17-e92f-4055-8090-1679b7aa099f tempest-CreateVolumesFromImageTest-1734190764 None] Creating volume b3132cfe-94d2-4581-b6bd-71c3e6946311 {{(pid=88695) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 06:20:49 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-cd875a17-e92f-4055-8090-1679b7aa099f tempest-CreateVolumesFromImageTest-1734190764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:20:49 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-cd875a17-e92f-4055-8090-1679b7aa099f tempest-CreateVolumesFromImageTest-1734190764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:20:49 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-cd875a17-e92f-4055-8090-1679b7aa099f tempest-CreateVolumesFromImageTest-1734190764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:20:49 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-cd875a17-e92f-4055-8090-1679b7aa099f tempest-CreateVolumesFromImageTest-1734190764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:20:49 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-cd875a17-e92f-4055-8090-1679b7aa099f tempest-CreateVolumesFromImageTest-1734190764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:20:49 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-cd875a17-e92f-4055-8090-1679b7aa099f tempest-CreateVolumesFromImageTest-1734190764 None] Selected osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 as target Quobyte volume. {{(pid=88695) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 06:20:49 devstack cinder-volume[88695]: INFO cinder.volume.drivers.remotefs [None req-cd875a17-e92f-4055-8090-1679b7aa099f tempest-CreateVolumesFromImageTest-1734190764 None] casted to osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 Aug 05 06:20:49 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-cd875a17-e92f-4055-8090-1679b7aa099f tempest-CreateVolumesFromImageTest-1734190764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-b3132cfe-94d2-4581-b6bd-71c3e6946311 1073741824 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:20:49 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-767f3cf2-cd0c-435b-9827-d6eb51b7314e tempest-AttachVolumeTestJSON-139946988 None] Lock "cinder-5236af9a-2031-474b-a8bd-9aa87db82a92-delete_volume" released by "delete_volume" :: held 1.605s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:20:49 devstack sudo[100055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-b3132cfe-94d2-4581-b6bd-71c3e6946311 1073741824 Aug 05 06:20:49 devstack sudo[100055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:20:49 devstack sudo[100054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-d0b81468-0f25-4c98-896d-5945e1510fbf Aug 05 06:20:49 devstack sudo[100054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:20:50 devstack cinder-volume[88695]: DEBUG cinder.volume.flows.manager.create_volume [None req-16622c6e-d0f4-452f-8439-afc3d75124b7 tempest-CreateVolumesFromImageTest-1734190764 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88695) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 06:20:50 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-16622c6e-d0f4-452f-8439-afc3d75124b7 tempest-CreateVolumesFromImageTest-1734190764 None] Flow 'volume_create_manager' (e398075c-302c-4eb5-8e17-bb23d43c8034) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:20:50 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-16622c6e-d0f4-452f-8439-afc3d75124b7 tempest-CreateVolumesFromImageTest-1734190764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a3b9d57-d199-40cd-afed-4ec65fdecf74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:20:50 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-16622c6e-d0f4-452f-8439-afc3d75124b7 tempest-CreateVolumesFromImageTest-1734190764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a3b9d57-d199-40cd-afed-4ec65fdecf74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:20:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-670479145',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50130fb4-38a1-477c-bb31-921736e3dd1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3b3778c923b4731a28dd286f7366a56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:20:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:20:50Z,use_quota=True,user_id='6ce2520e8cf84f9bb30708ffd6eed641',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:20:50 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-16622c6e-d0f4-452f-8439-afc3d75124b7 tempest-CreateVolumesFromImageTest-1734190764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5a607d2-37ff-4150-b64d-58a95b9247d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:20:50 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-16622c6e-d0f4-452f-8439-afc3d75124b7 tempest-CreateVolumesFromImageTest-1734190764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5a607d2-37ff-4150-b64d-58a95b9247d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:20:50 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-16622c6e-d0f4-452f-8439-afc3d75124b7 tempest-CreateVolumesFromImageTest-1734190764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba46f881-81b9-48b3-8818-4ebbe63bf845) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:20:50 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-16622c6e-d0f4-452f-8439-afc3d75124b7 tempest-CreateVolumesFromImageTest-1734190764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba46f881-81b9-48b3-8818-4ebbe63bf845) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '50130fb4-38a1-477c-bb31-921736e3dd1c', 'volume_name': 'volume-50130fb4-38a1-477c-bb31-921736e3dd1c', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:20:50 devstack sudo[100054]: pam_unix(sudo:session): session closed for user root Aug 05 06:20:50 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-16622c6e-d0f4-452f-8439-afc3d75124b7 tempest-CreateVolumesFromImageTest-1734190764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (069e0cd0-a762-4dae-96fc-fd617c290fa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:20:50 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-16622c6e-d0f4-452f-8439-afc3d75124b7 tempest-CreateVolumesFromImageTest-1734190764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (069e0cd0-a762-4dae-96fc-fd617c290fa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:20:50 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-16622c6e-d0f4-452f-8439-afc3d75124b7 tempest-CreateVolumesFromImageTest-1734190764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76a4d34b-3a3d-46a7-a7fe-d001c29b3413) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:20:50 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-16622c6e-d0f4-452f-8439-afc3d75124b7 tempest-CreateVolumesFromImageTest-1734190764 None] Volume 50130fb4-38a1-477c-bb31-921736e3dd1c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-50130fb4-38a1-477c-bb31-921736e3dd1c', 'volume_size': 1} Aug 05 06:20:50 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-16622c6e-d0f4-452f-8439-afc3d75124b7 tempest-CreateVolumesFromImageTest-1734190764 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:20:50 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-1d803622-f4f0-4e4c-ab0b-e7a92a87bef8 tempest-AttachVolumeTestJSON-139946988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-d0b81468-0f25-4c98-896d-5945e1510fbf" returned: 0 in 0.585s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:20:50 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-1d803622-f4f0-4e4c-ab0b-e7a92a87bef8 tempest-AttachVolumeTestJSON-139946988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-d0b81468-0f25-4c98-896d-5945e1510fbf {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:20:50 devstack sudo[100065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-d0b81468-0f25-4c98-896d-5945e1510fbf Aug 05 06:20:50 devstack sudo[100065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:20:50 devstack sudo[100055]: pam_unix(sudo:session): session closed for user root Aug 05 06:20:50 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-cd875a17-e92f-4055-8090-1679b7aa099f tempest-CreateVolumesFromImageTest-1734190764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-b3132cfe-94d2-4581-b6bd-71c3e6946311 1073741824" returned: 0 in 0.599s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:20:50 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-cd875a17-e92f-4055-8090-1679b7aa099f tempest-CreateVolumesFromImageTest-1734190764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-b3132cfe-94d2-4581-b6bd-71c3e6946311 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:20:50 devstack sudo[100071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-b3132cfe-94d2-4581-b6bd-71c3e6946311 Aug 05 06:20:50 devstack sudo[100071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:20:50 devstack sudo[100065]: pam_unix(sudo:session): session closed for user root Aug 05 06:20:50 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-1d803622-f4f0-4e4c-ab0b-e7a92a87bef8 tempest-AttachVolumeTestJSON-139946988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-d0b81468-0f25-4c98-896d-5945e1510fbf" returned: 0 in 0.355s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:20:50 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-1d803622-f4f0-4e4c-ab0b-e7a92a87bef8 tempest-AttachVolumeTestJSON-139946988 None] Lock "cinder-quobyte-d0b81468-0f25-4c98-896d-5945e1510fbf" released by "delete_volume" :: held 1.005s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:20:50 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-1d803622-f4f0-4e4c-ab0b-e7a92a87bef8 tempest-AttachVolumeTestJSON-139946988 None] Created reservations ['c3be801a-966c-448f-9446-86f7bfd12715', 'ede8126a-9fb8-4bb7-99f1-fa487750bfe1', 'bfe1bec7-a67a-4c85-9265-733864c7bc22', 'a3bf095a-0c91-4d7f-8b3e-fe1029112661'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:20:50 devstack cinder-volume[88695]: DEBUG cinder.volume.flows.manager.create_volume [None req-55731027-599a-4383-9e09-808faacbcf9a tempest-CreateVolumesFromImageTest-1734190764 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88695) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 06:20:50 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-55731027-599a-4383-9e09-808faacbcf9a tempest-CreateVolumesFromImageTest-1734190764 None] Flow 'volume_create_manager' (73931005-4fc3-465a-9d84-237df074d396) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:20:50 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-55731027-599a-4383-9e09-808faacbcf9a tempest-CreateVolumesFromImageTest-1734190764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f14d505-beb5-4da2-a13a-c7e82e5548f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:20:50 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-55731027-599a-4383-9e09-808faacbcf9a tempest-CreateVolumesFromImageTest-1734190764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f14d505-beb5-4da2-a13a-c7e82e5548f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:20:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1311990997',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74166b52-dcfc-4ea8-901a-b680ddc746df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3b3778c923b4731a28dd286f7366a56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:20:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:20:51Z,use_quota=True,user_id='6ce2520e8cf84f9bb30708ffd6eed641',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:20:50 devstack sudo[100071]: pam_unix(sudo:session): session closed for user root Aug 05 06:20:50 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-55731027-599a-4383-9e09-808faacbcf9a tempest-CreateVolumesFromImageTest-1734190764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1b07287-28ed-45be-9383-a3b5f5023b88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:20:50 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-55731027-599a-4383-9e09-808faacbcf9a tempest-CreateVolumesFromImageTest-1734190764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1b07287-28ed-45be-9383-a3b5f5023b88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:20:50 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-55731027-599a-4383-9e09-808faacbcf9a tempest-CreateVolumesFromImageTest-1734190764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bf3c3c6-e848-4101-8c45-7fc35db94b6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:20:50 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-55731027-599a-4383-9e09-808faacbcf9a tempest-CreateVolumesFromImageTest-1734190764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bf3c3c6-e848-4101-8c45-7fc35db94b6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '74166b52-dcfc-4ea8-901a-b680ddc746df', 'volume_name': 'volume-74166b52-dcfc-4ea8-901a-b680ddc746df', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:20:50 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-55731027-599a-4383-9e09-808faacbcf9a tempest-CreateVolumesFromImageTest-1734190764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd22bb12-37df-4408-8ffb-350893673f09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:20:50 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-55731027-599a-4383-9e09-808faacbcf9a tempest-CreateVolumesFromImageTest-1734190764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd22bb12-37df-4408-8ffb-350893673f09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:20:50 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-55731027-599a-4383-9e09-808faacbcf9a tempest-CreateVolumesFromImageTest-1734190764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a0c822b-9a49-4dc0-a3ab-2ae020c5064e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:20:50 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-55731027-599a-4383-9e09-808faacbcf9a tempest-CreateVolumesFromImageTest-1734190764 None] Volume 74166b52-dcfc-4ea8-901a-b680ddc746df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-74166b52-dcfc-4ea8-901a-b680ddc746df', 'volume_size': 1} Aug 05 06:20:50 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-55731027-599a-4383-9e09-808faacbcf9a tempest-CreateVolumesFromImageTest-1734190764 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:20:50 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-cd875a17-e92f-4055-8090-1679b7aa099f tempest-CreateVolumesFromImageTest-1734190764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-b3132cfe-94d2-4581-b6bd-71c3e6946311" returned: 0 in 0.435s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:20:50 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-cd875a17-e92f-4055-8090-1679b7aa099f tempest-CreateVolumesFromImageTest-1734190764 None] <== create_volume: return (1131ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'} {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 06:20:50 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-cd875a17-e92f-4055-8090-1679b7aa099f tempest-CreateVolumesFromImageTest-1734190764 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.138s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:20:51 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-16622c6e-d0f4-452f-8439-afc3d75124b7 tempest-CreateVolumesFromImageTest-1734190764 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.706s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:20:51 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-16622c6e-d0f4-452f-8439-afc3d75124b7 tempest-CreateVolumesFromImageTest-1734190764 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:20:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-670479145',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50130fb4-38a1-477c-bb31-921736e3dd1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3b3778c923b4731a28dd286f7366a56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:20:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:20:50Z,use_quota=True,user_id='6ce2520e8cf84f9bb30708ffd6eed641',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)}" {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 06:20:51 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-16622c6e-d0f4-452f-8439-afc3d75124b7 tempest-CreateVolumesFromImageTest-1734190764 None] Creating volume 50130fb4-38a1-477c-bb31-921736e3dd1c {{(pid=88695) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 06:20:51 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-16622c6e-d0f4-452f-8439-afc3d75124b7 tempest-CreateVolumesFromImageTest-1734190764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:20:51 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-16622c6e-d0f4-452f-8439-afc3d75124b7 tempest-CreateVolumesFromImageTest-1734190764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:20:51 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-16622c6e-d0f4-452f-8439-afc3d75124b7 tempest-CreateVolumesFromImageTest-1734190764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:20:51 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-16622c6e-d0f4-452f-8439-afc3d75124b7 tempest-CreateVolumesFromImageTest-1734190764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:20:51 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-16622c6e-d0f4-452f-8439-afc3d75124b7 tempest-CreateVolumesFromImageTest-1734190764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:20:51 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-16622c6e-d0f4-452f-8439-afc3d75124b7 tempest-CreateVolumesFromImageTest-1734190764 None] Selected osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 as target Quobyte volume. {{(pid=88695) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 06:20:51 devstack cinder-volume[88695]: INFO cinder.volume.drivers.remotefs [None req-16622c6e-d0f4-452f-8439-afc3d75124b7 tempest-CreateVolumesFromImageTest-1734190764 None] casted to osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 Aug 05 06:20:51 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-16622c6e-d0f4-452f-8439-afc3d75124b7 tempest-CreateVolumesFromImageTest-1734190764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-50130fb4-38a1-477c-bb31-921736e3dd1c 1073741824 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:20:51 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-cd875a17-e92f-4055-8090-1679b7aa099f tempest-CreateVolumesFromImageTest-1734190764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6367ca9a-f548-485f-8964-00c36c98ff0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3132cfe-94d2-4581-b6bd-71c3e6946311', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:20:51 devstack sudo[100078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-50130fb4-38a1-477c-bb31-921736e3dd1c 1073741824 Aug 05 06:20:51 devstack sudo[100078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:20:51 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-cd875a17-e92f-4055-8090-1679b7aa099f tempest-CreateVolumesFromImageTest-1734190764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0bab4d6c-a024-4a2b-82fc-36881e09f4a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:20:51 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-cd875a17-e92f-4055-8090-1679b7aa099f tempest-CreateVolumesFromImageTest-1734190764 None] Volume volume-b3132cfe-94d2-4581-b6bd-71c3e6946311 (b3132cfe-94d2-4581-b6bd-71c3e6946311): created successfully Aug 05 06:20:51 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-cd875a17-e92f-4055-8090-1679b7aa099f tempest-CreateVolumesFromImageTest-1734190764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0bab4d6c-a024-4a2b-82fc-36881e09f4a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:20:51 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-cd875a17-e92f-4055-8090-1679b7aa099f tempest-CreateVolumesFromImageTest-1734190764 None] Flow 'volume_create_manager' (fff12b86-2941-4a88-90e4-5e28bf3d84f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:20:51 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-cd875a17-e92f-4055-8090-1679b7aa099f tempest-CreateVolumesFromImageTest-1734190764 None] Created volume successfully. Aug 05 06:20:51 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-1d803622-f4f0-4e4c-ab0b-e7a92a87bef8 tempest-AttachVolumeTestJSON-139946988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:20:51 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-1d803622-f4f0-4e4c-ab0b-e7a92a87bef8 tempest-AttachVolumeTestJSON-139946988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:20:51 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-1d803622-f4f0-4e4c-ab0b-e7a92a87bef8 tempest-AttachVolumeTestJSON-139946988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:20:51 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-1d803622-f4f0-4e4c-ab0b-e7a92a87bef8 tempest-AttachVolumeTestJSON-139946988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:20:51 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-1d803622-f4f0-4e4c-ab0b-e7a92a87bef8 tempest-AttachVolumeTestJSON-139946988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:20:51 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-1d803622-f4f0-4e4c-ab0b-e7a92a87bef8 tempest-AttachVolumeTestJSON-139946988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:20:51 devstack sudo[100080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce Aug 05 06:20:51 devstack sudo[100080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:20:51 devstack cinder-volume[88695]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ec7f6b5-b178-4ee9-bd28-f5d4c0aea4b5 tempest-CreateVolumesFromImageTest-1734190764 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88695) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 06:20:51 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-1ec7f6b5-b178-4ee9-bd28-f5d4c0aea4b5 tempest-CreateVolumesFromImageTest-1734190764 None] Flow 'volume_create_manager' (2a65abfa-c544-4687-8ed6-44d2585049b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:20:51 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-1ec7f6b5-b178-4ee9-bd28-f5d4c0aea4b5 tempest-CreateVolumesFromImageTest-1734190764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c3f3258-ac79-435a-989b-e495af027e70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:20:51 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-1ec7f6b5-b178-4ee9-bd28-f5d4c0aea4b5 tempest-CreateVolumesFromImageTest-1734190764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c3f3258-ac79-435a-989b-e495af027e70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:20:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-850079437',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83da6a18-b1cb-4df4-bc71-2ebf31b13473,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3b3778c923b4731a28dd286f7366a56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:20:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:20:51Z,use_quota=True,user_id='6ce2520e8cf84f9bb30708ffd6eed641',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:20:51 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-1ec7f6b5-b178-4ee9-bd28-f5d4c0aea4b5 tempest-CreateVolumesFromImageTest-1734190764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9d1a9bd-2052-4036-962a-c82a786951e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:20:51 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-1ec7f6b5-b178-4ee9-bd28-f5d4c0aea4b5 tempest-CreateVolumesFromImageTest-1734190764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9d1a9bd-2052-4036-962a-c82a786951e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:20:51 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-1ec7f6b5-b178-4ee9-bd28-f5d4c0aea4b5 tempest-CreateVolumesFromImageTest-1734190764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ebedf25-de20-49b4-b605-bf08ce592385) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:20:51 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-1ec7f6b5-b178-4ee9-bd28-f5d4c0aea4b5 tempest-CreateVolumesFromImageTest-1734190764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ebedf25-de20-49b4-b605-bf08ce592385) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '83da6a18-b1cb-4df4-bc71-2ebf31b13473', 'volume_name': 'volume-83da6a18-b1cb-4df4-bc71-2ebf31b13473', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:20:51 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-1ec7f6b5-b178-4ee9-bd28-f5d4c0aea4b5 tempest-CreateVolumesFromImageTest-1734190764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7ce610c-fee0-4b62-8719-fac8829b0151) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:20:51 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-1ec7f6b5-b178-4ee9-bd28-f5d4c0aea4b5 tempest-CreateVolumesFromImageTest-1734190764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7ce610c-fee0-4b62-8719-fac8829b0151) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:20:51 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-1ec7f6b5-b178-4ee9-bd28-f5d4c0aea4b5 tempest-CreateVolumesFromImageTest-1734190764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (251c6718-9578-41d0-b81d-e32db063d649) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:20:51 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-1ec7f6b5-b178-4ee9-bd28-f5d4c0aea4b5 tempest-CreateVolumesFromImageTest-1734190764 None] Volume 83da6a18-b1cb-4df4-bc71-2ebf31b13473: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-83da6a18-b1cb-4df4-bc71-2ebf31b13473', 'volume_size': 1} Aug 05 06:20:51 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-1ec7f6b5-b178-4ee9-bd28-f5d4c0aea4b5 tempest-CreateVolumesFromImageTest-1734190764 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:20:51 devstack sudo[100080]: pam_unix(sudo:session): session closed for user root Aug 05 06:20:51 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-1d803622-f4f0-4e4c-ab0b-e7a92a87bef8 tempest-AttachVolumeTestJSON-139946988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce" returned: 0 in 0.426s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:20:51 devstack cinder-volume[88695]: DEBUG cinder.manager [None req-1d803622-f4f0-4e4c-ab0b-e7a92a87bef8 tempest-AttachVolumeTestJSON-139946988 None] Notifying Schedulers of capabilities ... {{(pid=88695) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 06:20:51 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-1d803622-f4f0-4e4c-ab0b-e7a92a87bef8 tempest-AttachVolumeTestJSON-139946988 None] Deleted volume successfully. Aug 05 06:20:51 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-1d803622-f4f0-4e4c-ab0b-e7a92a87bef8 tempest-AttachVolumeTestJSON-139946988 None] Lock "cinder-d0b81468-0f25-4c98-896d-5945e1510fbf-delete_volume" released by "delete_volume" :: held 2.071s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:20:51 devstack sudo[100078]: pam_unix(sudo:session): session closed for user root Aug 05 06:20:51 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-16622c6e-d0f4-452f-8439-afc3d75124b7 tempest-CreateVolumesFromImageTest-1734190764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-50130fb4-38a1-477c-bb31-921736e3dd1c 1073741824" returned: 0 in 0.627s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:20:51 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-16622c6e-d0f4-452f-8439-afc3d75124b7 tempest-CreateVolumesFromImageTest-1734190764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-50130fb4-38a1-477c-bb31-921736e3dd1c {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:20:51 devstack sudo[100087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-50130fb4-38a1-477c-bb31-921736e3dd1c Aug 05 06:20:51 devstack sudo[100087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:20:51 devstack cinder-volume[88695]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0fd97e0-3e55-4178-87dd-fc69bbf651fe tempest-CreateVolumesFromImageTest-1734190764 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88695) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 06:20:51 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-d0fd97e0-3e55-4178-87dd-fc69bbf651fe tempest-CreateVolumesFromImageTest-1734190764 None] Flow 'volume_create_manager' (1a4b94d8-4b26-457c-9fb9-b2ee150f05b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:20:51 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-d0fd97e0-3e55-4178-87dd-fc69bbf651fe tempest-CreateVolumesFromImageTest-1734190764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c474a739-1a51-4773-bf5a-642b3a9c341c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:20:51 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-d0fd97e0-3e55-4178-87dd-fc69bbf651fe tempest-CreateVolumesFromImageTest-1734190764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c474a739-1a51-4773-bf5a-642b3a9c341c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:20:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-93536853',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4cfc0d4f-5d35-4f77-b8b3-c2e8aba2c2ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3b3778c923b4731a28dd286f7366a56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:20:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:20:52Z,use_quota=True,user_id='6ce2520e8cf84f9bb30708ffd6eed641',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:20:51 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-d0fd97e0-3e55-4178-87dd-fc69bbf651fe tempest-CreateVolumesFromImageTest-1734190764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (711f6d0b-dd42-4252-bfa5-4e0ed52075be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:20:51 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-d0fd97e0-3e55-4178-87dd-fc69bbf651fe tempest-CreateVolumesFromImageTest-1734190764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (711f6d0b-dd42-4252-bfa5-4e0ed52075be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:20:51 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-d0fd97e0-3e55-4178-87dd-fc69bbf651fe tempest-CreateVolumesFromImageTest-1734190764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d84db189-fcbc-4bff-96d6-a6bda89d8e11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:20:51 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-d0fd97e0-3e55-4178-87dd-fc69bbf651fe tempest-CreateVolumesFromImageTest-1734190764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d84db189-fcbc-4bff-96d6-a6bda89d8e11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4cfc0d4f-5d35-4f77-b8b3-c2e8aba2c2ba', 'volume_name': 'volume-4cfc0d4f-5d35-4f77-b8b3-c2e8aba2c2ba', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:20:51 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-d0fd97e0-3e55-4178-87dd-fc69bbf651fe tempest-CreateVolumesFromImageTest-1734190764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0728746b-3693-4784-ba7f-e96fe5c98309) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:20:51 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-d0fd97e0-3e55-4178-87dd-fc69bbf651fe tempest-CreateVolumesFromImageTest-1734190764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0728746b-3693-4784-ba7f-e96fe5c98309) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:20:51 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-d0fd97e0-3e55-4178-87dd-fc69bbf651fe tempest-CreateVolumesFromImageTest-1734190764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (489bafe0-4118-4754-b1e9-6ef8521fd8cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:20:51 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-d0fd97e0-3e55-4178-87dd-fc69bbf651fe tempest-CreateVolumesFromImageTest-1734190764 None] Volume 4cfc0d4f-5d35-4f77-b8b3-c2e8aba2c2ba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4cfc0d4f-5d35-4f77-b8b3-c2e8aba2c2ba', 'volume_size': 1} Aug 05 06:20:51 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-d0fd97e0-3e55-4178-87dd-fc69bbf651fe tempest-CreateVolumesFromImageTest-1734190764 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:20:52 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-1f45e716-9327-49b2-8d89-c64ebdb83b6a tempest-AttachVolumeTestJSON-139946988 None] Acquiring lock "cinder-27eca293-8612-4cf4-8a80-c64442697811-delete_volume" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:20:52 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-1f45e716-9327-49b2-8d89-c64ebdb83b6a tempest-AttachVolumeTestJSON-139946988 None] Lock "cinder-27eca293-8612-4cf4-8a80-c64442697811-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:20:52 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-1f45e716-9327-49b2-8d89-c64ebdb83b6a tempest-AttachVolumeTestJSON-139946988 None] Acquiring lock "cinder-quobyte-27eca293-8612-4cf4-8a80-c64442697811" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:20:52 devstack sudo[100087]: pam_unix(sudo:session): session closed for user root Aug 05 06:20:52 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-16622c6e-d0f4-452f-8439-afc3d75124b7 tempest-CreateVolumesFromImageTest-1734190764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-50130fb4-38a1-477c-bb31-921736e3dd1c" returned: 0 in 0.398s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:20:52 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-16622c6e-d0f4-452f-8439-afc3d75124b7 tempest-CreateVolumesFromImageTest-1734190764 None] <== create_volume: return (1095ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'} {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 06:20:52 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-16622c6e-d0f4-452f-8439-afc3d75124b7 tempest-CreateVolumesFromImageTest-1734190764 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.102s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:20:52 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-55731027-599a-4383-9e09-808faacbcf9a tempest-CreateVolumesFromImageTest-1734190764 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.126s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:20:52 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-55731027-599a-4383-9e09-808faacbcf9a tempest-CreateVolumesFromImageTest-1734190764 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:20:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1311990997',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74166b52-dcfc-4ea8-901a-b680ddc746df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3b3778c923b4731a28dd286f7366a56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:20:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:20:51Z,use_quota=True,user_id='6ce2520e8cf84f9bb30708ffd6eed641',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)}" {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 06:20:52 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-55731027-599a-4383-9e09-808faacbcf9a tempest-CreateVolumesFromImageTest-1734190764 None] Creating volume 74166b52-dcfc-4ea8-901a-b680ddc746df {{(pid=88695) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 06:20:52 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-55731027-599a-4383-9e09-808faacbcf9a tempest-CreateVolumesFromImageTest-1734190764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:20:52 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-55731027-599a-4383-9e09-808faacbcf9a tempest-CreateVolumesFromImageTest-1734190764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:20:52 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-55731027-599a-4383-9e09-808faacbcf9a tempest-CreateVolumesFromImageTest-1734190764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:20:52 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-55731027-599a-4383-9e09-808faacbcf9a tempest-CreateVolumesFromImageTest-1734190764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:20:52 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-55731027-599a-4383-9e09-808faacbcf9a tempest-CreateVolumesFromImageTest-1734190764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:20:52 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-55731027-599a-4383-9e09-808faacbcf9a tempest-CreateVolumesFromImageTest-1734190764 None] Selected osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 as target Quobyte volume. {{(pid=88695) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 06:20:52 devstack cinder-volume[88695]: INFO cinder.volume.drivers.remotefs [None req-55731027-599a-4383-9e09-808faacbcf9a tempest-CreateVolumesFromImageTest-1734190764 None] casted to osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 Aug 05 06:20:52 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-55731027-599a-4383-9e09-808faacbcf9a tempest-CreateVolumesFromImageTest-1734190764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-74166b52-dcfc-4ea8-901a-b680ddc746df 1073741824 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:20:52 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-16622c6e-d0f4-452f-8439-afc3d75124b7 tempest-CreateVolumesFromImageTest-1734190764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76a4d34b-3a3d-46a7-a7fe-d001c29b3413) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50130fb4-38a1-477c-bb31-921736e3dd1c', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:20:52 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-16622c6e-d0f4-452f-8439-afc3d75124b7 tempest-CreateVolumesFromImageTest-1734190764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db4405db-fb39-4a13-b2b3-20b04a6f84c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:20:52 devstack sudo[100090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-74166b52-dcfc-4ea8-901a-b680ddc746df 1073741824 Aug 05 06:20:52 devstack sudo[100090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:20:52 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-1f45e716-9327-49b2-8d89-c64ebdb83b6a tempest-AttachVolumeTestJSON-139946988 None] Lock "cinder-quobyte-27eca293-8612-4cf4-8a80-c64442697811" acquired by "delete_volume" :: waited 0.056s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:20:52 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-16622c6e-d0f4-452f-8439-afc3d75124b7 tempest-CreateVolumesFromImageTest-1734190764 None] Volume volume-50130fb4-38a1-477c-bb31-921736e3dd1c (50130fb4-38a1-477c-bb31-921736e3dd1c): created successfully Aug 05 06:20:52 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-16622c6e-d0f4-452f-8439-afc3d75124b7 tempest-CreateVolumesFromImageTest-1734190764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db4405db-fb39-4a13-b2b3-20b04a6f84c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:20:52 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-16622c6e-d0f4-452f-8439-afc3d75124b7 tempest-CreateVolumesFromImageTest-1734190764 None] Flow 'volume_create_manager' (e398075c-302c-4eb5-8e17-bb23d43c8034) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:20:52 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1d3e064-f9c9-44ac-8b1a-786da3d93a90]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:20:52 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-1f45e716-9327-49b2-8d89-c64ebdb83b6a tempest-AttachVolumeTestJSON-139946988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-27eca293-8612-4cf4-8a80-c64442697811 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:20:52 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-16622c6e-d0f4-452f-8439-afc3d75124b7 tempest-CreateVolumesFromImageTest-1734190764 None] Created volume successfully. Aug 05 06:20:52 devstack sudo[100092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-27eca293-8612-4cf4-8a80-c64442697811 Aug 05 06:20:52 devstack sudo[100092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:20:52 devstack sudo[100092]: pam_unix(sudo:session): session closed for user root Aug 05 06:20:52 devstack sudo[100090]: pam_unix(sudo:session): session closed for user root Aug 05 06:20:52 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-55731027-599a-4383-9e09-808faacbcf9a tempest-CreateVolumesFromImageTest-1734190764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-74166b52-dcfc-4ea8-901a-b680ddc746df 1073741824" returned: 0 in 0.513s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:20:52 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-1f45e716-9327-49b2-8d89-c64ebdb83b6a tempest-AttachVolumeTestJSON-139946988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-27eca293-8612-4cf4-8a80-c64442697811" returned: 0 in 0.444s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:20:52 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-1f45e716-9327-49b2-8d89-c64ebdb83b6a tempest-AttachVolumeTestJSON-139946988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-27eca293-8612-4cf4-8a80-c64442697811 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:20:52 devstack sudo[100101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-27eca293-8612-4cf4-8a80-c64442697811 Aug 05 06:20:52 devstack sudo[100101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:20:52 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-55731027-599a-4383-9e09-808faacbcf9a tempest-CreateVolumesFromImageTest-1734190764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-74166b52-dcfc-4ea8-901a-b680ddc746df {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:20:52 devstack sudo[100103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-74166b52-dcfc-4ea8-901a-b680ddc746df Aug 05 06:20:52 devstack sudo[100103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:20:52 devstack sudo[100101]: pam_unix(sudo:session): session closed for user root Aug 05 06:20:52 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-1f45e716-9327-49b2-8d89-c64ebdb83b6a tempest-AttachVolumeTestJSON-139946988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-27eca293-8612-4cf4-8a80-c64442697811" returned: 0 in 0.287s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:20:52 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-1f45e716-9327-49b2-8d89-c64ebdb83b6a tempest-AttachVolumeTestJSON-139946988 None] Lock "cinder-quobyte-27eca293-8612-4cf4-8a80-c64442697811" released by "delete_volume" :: held 0.791s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:20:52 devstack sudo[100103]: pam_unix(sudo:session): session closed for user root Aug 05 06:20:52 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-55731027-599a-4383-9e09-808faacbcf9a tempest-CreateVolumesFromImageTest-1734190764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-74166b52-dcfc-4ea8-901a-b680ddc746df" returned: 0 in 0.291s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:20:52 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-55731027-599a-4383-9e09-808faacbcf9a tempest-CreateVolumesFromImageTest-1734190764 None] <== create_volume: return (878ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'} {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 06:20:52 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-55731027-599a-4383-9e09-808faacbcf9a tempest-CreateVolumesFromImageTest-1734190764 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.880s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:20:52 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-1ec7f6b5-b178-4ee9-bd28-f5d4c0aea4b5 tempest-CreateVolumesFromImageTest-1734190764 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.513s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:20:52 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-1ec7f6b5-b178-4ee9-bd28-f5d4c0aea4b5 tempest-CreateVolumesFromImageTest-1734190764 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:20:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-850079437',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83da6a18-b1cb-4df4-bc71-2ebf31b13473,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3b3778c923b4731a28dd286f7366a56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:20:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:20:51Z,use_quota=True,user_id='6ce2520e8cf84f9bb30708ffd6eed641',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)}" {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 06:20:52 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-1ec7f6b5-b178-4ee9-bd28-f5d4c0aea4b5 tempest-CreateVolumesFromImageTest-1734190764 None] Creating volume 83da6a18-b1cb-4df4-bc71-2ebf31b13473 {{(pid=88695) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 06:20:53 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-1ec7f6b5-b178-4ee9-bd28-f5d4c0aea4b5 tempest-CreateVolumesFromImageTest-1734190764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:20:53 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-1ec7f6b5-b178-4ee9-bd28-f5d4c0aea4b5 tempest-CreateVolumesFromImageTest-1734190764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:20:53 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-1ec7f6b5-b178-4ee9-bd28-f5d4c0aea4b5 tempest-CreateVolumesFromImageTest-1734190764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:20:53 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-1ec7f6b5-b178-4ee9-bd28-f5d4c0aea4b5 tempest-CreateVolumesFromImageTest-1734190764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:20:53 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-1ec7f6b5-b178-4ee9-bd28-f5d4c0aea4b5 tempest-CreateVolumesFromImageTest-1734190764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:20:53 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-1ec7f6b5-b178-4ee9-bd28-f5d4c0aea4b5 tempest-CreateVolumesFromImageTest-1734190764 None] Selected osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 as target Quobyte volume. {{(pid=88695) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 06:20:53 devstack cinder-volume[88695]: INFO cinder.volume.drivers.remotefs [None req-1ec7f6b5-b178-4ee9-bd28-f5d4c0aea4b5 tempest-CreateVolumesFromImageTest-1734190764 None] casted to osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 Aug 05 06:20:53 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-1ec7f6b5-b178-4ee9-bd28-f5d4c0aea4b5 tempest-CreateVolumesFromImageTest-1734190764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-83da6a18-b1cb-4df4-bc71-2ebf31b13473 1073741824 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:20:53 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-55731027-599a-4383-9e09-808faacbcf9a tempest-CreateVolumesFromImageTest-1734190764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a0c822b-9a49-4dc0-a3ab-2ae020c5064e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-74166b52-dcfc-4ea8-901a-b680ddc746df', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:20:53 devstack sudo[100107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-83da6a18-b1cb-4df4-bc71-2ebf31b13473 1073741824 Aug 05 06:20:53 devstack sudo[100107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:20:53 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-55731027-599a-4383-9e09-808faacbcf9a tempest-CreateVolumesFromImageTest-1734190764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (254026d1-75af-4830-856c-3f23e2f236f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:20:53 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-55731027-599a-4383-9e09-808faacbcf9a tempest-CreateVolumesFromImageTest-1734190764 None] Volume volume-74166b52-dcfc-4ea8-901a-b680ddc746df (74166b52-dcfc-4ea8-901a-b680ddc746df): created successfully Aug 05 06:20:53 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-55731027-599a-4383-9e09-808faacbcf9a tempest-CreateVolumesFromImageTest-1734190764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (254026d1-75af-4830-856c-3f23e2f236f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:20:53 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-55731027-599a-4383-9e09-808faacbcf9a tempest-CreateVolumesFromImageTest-1734190764 None] Flow 'volume_create_manager' (73931005-4fc3-465a-9d84-237df074d396) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:20:53 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-1f45e716-9327-49b2-8d89-c64ebdb83b6a tempest-AttachVolumeTestJSON-139946988 None] Created reservations ['97dd5cf0-6ac2-4775-bd71-79761f7ecef8', 'aac92ddd-ea80-44c4-8119-c8538c4886d8', 'e2693a77-3984-44be-9254-0ca404eb9d31', 'eed3f181-e26d-4f0a-af78-aacf9685fd4b'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:20:53 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-55731027-599a-4383-9e09-808faacbcf9a tempest-CreateVolumesFromImageTest-1734190764 None] Created volume successfully. Aug 05 06:20:53 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-1f45e716-9327-49b2-8d89-c64ebdb83b6a tempest-AttachVolumeTestJSON-139946988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:20:53 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-1f45e716-9327-49b2-8d89-c64ebdb83b6a tempest-AttachVolumeTestJSON-139946988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:20:53 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-1f45e716-9327-49b2-8d89-c64ebdb83b6a tempest-AttachVolumeTestJSON-139946988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:20:53 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-1f45e716-9327-49b2-8d89-c64ebdb83b6a tempest-AttachVolumeTestJSON-139946988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:20:53 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-1f45e716-9327-49b2-8d89-c64ebdb83b6a tempest-AttachVolumeTestJSON-139946988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:20:53 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-1f45e716-9327-49b2-8d89-c64ebdb83b6a tempest-AttachVolumeTestJSON-139946988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:20:53 devstack sudo[100109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce Aug 05 06:20:53 devstack sudo[100109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:20:53 devstack sudo[100109]: pam_unix(sudo:session): session closed for user root Aug 05 06:20:53 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-1f45e716-9327-49b2-8d89-c64ebdb83b6a tempest-AttachVolumeTestJSON-139946988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce" returned: 0 in 0.295s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:20:53 devstack cinder-volume[88695]: DEBUG cinder.manager [None req-1f45e716-9327-49b2-8d89-c64ebdb83b6a tempest-AttachVolumeTestJSON-139946988 None] Notifying Schedulers of capabilities ... {{(pid=88695) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 06:20:53 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-1f45e716-9327-49b2-8d89-c64ebdb83b6a tempest-AttachVolumeTestJSON-139946988 None] Deleted volume successfully. Aug 05 06:20:53 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-1f45e716-9327-49b2-8d89-c64ebdb83b6a tempest-AttachVolumeTestJSON-139946988 None] Lock "cinder-27eca293-8612-4cf4-8a80-c64442697811-delete_volume" released by "delete_volume" :: held 1.454s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:20:53 devstack sudo[100107]: pam_unix(sudo:session): session closed for user root Aug 05 06:20:53 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-1ec7f6b5-b178-4ee9-bd28-f5d4c0aea4b5 tempest-CreateVolumesFromImageTest-1734190764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-83da6a18-b1cb-4df4-bc71-2ebf31b13473 1073741824" returned: 0 in 0.564s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:20:53 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-1ec7f6b5-b178-4ee9-bd28-f5d4c0aea4b5 tempest-CreateVolumesFromImageTest-1734190764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-83da6a18-b1cb-4df4-bc71-2ebf31b13473 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:20:53 devstack sudo[100115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-83da6a18-b1cb-4df4-bc71-2ebf31b13473 Aug 05 06:20:53 devstack sudo[100115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:20:53 devstack sudo[100115]: pam_unix(sudo:session): session closed for user root Aug 05 06:20:53 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-1ec7f6b5-b178-4ee9-bd28-f5d4c0aea4b5 tempest-CreateVolumesFromImageTest-1734190764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-83da6a18-b1cb-4df4-bc71-2ebf31b13473" returned: 0 in 0.275s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:20:53 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-1ec7f6b5-b178-4ee9-bd28-f5d4c0aea4b5 tempest-CreateVolumesFromImageTest-1734190764 None] <== create_volume: return (888ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'} {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 06:20:53 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-1ec7f6b5-b178-4ee9-bd28-f5d4c0aea4b5 tempest-CreateVolumesFromImageTest-1734190764 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.892s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:20:53 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-d0fd97e0-3e55-4178-87dd-fc69bbf651fe tempest-CreateVolumesFromImageTest-1734190764 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.969s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:20:53 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-d0fd97e0-3e55-4178-87dd-fc69bbf651fe tempest-CreateVolumesFromImageTest-1734190764 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:20:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-93536853',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4cfc0d4f-5d35-4f77-b8b3-c2e8aba2c2ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3b3778c923b4731a28dd286f7366a56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:20:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:20:52Z,use_quota=True,user_id='6ce2520e8cf84f9bb30708ffd6eed641',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)}" {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 06:20:53 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-d0fd97e0-3e55-4178-87dd-fc69bbf651fe tempest-CreateVolumesFromImageTest-1734190764 None] Creating volume 4cfc0d4f-5d35-4f77-b8b3-c2e8aba2c2ba {{(pid=88695) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 06:20:53 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-d0fd97e0-3e55-4178-87dd-fc69bbf651fe tempest-CreateVolumesFromImageTest-1734190764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:20:53 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-d0fd97e0-3e55-4178-87dd-fc69bbf651fe tempest-CreateVolumesFromImageTest-1734190764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:20:53 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-d0fd97e0-3e55-4178-87dd-fc69bbf651fe tempest-CreateVolumesFromImageTest-1734190764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:20:53 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-d0fd97e0-3e55-4178-87dd-fc69bbf651fe tempest-CreateVolumesFromImageTest-1734190764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:20:53 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-d0fd97e0-3e55-4178-87dd-fc69bbf651fe tempest-CreateVolumesFromImageTest-1734190764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:20:53 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-d0fd97e0-3e55-4178-87dd-fc69bbf651fe tempest-CreateVolumesFromImageTest-1734190764 None] Selected osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 as target Quobyte volume. {{(pid=88695) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 06:20:53 devstack cinder-volume[88695]: INFO cinder.volume.drivers.remotefs [None req-d0fd97e0-3e55-4178-87dd-fc69bbf651fe tempest-CreateVolumesFromImageTest-1734190764 None] casted to osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 Aug 05 06:20:53 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-d0fd97e0-3e55-4178-87dd-fc69bbf651fe tempest-CreateVolumesFromImageTest-1734190764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-4cfc0d4f-5d35-4f77-b8b3-c2e8aba2c2ba 1073741824 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:20:53 devstack sudo[100118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-4cfc0d4f-5d35-4f77-b8b3-c2e8aba2c2ba 1073741824 Aug 05 06:20:53 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-1ec7f6b5-b178-4ee9-bd28-f5d4c0aea4b5 tempest-CreateVolumesFromImageTest-1734190764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (251c6718-9578-41d0-b81d-e32db063d649) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-83da6a18-b1cb-4df4-bc71-2ebf31b13473', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:20:53 devstack sudo[100118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:20:53 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-1ec7f6b5-b178-4ee9-bd28-f5d4c0aea4b5 tempest-CreateVolumesFromImageTest-1734190764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df4fae5f-0150-40b7-ba45-c6589767161b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:20:53 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-1ec7f6b5-b178-4ee9-bd28-f5d4c0aea4b5 tempest-CreateVolumesFromImageTest-1734190764 None] Volume volume-83da6a18-b1cb-4df4-bc71-2ebf31b13473 (83da6a18-b1cb-4df4-bc71-2ebf31b13473): created successfully Aug 05 06:20:53 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-1ec7f6b5-b178-4ee9-bd28-f5d4c0aea4b5 tempest-CreateVolumesFromImageTest-1734190764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df4fae5f-0150-40b7-ba45-c6589767161b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:20:54 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-1ec7f6b5-b178-4ee9-bd28-f5d4c0aea4b5 tempest-CreateVolumesFromImageTest-1734190764 None] Flow 'volume_create_manager' (2a65abfa-c544-4687-8ed6-44d2585049b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:20:54 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-1ec7f6b5-b178-4ee9-bd28-f5d4c0aea4b5 tempest-CreateVolumesFromImageTest-1734190764 None] Created volume successfully. Aug 05 06:20:54 devstack sudo[100118]: pam_unix(sudo:session): session closed for user root Aug 05 06:20:54 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-d0fd97e0-3e55-4178-87dd-fc69bbf651fe tempest-CreateVolumesFromImageTest-1734190764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-4cfc0d4f-5d35-4f77-b8b3-c2e8aba2c2ba 1073741824" returned: 0 in 0.580s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:20:54 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-d0fd97e0-3e55-4178-87dd-fc69bbf651fe tempest-CreateVolumesFromImageTest-1734190764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-4cfc0d4f-5d35-4f77-b8b3-c2e8aba2c2ba {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:20:54 devstack sudo[100124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-4cfc0d4f-5d35-4f77-b8b3-c2e8aba2c2ba Aug 05 06:20:54 devstack sudo[100124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:20:54 devstack cinder-volume[88695]: DEBUG cinder.volume.flows.manager.create_volume [None req-b759028a-7868-4a75-b59b-1d627bf84dc4 tempest-VolumesExtendTest-597420486 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88695) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 06:20:54 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-b759028a-7868-4a75-b59b-1d627bf84dc4 tempest-VolumesExtendTest-597420486 None] Flow 'volume_create_manager' (e1389528-b6d6-4bcf-9003-7b80808c710d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:20:54 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-b759028a-7868-4a75-b59b-1d627bf84dc4 tempest-VolumesExtendTest-597420486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d06319bc-3f46-4870-8c48-ea8eddf5fd26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:20:54 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-b759028a-7868-4a75-b59b-1d627bf84dc4 tempest-VolumesExtendTest-597420486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d06319bc-3f46-4870-8c48-ea8eddf5fd26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:20:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1571687327',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61d0ed5e-49b8-4072-8e86-a671847dd58e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1506c45df6a4fa6b114924c651ab115',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:20:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:20:55Z,use_quota=True,user_id='e615bbf07c8c4ff6983494a8860bc770',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:20:54 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-b759028a-7868-4a75-b59b-1d627bf84dc4 tempest-VolumesExtendTest-597420486 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3f704f0-3a21-47b1-b491-81241e030514) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:20:54 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-b759028a-7868-4a75-b59b-1d627bf84dc4 tempest-VolumesExtendTest-597420486 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3f704f0-3a21-47b1-b491-81241e030514) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:20:54 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-b759028a-7868-4a75-b59b-1d627bf84dc4 tempest-VolumesExtendTest-597420486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5afd9f34-d7b7-48e0-b69b-2408b18aa835) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:20:54 devstack cinder-volume[88695]: DEBUG cinder.image.glance [None req-b759028a-7868-4a75-b59b-1d627bf84dc4 tempest-VolumesExtendTest-597420486 None] Creating Keystone auth plugin from conf {{(pid=88695) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 05 06:20:54 devstack sudo[100124]: pam_unix(sudo:session): session closed for user root Aug 05 06:20:54 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-d0fd97e0-3e55-4178-87dd-fc69bbf651fe tempest-CreateVolumesFromImageTest-1734190764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-4cfc0d4f-5d35-4f77-b8b3-c2e8aba2c2ba" returned: 0 in 0.271s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:20:54 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-d0fd97e0-3e55-4178-87dd-fc69bbf651fe tempest-CreateVolumesFromImageTest-1734190764 None] <== create_volume: return (896ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'} {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 06:20:54 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-d0fd97e0-3e55-4178-87dd-fc69bbf651fe tempest-CreateVolumesFromImageTest-1734190764 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.900s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:20:54 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-d0fd97e0-3e55-4178-87dd-fc69bbf651fe tempest-CreateVolumesFromImageTest-1734190764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (489bafe0-4118-4754-b1e9-6ef8521fd8cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4cfc0d4f-5d35-4f77-b8b3-c2e8aba2c2ba', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:20:54 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-d0fd97e0-3e55-4178-87dd-fc69bbf651fe tempest-CreateVolumesFromImageTest-1734190764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bc3fa3c-c95b-41ab-945f-f65d4cac2eb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:20:54 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-d0fd97e0-3e55-4178-87dd-fc69bbf651fe tempest-CreateVolumesFromImageTest-1734190764 None] Volume volume-4cfc0d4f-5d35-4f77-b8b3-c2e8aba2c2ba (4cfc0d4f-5d35-4f77-b8b3-c2e8aba2c2ba): created successfully Aug 05 06:20:54 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-d0fd97e0-3e55-4178-87dd-fc69bbf651fe tempest-CreateVolumesFromImageTest-1734190764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bc3fa3c-c95b-41ab-945f-f65d4cac2eb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:20:54 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-d0fd97e0-3e55-4178-87dd-fc69bbf651fe tempest-CreateVolumesFromImageTest-1734190764 None] Flow 'volume_create_manager' (1a4b94d8-4b26-457c-9fb9-b2ee150f05b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:20:54 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-d0fd97e0-3e55-4178-87dd-fc69bbf651fe tempest-CreateVolumesFromImageTest-1734190764 None] Created volume successfully. Aug 05 06:20:54 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-b759028a-7868-4a75-b59b-1d627bf84dc4 tempest-VolumesExtendTest-597420486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5afd9f34-d7b7-48e0-b69b-2408b18aa835) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '61d0ed5e-49b8-4072-8e86-a671847dd58e', 'volume_name': 'volume-61d0ed5e-49b8-4072-8e86-a671847dd58e', 'volume_size': 1, 'image_id': '02d74946-ca9b-46cd-a590-fddaad1baed9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/02d74946-ca9b-46cd-a590-fddaad1baed9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '45a6d5bbcac24d598455fe1cd77a6beb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '02d74946-ca9b-46cd-a590-fddaad1baed9', 'created_at': datetime.datetime(2026, 8, 5, 4, 5, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 5, 4, 5, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/02d74946-ca9b-46cd-a590-fddaad1baed9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:20:54 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-b759028a-7868-4a75-b59b-1d627bf84dc4 tempest-VolumesExtendTest-597420486 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff76eaf7-c24d-4bf6-a0e4-c6cb1ea5d570) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:20:54 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-b759028a-7868-4a75-b59b-1d627bf84dc4 tempest-VolumesExtendTest-597420486 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff76eaf7-c24d-4bf6-a0e4-c6cb1ea5d570) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:20:55 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-b759028a-7868-4a75-b59b-1d627bf84dc4 tempest-VolumesExtendTest-597420486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f27f2b8-ff44-4490-9b46-c18136016ec1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:20:55 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-b759028a-7868-4a75-b59b-1d627bf84dc4 tempest-VolumesExtendTest-597420486 None] Volume 61d0ed5e-49b8-4072-8e86-a671847dd58e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-61d0ed5e-49b8-4072-8e86-a671847dd58e', 'volume_size': 1, 'image_id': '02d74946-ca9b-46cd-a590-fddaad1baed9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/02d74946-ca9b-46cd-a590-fddaad1baed9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '45a6d5bbcac24d598455fe1cd77a6beb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '02d74946-ca9b-46cd-a590-fddaad1baed9', 'created_at': datetime.datetime(2026, 8, 5, 4, 5, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 5, 4, 5, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/02d74946-ca9b-46cd-a590-fddaad1baed9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Aug 05 06:20:55 devstack cinder-volume[88695]: DEBUG cinder.volume.flows.manager.create_volume [None req-b759028a-7868-4a75-b59b-1d627bf84dc4 tempest-VolumesExtendTest-597420486 None] Trying to clone 61d0ed5e-49b8-4072-8e86-a671847dd58e from image 02d74946-ca9b-46cd-a590-fddaad1baed9 at location (None, [{'url': 'file:///opt/stack/data/glance/images/02d74946-ca9b-46cd-a590-fddaad1baed9', 'metadata': {}}]). {{(pid=88695) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 05 06:20:55 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-d5bf619d-d1f7-44c8-b4b8-57b8254e9d55 tempest-CreateVolumesFromImageTest-1734190764 None] Acquiring lock "cinder-4cfc0d4f-5d35-4f77-b8b3-c2e8aba2c2ba-delete_volume" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:20:55 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-d5bf619d-d1f7-44c8-b4b8-57b8254e9d55 tempest-CreateVolumesFromImageTest-1734190764 None] Lock "cinder-4cfc0d4f-5d35-4f77-b8b3-c2e8aba2c2ba-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:20:55 devstack cinder-volume[88695]: DEBUG cinder.image.image_utils [None req-b759028a-7868-4a75-b59b-1d627bf84dc4 tempest-VolumesExtendTest-597420486 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_02d74946-ca9b-46cd-a590-fddaad1baed9_9m401ws6devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=88695) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 05 06:20:55 devstack cinder-volume[88695]: INFO cinder.image.image_utils [None req-b759028a-7868-4a75-b59b-1d627bf84dc4 tempest-VolumesExtendTest-597420486 None] Image download 20.69 MB at 20.69 MB/s Aug 05 06:20:55 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0c17912-b57a-47bc-8dba-ce1dc5292f12]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:20:55 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-b759028a-7868-4a75-b59b-1d627bf84dc4 tempest-VolumesExtendTest-597420486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_02d74946-ca9b-46cd-a590-fddaad1baed9_9m401ws6devstack@QuobyteHD {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:20:55 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-d5bf619d-d1f7-44c8-b4b8-57b8254e9d55 tempest-CreateVolumesFromImageTest-1734190764 None] Acquiring lock "cinder-quobyte-4cfc0d4f-5d35-4f77-b8b3-c2e8aba2c2ba" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:20:55 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-d5bf619d-d1f7-44c8-b4b8-57b8254e9d55 tempest-CreateVolumesFromImageTest-1734190764 None] Lock "cinder-quobyte-4cfc0d4f-5d35-4f77-b8b3-c2e8aba2c2ba" acquired by "delete_volume" :: waited 0.020s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:20:55 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d18d6a2-e093-4e49-9d27-8758c28242bb]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:20:55 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-d5bf619d-d1f7-44c8-b4b8-57b8254e9d55 tempest-CreateVolumesFromImageTest-1734190764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-4cfc0d4f-5d35-4f77-b8b3-c2e8aba2c2ba {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:20:55 devstack sudo[100129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_02d74946-ca9b-46cd-a590-fddaad1baed9_9m401ws6devstack@QuobyteHD Aug 05 06:20:55 devstack sudo[100129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:20:55 devstack sudo[100130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-4cfc0d4f-5d35-4f77-b8b3-c2e8aba2c2ba Aug 05 06:20:55 devstack sudo[100130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:20:55 devstack sudo[100129]: pam_unix(sudo:session): session closed for user root Aug 05 06:20:55 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-b759028a-7868-4a75-b59b-1d627bf84dc4 tempest-VolumesExtendTest-597420486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_02d74946-ca9b-46cd-a590-fddaad1baed9_9m401ws6devstack@QuobyteHD" returned: 0 in 0.391s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:20:55 devstack cinder-volume[88695]: DEBUG cinder.image.image_utils [None req-b759028a-7868-4a75-b59b-1d627bf84dc4 tempest-VolumesExtendTest-597420486 None] Temporary image 02d74946-ca9b-46cd-a590-fddaad1baed9 is fetched for user e615bbf07c8c4ff6983494a8860bc770. {{(pid=88695) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 05 06:20:55 devstack sudo[100130]: pam_unix(sudo:session): session closed for user root Aug 05 06:20:55 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-d5bf619d-d1f7-44c8-b4b8-57b8254e9d55 tempest-CreateVolumesFromImageTest-1734190764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-4cfc0d4f-5d35-4f77-b8b3-c2e8aba2c2ba" returned: 0 in 0.385s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:20:55 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-d5bf619d-d1f7-44c8-b4b8-57b8254e9d55 tempest-CreateVolumesFromImageTest-1734190764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-4cfc0d4f-5d35-4f77-b8b3-c2e8aba2c2ba {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:20:55 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bc758ff-9e44-435f-b682-4dc5daa2f8e2]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:20:55 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-b759028a-7868-4a75-b59b-1d627bf84dc4 tempest-VolumesExtendTest-597420486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_02d74946-ca9b-46cd-a590-fddaad1baed9_9m401ws6devstack@QuobyteHD {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:20:55 devstack sudo[100141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-4cfc0d4f-5d35-4f77-b8b3-c2e8aba2c2ba Aug 05 06:20:55 devstack sudo[100141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:20:56 devstack sudo[100142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_02d74946-ca9b-46cd-a590-fddaad1baed9_9m401ws6devstack@QuobyteHD Aug 05 06:20:56 devstack sudo[100142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:20:56 devstack sudo[100141]: pam_unix(sudo:session): session closed for user root Aug 05 06:20:56 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-d5bf619d-d1f7-44c8-b4b8-57b8254e9d55 tempest-CreateVolumesFromImageTest-1734190764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-4cfc0d4f-5d35-4f77-b8b3-c2e8aba2c2ba" returned: 0 in 0.293s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:20:56 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-d5bf619d-d1f7-44c8-b4b8-57b8254e9d55 tempest-CreateVolumesFromImageTest-1734190764 None] Lock "cinder-quobyte-4cfc0d4f-5d35-4f77-b8b3-c2e8aba2c2ba" released by "delete_volume" :: held 0.742s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:20:56 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-d5bf619d-d1f7-44c8-b4b8-57b8254e9d55 tempest-CreateVolumesFromImageTest-1734190764 None] Created reservations ['255deafa-247f-48e6-a6ae-a230b452860d', 'dfa916d2-2fb9-4ed1-ad45-5d9177219aac', '78462d24-26c0-401a-a7d0-73db9092cc6b', 'f432dfee-515c-4023-b7bd-e868543a1bea'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:20:56 devstack sudo[100142]: pam_unix(sudo:session): session closed for user root Aug 05 06:20:56 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-b759028a-7868-4a75-b59b-1d627bf84dc4 tempest-VolumesExtendTest-597420486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_02d74946-ca9b-46cd-a590-fddaad1baed9_9m401ws6devstack@QuobyteHD" returned: 0 in 0.377s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:20:56 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-b759028a-7868-4a75-b59b-1d627bf84dc4 tempest-VolumesExtendTest-597420486 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:20:56 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-b759028a-7868-4a75-b59b-1d627bf84dc4 tempest-VolumesExtendTest-597420486 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:20:56 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-b759028a-7868-4a75-b59b-1d627bf84dc4 tempest-VolumesExtendTest-597420486 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:20:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1571687327',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61d0ed5e-49b8-4072-8e86-a671847dd58e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1506c45df6a4fa6b114924c651ab115',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:20:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:20:55Z,use_quota=True,user_id='e615bbf07c8c4ff6983494a8860bc770',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)}" {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 06:20:56 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-b759028a-7868-4a75-b59b-1d627bf84dc4 tempest-VolumesExtendTest-597420486 None] Creating volume 61d0ed5e-49b8-4072-8e86-a671847dd58e {{(pid=88695) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 06:20:56 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-b759028a-7868-4a75-b59b-1d627bf84dc4 tempest-VolumesExtendTest-597420486 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:20:56 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-b759028a-7868-4a75-b59b-1d627bf84dc4 tempest-VolumesExtendTest-597420486 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:20:56 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-b759028a-7868-4a75-b59b-1d627bf84dc4 tempest-VolumesExtendTest-597420486 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:20:56 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-b759028a-7868-4a75-b59b-1d627bf84dc4 tempest-VolumesExtendTest-597420486 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:20:56 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-b759028a-7868-4a75-b59b-1d627bf84dc4 tempest-VolumesExtendTest-597420486 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:20:56 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-b759028a-7868-4a75-b59b-1d627bf84dc4 tempest-VolumesExtendTest-597420486 None] Selected osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 as target Quobyte volume. {{(pid=88695) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 06:20:56 devstack cinder-volume[88695]: INFO cinder.volume.drivers.remotefs [None req-b759028a-7868-4a75-b59b-1d627bf84dc4 tempest-VolumesExtendTest-597420486 None] casted to osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 Aug 05 06:20:56 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-b759028a-7868-4a75-b59b-1d627bf84dc4 tempest-VolumesExtendTest-597420486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-61d0ed5e-49b8-4072-8e86-a671847dd58e 1073741824 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:20:56 devstack sudo[100149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-61d0ed5e-49b8-4072-8e86-a671847dd58e 1073741824 Aug 05 06:20:56 devstack sudo[100149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:20:56 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-d5bf619d-d1f7-44c8-b4b8-57b8254e9d55 tempest-CreateVolumesFromImageTest-1734190764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:20:56 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-d5bf619d-d1f7-44c8-b4b8-57b8254e9d55 tempest-CreateVolumesFromImageTest-1734190764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:20:56 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-d5bf619d-d1f7-44c8-b4b8-57b8254e9d55 tempest-CreateVolumesFromImageTest-1734190764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:20:56 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-d5bf619d-d1f7-44c8-b4b8-57b8254e9d55 tempest-CreateVolumesFromImageTest-1734190764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:20:56 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-d5bf619d-d1f7-44c8-b4b8-57b8254e9d55 tempest-CreateVolumesFromImageTest-1734190764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:20:56 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-d5bf619d-d1f7-44c8-b4b8-57b8254e9d55 tempest-CreateVolumesFromImageTest-1734190764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:20:56 devstack sudo[100151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce Aug 05 06:20:56 devstack sudo[100151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:20:56 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-e91abc2b-fc76-4999-9944-1b2ece36bed0 tempest-CreateVolumesFromImageTest-1734190764 None] Acquiring lock "cinder-83da6a18-b1cb-4df4-bc71-2ebf31b13473-delete_volume" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:20:56 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-e91abc2b-fc76-4999-9944-1b2ece36bed0 tempest-CreateVolumesFromImageTest-1734190764 None] Lock "cinder-83da6a18-b1cb-4df4-bc71-2ebf31b13473-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:20:56 devstack sudo[100151]: pam_unix(sudo:session): session closed for user root Aug 05 06:20:56 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-d5bf619d-d1f7-44c8-b4b8-57b8254e9d55 tempest-CreateVolumesFromImageTest-1734190764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce" returned: 0 in 0.347s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:20:56 devstack cinder-volume[88695]: DEBUG cinder.manager [None req-d5bf619d-d1f7-44c8-b4b8-57b8254e9d55 tempest-CreateVolumesFromImageTest-1734190764 None] Notifying Schedulers of capabilities ... {{(pid=88695) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 06:20:56 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-e91abc2b-fc76-4999-9944-1b2ece36bed0 tempest-CreateVolumesFromImageTest-1734190764 None] Acquiring lock "cinder-quobyte-83da6a18-b1cb-4df4-bc71-2ebf31b13473" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:20:56 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-d5bf619d-d1f7-44c8-b4b8-57b8254e9d55 tempest-CreateVolumesFromImageTest-1734190764 None] Deleted volume successfully. Aug 05 06:20:56 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-e91abc2b-fc76-4999-9944-1b2ece36bed0 tempest-CreateVolumesFromImageTest-1734190764 None] Lock "cinder-quobyte-83da6a18-b1cb-4df4-bc71-2ebf31b13473" acquired by "delete_volume" :: waited 0.027s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:20:56 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-d5bf619d-d1f7-44c8-b4b8-57b8254e9d55 tempest-CreateVolumesFromImageTest-1734190764 None] Lock "cinder-4cfc0d4f-5d35-4f77-b8b3-c2e8aba2c2ba-delete_volume" released by "delete_volume" :: held 1.426s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:20:56 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[22f9cc83-2edc-4515-9448-8c9845231d1f]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:20:56 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-e91abc2b-fc76-4999-9944-1b2ece36bed0 tempest-CreateVolumesFromImageTest-1734190764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-83da6a18-b1cb-4df4-bc71-2ebf31b13473 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:20:56 devstack sudo[100157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-83da6a18-b1cb-4df4-bc71-2ebf31b13473 Aug 05 06:20:56 devstack sudo[100157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:20:56 devstack sudo[100149]: pam_unix(sudo:session): session closed for user root Aug 05 06:20:56 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-b759028a-7868-4a75-b59b-1d627bf84dc4 tempest-VolumesExtendTest-597420486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-61d0ed5e-49b8-4072-8e86-a671847dd58e 1073741824" returned: 0 in 0.656s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:20:56 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-b759028a-7868-4a75-b59b-1d627bf84dc4 tempest-VolumesExtendTest-597420486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-61d0ed5e-49b8-4072-8e86-a671847dd58e {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:20:57 devstack sudo[100160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-61d0ed5e-49b8-4072-8e86-a671847dd58e Aug 05 06:20:57 devstack sudo[100160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:20:57 devstack sudo[100157]: pam_unix(sudo:session): session closed for user root Aug 05 06:20:57 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-e91abc2b-fc76-4999-9944-1b2ece36bed0 tempest-CreateVolumesFromImageTest-1734190764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-83da6a18-b1cb-4df4-bc71-2ebf31b13473" returned: 0 in 0.411s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:20:57 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-e91abc2b-fc76-4999-9944-1b2ece36bed0 tempest-CreateVolumesFromImageTest-1734190764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-83da6a18-b1cb-4df4-bc71-2ebf31b13473 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:20:57 devstack sudo[100166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-83da6a18-b1cb-4df4-bc71-2ebf31b13473 Aug 05 06:20:57 devstack sudo[100166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:20:57 devstack sudo[100160]: pam_unix(sudo:session): session closed for user root Aug 05 06:20:57 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-b759028a-7868-4a75-b59b-1d627bf84dc4 tempest-VolumesExtendTest-597420486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-61d0ed5e-49b8-4072-8e86-a671847dd58e" returned: 0 in 0.272s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:20:57 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-b759028a-7868-4a75-b59b-1d627bf84dc4 tempest-VolumesExtendTest-597420486 None] <== create_volume: return (975ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'} {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 06:20:57 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-b759028a-7868-4a75-b59b-1d627bf84dc4 tempest-VolumesExtendTest-597420486 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.978s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:20:57 devstack cinder-volume[88695]: DEBUG cinder.volume.volume_utils [None req-b759028a-7868-4a75-b59b-1d627bf84dc4 tempest-VolumesExtendTest-597420486 None] Attempting download of 02d74946-ca9b-46cd-a590-fddaad1baed9 ((None, [{'url': 'file:///opt/stack/data/glance/images/02d74946-ca9b-46cd-a590-fddaad1baed9', 'metadata': {}}])) to volume 61d0ed5e-49b8-4072-8e86-a671847dd58e. {{(pid=88695) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 05 06:20:57 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4e68089-7b19-486f-a33d-b47e4312a97f]: (4, 'raw') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:20:57 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-b759028a-7868-4a75-b59b-1d627bf84dc4 tempest-VolumesExtendTest-597420486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_02d74946-ca9b-46cd-a590-fddaad1baed9__u6soebr {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:20:57 devstack sudo[100166]: pam_unix(sudo:session): session closed for user root Aug 05 06:20:57 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-e91abc2b-fc76-4999-9944-1b2ece36bed0 tempest-CreateVolumesFromImageTest-1734190764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-83da6a18-b1cb-4df4-bc71-2ebf31b13473" returned: 0 in 0.286s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:20:57 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-e91abc2b-fc76-4999-9944-1b2ece36bed0 tempest-CreateVolumesFromImageTest-1734190764 None] Lock "cinder-quobyte-83da6a18-b1cb-4df4-bc71-2ebf31b13473" released by "delete_volume" :: held 0.750s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:20:57 devstack sudo[100169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_02d74946-ca9b-46cd-a590-fddaad1baed9__u6soebr Aug 05 06:20:57 devstack sudo[100169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:20:57 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-e91abc2b-fc76-4999-9944-1b2ece36bed0 tempest-CreateVolumesFromImageTest-1734190764 None] Created reservations ['1405061e-3635-4c79-9a75-6424e5b29d15', '0a47fe94-dcd1-492c-b096-2006b00db0f6', '6517c1a4-1a64-4181-8dd1-8af6f61ab021', '5142e908-523d-4241-a5d6-44bb44d3702e'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:20:57 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-e91abc2b-fc76-4999-9944-1b2ece36bed0 tempest-CreateVolumesFromImageTest-1734190764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:20:57 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-e91abc2b-fc76-4999-9944-1b2ece36bed0 tempest-CreateVolumesFromImageTest-1734190764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:20:57 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-e91abc2b-fc76-4999-9944-1b2ece36bed0 tempest-CreateVolumesFromImageTest-1734190764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:20:57 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-e91abc2b-fc76-4999-9944-1b2ece36bed0 tempest-CreateVolumesFromImageTest-1734190764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:20:57 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-e91abc2b-fc76-4999-9944-1b2ece36bed0 tempest-CreateVolumesFromImageTest-1734190764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:20:57 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-e91abc2b-fc76-4999-9944-1b2ece36bed0 tempest-CreateVolumesFromImageTest-1734190764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:20:57 devstack sudo[100173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce Aug 05 06:20:57 devstack sudo[100173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:20:57 devstack sudo[100169]: pam_unix(sudo:session): session closed for user root Aug 05 06:20:57 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-b759028a-7868-4a75-b59b-1d627bf84dc4 tempest-VolumesExtendTest-597420486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_02d74946-ca9b-46cd-a590-fddaad1baed9__u6soebr" returned: 0 in 0.405s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:20:57 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-b759028a-7868-4a75-b59b-1d627bf84dc4 tempest-VolumesExtendTest-597420486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_02d74946-ca9b-46cd-a590-fddaad1baed9__u6soebr {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:20:57 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-82e8dbb4-26bd-4540-9f95-de19796d8b8a tempest-CreateVolumesFromImageTest-1734190764 None] Acquiring lock "cinder-74166b52-dcfc-4ea8-901a-b680ddc746df-delete_volume" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:20:57 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-82e8dbb4-26bd-4540-9f95-de19796d8b8a tempest-CreateVolumesFromImageTest-1734190764 None] Lock "cinder-74166b52-dcfc-4ea8-901a-b680ddc746df-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:20:57 devstack sudo[100173]: pam_unix(sudo:session): session closed for user root Aug 05 06:20:57 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-e91abc2b-fc76-4999-9944-1b2ece36bed0 tempest-CreateVolumesFromImageTest-1734190764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce" returned: 0 in 0.266s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:20:57 devstack cinder-volume[88695]: DEBUG cinder.manager [None req-e91abc2b-fc76-4999-9944-1b2ece36bed0 tempest-CreateVolumesFromImageTest-1734190764 None] Notifying Schedulers of capabilities ... {{(pid=88695) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 06:20:57 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-e91abc2b-fc76-4999-9944-1b2ece36bed0 tempest-CreateVolumesFromImageTest-1734190764 None] Deleted volume successfully. Aug 05 06:20:57 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-82e8dbb4-26bd-4540-9f95-de19796d8b8a tempest-CreateVolumesFromImageTest-1734190764 None] Acquiring lock "cinder-quobyte-74166b52-dcfc-4ea8-901a-b680ddc746df" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:20:57 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-e91abc2b-fc76-4999-9944-1b2ece36bed0 tempest-CreateVolumesFromImageTest-1734190764 None] Lock "cinder-83da6a18-b1cb-4df4-bc71-2ebf31b13473-delete_volume" released by "delete_volume" :: held 1.315s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:20:57 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-82e8dbb4-26bd-4540-9f95-de19796d8b8a tempest-CreateVolumesFromImageTest-1734190764 None] Lock "cinder-quobyte-74166b52-dcfc-4ea8-901a-b680ddc746df" acquired by "delete_volume" :: waited 0.027s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:20:58 devstack sudo[100177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_02d74946-ca9b-46cd-a590-fddaad1baed9__u6soebr Aug 05 06:20:58 devstack sudo[100177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:20:58 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[73654777-e5aa-4e77-9152-9e242e5f30b2]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:20:58 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-82e8dbb4-26bd-4540-9f95-de19796d8b8a tempest-CreateVolumesFromImageTest-1734190764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-74166b52-dcfc-4ea8-901a-b680ddc746df {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:20:58 devstack sudo[100181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-74166b52-dcfc-4ea8-901a-b680ddc746df Aug 05 06:20:58 devstack sudo[100181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:20:58 devstack sudo[100177]: pam_unix(sudo:session): session closed for user root Aug 05 06:20:58 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-b759028a-7868-4a75-b59b-1d627bf84dc4 tempest-VolumesExtendTest-597420486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_02d74946-ca9b-46cd-a590-fddaad1baed9__u6soebr" returned: 1 in 0.435s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:20:58 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-b759028a-7868-4a75-b59b-1d627bf84dc4 tempest-VolumesExtendTest-597420486 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_02d74946-ca9b-46cd-a590-fddaad1baed9__u6soebr' failed. Not Retrying. {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 05 06:20:58 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ce9aa76-aa49-46c3-a371-14eb9b2e6a52]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:20:58 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-b759028a-7868-4a75-b59b-1d627bf84dc4 tempest-VolumesExtendTest-597420486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_02d74946-ca9b-46cd-a590-fddaad1baed9_9m401ws6devstack@QuobyteHD {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:20:58 devstack sudo[100185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_02d74946-ca9b-46cd-a590-fddaad1baed9_9m401ws6devstack@QuobyteHD Aug 05 06:20:58 devstack sudo[100185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:20:58 devstack sudo[100181]: pam_unix(sudo:session): session closed for user root Aug 05 06:20:58 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-82e8dbb4-26bd-4540-9f95-de19796d8b8a tempest-CreateVolumesFromImageTest-1734190764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-74166b52-dcfc-4ea8-901a-b680ddc746df" returned: 0 in 0.466s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:20:58 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-82e8dbb4-26bd-4540-9f95-de19796d8b8a tempest-CreateVolumesFromImageTest-1734190764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-74166b52-dcfc-4ea8-901a-b680ddc746df {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:20:58 devstack sudo[100190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-74166b52-dcfc-4ea8-901a-b680ddc746df Aug 05 06:20:58 devstack sudo[100190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:20:58 devstack sudo[100185]: pam_unix(sudo:session): session closed for user root Aug 05 06:20:58 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-b759028a-7868-4a75-b59b-1d627bf84dc4 tempest-VolumesExtendTest-597420486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_02d74946-ca9b-46cd-a590-fddaad1baed9_9m401ws6devstack@QuobyteHD" returned: 0 in 0.391s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:20:58 devstack cinder-volume[88695]: DEBUG cinder.image.image_utils [None req-b759028a-7868-4a75-b59b-1d627bf84dc4 tempest-VolumesExtendTest-597420486 None] 02d74946-ca9b-46cd-a590-fddaad1baed9 was qcow2, converting to qcow2 {{(pid=88695) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 05 06:20:58 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-b759028a-7868-4a75-b59b-1d627bf84dc4 tempest-VolumesExtendTest-597420486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_02d74946-ca9b-46cd-a590-fddaad1baed9_9m401ws6devstack@QuobyteHD /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-61d0ed5e-49b8-4072-8e86-a671847dd58e {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:20:58 devstack sudo[100195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_02d74946-ca9b-46cd-a590-fddaad1baed9_9m401ws6devstack@QuobyteHD /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-61d0ed5e-49b8-4072-8e86-a671847dd58e Aug 05 06:20:58 devstack sudo[100195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:20:58 devstack sudo[100190]: pam_unix(sudo:session): session closed for user root Aug 05 06:20:58 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-82e8dbb4-26bd-4540-9f95-de19796d8b8a tempest-CreateVolumesFromImageTest-1734190764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-74166b52-dcfc-4ea8-901a-b680ddc746df" returned: 0 in 0.310s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:20:58 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-82e8dbb4-26bd-4540-9f95-de19796d8b8a tempest-CreateVolumesFromImageTest-1734190764 None] Lock "cinder-quobyte-74166b52-dcfc-4ea8-901a-b680ddc746df" released by "delete_volume" :: held 0.834s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:20:58 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-82e8dbb4-26bd-4540-9f95-de19796d8b8a tempest-CreateVolumesFromImageTest-1734190764 None] Created reservations ['a0822ead-7a13-4786-ba23-9768f0988454', '3a7ecdf9-ef80-42fe-a3f1-76e0a5d76942', '386aef80-0e91-48dd-892e-a662dcd3e5eb', 'a3670c19-c9e0-46d3-93f4-20b499f32cb0'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:20:58 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-82e8dbb4-26bd-4540-9f95-de19796d8b8a tempest-CreateVolumesFromImageTest-1734190764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:20:58 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-82e8dbb4-26bd-4540-9f95-de19796d8b8a tempest-CreateVolumesFromImageTest-1734190764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:20:58 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-82e8dbb4-26bd-4540-9f95-de19796d8b8a tempest-CreateVolumesFromImageTest-1734190764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:20:58 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-82e8dbb4-26bd-4540-9f95-de19796d8b8a tempest-CreateVolumesFromImageTest-1734190764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:20:58 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-82e8dbb4-26bd-4540-9f95-de19796d8b8a tempest-CreateVolumesFromImageTest-1734190764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:20:59 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-82e8dbb4-26bd-4540-9f95-de19796d8b8a tempest-CreateVolumesFromImageTest-1734190764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:20:59 devstack sudo[100204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce Aug 05 06:20:59 devstack sudo[100204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:20:59 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-acd9164c-fc1e-4507-b2bc-4c92d134ae7c tempest-CreateVolumesFromImageTest-1734190764 None] Acquiring lock "cinder-50130fb4-38a1-477c-bb31-921736e3dd1c-delete_volume" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:20:59 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-acd9164c-fc1e-4507-b2bc-4c92d134ae7c tempest-CreateVolumesFromImageTest-1734190764 None] Lock "cinder-50130fb4-38a1-477c-bb31-921736e3dd1c-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:20:59 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-acd9164c-fc1e-4507-b2bc-4c92d134ae7c tempest-CreateVolumesFromImageTest-1734190764 None] Acquiring lock "cinder-quobyte-50130fb4-38a1-477c-bb31-921736e3dd1c" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:20:59 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-acd9164c-fc1e-4507-b2bc-4c92d134ae7c tempest-CreateVolumesFromImageTest-1734190764 None] Lock "cinder-quobyte-50130fb4-38a1-477c-bb31-921736e3dd1c" acquired by "delete_volume" :: waited 0.030s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:20:59 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa17314c-8e5c-484e-85c0-1cfef3a97b93]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:20:59 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-acd9164c-fc1e-4507-b2bc-4c92d134ae7c tempest-CreateVolumesFromImageTest-1734190764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-50130fb4-38a1-477c-bb31-921736e3dd1c {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:20:59 devstack sudo[100204]: pam_unix(sudo:session): session closed for user root Aug 05 06:20:59 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-82e8dbb4-26bd-4540-9f95-de19796d8b8a tempest-CreateVolumesFromImageTest-1734190764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce" returned: 0 in 0.328s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:20:59 devstack cinder-volume[88695]: DEBUG cinder.manager [None req-82e8dbb4-26bd-4540-9f95-de19796d8b8a tempest-CreateVolumesFromImageTest-1734190764 None] Notifying Schedulers of capabilities ... {{(pid=88695) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 06:20:59 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-82e8dbb4-26bd-4540-9f95-de19796d8b8a tempest-CreateVolumesFromImageTest-1734190764 None] Deleted volume successfully. Aug 05 06:20:59 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-82e8dbb4-26bd-4540-9f95-de19796d8b8a tempest-CreateVolumesFromImageTest-1734190764 None] Lock "cinder-74166b52-dcfc-4ea8-901a-b680ddc746df-delete_volume" released by "delete_volume" :: held 1.464s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:20:59 devstack sudo[100207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-50130fb4-38a1-477c-bb31-921736e3dd1c Aug 05 06:20:59 devstack sudo[100207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:20:59 devstack sudo[100207]: pam_unix(sudo:session): session closed for user root Aug 05 06:20:59 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-acd9164c-fc1e-4507-b2bc-4c92d134ae7c tempest-CreateVolumesFromImageTest-1734190764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-50130fb4-38a1-477c-bb31-921736e3dd1c" returned: 0 in 0.484s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:20:59 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-acd9164c-fc1e-4507-b2bc-4c92d134ae7c tempest-CreateVolumesFromImageTest-1734190764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-50130fb4-38a1-477c-bb31-921736e3dd1c {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:20:59 devstack sudo[100214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-50130fb4-38a1-477c-bb31-921736e3dd1c Aug 05 06:20:59 devstack sudo[100214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:21:00 devstack sudo[100214]: pam_unix(sudo:session): session closed for user root Aug 05 06:21:00 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-acd9164c-fc1e-4507-b2bc-4c92d134ae7c tempest-CreateVolumesFromImageTest-1734190764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-50130fb4-38a1-477c-bb31-921736e3dd1c" returned: 0 in 0.329s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:21:00 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-acd9164c-fc1e-4507-b2bc-4c92d134ae7c tempest-CreateVolumesFromImageTest-1734190764 None] Lock "cinder-quobyte-50130fb4-38a1-477c-bb31-921736e3dd1c" released by "delete_volume" :: held 0.875s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:21:00 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-acd9164c-fc1e-4507-b2bc-4c92d134ae7c tempest-CreateVolumesFromImageTest-1734190764 None] Created reservations ['7e2c1c35-e73e-4b40-950a-09f9326095b9', '588e7566-2576-44cb-b791-ac15fd2cf234', '6219f480-fa0a-43e2-9929-d3497ee748ff', 'd1083d7c-84d4-4ee1-ac69-f6f2dd43c4ee'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:21:00 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-acd9164c-fc1e-4507-b2bc-4c92d134ae7c tempest-CreateVolumesFromImageTest-1734190764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:21:00 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-acd9164c-fc1e-4507-b2bc-4c92d134ae7c tempest-CreateVolumesFromImageTest-1734190764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:21:00 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-acd9164c-fc1e-4507-b2bc-4c92d134ae7c tempest-CreateVolumesFromImageTest-1734190764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:21:00 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-acd9164c-fc1e-4507-b2bc-4c92d134ae7c tempest-CreateVolumesFromImageTest-1734190764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:21:00 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-acd9164c-fc1e-4507-b2bc-4c92d134ae7c tempest-CreateVolumesFromImageTest-1734190764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:21:00 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-acd9164c-fc1e-4507-b2bc-4c92d134ae7c tempest-CreateVolumesFromImageTest-1734190764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:21:00 devstack sudo[100217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce Aug 05 06:21:00 devstack sudo[100217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:21:00 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-a1b3b34a-8272-41f6-9356-4dc3fc3d684c tempest-CreateVolumesFromImageTest-1734190764 None] Acquiring lock "cinder-b3132cfe-94d2-4581-b6bd-71c3e6946311-delete_volume" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:21:00 devstack cinder-volume[88695]: DEBUG oslo_service.periodic_task [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88695) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 06:21:00 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:21:00 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:21:00 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:21:00 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:21:00 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:21:00 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:21:00 devstack sudo[100219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce Aug 05 06:21:00 devstack sudo[100219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:21:00 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-a1b3b34a-8272-41f6-9356-4dc3fc3d684c tempest-CreateVolumesFromImageTest-1734190764 None] Lock "cinder-b3132cfe-94d2-4581-b6bd-71c3e6946311-delete_volume" acquired by "delete_volume" :: waited 0.084s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:21:00 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-a1b3b34a-8272-41f6-9356-4dc3fc3d684c tempest-CreateVolumesFromImageTest-1734190764 None] Acquiring lock "cinder-quobyte-b3132cfe-94d2-4581-b6bd-71c3e6946311" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:21:00 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-a1b3b34a-8272-41f6-9356-4dc3fc3d684c tempest-CreateVolumesFromImageTest-1734190764 None] Lock "cinder-quobyte-b3132cfe-94d2-4581-b6bd-71c3e6946311" acquired by "delete_volume" :: waited 0.021s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:21:00 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b73659a-9b15-48c8-bc4d-3f31606e67e6]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:21:00 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-a1b3b34a-8272-41f6-9356-4dc3fc3d684c tempest-CreateVolumesFromImageTest-1734190764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-b3132cfe-94d2-4581-b6bd-71c3e6946311 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:21:00 devstack sudo[100217]: pam_unix(sudo:session): session closed for user root Aug 05 06:21:00 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-acd9164c-fc1e-4507-b2bc-4c92d134ae7c tempest-CreateVolumesFromImageTest-1734190764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce" returned: 0 in 0.397s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:21:00 devstack cinder-volume[88695]: DEBUG cinder.manager [None req-acd9164c-fc1e-4507-b2bc-4c92d134ae7c tempest-CreateVolumesFromImageTest-1734190764 None] Notifying Schedulers of capabilities ... {{(pid=88695) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 06:21:00 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-acd9164c-fc1e-4507-b2bc-4c92d134ae7c tempest-CreateVolumesFromImageTest-1734190764 None] Deleted volume successfully. Aug 05 06:21:00 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-acd9164c-fc1e-4507-b2bc-4c92d134ae7c tempest-CreateVolumesFromImageTest-1734190764 None] Lock "cinder-50130fb4-38a1-477c-bb31-921736e3dd1c-delete_volume" released by "delete_volume" :: held 1.561s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:21:00 devstack sudo[100221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-b3132cfe-94d2-4581-b6bd-71c3e6946311 Aug 05 06:21:00 devstack sudo[100221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:21:00 devstack sudo[100219]: pam_unix(sudo:session): session closed for user root Aug 05 06:21:00 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce" returned: 0 in 0.348s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:21:00 devstack cinder-volume[88695]: DEBUG cinder.manager [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] Notifying Schedulers of capabilities ... {{(pid=88695) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 06:21:00 devstack cinder-volume[88695]: DEBUG oslo_service.periodic_task [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] Running periodic task VolumeManager._thread_info {{(pid=88695) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 06:21:00 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] thread count: 28 {{(pid=88695) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 05 06:21:00 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] thread info: [<_MainThread(MainThread, started 134469211893888)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88695) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 05 06:21:00 devstack sudo[100195]: pam_unix(sudo:session): session closed for user root Aug 05 06:21:01 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-b759028a-7868-4a75-b59b-1d627bf84dc4 tempest-VolumesExtendTest-597420486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_02d74946-ca9b-46cd-a590-fddaad1baed9_9m401ws6devstack@QuobyteHD /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-61d0ed5e-49b8-4072-8e86-a671847dd58e" returned: 0 in 2.358s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:21:01 devstack cinder-volume[88695]: DEBUG cinder.image.image_utils [None req-b759028a-7868-4a75-b59b-1d627bf84dc4 tempest-VolumesExtendTest-597420486 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_02d74946-ca9b-46cd-a590-fddaad1baed9_9m401ws6devstack@QuobyteHD, size 112.00 MB, duration 2.36 sec, destination /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-61d0ed5e-49b8-4072-8e86-a671847dd58e {{(pid=88695) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 05 06:21:01 devstack cinder-volume[88695]: INFO cinder.image.image_utils [None req-b759028a-7868-4a75-b59b-1d627bf84dc4 tempest-VolumesExtendTest-597420486 None] Converted 112.00 MB image at 47.48 MB/s Aug 05 06:21:01 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-b759028a-7868-4a75-b59b-1d627bf84dc4 tempest-VolumesExtendTest-597420486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-61d0ed5e-49b8-4072-8e86-a671847dd58e 1G {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:21:01 devstack sudo[100227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-61d0ed5e-49b8-4072-8e86-a671847dd58e 1G Aug 05 06:21:01 devstack sudo[100227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:21:01 devstack sudo[100221]: pam_unix(sudo:session): session closed for user root Aug 05 06:21:01 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-a1b3b34a-8272-41f6-9356-4dc3fc3d684c tempest-CreateVolumesFromImageTest-1734190764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-b3132cfe-94d2-4581-b6bd-71c3e6946311" returned: 0 in 0.487s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:21:01 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-a1b3b34a-8272-41f6-9356-4dc3fc3d684c tempest-CreateVolumesFromImageTest-1734190764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-b3132cfe-94d2-4581-b6bd-71c3e6946311 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:21:01 devstack sudo[100230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-b3132cfe-94d2-4581-b6bd-71c3e6946311 Aug 05 06:21:01 devstack sudo[100230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:21:01 devstack sudo[100230]: pam_unix(sudo:session): session closed for user root Aug 05 06:21:01 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-a1b3b34a-8272-41f6-9356-4dc3fc3d684c tempest-CreateVolumesFromImageTest-1734190764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-b3132cfe-94d2-4581-b6bd-71c3e6946311" returned: 0 in 0.275s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:21:01 devstack sudo[100227]: pam_unix(sudo:session): session closed for user root Aug 05 06:21:01 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-b759028a-7868-4a75-b59b-1d627bf84dc4 tempest-VolumesExtendTest-597420486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-61d0ed5e-49b8-4072-8e86-a671847dd58e 1G" returned: 0 in 0.357s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:21:01 devstack cinder-volume[88695]: DEBUG cinder.volume.volume_utils [None req-b759028a-7868-4a75-b59b-1d627bf84dc4 tempest-VolumesExtendTest-597420486 None] Downloaded image 02d74946-ca9b-46cd-a590-fddaad1baed9 ((None, [{'url': 'file:///opt/stack/data/glance/images/02d74946-ca9b-46cd-a590-fddaad1baed9', 'metadata': {}}])) to volume 61d0ed5e-49b8-4072-8e86-a671847dd58e successfully. {{(pid=88695) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 05 06:21:01 devstack cinder-volume[88695]: DEBUG cinder.image.image_utils [None req-b759028a-7868-4a75-b59b-1d627bf84dc4 tempest-VolumesExtendTest-597420486 None] Temporary image 02d74946-ca9b-46cd-a590-fddaad1baed9 for user e615bbf07c8c4ff6983494a8860bc770 is deleted. {{(pid=88695) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 05 06:21:01 devstack cinder-volume[88695]: DEBUG cinder.volume.volume_utils [None req-b759028a-7868-4a75-b59b-1d627bf84dc4 tempest-VolumesExtendTest-597420486 None] Marking volume 61d0ed5e-49b8-4072-8e86-a671847dd58e as bootable. {{(pid=88695) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 05 06:21:01 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-a1b3b34a-8272-41f6-9356-4dc3fc3d684c tempest-CreateVolumesFromImageTest-1734190764 None] Lock "cinder-quobyte-b3132cfe-94d2-4581-b6bd-71c3e6946311" released by "delete_volume" :: held 0.827s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:21:01 devstack cinder-volume[88695]: DEBUG cinder.volume.flows.manager.create_volume [None req-b759028a-7868-4a75-b59b-1d627bf84dc4 tempest-VolumesExtendTest-597420486 None] Copying metadata from image 02d74946-ca9b-46cd-a590-fddaad1baed9 to 61d0ed5e-49b8-4072-8e86-a671847dd58e. {{(pid=88695) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 05 06:21:01 devstack cinder-volume[88695]: DEBUG cinder.volume.flows.manager.create_volume [None req-b759028a-7868-4a75-b59b-1d627bf84dc4 tempest-VolumesExtendTest-597420486 None] Creating volume glance metadata for volume 61d0ed5e-49b8-4072-8e86-a671847dd58e backed by image 02d74946-ca9b-46cd-a590-fddaad1baed9 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '02d74946-ca9b-46cd-a590-fddaad1baed9', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88695) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 05 06:21:01 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-a1b3b34a-8272-41f6-9356-4dc3fc3d684c tempest-CreateVolumesFromImageTest-1734190764 None] Created reservations ['b7829db6-a4b4-4080-a134-fa46fa990d23', '5f132d6a-175e-4ec3-9bc0-e61c99993fa4', 'fe1d51b9-476e-41b0-a35a-cc3da1dde083', 'ae4ff6bf-7bbb-4168-b188-fbfbc8f1e3f2'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:21:01 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-b759028a-7868-4a75-b59b-1d627bf84dc4 tempest-VolumesExtendTest-597420486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f27f2b8-ff44-4490-9b46-c18136016ec1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61d0ed5e-49b8-4072-8e86-a671847dd58e', 'volume_size': 1, 'image_id': '02d74946-ca9b-46cd-a590-fddaad1baed9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/02d74946-ca9b-46cd-a590-fddaad1baed9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '45a6d5bbcac24d598455fe1cd77a6beb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '02d74946-ca9b-46cd-a590-fddaad1baed9', 'created_at': datetime.datetime(2026, 8, 5, 4, 5, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 5, 4, 5, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/02d74946-ca9b-46cd-a590-fddaad1baed9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:21:01 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-b759028a-7868-4a75-b59b-1d627bf84dc4 tempest-VolumesExtendTest-597420486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (270086b7-a61e-49f5-9799-31059813e766) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:21:01 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-a1b3b34a-8272-41f6-9356-4dc3fc3d684c tempest-CreateVolumesFromImageTest-1734190764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:21:01 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-a1b3b34a-8272-41f6-9356-4dc3fc3d684c tempest-CreateVolumesFromImageTest-1734190764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:21:01 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-a1b3b34a-8272-41f6-9356-4dc3fc3d684c tempest-CreateVolumesFromImageTest-1734190764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:21:01 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-a1b3b34a-8272-41f6-9356-4dc3fc3d684c tempest-CreateVolumesFromImageTest-1734190764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:21:01 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-a1b3b34a-8272-41f6-9356-4dc3fc3d684c tempest-CreateVolumesFromImageTest-1734190764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:21:01 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-a1b3b34a-8272-41f6-9356-4dc3fc3d684c tempest-CreateVolumesFromImageTest-1734190764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:21:01 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-b759028a-7868-4a75-b59b-1d627bf84dc4 tempest-VolumesExtendTest-597420486 None] Volume volume-61d0ed5e-49b8-4072-8e86-a671847dd58e (61d0ed5e-49b8-4072-8e86-a671847dd58e): created successfully Aug 05 06:21:01 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-b759028a-7868-4a75-b59b-1d627bf84dc4 tempest-VolumesExtendTest-597420486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (270086b7-a61e-49f5-9799-31059813e766) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:21:01 devstack sudo[100236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce Aug 05 06:21:01 devstack sudo[100236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:21:01 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-b759028a-7868-4a75-b59b-1d627bf84dc4 tempest-VolumesExtendTest-597420486 None] Flow 'volume_create_manager' (e1389528-b6d6-4bcf-9003-7b80808c710d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:21:01 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-b759028a-7868-4a75-b59b-1d627bf84dc4 tempest-VolumesExtendTest-597420486 None] Created volume successfully. Aug 05 06:21:01 devstack sudo[100236]: pam_unix(sudo:session): session closed for user root Aug 05 06:21:01 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-a1b3b34a-8272-41f6-9356-4dc3fc3d684c tempest-CreateVolumesFromImageTest-1734190764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce" returned: 0 in 0.307s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:21:01 devstack cinder-volume[88695]: DEBUG cinder.manager [None req-a1b3b34a-8272-41f6-9356-4dc3fc3d684c tempest-CreateVolumesFromImageTest-1734190764 None] Notifying Schedulers of capabilities ... {{(pid=88695) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 06:21:01 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-a1b3b34a-8272-41f6-9356-4dc3fc3d684c tempest-CreateVolumesFromImageTest-1734190764 None] Deleted volume successfully. Aug 05 06:21:01 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-a1b3b34a-8272-41f6-9356-4dc3fc3d684c tempest-CreateVolumesFromImageTest-1734190764 None] Lock "cinder-b3132cfe-94d2-4581-b6bd-71c3e6946311-delete_volume" released by "delete_volume" :: held 1.425s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:21:02 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-b91e00e3-4b49-453f-9474-3f442b3c5ee3 tempest-VolumesExtendTest-597420486 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:21:02 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-b91e00e3-4b49-453f-9474-3f442b3c5ee3 tempest-VolumesExtendTest-597420486 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:21:02 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3605607-6652-43fb-adf7-2bb81d558dab]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:21:02 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-b91e00e3-4b49-453f-9474-3f442b3c5ee3 tempest-VolumesExtendTest-597420486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-61d0ed5e-49b8-4072-8e86-a671847dd58e {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:21:02 devstack sudo[100239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-61d0ed5e-49b8-4072-8e86-a671847dd58e Aug 05 06:21:02 devstack sudo[100239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:21:02 devstack sudo[100239]: pam_unix(sudo:session): session closed for user root Aug 05 06:21:02 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-b91e00e3-4b49-453f-9474-3f442b3c5ee3 tempest-VolumesExtendTest-597420486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-61d0ed5e-49b8-4072-8e86-a671847dd58e" returned: 0 in 0.448s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:21:02 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-b91e00e3-4b49-453f-9474-3f442b3c5ee3 tempest-VolumesExtendTest-597420486 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-61d0ed5e-49b8-4072-8e86-a671847dd58e 2G {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:21:02 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-b91e00e3-4b49-453f-9474-3f442b3c5ee3 tempest-VolumesExtendTest-597420486 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-61d0ed5e-49b8-4072-8e86-a671847dd58e 2G" returned: 0 in 0.143s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:21:02 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-b91e00e3-4b49-453f-9474-3f442b3c5ee3 tempest-VolumesExtendTest-597420486 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.626s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:21:02 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-b91e00e3-4b49-453f-9474-3f442b3c5ee3 tempest-VolumesExtendTest-597420486 None] Extend volume completed successfully. Aug 05 06:21:03 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-fc196010-aa0b-4270-a371-9fe05dbbf594 tempest-VolumesExtendTest-597420486 None] Acquiring lock "cinder-61d0ed5e-49b8-4072-8e86-a671847dd58e-delete_volume" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:21:03 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-fc196010-aa0b-4270-a371-9fe05dbbf594 tempest-VolumesExtendTest-597420486 None] Lock "cinder-61d0ed5e-49b8-4072-8e86-a671847dd58e-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:21:03 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-fc196010-aa0b-4270-a371-9fe05dbbf594 tempest-VolumesExtendTest-597420486 None] Acquiring lock "cinder-quobyte-61d0ed5e-49b8-4072-8e86-a671847dd58e" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:21:03 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-fc196010-aa0b-4270-a371-9fe05dbbf594 tempest-VolumesExtendTest-597420486 None] Lock "cinder-quobyte-61d0ed5e-49b8-4072-8e86-a671847dd58e" acquired by "delete_volume" :: waited 0.020s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:21:03 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[592992bf-5490-41ab-abd4-e7fad13adc19]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:21:03 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-fc196010-aa0b-4270-a371-9fe05dbbf594 tempest-VolumesExtendTest-597420486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-61d0ed5e-49b8-4072-8e86-a671847dd58e {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:21:03 devstack sudo[100248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-61d0ed5e-49b8-4072-8e86-a671847dd58e Aug 05 06:21:03 devstack sudo[100248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:21:04 devstack sudo[100248]: pam_unix(sudo:session): session closed for user root Aug 05 06:21:04 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-fc196010-aa0b-4270-a371-9fe05dbbf594 tempest-VolumesExtendTest-597420486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-61d0ed5e-49b8-4072-8e86-a671847dd58e" returned: 0 in 0.458s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:21:04 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-fc196010-aa0b-4270-a371-9fe05dbbf594 tempest-VolumesExtendTest-597420486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-61d0ed5e-49b8-4072-8e86-a671847dd58e {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:21:04 devstack sudo[100253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-61d0ed5e-49b8-4072-8e86-a671847dd58e Aug 05 06:21:04 devstack sudo[100253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:21:04 devstack sudo[100253]: pam_unix(sudo:session): session closed for user root Aug 05 06:21:04 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-fc196010-aa0b-4270-a371-9fe05dbbf594 tempest-VolumesExtendTest-597420486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-61d0ed5e-49b8-4072-8e86-a671847dd58e" returned: 0 in 0.280s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:21:04 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-fc196010-aa0b-4270-a371-9fe05dbbf594 tempest-VolumesExtendTest-597420486 None] Lock "cinder-quobyte-61d0ed5e-49b8-4072-8e86-a671847dd58e" released by "delete_volume" :: held 0.791s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:21:04 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-fc196010-aa0b-4270-a371-9fe05dbbf594 tempest-VolumesExtendTest-597420486 None] Created reservations ['b34c15d5-2baa-4d34-af32-33e571efb22b', '5eefcb69-ca05-45d6-90a3-a53b8c7de321', '584bf865-d1e2-4fea-a9c7-6ae1f5f672a9', '7bdc1811-aa8b-484f-a2f5-30914dc1edfd'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:21:04 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-fc196010-aa0b-4270-a371-9fe05dbbf594 tempest-VolumesExtendTest-597420486 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:21:04 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-fc196010-aa0b-4270-a371-9fe05dbbf594 tempest-VolumesExtendTest-597420486 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:21:04 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-fc196010-aa0b-4270-a371-9fe05dbbf594 tempest-VolumesExtendTest-597420486 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:21:04 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-fc196010-aa0b-4270-a371-9fe05dbbf594 tempest-VolumesExtendTest-597420486 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:21:04 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-fc196010-aa0b-4270-a371-9fe05dbbf594 tempest-VolumesExtendTest-597420486 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:21:04 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-fc196010-aa0b-4270-a371-9fe05dbbf594 tempest-VolumesExtendTest-597420486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:21:04 devstack sudo[100256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce Aug 05 06:21:04 devstack sudo[100256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:21:04 devstack sudo[100256]: pam_unix(sudo:session): session closed for user root Aug 05 06:21:04 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-fc196010-aa0b-4270-a371-9fe05dbbf594 tempest-VolumesExtendTest-597420486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce" returned: 0 in 0.324s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:21:04 devstack cinder-volume[88695]: DEBUG cinder.manager [None req-fc196010-aa0b-4270-a371-9fe05dbbf594 tempest-VolumesExtendTest-597420486 None] Notifying Schedulers of capabilities ... {{(pid=88695) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 06:21:04 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-fc196010-aa0b-4270-a371-9fe05dbbf594 tempest-VolumesExtendTest-597420486 None] Deleted volume successfully. Aug 05 06:21:05 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-fc196010-aa0b-4270-a371-9fe05dbbf594 tempest-VolumesExtendTest-597420486 None] Lock "cinder-61d0ed5e-49b8-4072-8e86-a671847dd58e-delete_volume" released by "delete_volume" :: held 1.386s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:21:05 devstack cinder-volume[88695]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e3740be-9af1-431c-92eb-96ff1a9e3063 tempest-VolumeDependencyTests-69769482 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88695) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 06:21:05 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-0e3740be-9af1-431c-92eb-96ff1a9e3063 tempest-VolumeDependencyTests-69769482 None] Flow 'volume_create_manager' (976edf31-639a-4ec2-9c59-68edf9293293) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:21:05 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-0e3740be-9af1-431c-92eb-96ff1a9e3063 tempest-VolumeDependencyTests-69769482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (723126f8-ed57-4f80-9ba0-6e36281d34c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:21:05 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-0e3740be-9af1-431c-92eb-96ff1a9e3063 tempest-VolumeDependencyTests-69769482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (723126f8-ed57-4f80-9ba0-6e36281d34c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:21:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-385947332',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7407a5d7-9186-4462-af38-3c87ab2091b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87c869e9b8c04903a7628382c6467d6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:21:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:21:05Z,use_quota=True,user_id='1e13b91ed2e844f2ac55c73457851cba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:21:05 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-0e3740be-9af1-431c-92eb-96ff1a9e3063 tempest-VolumeDependencyTests-69769482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95bfd3f6-8115-4a1a-8370-10baf4e43735) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:21:05 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-0e3740be-9af1-431c-92eb-96ff1a9e3063 tempest-VolumeDependencyTests-69769482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95bfd3f6-8115-4a1a-8370-10baf4e43735) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:21:05 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-0e3740be-9af1-431c-92eb-96ff1a9e3063 tempest-VolumeDependencyTests-69769482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37bb88bd-88c6-4dbe-8209-155614dec7d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:21:05 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-0e3740be-9af1-431c-92eb-96ff1a9e3063 tempest-VolumeDependencyTests-69769482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37bb88bd-88c6-4dbe-8209-155614dec7d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7407a5d7-9186-4462-af38-3c87ab2091b8', 'volume_name': 'volume-7407a5d7-9186-4462-af38-3c87ab2091b8', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:21:05 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-0e3740be-9af1-431c-92eb-96ff1a9e3063 tempest-VolumeDependencyTests-69769482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58a61b29-8def-4441-b357-086cbeca1c63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:21:05 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-0e3740be-9af1-431c-92eb-96ff1a9e3063 tempest-VolumeDependencyTests-69769482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58a61b29-8def-4441-b357-086cbeca1c63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:21:05 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-0e3740be-9af1-431c-92eb-96ff1a9e3063 tempest-VolumeDependencyTests-69769482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82343907-444c-48ce-9fa3-2845d3565d12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:21:05 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-0e3740be-9af1-431c-92eb-96ff1a9e3063 tempest-VolumeDependencyTests-69769482 None] Volume 7407a5d7-9186-4462-af38-3c87ab2091b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7407a5d7-9186-4462-af38-3c87ab2091b8', 'volume_size': 1} Aug 05 06:21:05 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-0e3740be-9af1-431c-92eb-96ff1a9e3063 tempest-VolumeDependencyTests-69769482 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:21:05 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-0e3740be-9af1-431c-92eb-96ff1a9e3063 tempest-VolumeDependencyTests-69769482 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:21:05 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-0e3740be-9af1-431c-92eb-96ff1a9e3063 tempest-VolumeDependencyTests-69769482 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:21:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-385947332',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7407a5d7-9186-4462-af38-3c87ab2091b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87c869e9b8c04903a7628382c6467d6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:21:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:21:05Z,use_quota=True,user_id='1e13b91ed2e844f2ac55c73457851cba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)}" {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 06:21:05 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-0e3740be-9af1-431c-92eb-96ff1a9e3063 tempest-VolumeDependencyTests-69769482 None] Creating volume 7407a5d7-9186-4462-af38-3c87ab2091b8 {{(pid=88695) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 06:21:05 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-0e3740be-9af1-431c-92eb-96ff1a9e3063 tempest-VolumeDependencyTests-69769482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:21:05 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-0e3740be-9af1-431c-92eb-96ff1a9e3063 tempest-VolumeDependencyTests-69769482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:21:05 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-0e3740be-9af1-431c-92eb-96ff1a9e3063 tempest-VolumeDependencyTests-69769482 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:21:05 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-0e3740be-9af1-431c-92eb-96ff1a9e3063 tempest-VolumeDependencyTests-69769482 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:21:05 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-0e3740be-9af1-431c-92eb-96ff1a9e3063 tempest-VolumeDependencyTests-69769482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:21:05 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-0e3740be-9af1-431c-92eb-96ff1a9e3063 tempest-VolumeDependencyTests-69769482 None] Selected osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 as target Quobyte volume. {{(pid=88695) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 06:21:05 devstack cinder-volume[88695]: INFO cinder.volume.drivers.remotefs [None req-0e3740be-9af1-431c-92eb-96ff1a9e3063 tempest-VolumeDependencyTests-69769482 None] casted to osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 Aug 05 06:21:05 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-0e3740be-9af1-431c-92eb-96ff1a9e3063 tempest-VolumeDependencyTests-69769482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7407a5d7-9186-4462-af38-3c87ab2091b8 1073741824 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:21:05 devstack sudo[100259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7407a5d7-9186-4462-af38-3c87ab2091b8 1073741824 Aug 05 06:21:05 devstack sudo[100259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:21:05 devstack cinder-volume[88695]: DEBUG cinder.volume.flows.manager.create_volume [None req-169d1d37-e45b-40aa-8c4b-44abf737f0e4 tempest-VolumesExtendTest-597420486 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88695) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 06:21:05 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-169d1d37-e45b-40aa-8c4b-44abf737f0e4 tempest-VolumesExtendTest-597420486 None] Flow 'volume_create_manager' (7a0a7a8c-d97c-4950-a9f4-79979d67ff5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:21:05 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-169d1d37-e45b-40aa-8c4b-44abf737f0e4 tempest-VolumesExtendTest-597420486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d11ade95-2b0d-4a77-9ba8-f9784a12e677) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:21:05 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-169d1d37-e45b-40aa-8c4b-44abf737f0e4 tempest-VolumesExtendTest-597420486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d11ade95-2b0d-4a77-9ba8-f9784a12e677) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:21:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-804571302',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e36c759-49b1-49bc-a306-a49654f5698b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1506c45df6a4fa6b114924c651ab115',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:21:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:21:05Z,use_quota=True,user_id='e615bbf07c8c4ff6983494a8860bc770',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:21:05 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-169d1d37-e45b-40aa-8c4b-44abf737f0e4 tempest-VolumesExtendTest-597420486 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2dcb5e04-36de-440f-8d23-52b4b3e94f0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:21:05 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-169d1d37-e45b-40aa-8c4b-44abf737f0e4 tempest-VolumesExtendTest-597420486 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2dcb5e04-36de-440f-8d23-52b4b3e94f0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:21:05 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-169d1d37-e45b-40aa-8c4b-44abf737f0e4 tempest-VolumesExtendTest-597420486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b570ba7-a06d-43a4-86d9-1c892f055cd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:21:05 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-169d1d37-e45b-40aa-8c4b-44abf737f0e4 tempest-VolumesExtendTest-597420486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b570ba7-a06d-43a4-86d9-1c892f055cd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e36c759-49b1-49bc-a306-a49654f5698b', 'volume_name': 'volume-7e36c759-49b1-49bc-a306-a49654f5698b', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:21:05 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-169d1d37-e45b-40aa-8c4b-44abf737f0e4 tempest-VolumesExtendTest-597420486 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94abaffe-56b3-4f16-a53a-061f5a9eee7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:21:05 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-169d1d37-e45b-40aa-8c4b-44abf737f0e4 tempest-VolumesExtendTest-597420486 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94abaffe-56b3-4f16-a53a-061f5a9eee7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:21:05 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-169d1d37-e45b-40aa-8c4b-44abf737f0e4 tempest-VolumesExtendTest-597420486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d7c08f4-c1e9-4763-8f91-aa4179b83dce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:21:05 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-169d1d37-e45b-40aa-8c4b-44abf737f0e4 tempest-VolumesExtendTest-597420486 None] Volume 7e36c759-49b1-49bc-a306-a49654f5698b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e36c759-49b1-49bc-a306-a49654f5698b', 'volume_size': 1} Aug 05 06:21:05 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-169d1d37-e45b-40aa-8c4b-44abf737f0e4 tempest-VolumesExtendTest-597420486 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:21:05 devstack sudo[100259]: pam_unix(sudo:session): session closed for user root Aug 05 06:21:05 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-0e3740be-9af1-431c-92eb-96ff1a9e3063 tempest-VolumeDependencyTests-69769482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7407a5d7-9186-4462-af38-3c87ab2091b8 1073741824" returned: 0 in 0.611s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:21:05 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-0e3740be-9af1-431c-92eb-96ff1a9e3063 tempest-VolumeDependencyTests-69769482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7407a5d7-9186-4462-af38-3c87ab2091b8 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:21:05 devstack sudo[100265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7407a5d7-9186-4462-af38-3c87ab2091b8 Aug 05 06:21:05 devstack sudo[100265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:21:06 devstack sudo[100265]: pam_unix(sudo:session): session closed for user root Aug 05 06:21:06 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-0e3740be-9af1-431c-92eb-96ff1a9e3063 tempest-VolumeDependencyTests-69769482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7407a5d7-9186-4462-af38-3c87ab2091b8" returned: 0 in 0.275s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:21:06 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-0e3740be-9af1-431c-92eb-96ff1a9e3063 tempest-VolumeDependencyTests-69769482 None] <== create_volume: return (931ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'} {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 06:21:06 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-0e3740be-9af1-431c-92eb-96ff1a9e3063 tempest-VolumeDependencyTests-69769482 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.934s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:21:06 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-169d1d37-e45b-40aa-8c4b-44abf737f0e4 tempest-VolumesExtendTest-597420486 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.437s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:21:06 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-169d1d37-e45b-40aa-8c4b-44abf737f0e4 tempest-VolumesExtendTest-597420486 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:21:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-804571302',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e36c759-49b1-49bc-a306-a49654f5698b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1506c45df6a4fa6b114924c651ab115',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:21:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:21:05Z,use_quota=True,user_id='e615bbf07c8c4ff6983494a8860bc770',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)}" {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 06:21:06 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-169d1d37-e45b-40aa-8c4b-44abf737f0e4 tempest-VolumesExtendTest-597420486 None] Creating volume 7e36c759-49b1-49bc-a306-a49654f5698b {{(pid=88695) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 06:21:06 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-169d1d37-e45b-40aa-8c4b-44abf737f0e4 tempest-VolumesExtendTest-597420486 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:21:06 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-169d1d37-e45b-40aa-8c4b-44abf737f0e4 tempest-VolumesExtendTest-597420486 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:21:06 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-169d1d37-e45b-40aa-8c4b-44abf737f0e4 tempest-VolumesExtendTest-597420486 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:21:06 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-169d1d37-e45b-40aa-8c4b-44abf737f0e4 tempest-VolumesExtendTest-597420486 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:21:06 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-169d1d37-e45b-40aa-8c4b-44abf737f0e4 tempest-VolumesExtendTest-597420486 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:21:06 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-169d1d37-e45b-40aa-8c4b-44abf737f0e4 tempest-VolumesExtendTest-597420486 None] Selected osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 as target Quobyte volume. {{(pid=88695) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 06:21:06 devstack cinder-volume[88695]: INFO cinder.volume.drivers.remotefs [None req-169d1d37-e45b-40aa-8c4b-44abf737f0e4 tempest-VolumesExtendTest-597420486 None] casted to osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 Aug 05 06:21:06 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-169d1d37-e45b-40aa-8c4b-44abf737f0e4 tempest-VolumesExtendTest-597420486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7e36c759-49b1-49bc-a306-a49654f5698b 1073741824 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:21:06 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-0e3740be-9af1-431c-92eb-96ff1a9e3063 tempest-VolumeDependencyTests-69769482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82343907-444c-48ce-9fa3-2845d3565d12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7407a5d7-9186-4462-af38-3c87ab2091b8', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:21:06 devstack sudo[100268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7e36c759-49b1-49bc-a306-a49654f5698b 1073741824 Aug 05 06:21:06 devstack sudo[100268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:21:06 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-0e3740be-9af1-431c-92eb-96ff1a9e3063 tempest-VolumeDependencyTests-69769482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a3540c0-945e-4f16-83c9-b073d3116f1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:21:06 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-0e3740be-9af1-431c-92eb-96ff1a9e3063 tempest-VolumeDependencyTests-69769482 None] Volume volume-7407a5d7-9186-4462-af38-3c87ab2091b8 (7407a5d7-9186-4462-af38-3c87ab2091b8): created successfully Aug 05 06:21:06 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-0e3740be-9af1-431c-92eb-96ff1a9e3063 tempest-VolumeDependencyTests-69769482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a3540c0-945e-4f16-83c9-b073d3116f1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:21:06 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-0e3740be-9af1-431c-92eb-96ff1a9e3063 tempest-VolumeDependencyTests-69769482 None] Flow 'volume_create_manager' (976edf31-639a-4ec2-9c59-68edf9293293) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:21:06 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-0e3740be-9af1-431c-92eb-96ff1a9e3063 tempest-VolumeDependencyTests-69769482 None] Created volume successfully. Aug 05 06:21:06 devstack sudo[100268]: pam_unix(sudo:session): session closed for user root Aug 05 06:21:06 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-169d1d37-e45b-40aa-8c4b-44abf737f0e4 tempest-VolumesExtendTest-597420486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7e36c759-49b1-49bc-a306-a49654f5698b 1073741824" returned: 0 in 0.501s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:21:06 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-169d1d37-e45b-40aa-8c4b-44abf737f0e4 tempest-VolumesExtendTest-597420486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7e36c759-49b1-49bc-a306-a49654f5698b {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:21:06 devstack sudo[100274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7e36c759-49b1-49bc-a306-a49654f5698b Aug 05 06:21:06 devstack sudo[100274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:21:06 devstack sudo[100274]: pam_unix(sudo:session): session closed for user root Aug 05 06:21:06 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-169d1d37-e45b-40aa-8c4b-44abf737f0e4 tempest-VolumesExtendTest-597420486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7e36c759-49b1-49bc-a306-a49654f5698b" returned: 0 in 0.254s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:21:06 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-169d1d37-e45b-40aa-8c4b-44abf737f0e4 tempest-VolumesExtendTest-597420486 None] <== create_volume: return (800ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'} {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 06:21:06 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-169d1d37-e45b-40aa-8c4b-44abf737f0e4 tempest-VolumesExtendTest-597420486 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.803s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:21:06 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-169d1d37-e45b-40aa-8c4b-44abf737f0e4 tempest-VolumesExtendTest-597420486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d7c08f4-c1e9-4763-8f91-aa4179b83dce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e36c759-49b1-49bc-a306-a49654f5698b', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:21:06 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-169d1d37-e45b-40aa-8c4b-44abf737f0e4 tempest-VolumesExtendTest-597420486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7eec8110-0dc6-43b1-839b-7403888d7c6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:21:06 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-169d1d37-e45b-40aa-8c4b-44abf737f0e4 tempest-VolumesExtendTest-597420486 None] Volume volume-7e36c759-49b1-49bc-a306-a49654f5698b (7e36c759-49b1-49bc-a306-a49654f5698b): created successfully Aug 05 06:21:06 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-169d1d37-e45b-40aa-8c4b-44abf737f0e4 tempest-VolumesExtendTest-597420486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7eec8110-0dc6-43b1-839b-7403888d7c6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:21:06 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-169d1d37-e45b-40aa-8c4b-44abf737f0e4 tempest-VolumesExtendTest-597420486 None] Flow 'volume_create_manager' (7a0a7a8c-d97c-4950-a9f4-79979d67ff5b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:21:06 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-169d1d37-e45b-40aa-8c4b-44abf737f0e4 tempest-VolumesExtendTest-597420486 None] Created volume successfully. Aug 05 06:21:07 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-433e2f27-a21e-4b4a-8f88-4e07788bf63b tempest-VolumeDependencyTests-69769482 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:21:07 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-433e2f27-a21e-4b4a-8f88-4e07788bf63b tempest-VolumeDependencyTests-69769482 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:21:07 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-433e2f27-a21e-4b4a-8f88-4e07788bf63b tempest-VolumeDependencyTests-69769482 None] Creating offline snapshot 381d6c04-6024-41a4-9f79-d22179d6006c of volume 7407a5d7-9186-4462-af38-3c87ab2091b8 {{(pid=88695) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 06:21:07 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6a3ee3c-e358-4ce6-9708-02634ea099ec]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:21:07 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-433e2f27-a21e-4b4a-8f88-4e07788bf63b tempest-VolumeDependencyTests-69769482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7407a5d7-9186-4462-af38-3c87ab2091b8 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:21:07 devstack sudo[100277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7407a5d7-9186-4462-af38-3c87ab2091b8 Aug 05 06:21:07 devstack sudo[100277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:21:07 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-10cce9d0-6bd7-4b1d-ae02-b8402fd6bb82 tempest-VolumesExtendTest-597420486 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:21:07 devstack sudo[100277]: pam_unix(sudo:session): session closed for user root Aug 05 06:21:07 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-433e2f27-a21e-4b4a-8f88-4e07788bf63b tempest-VolumeDependencyTests-69769482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7407a5d7-9186-4462-af38-3c87ab2091b8" returned: 0 in 0.520s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:21:07 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-433e2f27-a21e-4b4a-8f88-4e07788bf63b tempest-VolumeDependencyTests-69769482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7407a5d7-9186-4462-af38-3c87ab2091b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7407a5d7-9186-4462-af38-3c87ab2091b8.381d6c04-6024-41a4-9f79-d22179d6006c 1G {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:21:07 devstack sudo[100283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7407a5d7-9186-4462-af38-3c87ab2091b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7407a5d7-9186-4462-af38-3c87ab2091b8.381d6c04-6024-41a4-9f79-d22179d6006c 1G Aug 05 06:21:07 devstack sudo[100283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:21:08 devstack sudo[100283]: pam_unix(sudo:session): session closed for user root Aug 05 06:21:08 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-433e2f27-a21e-4b4a-8f88-4e07788bf63b tempest-VolumeDependencyTests-69769482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7407a5d7-9186-4462-af38-3c87ab2091b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7407a5d7-9186-4462-af38-3c87ab2091b8.381d6c04-6024-41a4-9f79-d22179d6006c 1G" returned: 0 in 0.464s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:21:08 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-433e2f27-a21e-4b4a-8f88-4e07788bf63b tempest-VolumeDependencyTests-69769482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7407a5d7-9186-4462-af38-3c87ab2091b8 -F qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7407a5d7-9186-4462-af38-3c87ab2091b8.381d6c04-6024-41a4-9f79-d22179d6006c {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:21:08 devstack sudo[100289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7407a5d7-9186-4462-af38-3c87ab2091b8 -F qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7407a5d7-9186-4462-af38-3c87ab2091b8.381d6c04-6024-41a4-9f79-d22179d6006c Aug 05 06:21:08 devstack sudo[100289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:21:08 devstack sudo[100289]: pam_unix(sudo:session): session closed for user root Aug 05 06:21:08 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-433e2f27-a21e-4b4a-8f88-4e07788bf63b tempest-VolumeDependencyTests-69769482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7407a5d7-9186-4462-af38-3c87ab2091b8 -F qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7407a5d7-9186-4462-af38-3c87ab2091b8.381d6c04-6024-41a4-9f79-d22179d6006c" returned: 0 in 0.338s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:21:08 devstack cinder-volume[88695]: WARNING cinder.volume.drivers.remotefs [None req-433e2f27-a21e-4b4a-8f88-4e07788bf63b tempest-VolumeDependencyTests-69769482 None] /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7407a5d7-9186-4462-af38-3c87ab2091b8.381d6c04-6024-41a4-9f79-d22179d6006c is being set with open permissions: ugo+rw Aug 05 06:21:08 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-433e2f27-a21e-4b4a-8f88-4e07788bf63b tempest-VolumeDependencyTests-69769482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7407a5d7-9186-4462-af38-3c87ab2091b8.381d6c04-6024-41a4-9f79-d22179d6006c {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:21:08 devstack sudo[100295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7407a5d7-9186-4462-af38-3c87ab2091b8.381d6c04-6024-41a4-9f79-d22179d6006c Aug 05 06:21:08 devstack sudo[100295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:21:08 devstack sudo[100295]: pam_unix(sudo:session): session closed for user root Aug 05 06:21:08 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-433e2f27-a21e-4b4a-8f88-4e07788bf63b tempest-VolumeDependencyTests-69769482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7407a5d7-9186-4462-af38-3c87ab2091b8.381d6c04-6024-41a4-9f79-d22179d6006c" returned: 0 in 0.247s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:21:08 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-433e2f27-a21e-4b4a-8f88-4e07788bf63b tempest-VolumeDependencyTests-69769482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7407a5d7-9186-4462-af38-3c87ab2091b8.info {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:21:08 devstack sudo[100298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7407a5d7-9186-4462-af38-3c87ab2091b8.info Aug 05 06:21:08 devstack sudo[100298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:21:09 devstack sudo[100298]: pam_unix(sudo:session): session closed for user root Aug 05 06:21:09 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-433e2f27-a21e-4b4a-8f88-4e07788bf63b tempest-VolumeDependencyTests-69769482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7407a5d7-9186-4462-af38-3c87ab2091b8.info" returned: 0 in 0.270s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:21:09 devstack cinder-volume[88695]: WARNING cinder.volume.drivers.remotefs [None req-433e2f27-a21e-4b4a-8f88-4e07788bf63b tempest-VolumeDependencyTests-69769482 None] /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7407a5d7-9186-4462-af38-3c87ab2091b8.info is being set with open permissions: ugo+rw Aug 05 06:21:09 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-433e2f27-a21e-4b4a-8f88-4e07788bf63b tempest-VolumeDependencyTests-69769482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7407a5d7-9186-4462-af38-3c87ab2091b8.info {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:21:09 devstack sudo[100301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7407a5d7-9186-4462-af38-3c87ab2091b8.info Aug 05 06:21:09 devstack sudo[100301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:21:09 devstack sudo[100301]: pam_unix(sudo:session): session closed for user root Aug 05 06:21:09 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-433e2f27-a21e-4b4a-8f88-4e07788bf63b tempest-VolumeDependencyTests-69769482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7407a5d7-9186-4462-af38-3c87ab2091b8.info" returned: 0 in 0.244s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:21:09 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-433e2f27-a21e-4b4a-8f88-4e07788bf63b tempest-VolumeDependencyTests-69769482 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.195s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:21:09 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-10cce9d0-6bd7-4b1d-ae02-b8402fd6bb82 tempest-VolumesExtendTest-597420486 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.729s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:21:09 devstack cinder-volume[88695]: DEBUG dbcounter [-] [88695] Writing DB stats cinder:SELECT=144,cinder:UPDATE=193,cinder:DELETE=19,cinder:INSERT=51 {{(pid=88695) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 06:21:09 devstack cinder-volume[88695]: DEBUG dbcounter [-] [88695] Writing DB stats cinder:UPDATE=198,cinder:SELECT=154,cinder:INSERT=48,cinder:DELETE=15 {{(pid=88695) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 06:21:09 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-10cce9d0-6bd7-4b1d-ae02-b8402fd6bb82 tempest-VolumesExtendTest-597420486 None] Creating offline snapshot 521be503-1774-4698-bc7e-e0a97900f19f of volume 7e36c759-49b1-49bc-a306-a49654f5698b {{(pid=88695) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 06:21:09 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-433e2f27-a21e-4b4a-8f88-4e07788bf63b tempest-VolumeDependencyTests-69769482 None] Create snapshot completed successfully Aug 05 06:21:09 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[10748fe4-58fd-4d08-bc74-2c930197fe6f]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:21:09 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-10cce9d0-6bd7-4b1d-ae02-b8402fd6bb82 tempest-VolumesExtendTest-597420486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7e36c759-49b1-49bc-a306-a49654f5698b {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:21:09 devstack sudo[100304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7e36c759-49b1-49bc-a306-a49654f5698b Aug 05 06:21:09 devstack sudo[100304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:21:09 devstack sudo[100304]: pam_unix(sudo:session): session closed for user root Aug 05 06:21:09 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-10cce9d0-6bd7-4b1d-ae02-b8402fd6bb82 tempest-VolumesExtendTest-597420486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7e36c759-49b1-49bc-a306-a49654f5698b" returned: 0 in 0.458s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:21:09 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-10cce9d0-6bd7-4b1d-ae02-b8402fd6bb82 tempest-VolumesExtendTest-597420486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7e36c759-49b1-49bc-a306-a49654f5698b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7e36c759-49b1-49bc-a306-a49654f5698b.521be503-1774-4698-bc7e-e0a97900f19f 1G {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:21:10 devstack sudo[100309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7e36c759-49b1-49bc-a306-a49654f5698b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7e36c759-49b1-49bc-a306-a49654f5698b.521be503-1774-4698-bc7e-e0a97900f19f 1G Aug 05 06:21:10 devstack sudo[100309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:21:10 devstack sudo[100309]: pam_unix(sudo:session): session closed for user root Aug 05 06:21:10 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-10cce9d0-6bd7-4b1d-ae02-b8402fd6bb82 tempest-VolumesExtendTest-597420486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7e36c759-49b1-49bc-a306-a49654f5698b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7e36c759-49b1-49bc-a306-a49654f5698b.521be503-1774-4698-bc7e-e0a97900f19f 1G" returned: 0 in 0.544s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:21:10 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-10cce9d0-6bd7-4b1d-ae02-b8402fd6bb82 tempest-VolumesExtendTest-597420486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e36c759-49b1-49bc-a306-a49654f5698b -F qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7e36c759-49b1-49bc-a306-a49654f5698b.521be503-1774-4698-bc7e-e0a97900f19f {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:21:10 devstack sudo[100319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e36c759-49b1-49bc-a306-a49654f5698b -F qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7e36c759-49b1-49bc-a306-a49654f5698b.521be503-1774-4698-bc7e-e0a97900f19f Aug 05 06:21:10 devstack sudo[100319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:21:10 devstack sudo[100319]: pam_unix(sudo:session): session closed for user root Aug 05 06:21:10 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-10cce9d0-6bd7-4b1d-ae02-b8402fd6bb82 tempest-VolumesExtendTest-597420486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e36c759-49b1-49bc-a306-a49654f5698b -F qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7e36c759-49b1-49bc-a306-a49654f5698b.521be503-1774-4698-bc7e-e0a97900f19f" returned: 0 in 0.449s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:21:10 devstack cinder-volume[88695]: WARNING cinder.volume.drivers.remotefs [None req-10cce9d0-6bd7-4b1d-ae02-b8402fd6bb82 tempest-VolumesExtendTest-597420486 None] /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7e36c759-49b1-49bc-a306-a49654f5698b.521be503-1774-4698-bc7e-e0a97900f19f is being set with open permissions: ugo+rw Aug 05 06:21:10 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-10cce9d0-6bd7-4b1d-ae02-b8402fd6bb82 tempest-VolumesExtendTest-597420486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7e36c759-49b1-49bc-a306-a49654f5698b.521be503-1774-4698-bc7e-e0a97900f19f {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:21:11 devstack sudo[100324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7e36c759-49b1-49bc-a306-a49654f5698b.521be503-1774-4698-bc7e-e0a97900f19f Aug 05 06:21:11 devstack sudo[100324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:21:11 devstack cinder-volume[88695]: DEBUG cinder.volume.flows.manager.create_volume [None req-39438c5d-1153-484b-9529-f024bf1d4d4c tempest-VolumeDependencyTests-69769482 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88695) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 06:21:11 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-39438c5d-1153-484b-9529-f024bf1d4d4c tempest-VolumeDependencyTests-69769482 None] Flow 'volume_create_manager' (9ec1f7c2-8427-48c9-af74-4d118f9727dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:21:11 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-39438c5d-1153-484b-9529-f024bf1d4d4c tempest-VolumeDependencyTests-69769482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c6489a4-5cf4-4c27-9c14-ea08f3b2ec99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:21:11 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-39438c5d-1153-484b-9529-f024bf1d4d4c tempest-VolumeDependencyTests-69769482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c6489a4-5cf4-4c27-9c14-ea08f3b2ec99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:21:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1406408284',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15768eed-b0b8-40cd-b03b-23aa4d96ad44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87c869e9b8c04903a7628382c6467d6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:21:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=381d6c04-6024-41a4-9f79-d22179d6006c,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:21:11Z,use_quota=True,user_id='1e13b91ed2e844f2ac55c73457851cba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:21:11 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-39438c5d-1153-484b-9529-f024bf1d4d4c tempest-VolumeDependencyTests-69769482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e7e1e9d-ad8c-4d06-8718-723b7792eeef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:21:11 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-39438c5d-1153-484b-9529-f024bf1d4d4c tempest-VolumeDependencyTests-69769482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e7e1e9d-ad8c-4d06-8718-723b7792eeef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:21:11 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-39438c5d-1153-484b-9529-f024bf1d4d4c tempest-VolumeDependencyTests-69769482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6dc57db2-2b1f-4b03-a57f-aea840b589dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:21:11 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-39438c5d-1153-484b-9529-f024bf1d4d4c tempest-VolumeDependencyTests-69769482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6dc57db2-2b1f-4b03-a57f-aea840b589dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '15768eed-b0b8-40cd-b03b-23aa4d96ad44', 'volume_name': 'volume-15768eed-b0b8-40cd-b03b-23aa4d96ad44', 'volume_size': 1, 'snapshot_id': '381d6c04-6024-41a4-9f79-d22179d6006c'}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:21:11 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-39438c5d-1153-484b-9529-f024bf1d4d4c tempest-VolumeDependencyTests-69769482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (faa0821f-e4a9-4bca-b4d9-c6c4ed1e99e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:21:11 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-39438c5d-1153-484b-9529-f024bf1d4d4c tempest-VolumeDependencyTests-69769482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (faa0821f-e4a9-4bca-b4d9-c6c4ed1e99e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:21:11 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-39438c5d-1153-484b-9529-f024bf1d4d4c tempest-VolumeDependencyTests-69769482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a0856e0-1214-4d7c-8d12-1289dce12ec6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:21:11 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-39438c5d-1153-484b-9529-f024bf1d4d4c tempest-VolumeDependencyTests-69769482 None] Volume 15768eed-b0b8-40cd-b03b-23aa4d96ad44: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-15768eed-b0b8-40cd-b03b-23aa4d96ad44', 'volume_size': 1, 'snapshot_id': '381d6c04-6024-41a4-9f79-d22179d6006c'} Aug 05 06:21:11 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-39438c5d-1153-484b-9529-f024bf1d4d4c tempest-VolumeDependencyTests-69769482 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:21:11 devstack sudo[100324]: pam_unix(sudo:session): session closed for user root Aug 05 06:21:11 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-10cce9d0-6bd7-4b1d-ae02-b8402fd6bb82 tempest-VolumesExtendTest-597420486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7e36c759-49b1-49bc-a306-a49654f5698b.521be503-1774-4698-bc7e-e0a97900f19f" returned: 0 in 0.403s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:21:11 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-10cce9d0-6bd7-4b1d-ae02-b8402fd6bb82 tempest-VolumesExtendTest-597420486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7e36c759-49b1-49bc-a306-a49654f5698b.info {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:21:11 devstack sudo[100327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7e36c759-49b1-49bc-a306-a49654f5698b.info Aug 05 06:21:11 devstack sudo[100327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:21:11 devstack sudo[100327]: pam_unix(sudo:session): session closed for user root Aug 05 06:21:11 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-10cce9d0-6bd7-4b1d-ae02-b8402fd6bb82 tempest-VolumesExtendTest-597420486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7e36c759-49b1-49bc-a306-a49654f5698b.info" returned: 0 in 0.269s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:21:11 devstack cinder-volume[88695]: WARNING cinder.volume.drivers.remotefs [None req-10cce9d0-6bd7-4b1d-ae02-b8402fd6bb82 tempest-VolumesExtendTest-597420486 None] /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7e36c759-49b1-49bc-a306-a49654f5698b.info is being set with open permissions: ugo+rw Aug 05 06:21:11 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-10cce9d0-6bd7-4b1d-ae02-b8402fd6bb82 tempest-VolumesExtendTest-597420486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7e36c759-49b1-49bc-a306-a49654f5698b.info {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:21:11 devstack sudo[100330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7e36c759-49b1-49bc-a306-a49654f5698b.info Aug 05 06:21:11 devstack sudo[100330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:21:11 devstack sudo[100330]: pam_unix(sudo:session): session closed for user root Aug 05 06:21:11 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-10cce9d0-6bd7-4b1d-ae02-b8402fd6bb82 tempest-VolumesExtendTest-597420486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7e36c759-49b1-49bc-a306-a49654f5698b.info" returned: 0 in 0.248s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:21:11 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-10cce9d0-6bd7-4b1d-ae02-b8402fd6bb82 tempest-VolumesExtendTest-597420486 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.503s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:21:11 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-39438c5d-1153-484b-9529-f024bf1d4d4c tempest-VolumeDependencyTests-69769482 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.601s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:21:11 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-39438c5d-1153-484b-9529-f024bf1d4d4c tempest-VolumeDependencyTests-69769482 None] Acquiring lock "cinder-quobyte-381d6c04-6024-41a4-9f79-d22179d6006c-15768eed-b0b8-40cd-b03b-23aa4d96ad44" by "_create_volume_from_snapshot" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:21:12 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-39438c5d-1153-484b-9529-f024bf1d4d4c tempest-VolumeDependencyTests-69769482 None] Lock "cinder-quobyte-381d6c04-6024-41a4-9f79-d22179d6006c-15768eed-b0b8-40cd-b03b-23aa4d96ad44" acquired by "_create_volume_from_snapshot" :: waited 0.022s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:21:12 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-39438c5d-1153-484b-9529-f024bf1d4d4c tempest-VolumeDependencyTests-69769482 None] Creating volume 15768eed-b0b8-40cd-b03b-23aa4d96ad44 from snapshot 381d6c04-6024-41a4-9f79-d22179d6006c {{(pid=88695) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 05 06:21:12 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-39438c5d-1153-484b-9529-f024bf1d4d4c tempest-VolumeDependencyTests-69769482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:21:12 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-39438c5d-1153-484b-9529-f024bf1d4d4c tempest-VolumeDependencyTests-69769482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:21:12 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-39438c5d-1153-484b-9529-f024bf1d4d4c tempest-VolumeDependencyTests-69769482 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:21:12 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-39438c5d-1153-484b-9529-f024bf1d4d4c tempest-VolumeDependencyTests-69769482 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:21:12 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-39438c5d-1153-484b-9529-f024bf1d4d4c tempest-VolumeDependencyTests-69769482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:21:12 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-39438c5d-1153-484b-9529-f024bf1d4d4c tempest-VolumeDependencyTests-69769482 None] Selected osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 as target Quobyte volume. {{(pid=88695) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 06:21:12 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-39438c5d-1153-484b-9529-f024bf1d4d4c tempest-VolumeDependencyTests-69769482 None] Acquiring lock "cinder-quobyte-15768eed-b0b8-40cd-b03b-23aa4d96ad44" by "_copy_volume_from_snapshot" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:21:12 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-10cce9d0-6bd7-4b1d-ae02-b8402fd6bb82 tempest-VolumesExtendTest-597420486 None] Create snapshot completed successfully Aug 05 06:21:12 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-39438c5d-1153-484b-9529-f024bf1d4d4c tempest-VolumeDependencyTests-69769482 None] Lock "cinder-quobyte-15768eed-b0b8-40cd-b03b-23aa4d96ad44" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:21:12 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-39438c5d-1153-484b-9529-f024bf1d4d4c tempest-VolumeDependencyTests-69769482 None] snapshot: 381d6c04-6024-41a4-9f79-d22179d6006c, volume: 15768eed-b0b8-40cd-b03b-23aa4d96ad44, {{(pid=88695) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 05 06:21:12 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-39438c5d-1153-484b-9529-f024bf1d4d4c tempest-VolumeDependencyTests-69769482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:21:12 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-39438c5d-1153-484b-9529-f024bf1d4d4c tempest-VolumeDependencyTests-69769482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:21:12 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-39438c5d-1153-484b-9529-f024bf1d4d4c tempest-VolumeDependencyTests-69769482 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:21:12 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-39438c5d-1153-484b-9529-f024bf1d4d4c tempest-VolumeDependencyTests-69769482 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:21:12 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-39438c5d-1153-484b-9529-f024bf1d4d4c tempest-VolumeDependencyTests-69769482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:21:12 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[fae2a738-fa91-4cad-8d3b-df149e47e127]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:21:12 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-39438c5d-1153-484b-9529-f024bf1d4d4c tempest-VolumeDependencyTests-69769482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7407a5d7-9186-4462-af38-3c87ab2091b8.381d6c04-6024-41a4-9f79-d22179d6006c {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:21:12 devstack sudo[100333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7407a5d7-9186-4462-af38-3c87ab2091b8.381d6c04-6024-41a4-9f79-d22179d6006c Aug 05 06:21:12 devstack sudo[100333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:21:12 devstack sudo[100333]: pam_unix(sudo:session): session closed for user root Aug 05 06:21:12 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-39438c5d-1153-484b-9529-f024bf1d4d4c tempest-VolumeDependencyTests-69769482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7407a5d7-9186-4462-af38-3c87ab2091b8.381d6c04-6024-41a4-9f79-d22179d6006c" returned: 0 in 0.417s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:21:12 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-39438c5d-1153-484b-9529-f024bf1d4d4c tempest-VolumeDependencyTests-69769482 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7407a5d7-9186-4462-af38-3c87ab2091b8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88695) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 06:21:12 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[18baa9a0-6c2f-4ca6-a75d-e2cffa8add2e]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:21:12 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-39438c5d-1153-484b-9529-f024bf1d4d4c tempest-VolumeDependencyTests-69769482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7407a5d7-9186-4462-af38-3c87ab2091b8 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:21:12 devstack sudo[100338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7407a5d7-9186-4462-af38-3c87ab2091b8 Aug 05 06:21:12 devstack sudo[100338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:21:12 devstack sudo[100338]: pam_unix(sudo:session): session closed for user root Aug 05 06:21:12 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-39438c5d-1153-484b-9529-f024bf1d4d4c tempest-VolumeDependencyTests-69769482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7407a5d7-9186-4462-af38-3c87ab2091b8" returned: 0 in 0.401s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:21:12 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-39438c5d-1153-484b-9529-f024bf1d4d4c tempest-VolumeDependencyTests-69769482 None] will copy from snapshot at /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7407a5d7-9186-4462-af38-3c87ab2091b8 {{(pid=88695) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 05 06:21:12 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-39438c5d-1153-484b-9529-f024bf1d4d4c tempest-VolumeDependencyTests-69769482 None] Creating direct copy from snapshot {{(pid=88695) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 05 06:21:12 devstack cinder-volume[88695]: DEBUG cinder.utils [None req-39438c5d-1153-484b-9529-f024bf1d4d4c tempest-VolumeDependencyTests-69769482 None] Path /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-15768eed-b0b8-40cd-b03b-23aa4d96ad44 not found in is_blk_device check {{(pid=88695) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 05 06:21:12 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-39438c5d-1153-484b-9529-f024bf1d4d4c tempest-VolumeDependencyTests-69769482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7407a5d7-9186-4462-af38-3c87ab2091b8 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-15768eed-b0b8-40cd-b03b-23aa4d96ad44 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:21:12 devstack sudo[100343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7407a5d7-9186-4462-af38-3c87ab2091b8 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-15768eed-b0b8-40cd-b03b-23aa4d96ad44 Aug 05 06:21:12 devstack sudo[100343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:21:13 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-c02e47f9-be3f-4b64-a893-4153f7b368e2 tempest-VolumesExtendTest-597420486 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:21:17 devstack sudo[100343]: pam_unix(sudo:session): session closed for user root Aug 05 06:21:17 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-39438c5d-1153-484b-9529-f024bf1d4d4c tempest-VolumeDependencyTests-69769482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7407a5d7-9186-4462-af38-3c87ab2091b8 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-15768eed-b0b8-40cd-b03b-23aa4d96ad44" returned: 0 in 4.770s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:21:17 devstack cinder-volume[88695]: DEBUG cinder.image.image_utils [None req-39438c5d-1153-484b-9529-f024bf1d4d4c tempest-VolumeDependencyTests-69769482 None] Image conversion details: src /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7407a5d7-9186-4462-af38-3c87ab2091b8, size 1024.00 MB, duration 4.77 sec, destination /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-15768eed-b0b8-40cd-b03b-23aa4d96ad44 {{(pid=88695) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 05 06:21:17 devstack cinder-volume[88695]: INFO cinder.image.image_utils [None req-39438c5d-1153-484b-9529-f024bf1d4d4c tempest-VolumeDependencyTests-69769482 None] Converted 1024.00 MB image at 214.64 MB/s Aug 05 06:21:17 devstack cinder-volume[88695]: WARNING cinder.volume.drivers.remotefs [None req-39438c5d-1153-484b-9529-f024bf1d4d4c tempest-VolumeDependencyTests-69769482 None] /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-15768eed-b0b8-40cd-b03b-23aa4d96ad44 is being set with open permissions: ugo+rw Aug 05 06:21:17 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-39438c5d-1153-484b-9529-f024bf1d4d4c tempest-VolumeDependencyTests-69769482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-15768eed-b0b8-40cd-b03b-23aa4d96ad44 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:21:17 devstack sudo[100359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-15768eed-b0b8-40cd-b03b-23aa4d96ad44 Aug 05 06:21:17 devstack sudo[100359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:21:17 devstack sudo[100359]: pam_unix(sudo:session): session closed for user root Aug 05 06:21:17 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-39438c5d-1153-484b-9529-f024bf1d4d4c tempest-VolumeDependencyTests-69769482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-15768eed-b0b8-40cd-b03b-23aa4d96ad44" returned: 0 in 0.256s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:21:17 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-39438c5d-1153-484b-9529-f024bf1d4d4c tempest-VolumeDependencyTests-69769482 None] Lock "cinder-quobyte-15768eed-b0b8-40cd-b03b-23aa4d96ad44" released by "_copy_volume_from_snapshot" :: held 5.937s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:21:18 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-39438c5d-1153-484b-9529-f024bf1d4d4c tempest-VolumeDependencyTests-69769482 None] Lock "cinder-quobyte-381d6c04-6024-41a4-9f79-d22179d6006c-15768eed-b0b8-40cd-b03b-23aa4d96ad44" released by "_create_volume_from_snapshot" :: held 6.007s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:21:18 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-39438c5d-1153-484b-9529-f024bf1d4d4c tempest-VolumeDependencyTests-69769482 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.031s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:21:18 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-c02e47f9-be3f-4b64-a893-4153f7b368e2 tempest-VolumesExtendTest-597420486 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 4.944s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:21:18 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[7504d331-97ee-4d65-bbb9-b2581c3405ba]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:21:18 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-c02e47f9-be3f-4b64-a893-4153f7b368e2 tempest-VolumesExtendTest-597420486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7e36c759-49b1-49bc-a306-a49654f5698b {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:21:18 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-39438c5d-1153-484b-9529-f024bf1d4d4c tempest-VolumeDependencyTests-69769482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a0856e0-1214-4d7c-8d12-1289dce12ec6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15768eed-b0b8-40cd-b03b-23aa4d96ad44', 'volume_size': 1, 'snapshot_id': '381d6c04-6024-41a4-9f79-d22179d6006c'}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:21:18 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-39438c5d-1153-484b-9529-f024bf1d4d4c tempest-VolumeDependencyTests-69769482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81643c13-6af2-48e9-85df-1a7e443ddabd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:21:18 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-39438c5d-1153-484b-9529-f024bf1d4d4c tempest-VolumeDependencyTests-69769482 None] Volume volume-15768eed-b0b8-40cd-b03b-23aa4d96ad44 (15768eed-b0b8-40cd-b03b-23aa4d96ad44): created successfully Aug 05 06:21:18 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-39438c5d-1153-484b-9529-f024bf1d4d4c tempest-VolumeDependencyTests-69769482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81643c13-6af2-48e9-85df-1a7e443ddabd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:21:18 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-39438c5d-1153-484b-9529-f024bf1d4d4c tempest-VolumeDependencyTests-69769482 None] Flow 'volume_create_manager' (9ec1f7c2-8427-48c9-af74-4d118f9727dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:21:18 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-39438c5d-1153-484b-9529-f024bf1d4d4c tempest-VolumeDependencyTests-69769482 None] Created volume successfully. Aug 05 06:21:18 devstack sudo[100363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7e36c759-49b1-49bc-a306-a49654f5698b Aug 05 06:21:18 devstack sudo[100363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:21:18 devstack sudo[100363]: pam_unix(sudo:session): session closed for user root Aug 05 06:21:18 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-c02e47f9-be3f-4b64-a893-4153f7b368e2 tempest-VolumesExtendTest-597420486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7e36c759-49b1-49bc-a306-a49654f5698b" returned: 0 in 0.411s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:21:18 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-c02e47f9-be3f-4b64-a893-4153f7b368e2 tempest-VolumesExtendTest-597420486 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7e36c759-49b1-49bc-a306-a49654f5698b.521be503-1774-4698-bc7e-e0a97900f19f 2G {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:21:18 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-c02e47f9-be3f-4b64-a893-4153f7b368e2 tempest-VolumesExtendTest-597420486 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7e36c759-49b1-49bc-a306-a49654f5698b.521be503-1774-4698-bc7e-e0a97900f19f 2G" returned: 0 in 0.141s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:21:18 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-c02e47f9-be3f-4b64-a893-4153f7b368e2 tempest-VolumesExtendTest-597420486 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.590s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:21:18 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-c02e47f9-be3f-4b64-a893-4153f7b368e2 tempest-VolumesExtendTest-597420486 None] Extend volume completed successfully. Aug 05 06:21:18 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-d8152f83-592f-4494-8f24-c3d46437ee45 tempest-VolumeDependencyTests-69769482 None] Acquiring lock "cinder-381d6c04-6024-41a4-9f79-d22179d6006c-delete_snapshot" by "delete_snapshot" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:21:18 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-d8152f83-592f-4494-8f24-c3d46437ee45 tempest-VolumeDependencyTests-69769482 None] Lock "cinder-381d6c04-6024-41a4-9f79-d22179d6006c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:21:18 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-d8152f83-592f-4494-8f24-c3d46437ee45 tempest-VolumeDependencyTests-69769482 None] Acquiring lock "cinder-quobyte-7407a5d7-9186-4462-af38-3c87ab2091b8" by "delete_snapshot" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:21:18 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-d8152f83-592f-4494-8f24-c3d46437ee45 tempest-VolumeDependencyTests-69769482 None] Lock "cinder-quobyte-7407a5d7-9186-4462-af38-3c87ab2091b8" acquired by "delete_snapshot" :: waited 0.028s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:21:18 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-d8152f83-592f-4494-8f24-c3d46437ee45 tempest-VolumeDependencyTests-69769482 None] Acquiring lock "cinder-quobyte-381d6c04-6024-41a4-9f79-d22179d6006c" by "_delete_snapshot" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:21:18 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-a77556c1-39a2-4b6f-8d3a-32829bafc093 tempest-VolumesExtendTest-597420486 None] Acquiring lock "cinder-521be503-1774-4698-bc7e-e0a97900f19f-delete_snapshot" by "delete_snapshot" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:21:18 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-d8152f83-592f-4494-8f24-c3d46437ee45 tempest-VolumeDependencyTests-69769482 None] Lock "cinder-quobyte-381d6c04-6024-41a4-9f79-d22179d6006c" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:21:18 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-d8152f83-592f-4494-8f24-c3d46437ee45 tempest-VolumeDependencyTests-69769482 None] Deleting offline snapshot 381d6c04-6024-41a4-9f79-d22179d6006c of volume 7407a5d7-9186-4462-af38-3c87ab2091b8 {{(pid=88695) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 06:21:18 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-d8152f83-592f-4494-8f24-c3d46437ee45 tempest-VolumeDependencyTests-69769482 None] snapshot_file for this snap is: volume-7407a5d7-9186-4462-af38-3c87ab2091b8.381d6c04-6024-41a4-9f79-d22179d6006c {{(pid=88695) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 06:21:18 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-a77556c1-39a2-4b6f-8d3a-32829bafc093 tempest-VolumesExtendTest-597420486 None] Lock "cinder-521be503-1774-4698-bc7e-e0a97900f19f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.071s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:21:18 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-a77556c1-39a2-4b6f-8d3a-32829bafc093 tempest-VolumesExtendTest-597420486 None] Acquiring lock "cinder-quobyte-7e36c759-49b1-49bc-a306-a49654f5698b" by "delete_snapshot" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:21:18 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f5c4770-d5f8-496b-81aa-f02b68ed4deb]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:21:18 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-d8152f83-592f-4494-8f24-c3d46437ee45 tempest-VolumeDependencyTests-69769482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7407a5d7-9186-4462-af38-3c87ab2091b8.381d6c04-6024-41a4-9f79-d22179d6006c {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:21:19 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-a77556c1-39a2-4b6f-8d3a-32829bafc093 tempest-VolumesExtendTest-597420486 None] Lock "cinder-quobyte-7e36c759-49b1-49bc-a306-a49654f5698b" acquired by "delete_snapshot" :: waited 0.043s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:21:19 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-a77556c1-39a2-4b6f-8d3a-32829bafc093 tempest-VolumesExtendTest-597420486 None] Acquiring lock "cinder-quobyte-521be503-1774-4698-bc7e-e0a97900f19f" by "_delete_snapshot" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:21:19 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-a77556c1-39a2-4b6f-8d3a-32829bafc093 tempest-VolumesExtendTest-597420486 None] Lock "cinder-quobyte-521be503-1774-4698-bc7e-e0a97900f19f" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:21:19 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-a77556c1-39a2-4b6f-8d3a-32829bafc093 tempest-VolumesExtendTest-597420486 None] Deleting offline snapshot 521be503-1774-4698-bc7e-e0a97900f19f of volume 7e36c759-49b1-49bc-a306-a49654f5698b {{(pid=88695) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 06:21:19 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-a77556c1-39a2-4b6f-8d3a-32829bafc093 tempest-VolumesExtendTest-597420486 None] snapshot_file for this snap is: volume-7e36c759-49b1-49bc-a306-a49654f5698b.521be503-1774-4698-bc7e-e0a97900f19f {{(pid=88695) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 06:21:19 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e7f7306-a65a-4d8a-aa3f-0396d84cf431]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:21:19 devstack sudo[100372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7407a5d7-9186-4462-af38-3c87ab2091b8.381d6c04-6024-41a4-9f79-d22179d6006c Aug 05 06:21:19 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-a77556c1-39a2-4b6f-8d3a-32829bafc093 tempest-VolumesExtendTest-597420486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7e36c759-49b1-49bc-a306-a49654f5698b.521be503-1774-4698-bc7e-e0a97900f19f {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:21:19 devstack sudo[100372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:21:19 devstack sudo[100374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7e36c759-49b1-49bc-a306-a49654f5698b.521be503-1774-4698-bc7e-e0a97900f19f Aug 05 06:21:19 devstack sudo[100374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:21:19 devstack sudo[100372]: pam_unix(sudo:session): session closed for user root Aug 05 06:21:19 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-d8152f83-592f-4494-8f24-c3d46437ee45 tempest-VolumeDependencyTests-69769482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7407a5d7-9186-4462-af38-3c87ab2091b8.381d6c04-6024-41a4-9f79-d22179d6006c" returned: 0 in 0.511s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:21:19 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-d8152f83-592f-4494-8f24-c3d46437ee45 tempest-VolumeDependencyTests-69769482 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7407a5d7-9186-4462-af38-3c87ab2091b8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88695) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 06:21:19 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[924ccbec-14c8-45b9-bba8-7d8382be81f7]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:21:19 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-d8152f83-592f-4494-8f24-c3d46437ee45 tempest-VolumeDependencyTests-69769482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7407a5d7-9186-4462-af38-3c87ab2091b8 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:21:19 devstack sudo[100374]: pam_unix(sudo:session): session closed for user root Aug 05 06:21:19 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-a77556c1-39a2-4b6f-8d3a-32829bafc093 tempest-VolumesExtendTest-597420486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7e36c759-49b1-49bc-a306-a49654f5698b.521be503-1774-4698-bc7e-e0a97900f19f" returned: 0 in 0.540s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:21:19 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-a77556c1-39a2-4b6f-8d3a-32829bafc093 tempest-VolumesExtendTest-597420486 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7e36c759-49b1-49bc-a306-a49654f5698b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88695) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 06:21:19 devstack sudo[100385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7407a5d7-9186-4462-af38-3c87ab2091b8 Aug 05 06:21:19 devstack sudo[100385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:21:19 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca859758-f0fa-4053-af93-743dbb32638a]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:21:19 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-a77556c1-39a2-4b6f-8d3a-32829bafc093 tempest-VolumesExtendTest-597420486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7e36c759-49b1-49bc-a306-a49654f5698b {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:21:19 devstack sudo[100395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7e36c759-49b1-49bc-a306-a49654f5698b Aug 05 06:21:19 devstack sudo[100395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:21:20 devstack sudo[100395]: pam_unix(sudo:session): session closed for user root Aug 05 06:21:20 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-a77556c1-39a2-4b6f-8d3a-32829bafc093 tempest-VolumesExtendTest-597420486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7e36c759-49b1-49bc-a306-a49654f5698b" returned: 0 in 0.578s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:21:20 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-a77556c1-39a2-4b6f-8d3a-32829bafc093 tempest-VolumesExtendTest-597420486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7e36c759-49b1-49bc-a306-a49654f5698b.521be503-1774-4698-bc7e-e0a97900f19f {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:21:20 devstack sudo[100385]: pam_unix(sudo:session): session closed for user root Aug 05 06:21:20 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-d8152f83-592f-4494-8f24-c3d46437ee45 tempest-VolumeDependencyTests-69769482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7407a5d7-9186-4462-af38-3c87ab2091b8" returned: 0 in 0.763s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:21:20 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-d8152f83-592f-4494-8f24-c3d46437ee45 tempest-VolumeDependencyTests-69769482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7407a5d7-9186-4462-af38-3c87ab2091b8.381d6c04-6024-41a4-9f79-d22179d6006c {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:21:20 devstack sudo[100411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7e36c759-49b1-49bc-a306-a49654f5698b.521be503-1774-4698-bc7e-e0a97900f19f Aug 05 06:21:20 devstack sudo[100411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:21:20 devstack sudo[100413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7407a5d7-9186-4462-af38-3c87ab2091b8.381d6c04-6024-41a4-9f79-d22179d6006c Aug 05 06:21:20 devstack sudo[100413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:21:20 devstack sudo[100411]: pam_unix(sudo:session): session closed for user root Aug 05 06:21:20 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-a77556c1-39a2-4b6f-8d3a-32829bafc093 tempest-VolumesExtendTest-597420486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7e36c759-49b1-49bc-a306-a49654f5698b.521be503-1774-4698-bc7e-e0a97900f19f" returned: 0 in 0.427s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:21:20 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-a77556c1-39a2-4b6f-8d3a-32829bafc093 tempest-VolumesExtendTest-597420486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7e36c759-49b1-49bc-a306-a49654f5698b.521be503-1774-4698-bc7e-e0a97900f19f {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:21:20 devstack sudo[100413]: pam_unix(sudo:session): session closed for user root Aug 05 06:21:20 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-d8152f83-592f-4494-8f24-c3d46437ee45 tempest-VolumeDependencyTests-69769482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7407a5d7-9186-4462-af38-3c87ab2091b8.381d6c04-6024-41a4-9f79-d22179d6006c" returned: 0 in 0.404s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:21:20 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-d8152f83-592f-4494-8f24-c3d46437ee45 tempest-VolumeDependencyTests-69769482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7407a5d7-9186-4462-af38-3c87ab2091b8.381d6c04-6024-41a4-9f79-d22179d6006c {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:21:20 devstack sudo[100423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7e36c759-49b1-49bc-a306-a49654f5698b.521be503-1774-4698-bc7e-e0a97900f19f Aug 05 06:21:20 devstack sudo[100423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:21:20 devstack sudo[100424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7407a5d7-9186-4462-af38-3c87ab2091b8.381d6c04-6024-41a4-9f79-d22179d6006c Aug 05 06:21:20 devstack sudo[100424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:21:21 devstack sudo[100424]: pam_unix(sudo:session): session closed for user root Aug 05 06:21:21 devstack sudo[100423]: pam_unix(sudo:session): session closed for user root Aug 05 06:21:21 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-d8152f83-592f-4494-8f24-c3d46437ee45 tempest-VolumeDependencyTests-69769482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7407a5d7-9186-4462-af38-3c87ab2091b8.381d6c04-6024-41a4-9f79-d22179d6006c" returned: 0 in 0.296s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:21:21 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-a77556c1-39a2-4b6f-8d3a-32829bafc093 tempest-VolumesExtendTest-597420486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7e36c759-49b1-49bc-a306-a49654f5698b.521be503-1774-4698-bc7e-e0a97900f19f" returned: 0 in 0.319s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:21:21 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-d8152f83-592f-4494-8f24-c3d46437ee45 tempest-VolumeDependencyTests-69769482 None] Lock "cinder-quobyte-381d6c04-6024-41a4-9f79-d22179d6006c" released by "_delete_snapshot" :: held 2.188s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:21:21 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-a77556c1-39a2-4b6f-8d3a-32829bafc093 tempest-VolumesExtendTest-597420486 None] Lock "cinder-quobyte-521be503-1774-4698-bc7e-e0a97900f19f" released by "_delete_snapshot" :: held 2.053s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:21:21 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-d8152f83-592f-4494-8f24-c3d46437ee45 tempest-VolumeDependencyTests-69769482 None] Lock "cinder-quobyte-7407a5d7-9186-4462-af38-3c87ab2091b8" released by "delete_snapshot" :: held 2.226s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:21:21 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-a77556c1-39a2-4b6f-8d3a-32829bafc093 tempest-VolumesExtendTest-597420486 None] Lock "cinder-quobyte-7e36c759-49b1-49bc-a306-a49654f5698b" released by "delete_snapshot" :: held 2.095s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:21:21 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-a77556c1-39a2-4b6f-8d3a-32829bafc093 tempest-VolumesExtendTest-597420486 None] Created reservations ['407e340f-3063-47be-90e0-28cbf91f9a60', '94027047-dc78-4ed8-8608-401fd394ed3d', '8ec640dc-e530-4b2a-adc5-567d98ec67cd', 'e03f9522-17c4-4c51-ad03-a927a67222ed'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:21:21 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-d8152f83-592f-4494-8f24-c3d46437ee45 tempest-VolumeDependencyTests-69769482 None] Created reservations ['c32b96c0-66bb-48a2-874e-72d44d6644fe', '5b0cff62-c22d-447f-b20e-171b1b746422', 'd73fc0ff-9fdd-47b9-99ab-f1a23da7ac79', '9eaa7ea0-20d9-452a-93c3-46b2a74e3f12'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:21:21 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-d8152f83-592f-4494-8f24-c3d46437ee45 tempest-VolumeDependencyTests-69769482 None] Delete snapshot completed successfully. Aug 05 06:21:21 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-d8152f83-592f-4494-8f24-c3d46437ee45 tempest-VolumeDependencyTests-69769482 None] Lock "cinder-381d6c04-6024-41a4-9f79-d22179d6006c-delete_snapshot" released by "delete_snapshot" :: held 2.456s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:21:21 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-a77556c1-39a2-4b6f-8d3a-32829bafc093 tempest-VolumesExtendTest-597420486 None] Delete snapshot completed successfully. Aug 05 06:21:21 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-a77556c1-39a2-4b6f-8d3a-32829bafc093 tempest-VolumesExtendTest-597420486 None] Lock "cinder-521be503-1774-4698-bc7e-e0a97900f19f-delete_snapshot" released by "delete_snapshot" :: held 2.397s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:21:22 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-0e16151e-7adc-4263-805d-7856fb3bd591 tempest-VolumeDependencyTests-69769482 None] Acquiring lock "cinder-7407a5d7-9186-4462-af38-3c87ab2091b8-delete_volume" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:21:22 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-0e16151e-7adc-4263-805d-7856fb3bd591 tempest-VolumeDependencyTests-69769482 None] Lock "cinder-7407a5d7-9186-4462-af38-3c87ab2091b8-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:21:22 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-0e16151e-7adc-4263-805d-7856fb3bd591 tempest-VolumeDependencyTests-69769482 None] Acquiring lock "cinder-quobyte-7407a5d7-9186-4462-af38-3c87ab2091b8" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:21:22 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-0e16151e-7adc-4263-805d-7856fb3bd591 tempest-VolumeDependencyTests-69769482 None] Lock "cinder-quobyte-7407a5d7-9186-4462-af38-3c87ab2091b8" acquired by "delete_volume" :: waited 0.019s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:21:22 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-cb8caa56-fca7-4b5a-a519-23c812fe7c42 tempest-VolumesExtendTest-597420486 None] Acquiring lock "cinder-7e36c759-49b1-49bc-a306-a49654f5698b-delete_volume" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:21:22 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb455761-bd9f-40b4-be47-e761204fa8b6]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:21:22 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-0e16151e-7adc-4263-805d-7856fb3bd591 tempest-VolumeDependencyTests-69769482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7407a5d7-9186-4462-af38-3c87ab2091b8 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:21:22 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-cb8caa56-fca7-4b5a-a519-23c812fe7c42 tempest-VolumesExtendTest-597420486 None] Lock "cinder-7e36c759-49b1-49bc-a306-a49654f5698b-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:21:22 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-cb8caa56-fca7-4b5a-a519-23c812fe7c42 tempest-VolumesExtendTest-597420486 None] Acquiring lock "cinder-quobyte-7e36c759-49b1-49bc-a306-a49654f5698b" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:21:22 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-cb8caa56-fca7-4b5a-a519-23c812fe7c42 tempest-VolumesExtendTest-597420486 None] Lock "cinder-quobyte-7e36c759-49b1-49bc-a306-a49654f5698b" acquired by "delete_volume" :: waited 0.042s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:21:22 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[94aa002a-3011-49ac-be2a-d38a721cdfde]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:21:22 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-cb8caa56-fca7-4b5a-a519-23c812fe7c42 tempest-VolumesExtendTest-597420486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7e36c759-49b1-49bc-a306-a49654f5698b {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:21:22 devstack sudo[100462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7407a5d7-9186-4462-af38-3c87ab2091b8 Aug 05 06:21:22 devstack sudo[100462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:21:22 devstack sudo[100474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7e36c759-49b1-49bc-a306-a49654f5698b Aug 05 06:21:22 devstack sudo[100474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:21:23 devstack sudo[100462]: pam_unix(sudo:session): session closed for user root Aug 05 06:21:23 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-0e16151e-7adc-4263-805d-7856fb3bd591 tempest-VolumeDependencyTests-69769482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7407a5d7-9186-4462-af38-3c87ab2091b8" returned: 0 in 0.708s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:21:23 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-0e16151e-7adc-4263-805d-7856fb3bd591 tempest-VolumeDependencyTests-69769482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7407a5d7-9186-4462-af38-3c87ab2091b8 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:21:23 devstack sudo[100496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7407a5d7-9186-4462-af38-3c87ab2091b8 Aug 05 06:21:23 devstack sudo[100496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:21:23 devstack sudo[100474]: pam_unix(sudo:session): session closed for user root Aug 05 06:21:23 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-cb8caa56-fca7-4b5a-a519-23c812fe7c42 tempest-VolumesExtendTest-597420486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7e36c759-49b1-49bc-a306-a49654f5698b" returned: 0 in 0.572s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:21:23 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-cb8caa56-fca7-4b5a-a519-23c812fe7c42 tempest-VolumesExtendTest-597420486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7e36c759-49b1-49bc-a306-a49654f5698b {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:21:23 devstack sudo[100501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7e36c759-49b1-49bc-a306-a49654f5698b Aug 05 06:21:23 devstack sudo[100501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:21:23 devstack sudo[100496]: pam_unix(sudo:session): session closed for user root Aug 05 06:21:23 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-0e16151e-7adc-4263-805d-7856fb3bd591 tempest-VolumeDependencyTests-69769482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7407a5d7-9186-4462-af38-3c87ab2091b8" returned: 0 in 0.354s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:21:23 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-0e16151e-7adc-4263-805d-7856fb3bd591 tempest-VolumeDependencyTests-69769482 None] Lock "cinder-quobyte-7407a5d7-9186-4462-af38-3c87ab2091b8" released by "delete_volume" :: held 1.210s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:21:23 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-0e16151e-7adc-4263-805d-7856fb3bd591 tempest-VolumeDependencyTests-69769482 None] Created reservations ['338aea3e-fda2-4614-b605-560e11dcc8f5', '8352d929-6030-4964-aec3-d0e0013ee21e', '617be494-1bd6-491c-add6-0b6538738894', 'b7a23090-ce1b-41ab-a1c5-eebff7b48610'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:21:23 devstack sudo[100501]: pam_unix(sudo:session): session closed for user root Aug 05 06:21:23 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-cb8caa56-fca7-4b5a-a519-23c812fe7c42 tempest-VolumesExtendTest-597420486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7e36c759-49b1-49bc-a306-a49654f5698b" returned: 0 in 0.374s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:21:23 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-cb8caa56-fca7-4b5a-a519-23c812fe7c42 tempest-VolumesExtendTest-597420486 None] Lock "cinder-quobyte-7e36c759-49b1-49bc-a306-a49654f5698b" released by "delete_volume" :: held 1.056s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:21:23 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-0e16151e-7adc-4263-805d-7856fb3bd591 tempest-VolumeDependencyTests-69769482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:21:23 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-0e16151e-7adc-4263-805d-7856fb3bd591 tempest-VolumeDependencyTests-69769482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:21:23 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-0e16151e-7adc-4263-805d-7856fb3bd591 tempest-VolumeDependencyTests-69769482 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:21:23 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-0e16151e-7adc-4263-805d-7856fb3bd591 tempest-VolumeDependencyTests-69769482 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:21:23 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-0e16151e-7adc-4263-805d-7856fb3bd591 tempest-VolumeDependencyTests-69769482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:21:23 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-0e16151e-7adc-4263-805d-7856fb3bd591 tempest-VolumeDependencyTests-69769482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:21:23 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-cb8caa56-fca7-4b5a-a519-23c812fe7c42 tempest-VolumesExtendTest-597420486 None] Created reservations ['e7ce24ba-9ea5-49ed-8226-d57228e54436', '74074350-146c-4bcb-b762-d8ca8bcd39f9', '33e0417f-f37b-4a6b-b607-9dc36b37d10a', '8146ba5b-afdf-44df-a9c9-0cd70b29130c'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:21:23 devstack sudo[100527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce Aug 05 06:21:23 devstack sudo[100527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:21:23 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-cb8caa56-fca7-4b5a-a519-23c812fe7c42 tempest-VolumesExtendTest-597420486 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:21:23 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-cb8caa56-fca7-4b5a-a519-23c812fe7c42 tempest-VolumesExtendTest-597420486 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:21:23 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-cb8caa56-fca7-4b5a-a519-23c812fe7c42 tempest-VolumesExtendTest-597420486 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:21:23 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-cb8caa56-fca7-4b5a-a519-23c812fe7c42 tempest-VolumesExtendTest-597420486 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:21:23 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-cb8caa56-fca7-4b5a-a519-23c812fe7c42 tempest-VolumesExtendTest-597420486 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:21:23 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-cb8caa56-fca7-4b5a-a519-23c812fe7c42 tempest-VolumesExtendTest-597420486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:21:23 devstack sudo[100529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce Aug 05 06:21:23 devstack sudo[100529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:21:24 devstack sudo[100527]: pam_unix(sudo:session): session closed for user root Aug 05 06:21:24 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-0e16151e-7adc-4263-805d-7856fb3bd591 tempest-VolumeDependencyTests-69769482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce" returned: 0 in 0.281s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:21:24 devstack cinder-volume[88695]: DEBUG cinder.manager [None req-0e16151e-7adc-4263-805d-7856fb3bd591 tempest-VolumeDependencyTests-69769482 None] Notifying Schedulers of capabilities ... {{(pid=88695) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 06:21:24 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-0e16151e-7adc-4263-805d-7856fb3bd591 tempest-VolumeDependencyTests-69769482 None] Deleted volume successfully. Aug 05 06:21:24 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-0e16151e-7adc-4263-805d-7856fb3bd591 tempest-VolumeDependencyTests-69769482 None] Lock "cinder-7407a5d7-9186-4462-af38-3c87ab2091b8-delete_volume" released by "delete_volume" :: held 1.842s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:21:24 devstack sudo[100529]: pam_unix(sudo:session): session closed for user root Aug 05 06:21:24 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-cb8caa56-fca7-4b5a-a519-23c812fe7c42 tempest-VolumesExtendTest-597420486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce" returned: 0 in 0.279s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:21:24 devstack cinder-volume[88695]: DEBUG cinder.manager [None req-cb8caa56-fca7-4b5a-a519-23c812fe7c42 tempest-VolumesExtendTest-597420486 None] Notifying Schedulers of capabilities ... {{(pid=88695) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 06:21:24 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-cb8caa56-fca7-4b5a-a519-23c812fe7c42 tempest-VolumesExtendTest-597420486 None] Deleted volume successfully. Aug 05 06:21:24 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-cb8caa56-fca7-4b5a-a519-23c812fe7c42 tempest-VolumesExtendTest-597420486 None] Lock "cinder-7e36c759-49b1-49bc-a306-a49654f5698b-delete_volume" released by "delete_volume" :: held 1.669s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:21:24 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-de611db3-fe59-4345-86be-b7e089fe82f7 tempest-VolumeDependencyTests-69769482 None] Acquiring lock "cinder-15768eed-b0b8-40cd-b03b-23aa4d96ad44-delete_volume" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:21:24 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-de611db3-fe59-4345-86be-b7e089fe82f7 tempest-VolumeDependencyTests-69769482 None] Lock "cinder-15768eed-b0b8-40cd-b03b-23aa4d96ad44-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:21:24 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-de611db3-fe59-4345-86be-b7e089fe82f7 tempest-VolumeDependencyTests-69769482 None] Acquiring lock "cinder-quobyte-15768eed-b0b8-40cd-b03b-23aa4d96ad44" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:21:24 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-de611db3-fe59-4345-86be-b7e089fe82f7 tempest-VolumeDependencyTests-69769482 None] Lock "cinder-quobyte-15768eed-b0b8-40cd-b03b-23aa4d96ad44" acquired by "delete_volume" :: waited 0.036s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:21:24 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[282bf83a-4aac-4d4e-8a03-34eba5db54bd]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:21:24 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-de611db3-fe59-4345-86be-b7e089fe82f7 tempest-VolumeDependencyTests-69769482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-15768eed-b0b8-40cd-b03b-23aa4d96ad44 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:21:25 devstack sudo[100535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-15768eed-b0b8-40cd-b03b-23aa4d96ad44 Aug 05 06:21:25 devstack sudo[100535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:21:25 devstack sudo[100535]: pam_unix(sudo:session): session closed for user root Aug 05 06:21:25 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-de611db3-fe59-4345-86be-b7e089fe82f7 tempest-VolumeDependencyTests-69769482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-15768eed-b0b8-40cd-b03b-23aa4d96ad44" returned: 0 in 0.456s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:21:25 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-de611db3-fe59-4345-86be-b7e089fe82f7 tempest-VolumeDependencyTests-69769482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-15768eed-b0b8-40cd-b03b-23aa4d96ad44 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:21:25 devstack sudo[100540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-15768eed-b0b8-40cd-b03b-23aa4d96ad44 Aug 05 06:21:25 devstack sudo[100540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:21:25 devstack sudo[100540]: pam_unix(sudo:session): session closed for user root Aug 05 06:21:25 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-de611db3-fe59-4345-86be-b7e089fe82f7 tempest-VolumeDependencyTests-69769482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-15768eed-b0b8-40cd-b03b-23aa4d96ad44" returned: 0 in 0.360s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:21:25 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-de611db3-fe59-4345-86be-b7e089fe82f7 tempest-VolumeDependencyTests-69769482 None] Lock "cinder-quobyte-15768eed-b0b8-40cd-b03b-23aa4d96ad44" released by "delete_volume" :: held 0.893s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:21:25 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-de611db3-fe59-4345-86be-b7e089fe82f7 tempest-VolumeDependencyTests-69769482 None] Created reservations ['d05eb783-a091-45e2-a8b5-65de3d5c538a', 'c9228832-deb3-4f83-b058-0f73fd86e8f1', 'a2c2a3a5-e71a-43f1-9c6f-160a459a8af1', 'c337075d-c2b6-4946-a4b4-618590456df1'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:21:25 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-de611db3-fe59-4345-86be-b7e089fe82f7 tempest-VolumeDependencyTests-69769482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:21:25 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-de611db3-fe59-4345-86be-b7e089fe82f7 tempest-VolumeDependencyTests-69769482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:21:25 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-de611db3-fe59-4345-86be-b7e089fe82f7 tempest-VolumeDependencyTests-69769482 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:21:25 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-de611db3-fe59-4345-86be-b7e089fe82f7 tempest-VolumeDependencyTests-69769482 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:21:25 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-de611db3-fe59-4345-86be-b7e089fe82f7 tempest-VolumeDependencyTests-69769482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:21:25 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-de611db3-fe59-4345-86be-b7e089fe82f7 tempest-VolumeDependencyTests-69769482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:21:26 devstack sudo[100543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce Aug 05 06:21:26 devstack sudo[100543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:21:26 devstack sudo[100543]: pam_unix(sudo:session): session closed for user root Aug 05 06:21:26 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-de611db3-fe59-4345-86be-b7e089fe82f7 tempest-VolumeDependencyTests-69769482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce" returned: 0 in 0.322s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:21:26 devstack cinder-volume[88695]: DEBUG cinder.manager [None req-de611db3-fe59-4345-86be-b7e089fe82f7 tempest-VolumeDependencyTests-69769482 None] Notifying Schedulers of capabilities ... {{(pid=88695) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 06:21:26 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-de611db3-fe59-4345-86be-b7e089fe82f7 tempest-VolumeDependencyTests-69769482 None] Deleted volume successfully. Aug 05 06:21:26 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-de611db3-fe59-4345-86be-b7e089fe82f7 tempest-VolumeDependencyTests-69769482 None] Lock "cinder-15768eed-b0b8-40cd-b03b-23aa4d96ad44-delete_volume" released by "delete_volume" :: held 1.699s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:21:29 devstack cinder-volume[88695]: DEBUG cinder.volume.flows.manager.create_volume [None req-c078b1f2-1655-40eb-9fed-d996ec420604 tempest-VolumesGetTest-2043829097 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88695) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 06:21:29 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-c078b1f2-1655-40eb-9fed-d996ec420604 tempest-VolumesGetTest-2043829097 None] Flow 'volume_create_manager' (a216ecc2-c5fe-4aa9-8ec3-2be07ed2b6d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:21:29 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-c078b1f2-1655-40eb-9fed-d996ec420604 tempest-VolumesGetTest-2043829097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (146625de-3453-46cd-bb50-3f9c6004b85a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:21:29 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-c078b1f2-1655-40eb-9fed-d996ec420604 tempest-VolumesGetTest-2043829097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (146625de-3453-46cd-bb50-3f9c6004b85a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:21:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1718883068',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de493777-c02b-4794-bccf-8cc26a5e0de9,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='b6175dd98f414599bfa5ef85ee767e37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:21:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:21:29Z,use_quota=True,user_id='193a110855b844cf84d18f71f6fe7b84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:21:29 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-c078b1f2-1655-40eb-9fed-d996ec420604 tempest-VolumesGetTest-2043829097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44252c84-0097-4cb7-9dba-41d93dc4dd57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:21:29 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-c078b1f2-1655-40eb-9fed-d996ec420604 tempest-VolumesGetTest-2043829097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44252c84-0097-4cb7-9dba-41d93dc4dd57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:21:29 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-c078b1f2-1655-40eb-9fed-d996ec420604 tempest-VolumesGetTest-2043829097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3d75a58-a928-473d-a5e0-9918f4f0d25e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:21:29 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-c078b1f2-1655-40eb-9fed-d996ec420604 tempest-VolumesGetTest-2043829097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3d75a58-a928-473d-a5e0-9918f4f0d25e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de493777-c02b-4794-bccf-8cc26a5e0de9', 'volume_name': 'volume-de493777-c02b-4794-bccf-8cc26a5e0de9', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:21:29 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-c078b1f2-1655-40eb-9fed-d996ec420604 tempest-VolumesGetTest-2043829097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46d28359-4148-4fa7-b928-65b8324dd72f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:21:29 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-c078b1f2-1655-40eb-9fed-d996ec420604 tempest-VolumesGetTest-2043829097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46d28359-4148-4fa7-b928-65b8324dd72f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:21:29 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-c078b1f2-1655-40eb-9fed-d996ec420604 tempest-VolumesGetTest-2043829097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15e066d2-06b9-4e41-a5ee-9ef34b1d14aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:21:29 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-c078b1f2-1655-40eb-9fed-d996ec420604 tempest-VolumesGetTest-2043829097 None] Volume de493777-c02b-4794-bccf-8cc26a5e0de9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de493777-c02b-4794-bccf-8cc26a5e0de9', 'volume_size': 1} Aug 05 06:21:29 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-c078b1f2-1655-40eb-9fed-d996ec420604 tempest-VolumesGetTest-2043829097 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:21:29 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-c078b1f2-1655-40eb-9fed-d996ec420604 tempest-VolumesGetTest-2043829097 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:21:29 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-c078b1f2-1655-40eb-9fed-d996ec420604 tempest-VolumesGetTest-2043829097 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:21:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1718883068',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de493777-c02b-4794-bccf-8cc26a5e0de9,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='b6175dd98f414599bfa5ef85ee767e37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:21:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:21:29Z,use_quota=True,user_id='193a110855b844cf84d18f71f6fe7b84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)}" {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 06:21:29 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-c078b1f2-1655-40eb-9fed-d996ec420604 tempest-VolumesGetTest-2043829097 None] Creating volume de493777-c02b-4794-bccf-8cc26a5e0de9 {{(pid=88695) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 06:21:29 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-c078b1f2-1655-40eb-9fed-d996ec420604 tempest-VolumesGetTest-2043829097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:21:29 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-c078b1f2-1655-40eb-9fed-d996ec420604 tempest-VolumesGetTest-2043829097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:21:29 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-c078b1f2-1655-40eb-9fed-d996ec420604 tempest-VolumesGetTest-2043829097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:21:29 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-c078b1f2-1655-40eb-9fed-d996ec420604 tempest-VolumesGetTest-2043829097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:21:29 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-c078b1f2-1655-40eb-9fed-d996ec420604 tempest-VolumesGetTest-2043829097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:21:29 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-c078b1f2-1655-40eb-9fed-d996ec420604 tempest-VolumesGetTest-2043829097 None] Selected osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 as target Quobyte volume. {{(pid=88695) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 06:21:29 devstack cinder-volume[88695]: INFO cinder.volume.drivers.remotefs [None req-c078b1f2-1655-40eb-9fed-d996ec420604 tempest-VolumesGetTest-2043829097 None] casted to osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 Aug 05 06:21:29 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-c078b1f2-1655-40eb-9fed-d996ec420604 tempest-VolumesGetTest-2043829097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-de493777-c02b-4794-bccf-8cc26a5e0de9 1073741824 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:21:29 devstack sudo[100550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-de493777-c02b-4794-bccf-8cc26a5e0de9 1073741824 Aug 05 06:21:29 devstack sudo[100550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:21:29 devstack sudo[100550]: pam_unix(sudo:session): session closed for user root Aug 05 06:21:29 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-c078b1f2-1655-40eb-9fed-d996ec420604 tempest-VolumesGetTest-2043829097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-de493777-c02b-4794-bccf-8cc26a5e0de9 1073741824" returned: 0 in 0.493s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:21:29 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-c078b1f2-1655-40eb-9fed-d996ec420604 tempest-VolumesGetTest-2043829097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-de493777-c02b-4794-bccf-8cc26a5e0de9 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:21:29 devstack sudo[100556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-de493777-c02b-4794-bccf-8cc26a5e0de9 Aug 05 06:21:29 devstack sudo[100556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:21:29 devstack sudo[100556]: pam_unix(sudo:session): session closed for user root Aug 05 06:21:29 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-c078b1f2-1655-40eb-9fed-d996ec420604 tempest-VolumesGetTest-2043829097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-de493777-c02b-4794-bccf-8cc26a5e0de9" returned: 0 in 0.301s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:21:29 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-c078b1f2-1655-40eb-9fed-d996ec420604 tempest-VolumesGetTest-2043829097 None] <== create_volume: return (845ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'} {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 06:21:29 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-c078b1f2-1655-40eb-9fed-d996ec420604 tempest-VolumesGetTest-2043829097 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.848s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:21:29 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-c078b1f2-1655-40eb-9fed-d996ec420604 tempest-VolumesGetTest-2043829097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15e066d2-06b9-4e41-a5ee-9ef34b1d14aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de493777-c02b-4794-bccf-8cc26a5e0de9', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:21:29 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-c078b1f2-1655-40eb-9fed-d996ec420604 tempest-VolumesGetTest-2043829097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b16daf65-40f3-4fda-8077-8650e668a24b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:21:29 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-c078b1f2-1655-40eb-9fed-d996ec420604 tempest-VolumesGetTest-2043829097 None] Volume volume-de493777-c02b-4794-bccf-8cc26a5e0de9 (de493777-c02b-4794-bccf-8cc26a5e0de9): created successfully Aug 05 06:21:30 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-c078b1f2-1655-40eb-9fed-d996ec420604 tempest-VolumesGetTest-2043829097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b16daf65-40f3-4fda-8077-8650e668a24b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:21:30 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-c078b1f2-1655-40eb-9fed-d996ec420604 tempest-VolumesGetTest-2043829097 None] Flow 'volume_create_manager' (a216ecc2-c5fe-4aa9-8ec3-2be07ed2b6d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:21:30 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-c078b1f2-1655-40eb-9fed-d996ec420604 tempest-VolumesGetTest-2043829097 None] Created volume successfully. Aug 05 06:21:30 devstack cinder-volume[88695]: DEBUG cinder.volume.flows.manager.create_volume [None req-6cbc066c-b36d-4047-9054-70337d9172ab tempest-CinderUnicodeTest-2090869398 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88695) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 06:21:30 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-6cbc066c-b36d-4047-9054-70337d9172ab tempest-CinderUnicodeTest-2090869398 None] Flow 'volume_create_manager' (71cf6a06-840a-44b3-a80e-e2762e3a1a9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:21:30 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-6cbc066c-b36d-4047-9054-70337d9172ab tempest-CinderUnicodeTest-2090869398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bb154cf-9e9c-465e-a1d9-f19c0db46abc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:21:30 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-6cbc066c-b36d-4047-9054-70337d9172ab tempest-CinderUnicodeTest-2090869398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bb154cf-9e9c-465e-a1d9-f19c0db46abc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:21:30Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8ece551-d6a8-4f0b-a935-b33a4828b71d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='109c57f1248b4c428408243d0118ecbd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:21:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:21:31Z,use_quota=True,user_id='c2dc1a2130754b76a84451a58b6db705',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:21:30 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-6cbc066c-b36d-4047-9054-70337d9172ab tempest-CinderUnicodeTest-2090869398 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b8ccbdd-938f-48cc-821d-c476e6134a3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:21:30 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-6cbc066c-b36d-4047-9054-70337d9172ab tempest-CinderUnicodeTest-2090869398 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b8ccbdd-938f-48cc-821d-c476e6134a3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:21:30 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-6cbc066c-b36d-4047-9054-70337d9172ab tempest-CinderUnicodeTest-2090869398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e92ba85-aed3-42b5-966d-f0549ce20bc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:21:30 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-6cbc066c-b36d-4047-9054-70337d9172ab tempest-CinderUnicodeTest-2090869398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e92ba85-aed3-42b5-966d-f0549ce20bc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd8ece551-d6a8-4f0b-a935-b33a4828b71d', 'volume_name': 'volume-d8ece551-d6a8-4f0b-a935-b33a4828b71d', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:21:30 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-6cbc066c-b36d-4047-9054-70337d9172ab tempest-CinderUnicodeTest-2090869398 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb8e6bd0-8887-4465-b5f4-c16a3e2db963) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:21:30 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-6cbc066c-b36d-4047-9054-70337d9172ab tempest-CinderUnicodeTest-2090869398 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb8e6bd0-8887-4465-b5f4-c16a3e2db963) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:21:30 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-6cbc066c-b36d-4047-9054-70337d9172ab tempest-CinderUnicodeTest-2090869398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6116c2ec-2d63-4df9-a6ee-dedc3be0c745) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:21:30 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-6cbc066c-b36d-4047-9054-70337d9172ab tempest-CinderUnicodeTest-2090869398 None] Volume d8ece551-d6a8-4f0b-a935-b33a4828b71d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d8ece551-d6a8-4f0b-a935-b33a4828b71d', 'volume_size': 1} Aug 05 06:21:30 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-6cbc066c-b36d-4047-9054-70337d9172ab tempest-CinderUnicodeTest-2090869398 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:21:30 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-6cbc066c-b36d-4047-9054-70337d9172ab tempest-CinderUnicodeTest-2090869398 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:21:30 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-6cbc066c-b36d-4047-9054-70337d9172ab tempest-CinderUnicodeTest-2090869398 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:21:30Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8ece551-d6a8-4f0b-a935-b33a4828b71d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='109c57f1248b4c428408243d0118ecbd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:21:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:21:31Z,use_quota=True,user_id='c2dc1a2130754b76a84451a58b6db705',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)}" {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 06:21:30 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-6cbc066c-b36d-4047-9054-70337d9172ab tempest-CinderUnicodeTest-2090869398 None] Creating volume d8ece551-d6a8-4f0b-a935-b33a4828b71d {{(pid=88695) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 06:21:30 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-6cbc066c-b36d-4047-9054-70337d9172ab tempest-CinderUnicodeTest-2090869398 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:21:30 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-6cbc066c-b36d-4047-9054-70337d9172ab tempest-CinderUnicodeTest-2090869398 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:21:30 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-6cbc066c-b36d-4047-9054-70337d9172ab tempest-CinderUnicodeTest-2090869398 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:21:30 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-6cbc066c-b36d-4047-9054-70337d9172ab tempest-CinderUnicodeTest-2090869398 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:21:30 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-6cbc066c-b36d-4047-9054-70337d9172ab tempest-CinderUnicodeTest-2090869398 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:21:30 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-6cbc066c-b36d-4047-9054-70337d9172ab tempest-CinderUnicodeTest-2090869398 None] Selected osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 as target Quobyte volume. {{(pid=88695) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 06:21:30 devstack cinder-volume[88695]: INFO cinder.volume.drivers.remotefs [None req-6cbc066c-b36d-4047-9054-70337d9172ab tempest-CinderUnicodeTest-2090869398 None] casted to osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 Aug 05 06:21:30 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-6cbc066c-b36d-4047-9054-70337d9172ab tempest-CinderUnicodeTest-2090869398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-d8ece551-d6a8-4f0b-a935-b33a4828b71d 1073741824 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:21:30 devstack sudo[100559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-d8ece551-d6a8-4f0b-a935-b33a4828b71d 1073741824 Aug 05 06:21:30 devstack sudo[100559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:21:31 devstack sudo[100559]: pam_unix(sudo:session): session closed for user root Aug 05 06:21:31 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-6cbc066c-b36d-4047-9054-70337d9172ab tempest-CinderUnicodeTest-2090869398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-d8ece551-d6a8-4f0b-a935-b33a4828b71d 1073741824" returned: 0 in 0.428s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:21:31 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-6cbc066c-b36d-4047-9054-70337d9172ab tempest-CinderUnicodeTest-2090869398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-d8ece551-d6a8-4f0b-a935-b33a4828b71d {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:21:31 devstack sudo[100565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-d8ece551-d6a8-4f0b-a935-b33a4828b71d Aug 05 06:21:31 devstack sudo[100565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:21:31 devstack sudo[100565]: pam_unix(sudo:session): session closed for user root Aug 05 06:21:31 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-6cbc066c-b36d-4047-9054-70337d9172ab tempest-CinderUnicodeTest-2090869398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-d8ece551-d6a8-4f0b-a935-b33a4828b71d" returned: 0 in 0.304s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:21:31 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-6cbc066c-b36d-4047-9054-70337d9172ab tempest-CinderUnicodeTest-2090869398 None] <== create_volume: return (774ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'} {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 06:21:31 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-6cbc066c-b36d-4047-9054-70337d9172ab tempest-CinderUnicodeTest-2090869398 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.777s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:21:31 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-6cbc066c-b36d-4047-9054-70337d9172ab tempest-CinderUnicodeTest-2090869398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6116c2ec-2d63-4df9-a6ee-dedc3be0c745) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8ece551-d6a8-4f0b-a935-b33a4828b71d', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:21:31 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-6cbc066c-b36d-4047-9054-70337d9172ab tempest-CinderUnicodeTest-2090869398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29c62240-2f87-4df0-bf51-fa1b18b4dd1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:21:31 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-6cbc066c-b36d-4047-9054-70337d9172ab tempest-CinderUnicodeTest-2090869398 None] Volume volume-d8ece551-d6a8-4f0b-a935-b33a4828b71d (d8ece551-d6a8-4f0b-a935-b33a4828b71d): created successfully Aug 05 06:21:31 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-6cbc066c-b36d-4047-9054-70337d9172ab tempest-CinderUnicodeTest-2090869398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29c62240-2f87-4df0-bf51-fa1b18b4dd1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:21:31 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-6cbc066c-b36d-4047-9054-70337d9172ab tempest-CinderUnicodeTest-2090869398 None] Flow 'volume_create_manager' (71cf6a06-840a-44b3-a80e-e2762e3a1a9e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:21:31 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-6cbc066c-b36d-4047-9054-70337d9172ab tempest-CinderUnicodeTest-2090869398 None] Created volume successfully. Aug 05 06:21:31 devstack cinder-volume[88695]: DEBUG cinder.volume.flows.manager.create_volume [None req-4105f789-1eda-48a1-a032-0df81cfcc80e tempest-VolumesGetTest-2043829097 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88695) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 06:21:31 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-4105f789-1eda-48a1-a032-0df81cfcc80e tempest-VolumesGetTest-2043829097 None] Flow 'volume_create_manager' (1c45f2ec-b01e-408f-abb9-4c2bd2daa69d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:21:31 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-4105f789-1eda-48a1-a032-0df81cfcc80e tempest-VolumesGetTest-2043829097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fccbb848-325d-473e-8d2c-7ba26e574da9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:21:31 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-4105f789-1eda-48a1-a032-0df81cfcc80e tempest-VolumesGetTest-2043829097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fccbb848-325d-473e-8d2c-7ba26e574da9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:21:32Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1119559073',display_name='tempest-VolumesGetTest-Volume-1935972106',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=617dfe6c-1ca3-44e0-b9f8-8fab3e327df6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6175dd98f414599bfa5ef85ee767e37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:21:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:21:32Z,use_quota=True,user_id='193a110855b844cf84d18f71f6fe7b84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:21:31 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-4105f789-1eda-48a1-a032-0df81cfcc80e tempest-VolumesGetTest-2043829097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0e9e74c-6976-46f2-a446-e60d1d0d8e1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:21:31 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-4105f789-1eda-48a1-a032-0df81cfcc80e tempest-VolumesGetTest-2043829097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0e9e74c-6976-46f2-a446-e60d1d0d8e1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:21:31 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-4105f789-1eda-48a1-a032-0df81cfcc80e tempest-VolumesGetTest-2043829097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3552e477-530e-48af-a13c-ad9afa230a53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:21:31 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-4105f789-1eda-48a1-a032-0df81cfcc80e tempest-VolumesGetTest-2043829097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3552e477-530e-48af-a13c-ad9afa230a53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '617dfe6c-1ca3-44e0-b9f8-8fab3e327df6', 'volume_name': 'volume-617dfe6c-1ca3-44e0-b9f8-8fab3e327df6', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:21:31 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-4105f789-1eda-48a1-a032-0df81cfcc80e tempest-VolumesGetTest-2043829097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d722296-773a-4773-aca9-73076696ae62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:21:31 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-4105f789-1eda-48a1-a032-0df81cfcc80e tempest-VolumesGetTest-2043829097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d722296-773a-4773-aca9-73076696ae62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:21:31 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-4105f789-1eda-48a1-a032-0df81cfcc80e tempest-VolumesGetTest-2043829097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf65b02c-e2c8-4c17-870e-cc7151610f2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:21:31 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-4105f789-1eda-48a1-a032-0df81cfcc80e tempest-VolumesGetTest-2043829097 None] Volume 617dfe6c-1ca3-44e0-b9f8-8fab3e327df6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-617dfe6c-1ca3-44e0-b9f8-8fab3e327df6', 'volume_size': 1} Aug 05 06:21:31 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-4105f789-1eda-48a1-a032-0df81cfcc80e tempest-VolumesGetTest-2043829097 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:21:31 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-4105f789-1eda-48a1-a032-0df81cfcc80e tempest-VolumesGetTest-2043829097 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:21:31 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-4105f789-1eda-48a1-a032-0df81cfcc80e tempest-VolumesGetTest-2043829097 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:21:32Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1119559073',display_name='tempest-VolumesGetTest-Volume-1935972106',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=617dfe6c-1ca3-44e0-b9f8-8fab3e327df6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6175dd98f414599bfa5ef85ee767e37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:21:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:21:32Z,use_quota=True,user_id='193a110855b844cf84d18f71f6fe7b84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)}" {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 06:21:31 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-4105f789-1eda-48a1-a032-0df81cfcc80e tempest-VolumesGetTest-2043829097 None] Creating volume 617dfe6c-1ca3-44e0-b9f8-8fab3e327df6 {{(pid=88695) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 06:21:31 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-4105f789-1eda-48a1-a032-0df81cfcc80e tempest-VolumesGetTest-2043829097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:21:31 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-4105f789-1eda-48a1-a032-0df81cfcc80e tempest-VolumesGetTest-2043829097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:21:31 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-4105f789-1eda-48a1-a032-0df81cfcc80e tempest-VolumesGetTest-2043829097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:21:31 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-4105f789-1eda-48a1-a032-0df81cfcc80e tempest-VolumesGetTest-2043829097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:21:31 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-4105f789-1eda-48a1-a032-0df81cfcc80e tempest-VolumesGetTest-2043829097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:21:31 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-4105f789-1eda-48a1-a032-0df81cfcc80e tempest-VolumesGetTest-2043829097 None] Selected osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 as target Quobyte volume. {{(pid=88695) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 06:21:31 devstack cinder-volume[88695]: INFO cinder.volume.drivers.remotefs [None req-4105f789-1eda-48a1-a032-0df81cfcc80e tempest-VolumesGetTest-2043829097 None] casted to osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 Aug 05 06:21:31 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-4105f789-1eda-48a1-a032-0df81cfcc80e tempest-VolumesGetTest-2043829097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-617dfe6c-1ca3-44e0-b9f8-8fab3e327df6 1073741824 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:21:31 devstack sudo[100568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-617dfe6c-1ca3-44e0-b9f8-8fab3e327df6 1073741824 Aug 05 06:21:31 devstack sudo[100568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:21:32 devstack sudo[100568]: pam_unix(sudo:session): session closed for user root Aug 05 06:21:32 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-4105f789-1eda-48a1-a032-0df81cfcc80e tempest-VolumesGetTest-2043829097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-617dfe6c-1ca3-44e0-b9f8-8fab3e327df6 1073741824" returned: 0 in 0.443s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:21:32 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-4105f789-1eda-48a1-a032-0df81cfcc80e tempest-VolumesGetTest-2043829097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-617dfe6c-1ca3-44e0-b9f8-8fab3e327df6 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:21:32 devstack sudo[100573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-617dfe6c-1ca3-44e0-b9f8-8fab3e327df6 Aug 05 06:21:32 devstack sudo[100573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:21:32 devstack sudo[100573]: pam_unix(sudo:session): session closed for user root Aug 05 06:21:32 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-4105f789-1eda-48a1-a032-0df81cfcc80e tempest-VolumesGetTest-2043829097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-617dfe6c-1ca3-44e0-b9f8-8fab3e327df6" returned: 0 in 0.301s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:21:32 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-4105f789-1eda-48a1-a032-0df81cfcc80e tempest-VolumesGetTest-2043829097 None] <== create_volume: return (797ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'} {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 06:21:32 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-4105f789-1eda-48a1-a032-0df81cfcc80e tempest-VolumesGetTest-2043829097 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.799s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:21:32 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-4105f789-1eda-48a1-a032-0df81cfcc80e tempest-VolumesGetTest-2043829097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf65b02c-e2c8-4c17-870e-cc7151610f2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-617dfe6c-1ca3-44e0-b9f8-8fab3e327df6', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:21:32 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-4105f789-1eda-48a1-a032-0df81cfcc80e tempest-VolumesGetTest-2043829097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23a5b07a-8546-4cda-9b6b-f55a79a521c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:21:32 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-4105f789-1eda-48a1-a032-0df81cfcc80e tempest-VolumesGetTest-2043829097 None] Volume volume-617dfe6c-1ca3-44e0-b9f8-8fab3e327df6 (617dfe6c-1ca3-44e0-b9f8-8fab3e327df6): created successfully Aug 05 06:21:32 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-4105f789-1eda-48a1-a032-0df81cfcc80e tempest-VolumesGetTest-2043829097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23a5b07a-8546-4cda-9b6b-f55a79a521c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:21:32 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-4105f789-1eda-48a1-a032-0df81cfcc80e tempest-VolumesGetTest-2043829097 None] Flow 'volume_create_manager' (1c45f2ec-b01e-408f-abb9-4c2bd2daa69d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:21:32 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-4105f789-1eda-48a1-a032-0df81cfcc80e tempest-VolumesGetTest-2043829097 None] Created volume successfully. Aug 05 06:21:33 devstack cinder-volume[88695]: DEBUG cinder.volume.flows.manager.create_volume [None req-4122609f-de5a-41db-b3a4-61eedb2858e5 tempest-CinderUnicodeTest-2090869398 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88695) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 06:21:33 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-4122609f-de5a-41db-b3a4-61eedb2858e5 tempest-CinderUnicodeTest-2090869398 None] Flow 'volume_create_manager' (9fbb9adb-4f3a-4f34-b359-4ba9dc5a38b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:21:33 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-4122609f-de5a-41db-b3a4-61eedb2858e5 tempest-CinderUnicodeTest-2090869398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3407027-5fea-4707-967d-ea96d2102ae1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:21:33 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-4122609f-de5a-41db-b3a4-61eedb2858e5 tempest-CinderUnicodeTest-2090869398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3407027-5fea-4707-967d-ea96d2102ae1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:21:33Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1470523771',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9371d151-981e-40e4-8ca8-0d49cd65ef87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='109c57f1248b4c428408243d0118ecbd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:21:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:21:33Z,use_quota=True,user_id='c2dc1a2130754b76a84451a58b6db705',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:21:33 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-4122609f-de5a-41db-b3a4-61eedb2858e5 tempest-CinderUnicodeTest-2090869398 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e8b685b-b897-4798-8882-e29790a7c3b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:21:33 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-4122609f-de5a-41db-b3a4-61eedb2858e5 tempest-CinderUnicodeTest-2090869398 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e8b685b-b897-4798-8882-e29790a7c3b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:21:33 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-4122609f-de5a-41db-b3a4-61eedb2858e5 tempest-CinderUnicodeTest-2090869398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6576541e-b0dc-4a01-87fa-0e65c96c773f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:21:33 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-4122609f-de5a-41db-b3a4-61eedb2858e5 tempest-CinderUnicodeTest-2090869398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6576541e-b0dc-4a01-87fa-0e65c96c773f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9371d151-981e-40e4-8ca8-0d49cd65ef87', 'volume_name': 'volume-9371d151-981e-40e4-8ca8-0d49cd65ef87', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:21:33 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-4122609f-de5a-41db-b3a4-61eedb2858e5 tempest-CinderUnicodeTest-2090869398 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d93893f1-7870-474b-a0e0-5b99f769ad89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:21:33 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-4122609f-de5a-41db-b3a4-61eedb2858e5 tempest-CinderUnicodeTest-2090869398 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d93893f1-7870-474b-a0e0-5b99f769ad89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:21:33 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-4122609f-de5a-41db-b3a4-61eedb2858e5 tempest-CinderUnicodeTest-2090869398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (763d3c3b-2a9c-4675-8d3a-409956255bd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:21:33 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-4122609f-de5a-41db-b3a4-61eedb2858e5 tempest-CinderUnicodeTest-2090869398 None] Volume 9371d151-981e-40e4-8ca8-0d49cd65ef87: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9371d151-981e-40e4-8ca8-0d49cd65ef87', 'volume_size': 1} Aug 05 06:21:33 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-4122609f-de5a-41db-b3a4-61eedb2858e5 tempest-CinderUnicodeTest-2090869398 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:21:33 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-4122609f-de5a-41db-b3a4-61eedb2858e5 tempest-CinderUnicodeTest-2090869398 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:21:33 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-4122609f-de5a-41db-b3a4-61eedb2858e5 tempest-CinderUnicodeTest-2090869398 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:21:33Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1470523771',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9371d151-981e-40e4-8ca8-0d49cd65ef87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='109c57f1248b4c428408243d0118ecbd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:21:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:21:33Z,use_quota=True,user_id='c2dc1a2130754b76a84451a58b6db705',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)}" {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 06:21:33 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-4122609f-de5a-41db-b3a4-61eedb2858e5 tempest-CinderUnicodeTest-2090869398 None] Creating volume 9371d151-981e-40e4-8ca8-0d49cd65ef87 {{(pid=88695) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 06:21:33 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-4122609f-de5a-41db-b3a4-61eedb2858e5 tempest-CinderUnicodeTest-2090869398 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:21:33 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-4122609f-de5a-41db-b3a4-61eedb2858e5 tempest-CinderUnicodeTest-2090869398 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:21:33 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-4122609f-de5a-41db-b3a4-61eedb2858e5 tempest-CinderUnicodeTest-2090869398 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:21:33 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-4122609f-de5a-41db-b3a4-61eedb2858e5 tempest-CinderUnicodeTest-2090869398 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:21:33 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-4122609f-de5a-41db-b3a4-61eedb2858e5 tempest-CinderUnicodeTest-2090869398 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:21:33 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-4122609f-de5a-41db-b3a4-61eedb2858e5 tempest-CinderUnicodeTest-2090869398 None] Selected osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 as target Quobyte volume. {{(pid=88695) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 06:21:33 devstack cinder-volume[88695]: INFO cinder.volume.drivers.remotefs [None req-4122609f-de5a-41db-b3a4-61eedb2858e5 tempest-CinderUnicodeTest-2090869398 None] casted to osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 Aug 05 06:21:33 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-4122609f-de5a-41db-b3a4-61eedb2858e5 tempest-CinderUnicodeTest-2090869398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9371d151-981e-40e4-8ca8-0d49cd65ef87 1073741824 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:21:33 devstack sudo[100576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9371d151-981e-40e4-8ca8-0d49cd65ef87 1073741824 Aug 05 06:21:33 devstack sudo[100576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:21:33 devstack sudo[100576]: pam_unix(sudo:session): session closed for user root Aug 05 06:21:33 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-4122609f-de5a-41db-b3a4-61eedb2858e5 tempest-CinderUnicodeTest-2090869398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9371d151-981e-40e4-8ca8-0d49cd65ef87 1073741824" returned: 0 in 0.487s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:21:33 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-4122609f-de5a-41db-b3a4-61eedb2858e5 tempest-CinderUnicodeTest-2090869398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9371d151-981e-40e4-8ca8-0d49cd65ef87 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:21:33 devstack sudo[100581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9371d151-981e-40e4-8ca8-0d49cd65ef87 Aug 05 06:21:33 devstack sudo[100581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:21:34 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-8463922a-0fd9-461d-b5f2-7afd1d6ac54f tempest-VolumesGetTest-2043829097 None] Acquiring lock "cinder-617dfe6c-1ca3-44e0-b9f8-8fab3e327df6-delete_volume" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:21:34 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-8463922a-0fd9-461d-b5f2-7afd1d6ac54f tempest-VolumesGetTest-2043829097 None] Lock "cinder-617dfe6c-1ca3-44e0-b9f8-8fab3e327df6-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:21:34 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-8463922a-0fd9-461d-b5f2-7afd1d6ac54f tempest-VolumesGetTest-2043829097 None] Acquiring lock "cinder-quobyte-617dfe6c-1ca3-44e0-b9f8-8fab3e327df6" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:21:34 devstack sudo[100581]: pam_unix(sudo:session): session closed for user root Aug 05 06:21:34 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-4122609f-de5a-41db-b3a4-61eedb2858e5 tempest-CinderUnicodeTest-2090869398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9371d151-981e-40e4-8ca8-0d49cd65ef87" returned: 0 in 0.355s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:21:34 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-4122609f-de5a-41db-b3a4-61eedb2858e5 tempest-CinderUnicodeTest-2090869398 None] <== create_volume: return (899ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'} {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 06:21:34 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-4122609f-de5a-41db-b3a4-61eedb2858e5 tempest-CinderUnicodeTest-2090869398 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.901s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:21:34 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-8463922a-0fd9-461d-b5f2-7afd1d6ac54f tempest-VolumesGetTest-2043829097 None] Lock "cinder-quobyte-617dfe6c-1ca3-44e0-b9f8-8fab3e327df6" acquired by "delete_volume" :: waited 0.037s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:21:34 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-4122609f-de5a-41db-b3a4-61eedb2858e5 tempest-CinderUnicodeTest-2090869398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (763d3c3b-2a9c-4675-8d3a-409956255bd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9371d151-981e-40e4-8ca8-0d49cd65ef87', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:21:34 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-4122609f-de5a-41db-b3a4-61eedb2858e5 tempest-CinderUnicodeTest-2090869398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20fb74fa-61ed-4549-8f82-4fa6920fedc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:21:34 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[c83fb8f1-82fd-4076-add0-6fc537c60957]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:21:34 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-8463922a-0fd9-461d-b5f2-7afd1d6ac54f tempest-VolumesGetTest-2043829097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-617dfe6c-1ca3-44e0-b9f8-8fab3e327df6 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:21:34 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-4122609f-de5a-41db-b3a4-61eedb2858e5 tempest-CinderUnicodeTest-2090869398 None] Volume volume-9371d151-981e-40e4-8ca8-0d49cd65ef87 (9371d151-981e-40e4-8ca8-0d49cd65ef87): created successfully Aug 05 06:21:34 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-4122609f-de5a-41db-b3a4-61eedb2858e5 tempest-CinderUnicodeTest-2090869398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20fb74fa-61ed-4549-8f82-4fa6920fedc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:21:34 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-4122609f-de5a-41db-b3a4-61eedb2858e5 tempest-CinderUnicodeTest-2090869398 None] Flow 'volume_create_manager' (9fbb9adb-4f3a-4f34-b359-4ba9dc5a38b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:21:34 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-4122609f-de5a-41db-b3a4-61eedb2858e5 tempest-CinderUnicodeTest-2090869398 None] Created volume successfully. Aug 05 06:21:34 devstack sudo[100584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-617dfe6c-1ca3-44e0-b9f8-8fab3e327df6 Aug 05 06:21:34 devstack sudo[100584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:21:34 devstack sudo[100584]: pam_unix(sudo:session): session closed for user root Aug 05 06:21:34 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-8463922a-0fd9-461d-b5f2-7afd1d6ac54f tempest-VolumesGetTest-2043829097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-617dfe6c-1ca3-44e0-b9f8-8fab3e327df6" returned: 0 in 0.370s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:21:34 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-8463922a-0fd9-461d-b5f2-7afd1d6ac54f tempest-VolumesGetTest-2043829097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-617dfe6c-1ca3-44e0-b9f8-8fab3e327df6 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:21:34 devstack sudo[100589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-617dfe6c-1ca3-44e0-b9f8-8fab3e327df6 Aug 05 06:21:34 devstack sudo[100589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:21:34 devstack sudo[100589]: pam_unix(sudo:session): session closed for user root Aug 05 06:21:34 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-8463922a-0fd9-461d-b5f2-7afd1d6ac54f tempest-VolumesGetTest-2043829097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-617dfe6c-1ca3-44e0-b9f8-8fab3e327df6" returned: 0 in 0.278s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:21:34 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-8463922a-0fd9-461d-b5f2-7afd1d6ac54f tempest-VolumesGetTest-2043829097 None] Lock "cinder-quobyte-617dfe6c-1ca3-44e0-b9f8-8fab3e327df6" released by "delete_volume" :: held 0.700s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:21:34 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-8463922a-0fd9-461d-b5f2-7afd1d6ac54f tempest-VolumesGetTest-2043829097 None] Created reservations ['a0d2dca7-08c5-4090-94a5-c2fc6e5968aa', '61b2ef27-e448-4867-8d3f-c340c74dfc3a', '18ac85a8-cf06-40fe-a8af-c6afd14481a1', '316272b2-f22f-4ff7-8ebe-09fe6fbf4174'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:21:35 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-8463922a-0fd9-461d-b5f2-7afd1d6ac54f tempest-VolumesGetTest-2043829097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:21:35 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-8463922a-0fd9-461d-b5f2-7afd1d6ac54f tempest-VolumesGetTest-2043829097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:21:35 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-8463922a-0fd9-461d-b5f2-7afd1d6ac54f tempest-VolumesGetTest-2043829097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:21:35 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-8463922a-0fd9-461d-b5f2-7afd1d6ac54f tempest-VolumesGetTest-2043829097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:21:35 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-8463922a-0fd9-461d-b5f2-7afd1d6ac54f tempest-VolumesGetTest-2043829097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:21:35 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-8463922a-0fd9-461d-b5f2-7afd1d6ac54f tempest-VolumesGetTest-2043829097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:21:35 devstack sudo[100592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce Aug 05 06:21:35 devstack sudo[100592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:21:35 devstack sudo[100592]: pam_unix(sudo:session): session closed for user root Aug 05 06:21:35 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-8463922a-0fd9-461d-b5f2-7afd1d6ac54f tempest-VolumesGetTest-2043829097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce" returned: 0 in 0.279s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:21:35 devstack cinder-volume[88695]: DEBUG cinder.manager [None req-8463922a-0fd9-461d-b5f2-7afd1d6ac54f tempest-VolumesGetTest-2043829097 None] Notifying Schedulers of capabilities ... {{(pid=88695) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 06:21:35 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-8463922a-0fd9-461d-b5f2-7afd1d6ac54f tempest-VolumesGetTest-2043829097 None] Deleted volume successfully. Aug 05 06:21:35 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-8463922a-0fd9-461d-b5f2-7afd1d6ac54f tempest-VolumesGetTest-2043829097 None] Lock "cinder-617dfe6c-1ca3-44e0-b9f8-8fab3e327df6-delete_volume" released by "delete_volume" :: held 1.250s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:21:35 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-926cb4d3-7577-4d60-85c7-c12ee502fb19 tempest-VolumesGetTest-2043829097 None] Acquiring lock "cinder-de493777-c02b-4794-bccf-8cc26a5e0de9-delete_volume" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:21:35 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-926cb4d3-7577-4d60-85c7-c12ee502fb19 tempest-VolumesGetTest-2043829097 None] Lock "cinder-de493777-c02b-4794-bccf-8cc26a5e0de9-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:21:35 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-926cb4d3-7577-4d60-85c7-c12ee502fb19 tempest-VolumesGetTest-2043829097 None] Acquiring lock "cinder-quobyte-de493777-c02b-4794-bccf-8cc26a5e0de9" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:21:35 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-926cb4d3-7577-4d60-85c7-c12ee502fb19 tempest-VolumesGetTest-2043829097 None] Lock "cinder-quobyte-de493777-c02b-4794-bccf-8cc26a5e0de9" acquired by "delete_volume" :: waited 0.021s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:21:35 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[e87d24ed-4e64-44c8-b154-fd17d953497b]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:21:35 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-926cb4d3-7577-4d60-85c7-c12ee502fb19 tempest-VolumesGetTest-2043829097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-de493777-c02b-4794-bccf-8cc26a5e0de9 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:21:35 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-b9c2a90b-1747-4df8-9c6c-a3257dc23981 tempest-CinderUnicodeTest-2090869398 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:21:35 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-b9c2a90b-1747-4df8-9c6c-a3257dc23981 tempest-CinderUnicodeTest-2090869398 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:21:35 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-b9c2a90b-1747-4df8-9c6c-a3257dc23981 tempest-CinderUnicodeTest-2090869398 None] Creating offline snapshot 86bcc33e-0588-443b-abd1-bac922a5b783 of volume 9371d151-981e-40e4-8ca8-0d49cd65ef87 {{(pid=88695) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 06:21:35 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[00d05467-f1ba-4be8-bfe5-f8199629b622]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:21:35 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-b9c2a90b-1747-4df8-9c6c-a3257dc23981 tempest-CinderUnicodeTest-2090869398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9371d151-981e-40e4-8ca8-0d49cd65ef87 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:21:35 devstack sudo[100595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-de493777-c02b-4794-bccf-8cc26a5e0de9 Aug 05 06:21:35 devstack sudo[100595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:21:35 devstack sudo[100596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9371d151-981e-40e4-8ca8-0d49cd65ef87 Aug 05 06:21:35 devstack sudo[100596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:21:36 devstack sudo[100595]: pam_unix(sudo:session): session closed for user root Aug 05 06:21:36 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-926cb4d3-7577-4d60-85c7-c12ee502fb19 tempest-VolumesGetTest-2043829097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-de493777-c02b-4794-bccf-8cc26a5e0de9" returned: 0 in 0.443s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:21:36 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-926cb4d3-7577-4d60-85c7-c12ee502fb19 tempest-VolumesGetTest-2043829097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-de493777-c02b-4794-bccf-8cc26a5e0de9 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:21:36 devstack sudo[100596]: pam_unix(sudo:session): session closed for user root Aug 05 06:21:36 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-b9c2a90b-1747-4df8-9c6c-a3257dc23981 tempest-CinderUnicodeTest-2090869398 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9371d151-981e-40e4-8ca8-0d49cd65ef87" returned: 0 in 0.387s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:21:36 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-b9c2a90b-1747-4df8-9c6c-a3257dc23981 tempest-CinderUnicodeTest-2090869398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9371d151-981e-40e4-8ca8-0d49cd65ef87,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9371d151-981e-40e4-8ca8-0d49cd65ef87.86bcc33e-0588-443b-abd1-bac922a5b783 1G {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:21:36 devstack sudo[100605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-de493777-c02b-4794-bccf-8cc26a5e0de9 Aug 05 06:21:36 devstack sudo[100605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:21:36 devstack sudo[100606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9371d151-981e-40e4-8ca8-0d49cd65ef87,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9371d151-981e-40e4-8ca8-0d49cd65ef87.86bcc33e-0588-443b-abd1-bac922a5b783 1G Aug 05 06:21:36 devstack sudo[100606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:21:36 devstack sudo[100605]: pam_unix(sudo:session): session closed for user root Aug 05 06:21:36 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-926cb4d3-7577-4d60-85c7-c12ee502fb19 tempest-VolumesGetTest-2043829097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-de493777-c02b-4794-bccf-8cc26a5e0de9" returned: 0 in 0.328s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:21:36 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-926cb4d3-7577-4d60-85c7-c12ee502fb19 tempest-VolumesGetTest-2043829097 None] Lock "cinder-quobyte-de493777-c02b-4794-bccf-8cc26a5e0de9" released by "delete_volume" :: held 0.848s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:21:36 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-926cb4d3-7577-4d60-85c7-c12ee502fb19 tempest-VolumesGetTest-2043829097 None] Created reservations ['dac2e4d1-6383-4f29-a479-f31ea9d98328', '3659d7ff-02df-4912-8a81-ab3ccb0b707d', 'c73f4e76-87a2-4750-a43d-8c5a5bcc0de0', 'a01bee43-2338-45cd-9b4e-7a61ee136dc6'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:21:36 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-926cb4d3-7577-4d60-85c7-c12ee502fb19 tempest-VolumesGetTest-2043829097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:21:36 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-926cb4d3-7577-4d60-85c7-c12ee502fb19 tempest-VolumesGetTest-2043829097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:21:36 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-926cb4d3-7577-4d60-85c7-c12ee502fb19 tempest-VolumesGetTest-2043829097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:21:36 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-926cb4d3-7577-4d60-85c7-c12ee502fb19 tempest-VolumesGetTest-2043829097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:21:36 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-926cb4d3-7577-4d60-85c7-c12ee502fb19 tempest-VolumesGetTest-2043829097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:21:36 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-926cb4d3-7577-4d60-85c7-c12ee502fb19 tempest-VolumesGetTest-2043829097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:21:36 devstack sudo[100660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce Aug 05 06:21:36 devstack sudo[100660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:21:36 devstack sudo[100606]: pam_unix(sudo:session): session closed for user root Aug 05 06:21:36 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-b9c2a90b-1747-4df8-9c6c-a3257dc23981 tempest-CinderUnicodeTest-2090869398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9371d151-981e-40e4-8ca8-0d49cd65ef87,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9371d151-981e-40e4-8ca8-0d49cd65ef87.86bcc33e-0588-443b-abd1-bac922a5b783 1G" returned: 0 in 0.606s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:21:36 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-b9c2a90b-1747-4df8-9c6c-a3257dc23981 tempest-CinderUnicodeTest-2090869398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9371d151-981e-40e4-8ca8-0d49cd65ef87 -F qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9371d151-981e-40e4-8ca8-0d49cd65ef87.86bcc33e-0588-443b-abd1-bac922a5b783 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:21:36 devstack sudo[100662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9371d151-981e-40e4-8ca8-0d49cd65ef87 -F qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9371d151-981e-40e4-8ca8-0d49cd65ef87.86bcc33e-0588-443b-abd1-bac922a5b783 Aug 05 06:21:36 devstack sudo[100662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:21:36 devstack sudo[100660]: pam_unix(sudo:session): session closed for user root Aug 05 06:21:36 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-926cb4d3-7577-4d60-85c7-c12ee502fb19 tempest-VolumesGetTest-2043829097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce" returned: 0 in 0.314s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:21:36 devstack cinder-volume[88695]: DEBUG cinder.manager [None req-926cb4d3-7577-4d60-85c7-c12ee502fb19 tempest-VolumesGetTest-2043829097 None] Notifying Schedulers of capabilities ... {{(pid=88695) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 06:21:36 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-926cb4d3-7577-4d60-85c7-c12ee502fb19 tempest-VolumesGetTest-2043829097 None] Deleted volume successfully. Aug 05 06:21:36 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-926cb4d3-7577-4d60-85c7-c12ee502fb19 tempest-VolumesGetTest-2043829097 None] Lock "cinder-de493777-c02b-4794-bccf-8cc26a5e0de9-delete_volume" released by "delete_volume" :: held 1.465s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:21:37 devstack sudo[100662]: pam_unix(sudo:session): session closed for user root Aug 05 06:21:37 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-b9c2a90b-1747-4df8-9c6c-a3257dc23981 tempest-CinderUnicodeTest-2090869398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9371d151-981e-40e4-8ca8-0d49cd65ef87 -F qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9371d151-981e-40e4-8ca8-0d49cd65ef87.86bcc33e-0588-443b-abd1-bac922a5b783" returned: 0 in 0.360s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:21:37 devstack cinder-volume[88695]: WARNING cinder.volume.drivers.remotefs [None req-b9c2a90b-1747-4df8-9c6c-a3257dc23981 tempest-CinderUnicodeTest-2090869398 None] /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9371d151-981e-40e4-8ca8-0d49cd65ef87.86bcc33e-0588-443b-abd1-bac922a5b783 is being set with open permissions: ugo+rw Aug 05 06:21:37 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-b9c2a90b-1747-4df8-9c6c-a3257dc23981 tempest-CinderUnicodeTest-2090869398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9371d151-981e-40e4-8ca8-0d49cd65ef87.86bcc33e-0588-443b-abd1-bac922a5b783 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:21:37 devstack sudo[100670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9371d151-981e-40e4-8ca8-0d49cd65ef87.86bcc33e-0588-443b-abd1-bac922a5b783 Aug 05 06:21:37 devstack sudo[100670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:21:37 devstack cinder-volume[88695]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f9b713d-0b9b-462e-aab4-a8b35e93919d tempest-VolumesGetTest-2043829097 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88695) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 06:21:37 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-3f9b713d-0b9b-462e-aab4-a8b35e93919d tempest-VolumesGetTest-2043829097 None] Flow 'volume_create_manager' (eb820c14-a732-44a7-b0d5-9cdd8c8cd692) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:21:37 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-3f9b713d-0b9b-462e-aab4-a8b35e93919d tempest-VolumesGetTest-2043829097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7dae913-3094-4abb-ae93-98797df2ce43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:21:37 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-3f9b713d-0b9b-462e-aab4-a8b35e93919d tempest-VolumesGetTest-2043829097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7dae913-3094-4abb-ae93-98797df2ce43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:21:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1308844541',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25a22d9c-cb7f-49fc-af25-fbbbab96870b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6175dd98f414599bfa5ef85ee767e37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:21:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:21:37Z,use_quota=True,user_id='193a110855b844cf84d18f71f6fe7b84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:21:37 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-3f9b713d-0b9b-462e-aab4-a8b35e93919d tempest-VolumesGetTest-2043829097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2bab2a05-4c26-4ea9-a940-5519dfe0d70c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:21:37 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-3f9b713d-0b9b-462e-aab4-a8b35e93919d tempest-VolumesGetTest-2043829097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2bab2a05-4c26-4ea9-a940-5519dfe0d70c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:21:37 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-3f9b713d-0b9b-462e-aab4-a8b35e93919d tempest-VolumesGetTest-2043829097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52bd3397-445c-41b1-b71a-98150a069312) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:21:37 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-3f9b713d-0b9b-462e-aab4-a8b35e93919d tempest-VolumesGetTest-2043829097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52bd3397-445c-41b1-b71a-98150a069312) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '25a22d9c-cb7f-49fc-af25-fbbbab96870b', 'volume_name': 'volume-25a22d9c-cb7f-49fc-af25-fbbbab96870b', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:21:37 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-3f9b713d-0b9b-462e-aab4-a8b35e93919d tempest-VolumesGetTest-2043829097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b225a89-72cf-4a5f-9d53-4fe70f5d2328) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:21:37 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-3f9b713d-0b9b-462e-aab4-a8b35e93919d tempest-VolumesGetTest-2043829097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b225a89-72cf-4a5f-9d53-4fe70f5d2328) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:21:37 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-3f9b713d-0b9b-462e-aab4-a8b35e93919d tempest-VolumesGetTest-2043829097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e5e5bf1-ebd9-43fe-88fd-9e47265b7682) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:21:37 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-3f9b713d-0b9b-462e-aab4-a8b35e93919d tempest-VolumesGetTest-2043829097 None] Volume 25a22d9c-cb7f-49fc-af25-fbbbab96870b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-25a22d9c-cb7f-49fc-af25-fbbbab96870b', 'volume_size': 1} Aug 05 06:21:37 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-3f9b713d-0b9b-462e-aab4-a8b35e93919d tempest-VolumesGetTest-2043829097 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:21:37 devstack sudo[100670]: pam_unix(sudo:session): session closed for user root Aug 05 06:21:37 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-b9c2a90b-1747-4df8-9c6c-a3257dc23981 tempest-CinderUnicodeTest-2090869398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9371d151-981e-40e4-8ca8-0d49cd65ef87.86bcc33e-0588-443b-abd1-bac922a5b783" returned: 0 in 0.276s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:21:37 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-b9c2a90b-1747-4df8-9c6c-a3257dc23981 tempest-CinderUnicodeTest-2090869398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9371d151-981e-40e4-8ca8-0d49cd65ef87.info {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:21:37 devstack sudo[100673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9371d151-981e-40e4-8ca8-0d49cd65ef87.info Aug 05 06:21:37 devstack sudo[100673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:21:37 devstack sudo[100673]: pam_unix(sudo:session): session closed for user root Aug 05 06:21:37 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-b9c2a90b-1747-4df8-9c6c-a3257dc23981 tempest-CinderUnicodeTest-2090869398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9371d151-981e-40e4-8ca8-0d49cd65ef87.info" returned: 0 in 0.246s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:21:37 devstack cinder-volume[88695]: WARNING cinder.volume.drivers.remotefs [None req-b9c2a90b-1747-4df8-9c6c-a3257dc23981 tempest-CinderUnicodeTest-2090869398 None] /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9371d151-981e-40e4-8ca8-0d49cd65ef87.info is being set with open permissions: ugo+rw Aug 05 06:21:37 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-b9c2a90b-1747-4df8-9c6c-a3257dc23981 tempest-CinderUnicodeTest-2090869398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9371d151-981e-40e4-8ca8-0d49cd65ef87.info {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:21:37 devstack sudo[100677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9371d151-981e-40e4-8ca8-0d49cd65ef87.info Aug 05 06:21:37 devstack sudo[100677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:21:37 devstack sudo[100677]: pam_unix(sudo:session): session closed for user root Aug 05 06:21:37 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-b9c2a90b-1747-4df8-9c6c-a3257dc23981 tempest-CinderUnicodeTest-2090869398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9371d151-981e-40e4-8ca8-0d49cd65ef87.info" returned: 0 in 0.237s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:21:37 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-b9c2a90b-1747-4df8-9c6c-a3257dc23981 tempest-CinderUnicodeTest-2090869398 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.238s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:21:37 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-3f9b713d-0b9b-462e-aab4-a8b35e93919d tempest-VolumesGetTest-2043829097 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.595s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:21:37 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-3f9b713d-0b9b-462e-aab4-a8b35e93919d tempest-VolumesGetTest-2043829097 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:21:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1308844541',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25a22d9c-cb7f-49fc-af25-fbbbab96870b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6175dd98f414599bfa5ef85ee767e37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:21:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:21:37Z,use_quota=True,user_id='193a110855b844cf84d18f71f6fe7b84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)}" {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 06:21:37 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-3f9b713d-0b9b-462e-aab4-a8b35e93919d tempest-VolumesGetTest-2043829097 None] Creating volume 25a22d9c-cb7f-49fc-af25-fbbbab96870b {{(pid=88695) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 06:21:37 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-3f9b713d-0b9b-462e-aab4-a8b35e93919d tempest-VolumesGetTest-2043829097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:21:37 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-3f9b713d-0b9b-462e-aab4-a8b35e93919d tempest-VolumesGetTest-2043829097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:21:37 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-3f9b713d-0b9b-462e-aab4-a8b35e93919d tempest-VolumesGetTest-2043829097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:21:37 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-3f9b713d-0b9b-462e-aab4-a8b35e93919d tempest-VolumesGetTest-2043829097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:21:37 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-3f9b713d-0b9b-462e-aab4-a8b35e93919d tempest-VolumesGetTest-2043829097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:21:37 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-3f9b713d-0b9b-462e-aab4-a8b35e93919d tempest-VolumesGetTest-2043829097 None] Selected osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 as target Quobyte volume. {{(pid=88695) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 06:21:37 devstack cinder-volume[88695]: INFO cinder.volume.drivers.remotefs [None req-3f9b713d-0b9b-462e-aab4-a8b35e93919d tempest-VolumesGetTest-2043829097 None] casted to osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 Aug 05 06:21:37 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-3f9b713d-0b9b-462e-aab4-a8b35e93919d tempest-VolumesGetTest-2043829097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-25a22d9c-cb7f-49fc-af25-fbbbab96870b 1073741824 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:21:37 devstack sudo[100681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-25a22d9c-cb7f-49fc-af25-fbbbab96870b 1073741824 Aug 05 06:21:37 devstack sudo[100681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:21:37 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-b9c2a90b-1747-4df8-9c6c-a3257dc23981 tempest-CinderUnicodeTest-2090869398 None] Create snapshot completed successfully Aug 05 06:21:38 devstack sudo[100681]: pam_unix(sudo:session): session closed for user root Aug 05 06:21:38 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-3f9b713d-0b9b-462e-aab4-a8b35e93919d tempest-VolumesGetTest-2043829097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-25a22d9c-cb7f-49fc-af25-fbbbab96870b 1073741824" returned: 0 in 0.395s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:21:38 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-3f9b713d-0b9b-462e-aab4-a8b35e93919d tempest-VolumesGetTest-2043829097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-25a22d9c-cb7f-49fc-af25-fbbbab96870b {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:21:38 devstack sudo[100686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-25a22d9c-cb7f-49fc-af25-fbbbab96870b Aug 05 06:21:38 devstack sudo[100686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:21:38 devstack sudo[100686]: pam_unix(sudo:session): session closed for user root Aug 05 06:21:38 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-3f9b713d-0b9b-462e-aab4-a8b35e93919d tempest-VolumesGetTest-2043829097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-25a22d9c-cb7f-49fc-af25-fbbbab96870b" returned: 0 in 0.248s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:21:38 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-3f9b713d-0b9b-462e-aab4-a8b35e93919d tempest-VolumesGetTest-2043829097 None] <== create_volume: return (682ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'} {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 06:21:38 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-3f9b713d-0b9b-462e-aab4-a8b35e93919d tempest-VolumesGetTest-2043829097 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.684s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:21:38 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-3f9b713d-0b9b-462e-aab4-a8b35e93919d tempest-VolumesGetTest-2043829097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e5e5bf1-ebd9-43fe-88fd-9e47265b7682) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25a22d9c-cb7f-49fc-af25-fbbbab96870b', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:21:38 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-3f9b713d-0b9b-462e-aab4-a8b35e93919d tempest-VolumesGetTest-2043829097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91a4f4b0-6292-46a7-9a78-f4e62090c2dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:21:38 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-3f9b713d-0b9b-462e-aab4-a8b35e93919d tempest-VolumesGetTest-2043829097 None] Volume volume-25a22d9c-cb7f-49fc-af25-fbbbab96870b (25a22d9c-cb7f-49fc-af25-fbbbab96870b): created successfully Aug 05 06:21:38 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-3f9b713d-0b9b-462e-aab4-a8b35e93919d tempest-VolumesGetTest-2043829097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91a4f4b0-6292-46a7-9a78-f4e62090c2dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:21:38 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-3f9b713d-0b9b-462e-aab4-a8b35e93919d tempest-VolumesGetTest-2043829097 None] Flow 'volume_create_manager' (eb820c14-a732-44a7-b0d5-9cdd8c8cd692) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:21:38 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-3f9b713d-0b9b-462e-aab4-a8b35e93919d tempest-VolumesGetTest-2043829097 None] Created volume successfully. Aug 05 06:21:38 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-a190f013-bf34-46b6-abcb-af4adc9e6ac7 tempest-CinderUnicodeTest-2090869398 None] Acquiring lock "cinder-86bcc33e-0588-443b-abd1-bac922a5b783-delete_snapshot" by "delete_snapshot" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:21:38 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-a190f013-bf34-46b6-abcb-af4adc9e6ac7 tempest-CinderUnicodeTest-2090869398 None] Lock "cinder-86bcc33e-0588-443b-abd1-bac922a5b783-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:21:38 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-a190f013-bf34-46b6-abcb-af4adc9e6ac7 tempest-CinderUnicodeTest-2090869398 None] Acquiring lock "cinder-quobyte-9371d151-981e-40e4-8ca8-0d49cd65ef87" by "delete_snapshot" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:21:38 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-a190f013-bf34-46b6-abcb-af4adc9e6ac7 tempest-CinderUnicodeTest-2090869398 None] Lock "cinder-quobyte-9371d151-981e-40e4-8ca8-0d49cd65ef87" acquired by "delete_snapshot" :: waited 0.014s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:21:38 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-a190f013-bf34-46b6-abcb-af4adc9e6ac7 tempest-CinderUnicodeTest-2090869398 None] Acquiring lock "cinder-quobyte-86bcc33e-0588-443b-abd1-bac922a5b783" by "_delete_snapshot" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:21:38 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-a190f013-bf34-46b6-abcb-af4adc9e6ac7 tempest-CinderUnicodeTest-2090869398 None] Lock "cinder-quobyte-86bcc33e-0588-443b-abd1-bac922a5b783" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:21:38 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-a190f013-bf34-46b6-abcb-af4adc9e6ac7 tempest-CinderUnicodeTest-2090869398 None] Deleting offline snapshot 86bcc33e-0588-443b-abd1-bac922a5b783 of volume 9371d151-981e-40e4-8ca8-0d49cd65ef87 {{(pid=88695) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 06:21:38 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-a190f013-bf34-46b6-abcb-af4adc9e6ac7 tempest-CinderUnicodeTest-2090869398 None] snapshot_file for this snap is: volume-9371d151-981e-40e4-8ca8-0d49cd65ef87.86bcc33e-0588-443b-abd1-bac922a5b783 {{(pid=88695) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 06:21:38 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[46a8e759-ac0f-4bb4-bba6-1920c9fb8f2e]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:21:38 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-a190f013-bf34-46b6-abcb-af4adc9e6ac7 tempest-CinderUnicodeTest-2090869398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9371d151-981e-40e4-8ca8-0d49cd65ef87.86bcc33e-0588-443b-abd1-bac922a5b783 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:21:39 devstack sudo[100689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9371d151-981e-40e4-8ca8-0d49cd65ef87.86bcc33e-0588-443b-abd1-bac922a5b783 Aug 05 06:21:39 devstack sudo[100689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:21:39 devstack sudo[100689]: pam_unix(sudo:session): session closed for user root Aug 05 06:21:39 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-a190f013-bf34-46b6-abcb-af4adc9e6ac7 tempest-CinderUnicodeTest-2090869398 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9371d151-981e-40e4-8ca8-0d49cd65ef87.86bcc33e-0588-443b-abd1-bac922a5b783" returned: 0 in 0.375s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:21:39 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-a190f013-bf34-46b6-abcb-af4adc9e6ac7 tempest-CinderUnicodeTest-2090869398 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9371d151-981e-40e4-8ca8-0d49cd65ef87(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88695) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 06:21:39 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d0f7d37-09ac-439f-8aa6-634b35e09d35]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:21:39 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-a190f013-bf34-46b6-abcb-af4adc9e6ac7 tempest-CinderUnicodeTest-2090869398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9371d151-981e-40e4-8ca8-0d49cd65ef87 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:21:39 devstack sudo[100694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9371d151-981e-40e4-8ca8-0d49cd65ef87 Aug 05 06:21:39 devstack sudo[100694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:21:39 devstack sudo[100694]: pam_unix(sudo:session): session closed for user root Aug 05 06:21:39 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-a190f013-bf34-46b6-abcb-af4adc9e6ac7 tempest-CinderUnicodeTest-2090869398 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9371d151-981e-40e4-8ca8-0d49cd65ef87" returned: 0 in 0.377s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:21:39 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-a190f013-bf34-46b6-abcb-af4adc9e6ac7 tempest-CinderUnicodeTest-2090869398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9371d151-981e-40e4-8ca8-0d49cd65ef87.86bcc33e-0588-443b-abd1-bac922a5b783 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:21:39 devstack sudo[100699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9371d151-981e-40e4-8ca8-0d49cd65ef87.86bcc33e-0588-443b-abd1-bac922a5b783 Aug 05 06:21:39 devstack sudo[100699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:21:39 devstack cinder-volume[88695]: DEBUG cinder.volume.flows.manager.create_volume [None req-279f8cf7-ba05-4bfc-9149-d968199723cc tempest-VolumesGetTest-2043829097 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88695) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 06:21:39 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-279f8cf7-ba05-4bfc-9149-d968199723cc tempest-VolumesGetTest-2043829097 None] Flow 'volume_create_manager' (41a1d48e-a4f8-44e2-b11a-1b9fba472b00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:21:39 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-279f8cf7-ba05-4bfc-9149-d968199723cc tempest-VolumesGetTest-2043829097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58099300-d953-48bd-945c-6be3361ba5b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:21:39 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-279f8cf7-ba05-4bfc-9149-d968199723cc tempest-VolumesGetTest-2043829097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58099300-d953-48bd-945c-6be3361ba5b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:21:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-786043825',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=359f2cae-c81e-4431-ace6-43e44b118603,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='b6175dd98f414599bfa5ef85ee767e37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:21:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=25a22d9c-cb7f-49fc-af25-fbbbab96870b,status='creating',terminated_at=None,updated_at=2026-08-05T04:21:40Z,use_quota=True,user_id='193a110855b844cf84d18f71f6fe7b84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:21:39 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-279f8cf7-ba05-4bfc-9149-d968199723cc tempest-VolumesGetTest-2043829097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (696e6391-838b-41e4-b087-17b9621b2710) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:21:39 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-279f8cf7-ba05-4bfc-9149-d968199723cc tempest-VolumesGetTest-2043829097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (696e6391-838b-41e4-b087-17b9621b2710) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:21:39 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-279f8cf7-ba05-4bfc-9149-d968199723cc tempest-VolumesGetTest-2043829097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ce1d03c-be4b-4681-bd1d-c83514574145) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:21:39 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-279f8cf7-ba05-4bfc-9149-d968199723cc tempest-VolumesGetTest-2043829097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ce1d03c-be4b-4681-bd1d-c83514574145) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '359f2cae-c81e-4431-ace6-43e44b118603', 'volume_name': 'volume-359f2cae-c81e-4431-ace6-43e44b118603', 'volume_size': 1, 'source_volid': '25a22d9c-cb7f-49fc-af25-fbbbab96870b', 'source_volstatus': 'available'}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:21:39 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-279f8cf7-ba05-4bfc-9149-d968199723cc tempest-VolumesGetTest-2043829097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c9710df-5038-470c-91be-24e8d89161da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:21:39 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-279f8cf7-ba05-4bfc-9149-d968199723cc tempest-VolumesGetTest-2043829097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c9710df-5038-470c-91be-24e8d89161da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:21:39 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-279f8cf7-ba05-4bfc-9149-d968199723cc tempest-VolumesGetTest-2043829097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf0e7c43-5d89-4df2-a7a1-cfa49c64841c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:21:39 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-279f8cf7-ba05-4bfc-9149-d968199723cc tempest-VolumesGetTest-2043829097 None] Volume 359f2cae-c81e-4431-ace6-43e44b118603: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-359f2cae-c81e-4431-ace6-43e44b118603', 'volume_size': 1, 'source_volid': '25a22d9c-cb7f-49fc-af25-fbbbab96870b', 'source_volstatus': 'available'} Aug 05 06:21:39 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-279f8cf7-ba05-4bfc-9149-d968199723cc tempest-VolumesGetTest-2043829097 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:21:39 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-279f8cf7-ba05-4bfc-9149-d968199723cc tempest-VolumesGetTest-2043829097 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:21:39 devstack cinder-volume[88695]: INFO cinder.volume.drivers.remotefs [None req-279f8cf7-ba05-4bfc-9149-d968199723cc tempest-VolumesGetTest-2043829097 None] Cloning volume 25a22d9c-cb7f-49fc-af25-fbbbab96870b to volume 359f2cae-c81e-4431-ace6-43e44b118603 Aug 05 06:21:39 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-279f8cf7-ba05-4bfc-9149-d968199723cc tempest-VolumesGetTest-2043829097 None] Creating offline snapshot 4f7b70fd-e6d8-46fc-9d8d-a2873b63ef08 of volume 25a22d9c-cb7f-49fc-af25-fbbbab96870b {{(pid=88695) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 06:21:39 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a9400c7-acfb-44bc-9054-720936223934]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:21:39 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-279f8cf7-ba05-4bfc-9149-d968199723cc tempest-VolumesGetTest-2043829097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-25a22d9c-cb7f-49fc-af25-fbbbab96870b {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:21:40 devstack sudo[100704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-25a22d9c-cb7f-49fc-af25-fbbbab96870b Aug 05 06:21:40 devstack sudo[100704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:21:40 devstack sudo[100699]: pam_unix(sudo:session): session closed for user root Aug 05 06:21:40 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-a190f013-bf34-46b6-abcb-af4adc9e6ac7 tempest-CinderUnicodeTest-2090869398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9371d151-981e-40e4-8ca8-0d49cd65ef87.86bcc33e-0588-443b-abd1-bac922a5b783" returned: 0 in 0.367s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:21:40 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-a190f013-bf34-46b6-abcb-af4adc9e6ac7 tempest-CinderUnicodeTest-2090869398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9371d151-981e-40e4-8ca8-0d49cd65ef87.86bcc33e-0588-443b-abd1-bac922a5b783 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:21:40 devstack sudo[100707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9371d151-981e-40e4-8ca8-0d49cd65ef87.86bcc33e-0588-443b-abd1-bac922a5b783 Aug 05 06:21:40 devstack sudo[100707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:21:40 devstack sudo[100707]: pam_unix(sudo:session): session closed for user root Aug 05 06:21:40 devstack sudo[100704]: pam_unix(sudo:session): session closed for user root Aug 05 06:21:40 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-a190f013-bf34-46b6-abcb-af4adc9e6ac7 tempest-CinderUnicodeTest-2090869398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9371d151-981e-40e4-8ca8-0d49cd65ef87.86bcc33e-0588-443b-abd1-bac922a5b783" returned: 0 in 0.248s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:21:40 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-279f8cf7-ba05-4bfc-9149-d968199723cc tempest-VolumesGetTest-2043829097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-25a22d9c-cb7f-49fc-af25-fbbbab96870b" returned: 0 in 0.382s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:21:40 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-279f8cf7-ba05-4bfc-9149-d968199723cc tempest-VolumesGetTest-2043829097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-25a22d9c-cb7f-49fc-af25-fbbbab96870b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-25a22d9c-cb7f-49fc-af25-fbbbab96870b.4f7b70fd-e6d8-46fc-9d8d-a2873b63ef08 1G {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:21:40 devstack sudo[100713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-25a22d9c-cb7f-49fc-af25-fbbbab96870b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-25a22d9c-cb7f-49fc-af25-fbbbab96870b.4f7b70fd-e6d8-46fc-9d8d-a2873b63ef08 1G Aug 05 06:21:40 devstack sudo[100713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:21:40 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-a190f013-bf34-46b6-abcb-af4adc9e6ac7 tempest-CinderUnicodeTest-2090869398 None] Lock "cinder-quobyte-86bcc33e-0588-443b-abd1-bac922a5b783" released by "_delete_snapshot" :: held 1.491s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:21:40 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-a190f013-bf34-46b6-abcb-af4adc9e6ac7 tempest-CinderUnicodeTest-2090869398 None] Lock "cinder-quobyte-9371d151-981e-40e4-8ca8-0d49cd65ef87" released by "delete_snapshot" :: held 1.512s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:21:40 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-a190f013-bf34-46b6-abcb-af4adc9e6ac7 tempest-CinderUnicodeTest-2090869398 None] Created reservations ['0bcbd117-4891-4ed1-98e1-f413235c3063', '533e8248-063c-4d58-8d49-e39d2001b046', '4015199f-1df3-46ee-acbd-bff0fccaa186', '8aef0950-3a64-459c-963b-253ea848c1b1'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:21:40 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-a190f013-bf34-46b6-abcb-af4adc9e6ac7 tempest-CinderUnicodeTest-2090869398 None] Delete snapshot completed successfully. Aug 05 06:21:40 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-a190f013-bf34-46b6-abcb-af4adc9e6ac7 tempest-CinderUnicodeTest-2090869398 None] Lock "cinder-86bcc33e-0588-443b-abd1-bac922a5b783-delete_snapshot" released by "delete_snapshot" :: held 1.650s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:21:40 devstack sudo[100713]: pam_unix(sudo:session): session closed for user root Aug 05 06:21:40 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-279f8cf7-ba05-4bfc-9149-d968199723cc tempest-VolumesGetTest-2043829097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-25a22d9c-cb7f-49fc-af25-fbbbab96870b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-25a22d9c-cb7f-49fc-af25-fbbbab96870b.4f7b70fd-e6d8-46fc-9d8d-a2873b63ef08 1G" returned: 0 in 0.388s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:21:40 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-279f8cf7-ba05-4bfc-9149-d968199723cc tempest-VolumesGetTest-2043829097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-25a22d9c-cb7f-49fc-af25-fbbbab96870b -F qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-25a22d9c-cb7f-49fc-af25-fbbbab96870b.4f7b70fd-e6d8-46fc-9d8d-a2873b63ef08 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:21:40 devstack sudo[100722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-25a22d9c-cb7f-49fc-af25-fbbbab96870b -F qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-25a22d9c-cb7f-49fc-af25-fbbbab96870b.4f7b70fd-e6d8-46fc-9d8d-a2873b63ef08 Aug 05 06:21:40 devstack sudo[100722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:21:41 devstack sudo[100722]: pam_unix(sudo:session): session closed for user root Aug 05 06:21:41 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-f2e94adc-c1a2-4287-b807-2caeef8c4ea7 tempest-CinderUnicodeTest-2090869398 None] Acquiring lock "cinder-9371d151-981e-40e4-8ca8-0d49cd65ef87-delete_volume" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:21:41 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-279f8cf7-ba05-4bfc-9149-d968199723cc tempest-VolumesGetTest-2043829097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-25a22d9c-cb7f-49fc-af25-fbbbab96870b -F qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-25a22d9c-cb7f-49fc-af25-fbbbab96870b.4f7b70fd-e6d8-46fc-9d8d-a2873b63ef08" returned: 0 in 0.305s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:21:41 devstack cinder-volume[88695]: WARNING cinder.volume.drivers.remotefs [None req-279f8cf7-ba05-4bfc-9149-d968199723cc tempest-VolumesGetTest-2043829097 None] /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-25a22d9c-cb7f-49fc-af25-fbbbab96870b.4f7b70fd-e6d8-46fc-9d8d-a2873b63ef08 is being set with open permissions: ugo+rw Aug 05 06:21:41 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-279f8cf7-ba05-4bfc-9149-d968199723cc tempest-VolumesGetTest-2043829097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-25a22d9c-cb7f-49fc-af25-fbbbab96870b.4f7b70fd-e6d8-46fc-9d8d-a2873b63ef08 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:21:41 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-f2e94adc-c1a2-4287-b807-2caeef8c4ea7 tempest-CinderUnicodeTest-2090869398 None] Lock "cinder-9371d151-981e-40e4-8ca8-0d49cd65ef87-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:21:41 devstack sudo[100728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-25a22d9c-cb7f-49fc-af25-fbbbab96870b.4f7b70fd-e6d8-46fc-9d8d-a2873b63ef08 Aug 05 06:21:41 devstack sudo[100728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:21:41 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-f2e94adc-c1a2-4287-b807-2caeef8c4ea7 tempest-CinderUnicodeTest-2090869398 None] Acquiring lock "cinder-quobyte-9371d151-981e-40e4-8ca8-0d49cd65ef87" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:21:41 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-f2e94adc-c1a2-4287-b807-2caeef8c4ea7 tempest-CinderUnicodeTest-2090869398 None] Lock "cinder-quobyte-9371d151-981e-40e4-8ca8-0d49cd65ef87" acquired by "delete_volume" :: waited 0.014s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:21:41 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[d282871d-dfdb-43fa-932b-2a21f4cd0895]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:21:41 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-f2e94adc-c1a2-4287-b807-2caeef8c4ea7 tempest-CinderUnicodeTest-2090869398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9371d151-981e-40e4-8ca8-0d49cd65ef87 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:21:41 devstack sudo[100730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9371d151-981e-40e4-8ca8-0d49cd65ef87 Aug 05 06:21:41 devstack sudo[100730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:21:41 devstack sudo[100728]: pam_unix(sudo:session): session closed for user root Aug 05 06:21:41 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-279f8cf7-ba05-4bfc-9149-d968199723cc tempest-VolumesGetTest-2043829097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-25a22d9c-cb7f-49fc-af25-fbbbab96870b.4f7b70fd-e6d8-46fc-9d8d-a2873b63ef08" returned: 0 in 0.248s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:21:41 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-279f8cf7-ba05-4bfc-9149-d968199723cc tempest-VolumesGetTest-2043829097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-25a22d9c-cb7f-49fc-af25-fbbbab96870b.info {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:21:41 devstack sudo[100733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-25a22d9c-cb7f-49fc-af25-fbbbab96870b.info Aug 05 06:21:41 devstack sudo[100733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:21:41 devstack sudo[100730]: pam_unix(sudo:session): session closed for user root Aug 05 06:21:41 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-f2e94adc-c1a2-4287-b807-2caeef8c4ea7 tempest-CinderUnicodeTest-2090869398 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9371d151-981e-40e4-8ca8-0d49cd65ef87" returned: 0 in 0.436s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:21:41 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-f2e94adc-c1a2-4287-b807-2caeef8c4ea7 tempest-CinderUnicodeTest-2090869398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9371d151-981e-40e4-8ca8-0d49cd65ef87 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:21:41 devstack sudo[100733]: pam_unix(sudo:session): session closed for user root Aug 05 06:21:41 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-279f8cf7-ba05-4bfc-9149-d968199723cc tempest-VolumesGetTest-2043829097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-25a22d9c-cb7f-49fc-af25-fbbbab96870b.info" returned: 0 in 0.300s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:21:41 devstack cinder-volume[88695]: WARNING cinder.volume.drivers.remotefs [None req-279f8cf7-ba05-4bfc-9149-d968199723cc tempest-VolumesGetTest-2043829097 None] /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-25a22d9c-cb7f-49fc-af25-fbbbab96870b.info is being set with open permissions: ugo+rw Aug 05 06:21:41 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-279f8cf7-ba05-4bfc-9149-d968199723cc tempest-VolumesGetTest-2043829097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-25a22d9c-cb7f-49fc-af25-fbbbab96870b.info {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:21:41 devstack sudo[100739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9371d151-981e-40e4-8ca8-0d49cd65ef87 Aug 05 06:21:41 devstack sudo[100739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:21:41 devstack sudo[100740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-25a22d9c-cb7f-49fc-af25-fbbbab96870b.info Aug 05 06:21:41 devstack sudo[100740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:21:41 devstack sudo[100739]: pam_unix(sudo:session): session closed for user root Aug 05 06:21:41 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-f2e94adc-c1a2-4287-b807-2caeef8c4ea7 tempest-CinderUnicodeTest-2090869398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9371d151-981e-40e4-8ca8-0d49cd65ef87" returned: 0 in 0.286s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:21:41 devstack sudo[100740]: pam_unix(sudo:session): session closed for user root Aug 05 06:21:41 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-279f8cf7-ba05-4bfc-9149-d968199723cc tempest-VolumesGetTest-2043829097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-25a22d9c-cb7f-49fc-af25-fbbbab96870b.info" returned: 0 in 0.287s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:21:41 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-279f8cf7-ba05-4bfc-9149-d968199723cc tempest-VolumesGetTest-2043829097 None] Acquiring lock "cinder-quobyte-359f2cae-c81e-4431-ace6-43e44b118603" by "_copy_volume_from_snapshot" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:21:41 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-f2e94adc-c1a2-4287-b807-2caeef8c4ea7 tempest-CinderUnicodeTest-2090869398 None] Lock "cinder-quobyte-9371d151-981e-40e4-8ca8-0d49cd65ef87" released by "delete_volume" :: held 0.803s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:21:41 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-279f8cf7-ba05-4bfc-9149-d968199723cc tempest-VolumesGetTest-2043829097 None] Lock "cinder-quobyte-359f2cae-c81e-4431-ace6-43e44b118603" acquired by "_copy_volume_from_snapshot" :: waited 0.027s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:21:41 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-279f8cf7-ba05-4bfc-9149-d968199723cc tempest-VolumesGetTest-2043829097 None] snapshot: 4f7b70fd-e6d8-46fc-9d8d-a2873b63ef08, volume: 359f2cae-c81e-4431-ace6-43e44b118603, {{(pid=88695) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 05 06:21:41 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-279f8cf7-ba05-4bfc-9149-d968199723cc tempest-VolumesGetTest-2043829097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:21:41 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-279f8cf7-ba05-4bfc-9149-d968199723cc tempest-VolumesGetTest-2043829097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:21:41 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-279f8cf7-ba05-4bfc-9149-d968199723cc tempest-VolumesGetTest-2043829097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:21:41 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-279f8cf7-ba05-4bfc-9149-d968199723cc tempest-VolumesGetTest-2043829097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:21:41 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-279f8cf7-ba05-4bfc-9149-d968199723cc tempest-VolumesGetTest-2043829097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:21:41 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d465af1-01b8-486f-b75f-3deb68ded35c]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:21:41 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-279f8cf7-ba05-4bfc-9149-d968199723cc tempest-VolumesGetTest-2043829097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-25a22d9c-cb7f-49fc-af25-fbbbab96870b.4f7b70fd-e6d8-46fc-9d8d-a2873b63ef08 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:21:42 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-f2e94adc-c1a2-4287-b807-2caeef8c4ea7 tempest-CinderUnicodeTest-2090869398 None] Created reservations ['832ff5a8-1377-4d80-9a62-38e8114cf9fc', 'c9dd819c-bcf0-4daf-9f6c-67d169ca172a', '522480c5-3e51-4e10-8829-0c21ce58aa6c', '3da70b3f-5246-4762-ba70-5f5653d1611a'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:21:42 devstack sudo[100745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-25a22d9c-cb7f-49fc-af25-fbbbab96870b.4f7b70fd-e6d8-46fc-9d8d-a2873b63ef08 Aug 05 06:21:42 devstack sudo[100745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:21:42 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-f2e94adc-c1a2-4287-b807-2caeef8c4ea7 tempest-CinderUnicodeTest-2090869398 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:21:42 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-f2e94adc-c1a2-4287-b807-2caeef8c4ea7 tempest-CinderUnicodeTest-2090869398 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:21:42 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-f2e94adc-c1a2-4287-b807-2caeef8c4ea7 tempest-CinderUnicodeTest-2090869398 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:21:42 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-f2e94adc-c1a2-4287-b807-2caeef8c4ea7 tempest-CinderUnicodeTest-2090869398 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:21:42 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-f2e94adc-c1a2-4287-b807-2caeef8c4ea7 tempest-CinderUnicodeTest-2090869398 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:21:42 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-f2e94adc-c1a2-4287-b807-2caeef8c4ea7 tempest-CinderUnicodeTest-2090869398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:21:42 devstack sudo[100747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce Aug 05 06:21:42 devstack sudo[100747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:21:42 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-fd777456-b1da-4a1e-ae33-741ffa7194db tempest-CinderUnicodeTest-2090869398 None] Acquiring lock "cinder-d8ece551-d6a8-4f0b-a935-b33a4828b71d-delete_volume" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:21:42 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-fd777456-b1da-4a1e-ae33-741ffa7194db tempest-CinderUnicodeTest-2090869398 None] Lock "cinder-d8ece551-d6a8-4f0b-a935-b33a4828b71d-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:21:42 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-fd777456-b1da-4a1e-ae33-741ffa7194db tempest-CinderUnicodeTest-2090869398 None] Acquiring lock "cinder-quobyte-d8ece551-d6a8-4f0b-a935-b33a4828b71d" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:21:42 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-fd777456-b1da-4a1e-ae33-741ffa7194db tempest-CinderUnicodeTest-2090869398 None] Lock "cinder-quobyte-d8ece551-d6a8-4f0b-a935-b33a4828b71d" acquired by "delete_volume" :: waited 0.017s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:21:42 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dd1af7d-ed98-410f-9a04-4828ee59639e]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:21:42 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-fd777456-b1da-4a1e-ae33-741ffa7194db tempest-CinderUnicodeTest-2090869398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-d8ece551-d6a8-4f0b-a935-b33a4828b71d {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:21:42 devstack sudo[100747]: pam_unix(sudo:session): session closed for user root Aug 05 06:21:42 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-f2e94adc-c1a2-4287-b807-2caeef8c4ea7 tempest-CinderUnicodeTest-2090869398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce" returned: 0 in 0.337s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:21:42 devstack cinder-volume[88695]: DEBUG cinder.manager [None req-f2e94adc-c1a2-4287-b807-2caeef8c4ea7 tempest-CinderUnicodeTest-2090869398 None] Notifying Schedulers of capabilities ... {{(pid=88695) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 06:21:42 devstack sudo[100745]: pam_unix(sudo:session): session closed for user root Aug 05 06:21:42 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-f2e94adc-c1a2-4287-b807-2caeef8c4ea7 tempest-CinderUnicodeTest-2090869398 None] Deleted volume successfully. Aug 05 06:21:42 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-279f8cf7-ba05-4bfc-9149-d968199723cc tempest-VolumesGetTest-2043829097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-25a22d9c-cb7f-49fc-af25-fbbbab96870b.4f7b70fd-e6d8-46fc-9d8d-a2873b63ef08" returned: 0 in 0.523s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:21:42 devstack sudo[100749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-d8ece551-d6a8-4f0b-a935-b33a4828b71d Aug 05 06:21:42 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-279f8cf7-ba05-4bfc-9149-d968199723cc tempest-VolumesGetTest-2043829097 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-25a22d9c-cb7f-49fc-af25-fbbbab96870b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88695) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 06:21:42 devstack sudo[100749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:21:42 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-f2e94adc-c1a2-4287-b807-2caeef8c4ea7 tempest-CinderUnicodeTest-2090869398 None] Lock "cinder-9371d151-981e-40e4-8ca8-0d49cd65ef87-delete_volume" released by "delete_volume" :: held 1.474s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:21:42 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b6d5b54-5110-4e5d-b93e-61226ac699d8]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:21:42 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-279f8cf7-ba05-4bfc-9149-d968199723cc tempest-VolumesGetTest-2043829097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-25a22d9c-cb7f-49fc-af25-fbbbab96870b {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:21:42 devstack sudo[100755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-25a22d9c-cb7f-49fc-af25-fbbbab96870b Aug 05 06:21:42 devstack sudo[100755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:21:42 devstack sudo[100749]: pam_unix(sudo:session): session closed for user root Aug 05 06:21:42 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-fd777456-b1da-4a1e-ae33-741ffa7194db tempest-CinderUnicodeTest-2090869398 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-d8ece551-d6a8-4f0b-a935-b33a4828b71d" returned: 0 in 0.421s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:21:42 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-fd777456-b1da-4a1e-ae33-741ffa7194db tempest-CinderUnicodeTest-2090869398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-d8ece551-d6a8-4f0b-a935-b33a4828b71d {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:21:42 devstack sudo[100760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-d8ece551-d6a8-4f0b-a935-b33a4828b71d Aug 05 06:21:42 devstack sudo[100760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:21:42 devstack sudo[100755]: pam_unix(sudo:session): session closed for user root Aug 05 06:21:42 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-279f8cf7-ba05-4bfc-9149-d968199723cc tempest-VolumesGetTest-2043829097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-25a22d9c-cb7f-49fc-af25-fbbbab96870b" returned: 0 in 0.398s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:21:42 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-279f8cf7-ba05-4bfc-9149-d968199723cc tempest-VolumesGetTest-2043829097 None] will copy from snapshot at /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-25a22d9c-cb7f-49fc-af25-fbbbab96870b {{(pid=88695) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 05 06:21:42 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-279f8cf7-ba05-4bfc-9149-d968199723cc tempest-VolumesGetTest-2043829097 None] Creating direct copy from snapshot {{(pid=88695) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 05 06:21:42 devstack cinder-volume[88695]: DEBUG cinder.utils [None req-279f8cf7-ba05-4bfc-9149-d968199723cc tempest-VolumesGetTest-2043829097 None] Path /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-359f2cae-c81e-4431-ace6-43e44b118603 not found in is_blk_device check {{(pid=88695) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 05 06:21:42 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-279f8cf7-ba05-4bfc-9149-d968199723cc tempest-VolumesGetTest-2043829097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-25a22d9c-cb7f-49fc-af25-fbbbab96870b /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-359f2cae-c81e-4431-ace6-43e44b118603 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:21:42 devstack sudo[100765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-25a22d9c-cb7f-49fc-af25-fbbbab96870b /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-359f2cae-c81e-4431-ace6-43e44b118603 Aug 05 06:21:42 devstack sudo[100765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:21:43 devstack sudo[100760]: pam_unix(sudo:session): session closed for user root Aug 05 06:21:43 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-fd777456-b1da-4a1e-ae33-741ffa7194db tempest-CinderUnicodeTest-2090869398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-d8ece551-d6a8-4f0b-a935-b33a4828b71d" returned: 0 in 0.251s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:21:43 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-fd777456-b1da-4a1e-ae33-741ffa7194db tempest-CinderUnicodeTest-2090869398 None] Lock "cinder-quobyte-d8ece551-d6a8-4f0b-a935-b33a4828b71d" released by "delete_volume" :: held 0.732s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:21:43 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-fd777456-b1da-4a1e-ae33-741ffa7194db tempest-CinderUnicodeTest-2090869398 None] Created reservations ['2aee4321-c63f-40b5-9ac9-0dc37382ecf9', '22f3b2c8-c72b-444d-a7e7-c3031c17b095', '21729ff6-f7a1-4c73-b057-44a290d7b1cb', '2abb095e-00a8-4ef3-b3e4-bfe134be4bef'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:21:43 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-fd777456-b1da-4a1e-ae33-741ffa7194db tempest-CinderUnicodeTest-2090869398 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:21:43 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-fd777456-b1da-4a1e-ae33-741ffa7194db tempest-CinderUnicodeTest-2090869398 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:21:43 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-fd777456-b1da-4a1e-ae33-741ffa7194db tempest-CinderUnicodeTest-2090869398 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:21:43 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-fd777456-b1da-4a1e-ae33-741ffa7194db tempest-CinderUnicodeTest-2090869398 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:21:43 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-fd777456-b1da-4a1e-ae33-741ffa7194db tempest-CinderUnicodeTest-2090869398 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:21:43 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-fd777456-b1da-4a1e-ae33-741ffa7194db tempest-CinderUnicodeTest-2090869398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:21:43 devstack sudo[100770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce Aug 05 06:21:43 devstack sudo[100770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:21:43 devstack sudo[100770]: pam_unix(sudo:session): session closed for user root Aug 05 06:21:43 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-fd777456-b1da-4a1e-ae33-741ffa7194db tempest-CinderUnicodeTest-2090869398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce" returned: 0 in 0.416s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:21:43 devstack cinder-volume[88695]: DEBUG cinder.manager [None req-fd777456-b1da-4a1e-ae33-741ffa7194db tempest-CinderUnicodeTest-2090869398 None] Notifying Schedulers of capabilities ... {{(pid=88695) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 06:21:43 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-fd777456-b1da-4a1e-ae33-741ffa7194db tempest-CinderUnicodeTest-2090869398 None] Deleted volume successfully. Aug 05 06:21:43 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-fd777456-b1da-4a1e-ae33-741ffa7194db tempest-CinderUnicodeTest-2090869398 None] Lock "cinder-d8ece551-d6a8-4f0b-a935-b33a4828b71d-delete_volume" released by "delete_volume" :: held 1.414s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:21:47 devstack sudo[100765]: pam_unix(sudo:session): session closed for user root Aug 05 06:21:47 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-279f8cf7-ba05-4bfc-9149-d968199723cc tempest-VolumesGetTest-2043829097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-25a22d9c-cb7f-49fc-af25-fbbbab96870b /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-359f2cae-c81e-4431-ace6-43e44b118603" returned: 0 in 4.725s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:21:47 devstack cinder-volume[88695]: DEBUG cinder.image.image_utils [None req-279f8cf7-ba05-4bfc-9149-d968199723cc tempest-VolumesGetTest-2043829097 None] Image conversion details: src /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-25a22d9c-cb7f-49fc-af25-fbbbab96870b, size 1024.00 MB, duration 4.73 sec, destination /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-359f2cae-c81e-4431-ace6-43e44b118603 {{(pid=88695) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 05 06:21:47 devstack cinder-volume[88695]: INFO cinder.image.image_utils [None req-279f8cf7-ba05-4bfc-9149-d968199723cc tempest-VolumesGetTest-2043829097 None] Converted 1024.00 MB image at 216.67 MB/s Aug 05 06:21:47 devstack cinder-volume[88695]: WARNING cinder.volume.drivers.remotefs [None req-279f8cf7-ba05-4bfc-9149-d968199723cc tempest-VolumesGetTest-2043829097 None] /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-359f2cae-c81e-4431-ace6-43e44b118603 is being set with open permissions: ugo+rw Aug 05 06:21:47 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-279f8cf7-ba05-4bfc-9149-d968199723cc tempest-VolumesGetTest-2043829097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-359f2cae-c81e-4431-ace6-43e44b118603 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:21:47 devstack sudo[100783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-359f2cae-c81e-4431-ace6-43e44b118603 Aug 05 06:21:47 devstack sudo[100783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:21:47 devstack sudo[100783]: pam_unix(sudo:session): session closed for user root Aug 05 06:21:47 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-279f8cf7-ba05-4bfc-9149-d968199723cc tempest-VolumesGetTest-2043829097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-359f2cae-c81e-4431-ace6-43e44b118603" returned: 0 in 0.287s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:21:47 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-279f8cf7-ba05-4bfc-9149-d968199723cc tempest-VolumesGetTest-2043829097 None] Lock "cinder-quobyte-359f2cae-c81e-4431-ace6-43e44b118603" released by "_copy_volume_from_snapshot" :: held 6.043s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:21:48 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-279f8cf7-ba05-4bfc-9149-d968199723cc tempest-VolumesGetTest-2043829097 None] Acquiring lock "cinder-quobyte-4f7b70fd-e6d8-46fc-9d8d-a2873b63ef08" by "_delete_snapshot" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:21:48 devstack cinder-volume[88695]: DEBUG cinder.volume.flows.manager.create_volume [None req-41012fef-819d-407d-95bc-c2a5d667e528 tempest-AttachVolumeNegativeTest-1368352343 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88695) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 06:21:48 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-41012fef-819d-407d-95bc-c2a5d667e528 tempest-AttachVolumeNegativeTest-1368352343 None] Flow 'volume_create_manager' (b924a302-8345-4dbf-878e-d0a0ac2bf9f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:21:48 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-41012fef-819d-407d-95bc-c2a5d667e528 tempest-AttachVolumeNegativeTest-1368352343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54594aec-89a6-49b3-b208-7bc8c610f0f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:21:48 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-279f8cf7-ba05-4bfc-9149-d968199723cc tempest-VolumesGetTest-2043829097 None] Lock "cinder-quobyte-4f7b70fd-e6d8-46fc-9d8d-a2873b63ef08" acquired by "_delete_snapshot" :: waited 0.060s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:21:48 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-279f8cf7-ba05-4bfc-9149-d968199723cc tempest-VolumesGetTest-2043829097 None] Deleting offline snapshot 4f7b70fd-e6d8-46fc-9d8d-a2873b63ef08 of volume 25a22d9c-cb7f-49fc-af25-fbbbab96870b {{(pid=88695) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 06:21:48 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-279f8cf7-ba05-4bfc-9149-d968199723cc tempest-VolumesGetTest-2043829097 None] snapshot_file for this snap is: volume-25a22d9c-cb7f-49fc-af25-fbbbab96870b.4f7b70fd-e6d8-46fc-9d8d-a2873b63ef08 {{(pid=88695) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 06:21:48 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-41012fef-819d-407d-95bc-c2a5d667e528 tempest-AttachVolumeNegativeTest-1368352343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54594aec-89a6-49b3-b208-7bc8c610f0f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:21:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1144808164',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=141c8479-fd92-499e-b9c4-6a4b989bbe2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f582f538cec4452a5f67cec7936e431',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:21:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:21:48Z,use_quota=True,user_id='7af00ab35f0247e98b9718283cbcd42c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:21:48 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-41012fef-819d-407d-95bc-c2a5d667e528 tempest-AttachVolumeNegativeTest-1368352343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fdbcb8e-ffb8-4645-a157-a5c0ad8d6060) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:21:48 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-41012fef-819d-407d-95bc-c2a5d667e528 tempest-AttachVolumeNegativeTest-1368352343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fdbcb8e-ffb8-4645-a157-a5c0ad8d6060) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:21:48 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-41012fef-819d-407d-95bc-c2a5d667e528 tempest-AttachVolumeNegativeTest-1368352343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a10dc1d0-f436-46b2-ab1c-ceaaef32e8ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:21:48 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-41012fef-819d-407d-95bc-c2a5d667e528 tempest-AttachVolumeNegativeTest-1368352343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a10dc1d0-f436-46b2-ab1c-ceaaef32e8ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '141c8479-fd92-499e-b9c4-6a4b989bbe2d', 'volume_name': 'volume-141c8479-fd92-499e-b9c4-6a4b989bbe2d', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:21:48 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-41012fef-819d-407d-95bc-c2a5d667e528 tempest-AttachVolumeNegativeTest-1368352343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c40988ce-645d-4b0e-9242-7b139637ddfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:21:48 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-41012fef-819d-407d-95bc-c2a5d667e528 tempest-AttachVolumeNegativeTest-1368352343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c40988ce-645d-4b0e-9242-7b139637ddfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:21:48 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-41012fef-819d-407d-95bc-c2a5d667e528 tempest-AttachVolumeNegativeTest-1368352343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cabbc580-6ba2-4dbd-815a-67c11791d9ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:21:48 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-41012fef-819d-407d-95bc-c2a5d667e528 tempest-AttachVolumeNegativeTest-1368352343 None] Volume 141c8479-fd92-499e-b9c4-6a4b989bbe2d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-141c8479-fd92-499e-b9c4-6a4b989bbe2d', 'volume_size': 1} Aug 05 06:21:48 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-41012fef-819d-407d-95bc-c2a5d667e528 tempest-AttachVolumeNegativeTest-1368352343 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:21:48 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f02ad4c-209b-48af-9c38-552d66eec7c6]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:21:48 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-279f8cf7-ba05-4bfc-9149-d968199723cc tempest-VolumesGetTest-2043829097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-25a22d9c-cb7f-49fc-af25-fbbbab96870b.4f7b70fd-e6d8-46fc-9d8d-a2873b63ef08 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:21:48 devstack sudo[100787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-25a22d9c-cb7f-49fc-af25-fbbbab96870b.4f7b70fd-e6d8-46fc-9d8d-a2873b63ef08 Aug 05 06:21:48 devstack sudo[100787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:21:48 devstack sudo[100787]: pam_unix(sudo:session): session closed for user root Aug 05 06:21:48 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-279f8cf7-ba05-4bfc-9149-d968199723cc tempest-VolumesGetTest-2043829097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-25a22d9c-cb7f-49fc-af25-fbbbab96870b.4f7b70fd-e6d8-46fc-9d8d-a2873b63ef08" returned: 0 in 0.396s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:21:48 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-279f8cf7-ba05-4bfc-9149-d968199723cc tempest-VolumesGetTest-2043829097 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-25a22d9c-cb7f-49fc-af25-fbbbab96870b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88695) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 06:21:48 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[e80d19b8-c8d9-4da4-b6a3-f75f24f2aa22]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:21:48 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-279f8cf7-ba05-4bfc-9149-d968199723cc tempest-VolumesGetTest-2043829097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-25a22d9c-cb7f-49fc-af25-fbbbab96870b {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:21:48 devstack sudo[100792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-25a22d9c-cb7f-49fc-af25-fbbbab96870b Aug 05 06:21:48 devstack sudo[100792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:21:49 devstack sudo[100792]: pam_unix(sudo:session): session closed for user root Aug 05 06:21:49 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-279f8cf7-ba05-4bfc-9149-d968199723cc tempest-VolumesGetTest-2043829097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-25a22d9c-cb7f-49fc-af25-fbbbab96870b" returned: 0 in 0.552s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:21:49 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-279f8cf7-ba05-4bfc-9149-d968199723cc tempest-VolumesGetTest-2043829097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-25a22d9c-cb7f-49fc-af25-fbbbab96870b.4f7b70fd-e6d8-46fc-9d8d-a2873b63ef08 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:21:49 devstack sudo[100799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-25a22d9c-cb7f-49fc-af25-fbbbab96870b.4f7b70fd-e6d8-46fc-9d8d-a2873b63ef08 Aug 05 06:21:49 devstack sudo[100799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:21:49 devstack sudo[100799]: pam_unix(sudo:session): session closed for user root Aug 05 06:21:49 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-279f8cf7-ba05-4bfc-9149-d968199723cc tempest-VolumesGetTest-2043829097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-25a22d9c-cb7f-49fc-af25-fbbbab96870b.4f7b70fd-e6d8-46fc-9d8d-a2873b63ef08" returned: 0 in 0.359s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:21:49 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-279f8cf7-ba05-4bfc-9149-d968199723cc tempest-VolumesGetTest-2043829097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-25a22d9c-cb7f-49fc-af25-fbbbab96870b.4f7b70fd-e6d8-46fc-9d8d-a2873b63ef08 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:21:49 devstack sudo[100804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-25a22d9c-cb7f-49fc-af25-fbbbab96870b.4f7b70fd-e6d8-46fc-9d8d-a2873b63ef08 Aug 05 06:21:49 devstack sudo[100804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:21:49 devstack cinder-volume[88695]: DEBUG cinder.volume.flows.manager.create_volume [None req-96c5f733-98b3-4541-b109-f34ee1330546 tempest-ProjectReaderTests-1308557845 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88695) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 06:21:49 devstack sudo[100804]: pam_unix(sudo:session): session closed for user root Aug 05 06:21:49 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-96c5f733-98b3-4541-b109-f34ee1330546 tempest-ProjectReaderTests-1308557845 None] Flow 'volume_create_manager' (6fbec077-e1b0-400f-a303-f344478bbfad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:21:49 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-96c5f733-98b3-4541-b109-f34ee1330546 tempest-ProjectReaderTests-1308557845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3835cc2-9ea6-40aa-861a-83a6608f58ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:21:49 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-279f8cf7-ba05-4bfc-9149-d968199723cc tempest-VolumesGetTest-2043829097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-25a22d9c-cb7f-49fc-af25-fbbbab96870b.4f7b70fd-e6d8-46fc-9d8d-a2873b63ef08" returned: 0 in 0.298s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:21:49 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-96c5f733-98b3-4541-b109-f34ee1330546 tempest-ProjectReaderTests-1308557845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3835cc2-9ea6-40aa-861a-83a6608f58ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:21:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-766607205',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=925c586d-0716-48db-8298-cdfdc4ca26b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fab3b71f051c4355b05699c5a8bd6b4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:21:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:21:50Z,use_quota=True,user_id='b296d4aa7e8a4e7b886a903e61fccd0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:21:49 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-96c5f733-98b3-4541-b109-f34ee1330546 tempest-ProjectReaderTests-1308557845 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6f269c5-0564-4a55-9f6b-9cbb01448947) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:21:49 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-96c5f733-98b3-4541-b109-f34ee1330546 tempest-ProjectReaderTests-1308557845 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6f269c5-0564-4a55-9f6b-9cbb01448947) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:21:49 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-96c5f733-98b3-4541-b109-f34ee1330546 tempest-ProjectReaderTests-1308557845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b285a00e-45c2-44a4-aad4-2c72c2a09a45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:21:49 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-96c5f733-98b3-4541-b109-f34ee1330546 tempest-ProjectReaderTests-1308557845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b285a00e-45c2-44a4-aad4-2c72c2a09a45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '925c586d-0716-48db-8298-cdfdc4ca26b0', 'volume_name': 'volume-925c586d-0716-48db-8298-cdfdc4ca26b0', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:21:49 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-96c5f733-98b3-4541-b109-f34ee1330546 tempest-ProjectReaderTests-1308557845 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f74f404-8dfd-4db9-b246-43b0755b256c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:21:49 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-96c5f733-98b3-4541-b109-f34ee1330546 tempest-ProjectReaderTests-1308557845 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f74f404-8dfd-4db9-b246-43b0755b256c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:21:49 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-96c5f733-98b3-4541-b109-f34ee1330546 tempest-ProjectReaderTests-1308557845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ffcf471-c96f-4df8-a411-08e464bf7076) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:21:49 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-96c5f733-98b3-4541-b109-f34ee1330546 tempest-ProjectReaderTests-1308557845 None] Volume 925c586d-0716-48db-8298-cdfdc4ca26b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-925c586d-0716-48db-8298-cdfdc4ca26b0', 'volume_size': 1} Aug 05 06:21:49 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-96c5f733-98b3-4541-b109-f34ee1330546 tempest-ProjectReaderTests-1308557845 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:21:49 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-279f8cf7-ba05-4bfc-9149-d968199723cc tempest-VolumesGetTest-2043829097 None] Lock "cinder-quobyte-4f7b70fd-e6d8-46fc-9d8d-a2873b63ef08" released by "_delete_snapshot" :: held 1.784s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:21:49 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-279f8cf7-ba05-4bfc-9149-d968199723cc tempest-VolumesGetTest-2043829097 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 9.980s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:21:49 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-41012fef-819d-407d-95bc-c2a5d667e528 tempest-AttachVolumeNegativeTest-1368352343 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.743s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:21:49 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-41012fef-819d-407d-95bc-c2a5d667e528 tempest-AttachVolumeNegativeTest-1368352343 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:21:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1144808164',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=141c8479-fd92-499e-b9c4-6a4b989bbe2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f582f538cec4452a5f67cec7936e431',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:21:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:21:48Z,use_quota=True,user_id='7af00ab35f0247e98b9718283cbcd42c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)}" {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 06:21:49 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-41012fef-819d-407d-95bc-c2a5d667e528 tempest-AttachVolumeNegativeTest-1368352343 None] Creating volume 141c8479-fd92-499e-b9c4-6a4b989bbe2d {{(pid=88695) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 06:21:49 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-41012fef-819d-407d-95bc-c2a5d667e528 tempest-AttachVolumeNegativeTest-1368352343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:21:49 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-41012fef-819d-407d-95bc-c2a5d667e528 tempest-AttachVolumeNegativeTest-1368352343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:21:49 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-41012fef-819d-407d-95bc-c2a5d667e528 tempest-AttachVolumeNegativeTest-1368352343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:21:49 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-41012fef-819d-407d-95bc-c2a5d667e528 tempest-AttachVolumeNegativeTest-1368352343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:21:49 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-41012fef-819d-407d-95bc-c2a5d667e528 tempest-AttachVolumeNegativeTest-1368352343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:21:49 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-41012fef-819d-407d-95bc-c2a5d667e528 tempest-AttachVolumeNegativeTest-1368352343 None] Selected osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 as target Quobyte volume. {{(pid=88695) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 06:21:49 devstack cinder-volume[88695]: INFO cinder.volume.drivers.remotefs [None req-41012fef-819d-407d-95bc-c2a5d667e528 tempest-AttachVolumeNegativeTest-1368352343 None] casted to osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 Aug 05 06:21:49 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-41012fef-819d-407d-95bc-c2a5d667e528 tempest-AttachVolumeNegativeTest-1368352343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-141c8479-fd92-499e-b9c4-6a4b989bbe2d 1073741824 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:21:49 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-279f8cf7-ba05-4bfc-9149-d968199723cc tempest-VolumesGetTest-2043829097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf0e7c43-5d89-4df2-a7a1-cfa49c64841c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-359f2cae-c81e-4431-ace6-43e44b118603', 'volume_size': 1, 'source_volid': '25a22d9c-cb7f-49fc-af25-fbbbab96870b', 'source_volstatus': 'available'}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:21:49 devstack sudo[100807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-141c8479-fd92-499e-b9c4-6a4b989bbe2d 1073741824 Aug 05 06:21:49 devstack sudo[100807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:21:49 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-279f8cf7-ba05-4bfc-9149-d968199723cc tempest-VolumesGetTest-2043829097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52b41536-2aec-43ec-a63b-e88ec828a93d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:21:49 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-279f8cf7-ba05-4bfc-9149-d968199723cc tempest-VolumesGetTest-2043829097 None] Volume volume-359f2cae-c81e-4431-ace6-43e44b118603 (359f2cae-c81e-4431-ace6-43e44b118603): created successfully Aug 05 06:21:49 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-279f8cf7-ba05-4bfc-9149-d968199723cc tempest-VolumesGetTest-2043829097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52b41536-2aec-43ec-a63b-e88ec828a93d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:21:49 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-279f8cf7-ba05-4bfc-9149-d968199723cc tempest-VolumesGetTest-2043829097 None] Flow 'volume_create_manager' (41a1d48e-a4f8-44e2-b11a-1b9fba472b00) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:21:49 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-279f8cf7-ba05-4bfc-9149-d968199723cc tempest-VolumesGetTest-2043829097 None] Created volume successfully. Aug 05 06:21:50 devstack sudo[100807]: pam_unix(sudo:session): session closed for user root Aug 05 06:21:50 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-41012fef-819d-407d-95bc-c2a5d667e528 tempest-AttachVolumeNegativeTest-1368352343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-141c8479-fd92-499e-b9c4-6a4b989bbe2d 1073741824" returned: 0 in 0.402s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:21:50 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-41012fef-819d-407d-95bc-c2a5d667e528 tempest-AttachVolumeNegativeTest-1368352343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-141c8479-fd92-499e-b9c4-6a4b989bbe2d {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:21:50 devstack sudo[100813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-141c8479-fd92-499e-b9c4-6a4b989bbe2d Aug 05 06:21:50 devstack sudo[100813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:21:50 devstack sudo[100813]: pam_unix(sudo:session): session closed for user root Aug 05 06:21:50 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-41012fef-819d-407d-95bc-c2a5d667e528 tempest-AttachVolumeNegativeTest-1368352343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-141c8479-fd92-499e-b9c4-6a4b989bbe2d" returned: 0 in 0.254s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:21:50 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-41012fef-819d-407d-95bc-c2a5d667e528 tempest-AttachVolumeNegativeTest-1368352343 None] <== create_volume: return (695ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'} {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 06:21:50 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-41012fef-819d-407d-95bc-c2a5d667e528 tempest-AttachVolumeNegativeTest-1368352343 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.697s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:21:50 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-96c5f733-98b3-4541-b109-f34ee1330546 tempest-ProjectReaderTests-1308557845 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.736s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:21:50 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-96c5f733-98b3-4541-b109-f34ee1330546 tempest-ProjectReaderTests-1308557845 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:21:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-766607205',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=925c586d-0716-48db-8298-cdfdc4ca26b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fab3b71f051c4355b05699c5a8bd6b4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:21:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:21:50Z,use_quota=True,user_id='b296d4aa7e8a4e7b886a903e61fccd0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)}" {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 06:21:50 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-96c5f733-98b3-4541-b109-f34ee1330546 tempest-ProjectReaderTests-1308557845 None] Creating volume 925c586d-0716-48db-8298-cdfdc4ca26b0 {{(pid=88695) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 06:21:50 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-96c5f733-98b3-4541-b109-f34ee1330546 tempest-ProjectReaderTests-1308557845 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:21:50 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-96c5f733-98b3-4541-b109-f34ee1330546 tempest-ProjectReaderTests-1308557845 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:21:50 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-96c5f733-98b3-4541-b109-f34ee1330546 tempest-ProjectReaderTests-1308557845 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:21:50 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-96c5f733-98b3-4541-b109-f34ee1330546 tempest-ProjectReaderTests-1308557845 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:21:50 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-96c5f733-98b3-4541-b109-f34ee1330546 tempest-ProjectReaderTests-1308557845 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:21:50 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-96c5f733-98b3-4541-b109-f34ee1330546 tempest-ProjectReaderTests-1308557845 None] Selected osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 as target Quobyte volume. {{(pid=88695) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 06:21:50 devstack cinder-volume[88695]: INFO cinder.volume.drivers.remotefs [None req-96c5f733-98b3-4541-b109-f34ee1330546 tempest-ProjectReaderTests-1308557845 None] casted to osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 Aug 05 06:21:50 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-96c5f733-98b3-4541-b109-f34ee1330546 tempest-ProjectReaderTests-1308557845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-925c586d-0716-48db-8298-cdfdc4ca26b0 1073741824 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:21:50 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-41012fef-819d-407d-95bc-c2a5d667e528 tempest-AttachVolumeNegativeTest-1368352343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cabbc580-6ba2-4dbd-815a-67c11791d9ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-141c8479-fd92-499e-b9c4-6a4b989bbe2d', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:21:50 devstack sudo[100817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-925c586d-0716-48db-8298-cdfdc4ca26b0 1073741824 Aug 05 06:21:50 devstack sudo[100817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:21:50 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-41012fef-819d-407d-95bc-c2a5d667e528 tempest-AttachVolumeNegativeTest-1368352343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31901e7a-03d7-4a30-b54a-1d0e318d91c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:21:50 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-41012fef-819d-407d-95bc-c2a5d667e528 tempest-AttachVolumeNegativeTest-1368352343 None] Volume volume-141c8479-fd92-499e-b9c4-6a4b989bbe2d (141c8479-fd92-499e-b9c4-6a4b989bbe2d): created successfully Aug 05 06:21:50 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-41012fef-819d-407d-95bc-c2a5d667e528 tempest-AttachVolumeNegativeTest-1368352343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31901e7a-03d7-4a30-b54a-1d0e318d91c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:21:50 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-41012fef-819d-407d-95bc-c2a5d667e528 tempest-AttachVolumeNegativeTest-1368352343 None] Flow 'volume_create_manager' (b924a302-8345-4dbf-878e-d0a0ac2bf9f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:21:50 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-41012fef-819d-407d-95bc-c2a5d667e528 tempest-AttachVolumeNegativeTest-1368352343 None] Created volume successfully. Aug 05 06:21:51 devstack sudo[100817]: pam_unix(sudo:session): session closed for user root Aug 05 06:21:51 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-96c5f733-98b3-4541-b109-f34ee1330546 tempest-ProjectReaderTests-1308557845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-925c586d-0716-48db-8298-cdfdc4ca26b0 1073741824" returned: 0 in 0.479s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:21:51 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-96c5f733-98b3-4541-b109-f34ee1330546 tempest-ProjectReaderTests-1308557845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-925c586d-0716-48db-8298-cdfdc4ca26b0 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:21:51 devstack sudo[100827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-925c586d-0716-48db-8298-cdfdc4ca26b0 Aug 05 06:21:51 devstack sudo[100827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:21:51 devstack sudo[100827]: pam_unix(sudo:session): session closed for user root Aug 05 06:21:51 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-96c5f733-98b3-4541-b109-f34ee1330546 tempest-ProjectReaderTests-1308557845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-925c586d-0716-48db-8298-cdfdc4ca26b0" returned: 0 in 0.332s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:21:51 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-96c5f733-98b3-4541-b109-f34ee1330546 tempest-ProjectReaderTests-1308557845 None] <== create_volume: return (855ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'} {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 06:21:51 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-96c5f733-98b3-4541-b109-f34ee1330546 tempest-ProjectReaderTests-1308557845 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.858s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:21:51 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-96c5f733-98b3-4541-b109-f34ee1330546 tempest-ProjectReaderTests-1308557845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ffcf471-c96f-4df8-a411-08e464bf7076) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-925c586d-0716-48db-8298-cdfdc4ca26b0', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:21:51 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-96c5f733-98b3-4541-b109-f34ee1330546 tempest-ProjectReaderTests-1308557845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01afcbcd-35a5-44ed-8b36-005f813eb9dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:21:51 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-96c5f733-98b3-4541-b109-f34ee1330546 tempest-ProjectReaderTests-1308557845 None] Volume volume-925c586d-0716-48db-8298-cdfdc4ca26b0 (925c586d-0716-48db-8298-cdfdc4ca26b0): created successfully Aug 05 06:21:51 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-96c5f733-98b3-4541-b109-f34ee1330546 tempest-ProjectReaderTests-1308557845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01afcbcd-35a5-44ed-8b36-005f813eb9dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:21:51 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-96c5f733-98b3-4541-b109-f34ee1330546 tempest-ProjectReaderTests-1308557845 None] Flow 'volume_create_manager' (6fbec077-e1b0-400f-a303-f344478bbfad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:21:51 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-96c5f733-98b3-4541-b109-f34ee1330546 tempest-ProjectReaderTests-1308557845 None] Created volume successfully. Aug 05 06:21:51 devstack cinder-volume[88695]: DEBUG cinder.volume.flows.manager.create_volume [None req-85ffceed-7906-4100-81ea-18413c8d6aa0 tempest-VolumesGetTest-2043829097 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88695) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 06:21:51 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-85ffceed-7906-4100-81ea-18413c8d6aa0 tempest-VolumesGetTest-2043829097 None] Flow 'volume_create_manager' (f183d6d9-c92c-434b-97f0-b4e9ca27c5a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:21:51 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-85ffceed-7906-4100-81ea-18413c8d6aa0 tempest-VolumesGetTest-2043829097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30f9cfd0-8e18-48f9-a354-f0de8aa6c193) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:21:51 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-85ffceed-7906-4100-81ea-18413c8d6aa0 tempest-VolumesGetTest-2043829097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30f9cfd0-8e18-48f9-a354-f0de8aa6c193) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:21:51Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1630515810',display_name='tempest-VolumesGetTest-Volume-756852774',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc79219f-0103-4bc3-a0b5-fc8f210e250d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6175dd98f414599bfa5ef85ee767e37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:21:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:21:51Z,use_quota=True,user_id='193a110855b844cf84d18f71f6fe7b84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:21:51 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-85ffceed-7906-4100-81ea-18413c8d6aa0 tempest-VolumesGetTest-2043829097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70dd47f0-62e8-40ca-bf5e-3fe40d55f9b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:21:51 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-85ffceed-7906-4100-81ea-18413c8d6aa0 tempest-VolumesGetTest-2043829097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70dd47f0-62e8-40ca-bf5e-3fe40d55f9b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:21:51 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-85ffceed-7906-4100-81ea-18413c8d6aa0 tempest-VolumesGetTest-2043829097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc57b455-69a1-42b9-953b-b7fc918b1f2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:21:51 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-85ffceed-7906-4100-81ea-18413c8d6aa0 tempest-VolumesGetTest-2043829097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc57b455-69a1-42b9-953b-b7fc918b1f2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc79219f-0103-4bc3-a0b5-fc8f210e250d', 'volume_name': 'volume-bc79219f-0103-4bc3-a0b5-fc8f210e250d', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:21:51 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-85ffceed-7906-4100-81ea-18413c8d6aa0 tempest-VolumesGetTest-2043829097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9362f150-823a-414f-9afe-885b7002c58d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:21:51 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-85ffceed-7906-4100-81ea-18413c8d6aa0 tempest-VolumesGetTest-2043829097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9362f150-823a-414f-9afe-885b7002c58d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:21:51 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-85ffceed-7906-4100-81ea-18413c8d6aa0 tempest-VolumesGetTest-2043829097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad573d14-89f1-403b-bb18-2ab01dfd6cd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:21:51 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-85ffceed-7906-4100-81ea-18413c8d6aa0 tempest-VolumesGetTest-2043829097 None] Volume bc79219f-0103-4bc3-a0b5-fc8f210e250d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc79219f-0103-4bc3-a0b5-fc8f210e250d', 'volume_size': 1} Aug 05 06:21:51 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-85ffceed-7906-4100-81ea-18413c8d6aa0 tempest-VolumesGetTest-2043829097 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:21:51 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-85ffceed-7906-4100-81ea-18413c8d6aa0 tempest-VolumesGetTest-2043829097 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:21:51 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-85ffceed-7906-4100-81ea-18413c8d6aa0 tempest-VolumesGetTest-2043829097 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:21:51Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1630515810',display_name='tempest-VolumesGetTest-Volume-756852774',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc79219f-0103-4bc3-a0b5-fc8f210e250d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6175dd98f414599bfa5ef85ee767e37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:21:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:21:51Z,use_quota=True,user_id='193a110855b844cf84d18f71f6fe7b84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)}" {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 06:21:51 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-85ffceed-7906-4100-81ea-18413c8d6aa0 tempest-VolumesGetTest-2043829097 None] Creating volume bc79219f-0103-4bc3-a0b5-fc8f210e250d {{(pid=88695) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 06:21:51 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-85ffceed-7906-4100-81ea-18413c8d6aa0 tempest-VolumesGetTest-2043829097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:21:51 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-85ffceed-7906-4100-81ea-18413c8d6aa0 tempest-VolumesGetTest-2043829097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:21:51 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-85ffceed-7906-4100-81ea-18413c8d6aa0 tempest-VolumesGetTest-2043829097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:21:51 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-85ffceed-7906-4100-81ea-18413c8d6aa0 tempest-VolumesGetTest-2043829097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:21:51 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-85ffceed-7906-4100-81ea-18413c8d6aa0 tempest-VolumesGetTest-2043829097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:21:51 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-85ffceed-7906-4100-81ea-18413c8d6aa0 tempest-VolumesGetTest-2043829097 None] Selected osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 as target Quobyte volume. {{(pid=88695) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 06:21:51 devstack cinder-volume[88695]: INFO cinder.volume.drivers.remotefs [None req-85ffceed-7906-4100-81ea-18413c8d6aa0 tempest-VolumesGetTest-2043829097 None] casted to osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 Aug 05 06:21:51 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-85ffceed-7906-4100-81ea-18413c8d6aa0 tempest-VolumesGetTest-2043829097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-bc79219f-0103-4bc3-a0b5-fc8f210e250d 1073741824 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:21:51 devstack sudo[100833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-bc79219f-0103-4bc3-a0b5-fc8f210e250d 1073741824 Aug 05 06:21:51 devstack sudo[100833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:21:51 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [req-2eaa6b42-5fa8-4302-8d9d-98054d20fdd1 req-6ba5c527-3a57-4ec9-996c-2c8b0792634d tempest-AttachVolumeNegativeTest-1368352343 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:21:52 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-5656240c-92f8-4cfd-bc4c-9eaef0e8d0bd tempest-ProjectReaderTests-1308557845 None] Acquiring lock "cinder-925c586d-0716-48db-8298-cdfdc4ca26b0-delete_volume" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:21:52 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-5656240c-92f8-4cfd-bc4c-9eaef0e8d0bd tempest-ProjectReaderTests-1308557845 None] Lock "cinder-925c586d-0716-48db-8298-cdfdc4ca26b0-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:21:52 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-5656240c-92f8-4cfd-bc4c-9eaef0e8d0bd tempest-ProjectReaderTests-1308557845 None] Acquiring lock "cinder-quobyte-925c586d-0716-48db-8298-cdfdc4ca26b0" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:21:52 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-5656240c-92f8-4cfd-bc4c-9eaef0e8d0bd tempest-ProjectReaderTests-1308557845 None] Lock "cinder-quobyte-925c586d-0716-48db-8298-cdfdc4ca26b0" acquired by "delete_volume" :: waited 0.021s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:21:52 devstack sudo[100833]: pam_unix(sudo:session): session closed for user root Aug 05 06:21:52 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-85ffceed-7906-4100-81ea-18413c8d6aa0 tempest-VolumesGetTest-2043829097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-bc79219f-0103-4bc3-a0b5-fc8f210e250d 1073741824" returned: 0 in 0.490s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:21:52 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea2fed23-ba66-48c2-b198-02f8d594a3ee]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:21:52 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-5656240c-92f8-4cfd-bc4c-9eaef0e8d0bd tempest-ProjectReaderTests-1308557845 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-925c586d-0716-48db-8298-cdfdc4ca26b0 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:21:52 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-85ffceed-7906-4100-81ea-18413c8d6aa0 tempest-VolumesGetTest-2043829097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-bc79219f-0103-4bc3-a0b5-fc8f210e250d {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:21:52 devstack sudo[100848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-bc79219f-0103-4bc3-a0b5-fc8f210e250d Aug 05 06:21:52 devstack sudo[100848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:21:52 devstack sudo[100847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-925c586d-0716-48db-8298-cdfdc4ca26b0 Aug 05 06:21:52 devstack sudo[100847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:21:52 devstack sudo[100848]: pam_unix(sudo:session): session closed for user root Aug 05 06:21:52 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-85ffceed-7906-4100-81ea-18413c8d6aa0 tempest-VolumesGetTest-2043829097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-bc79219f-0103-4bc3-a0b5-fc8f210e250d" returned: 0 in 0.252s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:21:52 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-85ffceed-7906-4100-81ea-18413c8d6aa0 tempest-VolumesGetTest-2043829097 None] <== create_volume: return (797ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'} {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 06:21:52 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-85ffceed-7906-4100-81ea-18413c8d6aa0 tempest-VolumesGetTest-2043829097 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.801s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:21:52 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [req-2eaa6b42-5fa8-4302-8d9d-98054d20fdd1 req-6ba5c527-3a57-4ec9-996c-2c8b0792634d tempest-AttachVolumeNegativeTest-1368352343 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.553s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:21:52 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [req-2eaa6b42-5fa8-4302-8d9d-98054d20fdd1 req-6ba5c527-3a57-4ec9-996c-2c8b0792634d tempest-AttachVolumeNegativeTest-1368352343 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:21:52 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-85ffceed-7906-4100-81ea-18413c8d6aa0 tempest-VolumesGetTest-2043829097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad573d14-89f1-403b-bb18-2ab01dfd6cd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc79219f-0103-4bc3-a0b5-fc8f210e250d', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:21:52 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-85ffceed-7906-4100-81ea-18413c8d6aa0 tempest-VolumesGetTest-2043829097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2af004d-c56e-4330-84a5-1ecc10fa6dc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:21:52 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-85ffceed-7906-4100-81ea-18413c8d6aa0 tempest-VolumesGetTest-2043829097 None] Volume volume-bc79219f-0103-4bc3-a0b5-fc8f210e250d (bc79219f-0103-4bc3-a0b5-fc8f210e250d): created successfully Aug 05 06:21:52 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-85ffceed-7906-4100-81ea-18413c8d6aa0 tempest-VolumesGetTest-2043829097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2af004d-c56e-4330-84a5-1ecc10fa6dc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:21:52 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-85ffceed-7906-4100-81ea-18413c8d6aa0 tempest-VolumesGetTest-2043829097 None] Flow 'volume_create_manager' (f183d6d9-c92c-434b-97f0-b4e9ca27c5a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:21:52 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-85ffceed-7906-4100-81ea-18413c8d6aa0 tempest-VolumesGetTest-2043829097 None] Created volume successfully. Aug 05 06:21:52 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [req-2eaa6b42-5fa8-4302-8d9d-98054d20fdd1 req-6ba5c527-3a57-4ec9-996c-2c8b0792634d tempest-AttachVolumeNegativeTest-1368352343 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087', 'name': 'volume-141c8479-fd92-499e-b9c4-6a4b989bbe2d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e52e0cd1-e596-409a-a5b9-a7ac309435a2', 'enforce_multipath': True} {{(pid=88695) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 05 06:21:52 devstack sudo[100847]: pam_unix(sudo:session): session closed for user root Aug 05 06:21:52 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-5656240c-92f8-4cfd-bc4c-9eaef0e8d0bd tempest-ProjectReaderTests-1308557845 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-925c586d-0716-48db-8298-cdfdc4ca26b0" returned: 0 in 0.390s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:21:52 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-5656240c-92f8-4cfd-bc4c-9eaef0e8d0bd tempest-ProjectReaderTests-1308557845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-925c586d-0716-48db-8298-cdfdc4ca26b0 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:21:52 devstack sudo[100855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-925c586d-0716-48db-8298-cdfdc4ca26b0 Aug 05 06:21:52 devstack sudo[100855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:21:52 devstack cinder-volume[88695]: INFO cinder.volume.manager [req-2eaa6b42-5fa8-4302-8d9d-98054d20fdd1 req-6ba5c527-3a57-4ec9-996c-2c8b0792634d tempest-AttachVolumeNegativeTest-1368352343 None] attachment_update completed successfully. Aug 05 06:21:52 devstack sudo[100855]: pam_unix(sudo:session): session closed for user root Aug 05 06:21:52 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-5656240c-92f8-4cfd-bc4c-9eaef0e8d0bd tempest-ProjectReaderTests-1308557845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-925c586d-0716-48db-8298-cdfdc4ca26b0" returned: 0 in 0.270s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:21:52 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-5656240c-92f8-4cfd-bc4c-9eaef0e8d0bd tempest-ProjectReaderTests-1308557845 None] Lock "cinder-quobyte-925c586d-0716-48db-8298-cdfdc4ca26b0" released by "delete_volume" :: held 0.698s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:21:52 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-5656240c-92f8-4cfd-bc4c-9eaef0e8d0bd tempest-ProjectReaderTests-1308557845 None] Created reservations ['d447762e-a598-49e9-aceb-1ee8ac91e09a', 'e3ce5069-bc2f-4be9-9488-458fd34ce9dc', '4ae3d3f2-6206-43d4-8133-6c65ba92a2db', 'b96531d0-9976-4752-9125-951383779832'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:21:52 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-5656240c-92f8-4cfd-bc4c-9eaef0e8d0bd tempest-ProjectReaderTests-1308557845 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:21:52 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-5656240c-92f8-4cfd-bc4c-9eaef0e8d0bd tempest-ProjectReaderTests-1308557845 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:21:52 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-5656240c-92f8-4cfd-bc4c-9eaef0e8d0bd tempest-ProjectReaderTests-1308557845 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:21:52 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-5656240c-92f8-4cfd-bc4c-9eaef0e8d0bd tempest-ProjectReaderTests-1308557845 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:21:52 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-5656240c-92f8-4cfd-bc4c-9eaef0e8d0bd tempest-ProjectReaderTests-1308557845 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:21:52 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-5656240c-92f8-4cfd-bc4c-9eaef0e8d0bd tempest-ProjectReaderTests-1308557845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:21:52 devstack sudo[101239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce Aug 05 06:21:52 devstack sudo[101239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:21:53 devstack sudo[101239]: pam_unix(sudo:session): session closed for user root Aug 05 06:21:53 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-5656240c-92f8-4cfd-bc4c-9eaef0e8d0bd tempest-ProjectReaderTests-1308557845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce" returned: 0 in 0.268s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:21:53 devstack cinder-volume[88695]: DEBUG cinder.manager [None req-5656240c-92f8-4cfd-bc4c-9eaef0e8d0bd tempest-ProjectReaderTests-1308557845 None] Notifying Schedulers of capabilities ... {{(pid=88695) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 06:21:53 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-5656240c-92f8-4cfd-bc4c-9eaef0e8d0bd tempest-ProjectReaderTests-1308557845 None] Deleted volume successfully. Aug 05 06:21:53 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-5656240c-92f8-4cfd-bc4c-9eaef0e8d0bd tempest-ProjectReaderTests-1308557845 None] Lock "cinder-925c586d-0716-48db-8298-cdfdc4ca26b0-delete_volume" released by "delete_volume" :: held 1.174s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:21:53 devstack cinder-volume[88695]: DEBUG cinder.volume.flows.manager.create_volume [None req-3397caab-e6fa-4733-a5f1-4be5664f9c63 tempest-ProjectReaderTests-1308557845 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88695) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 06:21:53 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-3397caab-e6fa-4733-a5f1-4be5664f9c63 tempest-ProjectReaderTests-1308557845 None] Flow 'volume_create_manager' (ca4f55b8-6dc3-4423-8a47-c698fafe4d49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:21:53 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-3397caab-e6fa-4733-a5f1-4be5664f9c63 tempest-ProjectReaderTests-1308557845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3288c3a0-9cd4-4b05-85e5-016221c50622) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:21:53 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-3397caab-e6fa-4733-a5f1-4be5664f9c63 tempest-ProjectReaderTests-1308557845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3288c3a0-9cd4-4b05-85e5-016221c50622) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:21:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-905073514',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3502ee48-0e3d-4c27-b799-a5f435997a0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fab3b71f051c4355b05699c5a8bd6b4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:21:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:21:54Z,use_quota=True,user_id='b296d4aa7e8a4e7b886a903e61fccd0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:21:53 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-3397caab-e6fa-4733-a5f1-4be5664f9c63 tempest-ProjectReaderTests-1308557845 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d8015ed-0f26-490a-9372-3f4796bf78e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:21:53 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-3397caab-e6fa-4733-a5f1-4be5664f9c63 tempest-ProjectReaderTests-1308557845 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d8015ed-0f26-490a-9372-3f4796bf78e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:21:53 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-3397caab-e6fa-4733-a5f1-4be5664f9c63 tempest-ProjectReaderTests-1308557845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0bf46901-fa52-4b1f-8958-1224a1f42380) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:21:53 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-3397caab-e6fa-4733-a5f1-4be5664f9c63 tempest-ProjectReaderTests-1308557845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0bf46901-fa52-4b1f-8958-1224a1f42380) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3502ee48-0e3d-4c27-b799-a5f435997a0c', 'volume_name': 'volume-3502ee48-0e3d-4c27-b799-a5f435997a0c', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:21:53 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-3397caab-e6fa-4733-a5f1-4be5664f9c63 tempest-ProjectReaderTests-1308557845 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2afd5746-88eb-4d57-b5fc-c28d7cf130dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:21:53 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-3397caab-e6fa-4733-a5f1-4be5664f9c63 tempest-ProjectReaderTests-1308557845 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2afd5746-88eb-4d57-b5fc-c28d7cf130dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:21:53 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-3397caab-e6fa-4733-a5f1-4be5664f9c63 tempest-ProjectReaderTests-1308557845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2323370-1e88-41a4-a26a-646bbcaaaec7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:21:53 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-3397caab-e6fa-4733-a5f1-4be5664f9c63 tempest-ProjectReaderTests-1308557845 None] Volume 3502ee48-0e3d-4c27-b799-a5f435997a0c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3502ee48-0e3d-4c27-b799-a5f435997a0c', 'volume_size': 1} Aug 05 06:21:53 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-3397caab-e6fa-4733-a5f1-4be5664f9c63 tempest-ProjectReaderTests-1308557845 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:21:53 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-3397caab-e6fa-4733-a5f1-4be5664f9c63 tempest-ProjectReaderTests-1308557845 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:21:53 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-3397caab-e6fa-4733-a5f1-4be5664f9c63 tempest-ProjectReaderTests-1308557845 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:21:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-905073514',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3502ee48-0e3d-4c27-b799-a5f435997a0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fab3b71f051c4355b05699c5a8bd6b4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:21:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:21:54Z,use_quota=True,user_id='b296d4aa7e8a4e7b886a903e61fccd0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)}" {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 06:21:53 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-3397caab-e6fa-4733-a5f1-4be5664f9c63 tempest-ProjectReaderTests-1308557845 None] Creating volume 3502ee48-0e3d-4c27-b799-a5f435997a0c {{(pid=88695) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 06:21:53 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-3397caab-e6fa-4733-a5f1-4be5664f9c63 tempest-ProjectReaderTests-1308557845 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:21:53 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-3397caab-e6fa-4733-a5f1-4be5664f9c63 tempest-ProjectReaderTests-1308557845 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:21:53 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-3397caab-e6fa-4733-a5f1-4be5664f9c63 tempest-ProjectReaderTests-1308557845 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:21:53 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-3397caab-e6fa-4733-a5f1-4be5664f9c63 tempest-ProjectReaderTests-1308557845 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:21:53 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-3397caab-e6fa-4733-a5f1-4be5664f9c63 tempest-ProjectReaderTests-1308557845 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:21:53 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-3397caab-e6fa-4733-a5f1-4be5664f9c63 tempest-ProjectReaderTests-1308557845 None] Selected osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 as target Quobyte volume. {{(pid=88695) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 06:21:53 devstack cinder-volume[88695]: INFO cinder.volume.drivers.remotefs [None req-3397caab-e6fa-4733-a5f1-4be5664f9c63 tempest-ProjectReaderTests-1308557845 None] casted to osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 Aug 05 06:21:53 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-3397caab-e6fa-4733-a5f1-4be5664f9c63 tempest-ProjectReaderTests-1308557845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-3502ee48-0e3d-4c27-b799-a5f435997a0c 1073741824 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:21:53 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-660c699e-9837-4bca-998a-da9a02620121 tempest-VolumesGetTest-2043829097 None] Acquiring lock "cinder-bc79219f-0103-4bc3-a0b5-fc8f210e250d-delete_volume" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:21:53 devstack sudo[101246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-3502ee48-0e3d-4c27-b799-a5f435997a0c 1073741824 Aug 05 06:21:53 devstack sudo[101246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:21:53 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-660c699e-9837-4bca-998a-da9a02620121 tempest-VolumesGetTest-2043829097 None] Lock "cinder-bc79219f-0103-4bc3-a0b5-fc8f210e250d-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:21:53 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-660c699e-9837-4bca-998a-da9a02620121 tempest-VolumesGetTest-2043829097 None] Acquiring lock "cinder-quobyte-bc79219f-0103-4bc3-a0b5-fc8f210e250d" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:21:53 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-660c699e-9837-4bca-998a-da9a02620121 tempest-VolumesGetTest-2043829097 None] Lock "cinder-quobyte-bc79219f-0103-4bc3-a0b5-fc8f210e250d" acquired by "delete_volume" :: waited 0.013s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:21:53 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[b27890d4-fdf8-4df6-9552-50011974dcc1]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:21:53 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-660c699e-9837-4bca-998a-da9a02620121 tempest-VolumesGetTest-2043829097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-bc79219f-0103-4bc3-a0b5-fc8f210e250d {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:21:54 devstack sudo[101248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-bc79219f-0103-4bc3-a0b5-fc8f210e250d Aug 05 06:21:54 devstack sudo[101248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:21:54 devstack sudo[101246]: pam_unix(sudo:session): session closed for user root Aug 05 06:21:54 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-3397caab-e6fa-4733-a5f1-4be5664f9c63 tempest-ProjectReaderTests-1308557845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-3502ee48-0e3d-4c27-b799-a5f435997a0c 1073741824" returned: 0 in 0.513s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:21:54 devstack sudo[101248]: pam_unix(sudo:session): session closed for user root Aug 05 06:21:54 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-660c699e-9837-4bca-998a-da9a02620121 tempest-VolumesGetTest-2043829097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-bc79219f-0103-4bc3-a0b5-fc8f210e250d" returned: 0 in 0.428s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:21:54 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-660c699e-9837-4bca-998a-da9a02620121 tempest-VolumesGetTest-2043829097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-bc79219f-0103-4bc3-a0b5-fc8f210e250d {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:21:54 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-3397caab-e6fa-4733-a5f1-4be5664f9c63 tempest-ProjectReaderTests-1308557845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-3502ee48-0e3d-4c27-b799-a5f435997a0c {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:21:54 devstack sudo[101257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-bc79219f-0103-4bc3-a0b5-fc8f210e250d Aug 05 06:21:54 devstack sudo[101257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:21:54 devstack sudo[101258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-3502ee48-0e3d-4c27-b799-a5f435997a0c Aug 05 06:21:54 devstack sudo[101258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:21:54 devstack sudo[101258]: pam_unix(sudo:session): session closed for user root Aug 05 06:21:54 devstack sudo[101257]: pam_unix(sudo:session): session closed for user root Aug 05 06:21:54 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-3397caab-e6fa-4733-a5f1-4be5664f9c63 tempest-ProjectReaderTests-1308557845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-3502ee48-0e3d-4c27-b799-a5f435997a0c" returned: 0 in 0.303s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:21:54 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-3397caab-e6fa-4733-a5f1-4be5664f9c63 tempest-ProjectReaderTests-1308557845 None] <== create_volume: return (894ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'} {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 06:21:54 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-3397caab-e6fa-4733-a5f1-4be5664f9c63 tempest-ProjectReaderTests-1308557845 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.897s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:21:54 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-660c699e-9837-4bca-998a-da9a02620121 tempest-VolumesGetTest-2043829097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-bc79219f-0103-4bc3-a0b5-fc8f210e250d" returned: 0 in 0.331s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:21:54 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-660c699e-9837-4bca-998a-da9a02620121 tempest-VolumesGetTest-2043829097 None] Lock "cinder-quobyte-bc79219f-0103-4bc3-a0b5-fc8f210e250d" released by "delete_volume" :: held 0.822s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:21:54 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-3397caab-e6fa-4733-a5f1-4be5664f9c63 tempest-ProjectReaderTests-1308557845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2323370-1e88-41a4-a26a-646bbcaaaec7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3502ee48-0e3d-4c27-b799-a5f435997a0c', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:21:54 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-3397caab-e6fa-4733-a5f1-4be5664f9c63 tempest-ProjectReaderTests-1308557845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5997404d-002a-4d52-a842-da4ef4f609a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:21:54 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-3397caab-e6fa-4733-a5f1-4be5664f9c63 tempest-ProjectReaderTests-1308557845 None] Volume volume-3502ee48-0e3d-4c27-b799-a5f435997a0c (3502ee48-0e3d-4c27-b799-a5f435997a0c): created successfully Aug 05 06:21:54 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-3397caab-e6fa-4733-a5f1-4be5664f9c63 tempest-ProjectReaderTests-1308557845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5997404d-002a-4d52-a842-da4ef4f609a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:21:54 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-3397caab-e6fa-4733-a5f1-4be5664f9c63 tempest-ProjectReaderTests-1308557845 None] Flow 'volume_create_manager' (ca4f55b8-6dc3-4423-8a47-c698fafe4d49) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:21:54 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-3397caab-e6fa-4733-a5f1-4be5664f9c63 tempest-ProjectReaderTests-1308557845 None] Created volume successfully. Aug 05 06:21:54 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-660c699e-9837-4bca-998a-da9a02620121 tempest-VolumesGetTest-2043829097 None] Created reservations ['3531a05a-223b-4959-857b-2708756b9cea', '9e28bfd3-8ea3-4cbd-9563-aedc101fc27f', '5bbc965e-ba81-440c-866d-c4008eb67e0e', 'ae620d5e-9e6a-4b31-b445-3e6aba0f5878'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:21:54 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-660c699e-9837-4bca-998a-da9a02620121 tempest-VolumesGetTest-2043829097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:21:54 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-660c699e-9837-4bca-998a-da9a02620121 tempest-VolumesGetTest-2043829097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:21:54 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-660c699e-9837-4bca-998a-da9a02620121 tempest-VolumesGetTest-2043829097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:21:54 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-660c699e-9837-4bca-998a-da9a02620121 tempest-VolumesGetTest-2043829097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:21:54 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-660c699e-9837-4bca-998a-da9a02620121 tempest-VolumesGetTest-2043829097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:21:54 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-660c699e-9837-4bca-998a-da9a02620121 tempest-VolumesGetTest-2043829097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:21:54 devstack sudo[101263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce Aug 05 06:21:54 devstack sudo[101263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:21:55 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-1bfb9c11-6080-44ff-952a-8a58f99690b8 tempest-VolumesGetTest-2043829097 None] Acquiring lock "cinder-359f2cae-c81e-4431-ace6-43e44b118603-delete_volume" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:21:55 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-1bfb9c11-6080-44ff-952a-8a58f99690b8 tempest-VolumesGetTest-2043829097 None] Lock "cinder-359f2cae-c81e-4431-ace6-43e44b118603-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:21:55 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-1bfb9c11-6080-44ff-952a-8a58f99690b8 tempest-VolumesGetTest-2043829097 None] Acquiring lock "cinder-quobyte-359f2cae-c81e-4431-ace6-43e44b118603" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:21:55 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-1bfb9c11-6080-44ff-952a-8a58f99690b8 tempest-VolumesGetTest-2043829097 None] Lock "cinder-quobyte-359f2cae-c81e-4431-ace6-43e44b118603" acquired by "delete_volume" :: waited 0.019s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:21:55 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3ae52de-972b-4302-b631-df99859dbe1e]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:21:55 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-1bfb9c11-6080-44ff-952a-8a58f99690b8 tempest-VolumesGetTest-2043829097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-359f2cae-c81e-4431-ace6-43e44b118603 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:21:55 devstack sudo[101263]: pam_unix(sudo:session): session closed for user root Aug 05 06:21:55 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-660c699e-9837-4bca-998a-da9a02620121 tempest-VolumesGetTest-2043829097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce" returned: 0 in 0.280s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:21:55 devstack cinder-volume[88695]: DEBUG cinder.manager [None req-660c699e-9837-4bca-998a-da9a02620121 tempest-VolumesGetTest-2043829097 None] Notifying Schedulers of capabilities ... {{(pid=88695) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 06:21:55 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-660c699e-9837-4bca-998a-da9a02620121 tempest-VolumesGetTest-2043829097 None] Deleted volume successfully. Aug 05 06:21:55 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-660c699e-9837-4bca-998a-da9a02620121 tempest-VolumesGetTest-2043829097 None] Lock "cinder-bc79219f-0103-4bc3-a0b5-fc8f210e250d-delete_volume" released by "delete_volume" :: held 1.377s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:21:55 devstack sudo[101266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-359f2cae-c81e-4431-ace6-43e44b118603 Aug 05 06:21:55 devstack sudo[101266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:21:55 devstack sudo[101266]: pam_unix(sudo:session): session closed for user root Aug 05 06:21:55 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-1bfb9c11-6080-44ff-952a-8a58f99690b8 tempest-VolumesGetTest-2043829097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-359f2cae-c81e-4431-ace6-43e44b118603" returned: 0 in 0.384s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:21:55 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-1bfb9c11-6080-44ff-952a-8a58f99690b8 tempest-VolumesGetTest-2043829097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-359f2cae-c81e-4431-ace6-43e44b118603 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:21:55 devstack sudo[101271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-359f2cae-c81e-4431-ace6-43e44b118603 Aug 05 06:21:55 devstack sudo[101271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:21:55 devstack sudo[101271]: pam_unix(sudo:session): session closed for user root Aug 05 06:21:55 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-1bfb9c11-6080-44ff-952a-8a58f99690b8 tempest-VolumesGetTest-2043829097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-359f2cae-c81e-4431-ace6-43e44b118603" returned: 0 in 0.272s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:21:55 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-1bfb9c11-6080-44ff-952a-8a58f99690b8 tempest-VolumesGetTest-2043829097 None] Lock "cinder-quobyte-359f2cae-c81e-4431-ace6-43e44b118603" released by "delete_volume" :: held 0.697s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:21:55 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-add3dc04-4935-446a-9e84-2d7487431320 tempest-ProjectReaderTests-1308557845 None] Acquiring lock "cinder-3502ee48-0e3d-4c27-b799-a5f435997a0c-delete_volume" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:21:55 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-add3dc04-4935-446a-9e84-2d7487431320 tempest-ProjectReaderTests-1308557845 None] Lock "cinder-3502ee48-0e3d-4c27-b799-a5f435997a0c-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:21:55 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-add3dc04-4935-446a-9e84-2d7487431320 tempest-ProjectReaderTests-1308557845 None] Acquiring lock "cinder-quobyte-3502ee48-0e3d-4c27-b799-a5f435997a0c" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:21:56 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-1bfb9c11-6080-44ff-952a-8a58f99690b8 tempest-VolumesGetTest-2043829097 None] Created reservations ['1d494c8c-b967-485d-aaa5-14e3be7dd478', 'af64142a-afe5-45d6-ace9-afc8a30c6051', '5c18bc26-4bf8-40dc-90f7-1b90fc07eaca', 'd489fda9-0b6b-4b56-bf0d-a31100b2dc42'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:21:56 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-add3dc04-4935-446a-9e84-2d7487431320 tempest-ProjectReaderTests-1308557845 None] Lock "cinder-quobyte-3502ee48-0e3d-4c27-b799-a5f435997a0c" acquired by "delete_volume" :: waited 0.026s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:21:56 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[5638231d-696c-43a9-882e-e96db1d33143]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:21:56 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-add3dc04-4935-446a-9e84-2d7487431320 tempest-ProjectReaderTests-1308557845 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-3502ee48-0e3d-4c27-b799-a5f435997a0c {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:21:56 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-1bfb9c11-6080-44ff-952a-8a58f99690b8 tempest-VolumesGetTest-2043829097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:21:56 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-1bfb9c11-6080-44ff-952a-8a58f99690b8 tempest-VolumesGetTest-2043829097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:21:56 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-1bfb9c11-6080-44ff-952a-8a58f99690b8 tempest-VolumesGetTest-2043829097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:21:56 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-1bfb9c11-6080-44ff-952a-8a58f99690b8 tempest-VolumesGetTest-2043829097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:21:56 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-1bfb9c11-6080-44ff-952a-8a58f99690b8 tempest-VolumesGetTest-2043829097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:21:56 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-1bfb9c11-6080-44ff-952a-8a58f99690b8 tempest-VolumesGetTest-2043829097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:21:56 devstack sudo[101275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce Aug 05 06:21:56 devstack sudo[101275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:21:56 devstack sudo[101274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-3502ee48-0e3d-4c27-b799-a5f435997a0c Aug 05 06:21:56 devstack sudo[101274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:21:56 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-c96423bc-6218-4f4f-8eb1-6acebf084b1c tempest-VolumesGetTest-2043829097 None] Acquiring lock "cinder-25a22d9c-cb7f-49fc-af25-fbbbab96870b-delete_volume" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:21:56 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-c96423bc-6218-4f4f-8eb1-6acebf084b1c tempest-VolumesGetTest-2043829097 None] Lock "cinder-25a22d9c-cb7f-49fc-af25-fbbbab96870b-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:21:56 devstack sudo[101275]: pam_unix(sudo:session): session closed for user root Aug 05 06:21:56 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-1bfb9c11-6080-44ff-952a-8a58f99690b8 tempest-VolumesGetTest-2043829097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce" returned: 0 in 0.299s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:21:56 devstack cinder-volume[88695]: DEBUG cinder.manager [None req-1bfb9c11-6080-44ff-952a-8a58f99690b8 tempest-VolumesGetTest-2043829097 None] Notifying Schedulers of capabilities ... {{(pid=88695) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 06:21:56 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-1bfb9c11-6080-44ff-952a-8a58f99690b8 tempest-VolumesGetTest-2043829097 None] Deleted volume successfully. Aug 05 06:21:56 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-c96423bc-6218-4f4f-8eb1-6acebf084b1c tempest-VolumesGetTest-2043829097 None] Acquiring lock "cinder-quobyte-25a22d9c-cb7f-49fc-af25-fbbbab96870b" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:21:56 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-1bfb9c11-6080-44ff-952a-8a58f99690b8 tempest-VolumesGetTest-2043829097 None] Lock "cinder-359f2cae-c81e-4431-ace6-43e44b118603-delete_volume" released by "delete_volume" :: held 1.343s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:21:56 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-c96423bc-6218-4f4f-8eb1-6acebf084b1c tempest-VolumesGetTest-2043829097 None] Lock "cinder-quobyte-25a22d9c-cb7f-49fc-af25-fbbbab96870b" acquired by "delete_volume" :: waited 0.029s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:21:56 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b0d6887-fa4f-40bb-a2ad-c9397d82e5fc]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:21:56 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-c96423bc-6218-4f4f-8eb1-6acebf084b1c tempest-VolumesGetTest-2043829097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-25a22d9c-cb7f-49fc-af25-fbbbab96870b {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:21:56 devstack sudo[101274]: pam_unix(sudo:session): session closed for user root Aug 05 06:21:56 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-add3dc04-4935-446a-9e84-2d7487431320 tempest-ProjectReaderTests-1308557845 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-3502ee48-0e3d-4c27-b799-a5f435997a0c" returned: 0 in 0.530s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:21:56 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-add3dc04-4935-446a-9e84-2d7487431320 tempest-ProjectReaderTests-1308557845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-3502ee48-0e3d-4c27-b799-a5f435997a0c {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:21:56 devstack sudo[101284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-3502ee48-0e3d-4c27-b799-a5f435997a0c Aug 05 06:21:56 devstack sudo[101284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:21:56 devstack sudo[101281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-25a22d9c-cb7f-49fc-af25-fbbbab96870b Aug 05 06:21:56 devstack sudo[101281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:21:56 devstack sudo[101284]: pam_unix(sudo:session): session closed for user root Aug 05 06:21:56 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-add3dc04-4935-446a-9e84-2d7487431320 tempest-ProjectReaderTests-1308557845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-3502ee48-0e3d-4c27-b799-a5f435997a0c" returned: 0 in 0.284s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:21:56 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-add3dc04-4935-446a-9e84-2d7487431320 tempest-ProjectReaderTests-1308557845 None] Lock "cinder-quobyte-3502ee48-0e3d-4c27-b799-a5f435997a0c" released by "delete_volume" :: held 0.861s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:21:56 devstack sudo[101281]: pam_unix(sudo:session): session closed for user root Aug 05 06:21:56 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-c96423bc-6218-4f4f-8eb1-6acebf084b1c tempest-VolumesGetTest-2043829097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-25a22d9c-cb7f-49fc-af25-fbbbab96870b" returned: 0 in 0.420s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:21:56 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-c96423bc-6218-4f4f-8eb1-6acebf084b1c tempest-VolumesGetTest-2043829097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-25a22d9c-cb7f-49fc-af25-fbbbab96870b {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:21:56 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-add3dc04-4935-446a-9e84-2d7487431320 tempest-ProjectReaderTests-1308557845 None] Created reservations ['ab9e82a5-03bb-4d80-99e4-edabcbc53285', 'a4152128-b46a-4830-9221-0a4ed424b03c', '05af0f0f-eb87-4bc0-b62a-da71ad138391', '8b3e644c-cc48-4628-9b56-c5a6f8adb89a'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:21:56 devstack sudo[101291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-25a22d9c-cb7f-49fc-af25-fbbbab96870b Aug 05 06:21:56 devstack sudo[101291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:21:57 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-add3dc04-4935-446a-9e84-2d7487431320 tempest-ProjectReaderTests-1308557845 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:21:57 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-add3dc04-4935-446a-9e84-2d7487431320 tempest-ProjectReaderTests-1308557845 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:21:57 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-add3dc04-4935-446a-9e84-2d7487431320 tempest-ProjectReaderTests-1308557845 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:21:57 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-add3dc04-4935-446a-9e84-2d7487431320 tempest-ProjectReaderTests-1308557845 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:21:57 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-add3dc04-4935-446a-9e84-2d7487431320 tempest-ProjectReaderTests-1308557845 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:21:57 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-add3dc04-4935-446a-9e84-2d7487431320 tempest-ProjectReaderTests-1308557845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:21:57 devstack sudo[101293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce Aug 05 06:21:57 devstack sudo[101293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:21:57 devstack sudo[101291]: pam_unix(sudo:session): session closed for user root Aug 05 06:21:57 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-c96423bc-6218-4f4f-8eb1-6acebf084b1c tempest-VolumesGetTest-2043829097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-25a22d9c-cb7f-49fc-af25-fbbbab96870b" returned: 0 in 0.355s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:21:57 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-c96423bc-6218-4f4f-8eb1-6acebf084b1c tempest-VolumesGetTest-2043829097 None] Lock "cinder-quobyte-25a22d9c-cb7f-49fc-af25-fbbbab96870b" released by "delete_volume" :: held 0.849s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:21:57 devstack sudo[101293]: pam_unix(sudo:session): session closed for user root Aug 05 06:21:57 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-add3dc04-4935-446a-9e84-2d7487431320 tempest-ProjectReaderTests-1308557845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce" returned: 0 in 0.351s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:21:57 devstack cinder-volume[88695]: DEBUG cinder.manager [None req-add3dc04-4935-446a-9e84-2d7487431320 tempest-ProjectReaderTests-1308557845 None] Notifying Schedulers of capabilities ... {{(pid=88695) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 06:21:57 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-add3dc04-4935-446a-9e84-2d7487431320 tempest-ProjectReaderTests-1308557845 None] Deleted volume successfully. Aug 05 06:21:57 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-c96423bc-6218-4f4f-8eb1-6acebf084b1c tempest-VolumesGetTest-2043829097 None] Created reservations ['afc13256-3880-4ffd-af8d-f6965053d204', '73b4de38-4ec2-4fa8-b6b4-254193abe929', '3df4735b-5a98-4d77-8fce-51f6d144b05c', '06197d79-9839-4d7c-96fd-ae8470d04beb'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:21:57 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-add3dc04-4935-446a-9e84-2d7487431320 tempest-ProjectReaderTests-1308557845 None] Lock "cinder-3502ee48-0e3d-4c27-b799-a5f435997a0c-delete_volume" released by "delete_volume" :: held 1.488s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:21:57 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-c96423bc-6218-4f4f-8eb1-6acebf084b1c tempest-VolumesGetTest-2043829097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:21:57 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-c96423bc-6218-4f4f-8eb1-6acebf084b1c tempest-VolumesGetTest-2043829097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:21:57 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-c96423bc-6218-4f4f-8eb1-6acebf084b1c tempest-VolumesGetTest-2043829097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:21:57 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-c96423bc-6218-4f4f-8eb1-6acebf084b1c tempest-VolumesGetTest-2043829097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:21:57 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-c96423bc-6218-4f4f-8eb1-6acebf084b1c tempest-VolumesGetTest-2043829097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:21:57 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-c96423bc-6218-4f4f-8eb1-6acebf084b1c tempest-VolumesGetTest-2043829097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:21:57 devstack sudo[101300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce Aug 05 06:21:57 devstack sudo[101300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:21:57 devstack sudo[101300]: pam_unix(sudo:session): session closed for user root Aug 05 06:21:57 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-c96423bc-6218-4f4f-8eb1-6acebf084b1c tempest-VolumesGetTest-2043829097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce" returned: 0 in 0.344s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:21:57 devstack cinder-volume[88695]: DEBUG cinder.manager [None req-c96423bc-6218-4f4f-8eb1-6acebf084b1c tempest-VolumesGetTest-2043829097 None] Notifying Schedulers of capabilities ... {{(pid=88695) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 06:21:57 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-c96423bc-6218-4f4f-8eb1-6acebf084b1c tempest-VolumesGetTest-2043829097 None] Deleted volume successfully. Aug 05 06:21:57 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-c96423bc-6218-4f4f-8eb1-6acebf084b1c tempest-VolumesGetTest-2043829097 None] Lock "cinder-25a22d9c-cb7f-49fc-af25-fbbbab96870b-delete_volume" released by "delete_volume" :: held 1.527s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:21:59 devstack cinder-volume[88695]: DEBUG cinder.volume.flows.manager.create_volume [None req-25cde923-9ab6-4079-b400-75084de57b81 tempest-VolumesGetTest-2043829097 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88695) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 06:21:59 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-25cde923-9ab6-4079-b400-75084de57b81 tempest-VolumesGetTest-2043829097 None] Flow 'volume_create_manager' (dabae7d3-7b66-4b69-923e-7116bc24765c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:21:59 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-25cde923-9ab6-4079-b400-75084de57b81 tempest-VolumesGetTest-2043829097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0291914b-763d-430f-921a-850dcc16e721) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:21:59 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-25cde923-9ab6-4079-b400-75084de57b81 tempest-VolumesGetTest-2043829097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0291914b-763d-430f-921a-850dcc16e721) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:21:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-832169225',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a60fcc7-2903-4aa3-bd97-3249f342c196,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='b6175dd98f414599bfa5ef85ee767e37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:21:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:21:59Z,use_quota=True,user_id='193a110855b844cf84d18f71f6fe7b84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:21:59 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-25cde923-9ab6-4079-b400-75084de57b81 tempest-VolumesGetTest-2043829097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7196d6bb-0715-4efe-953b-f681a97bed2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:21:59 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-25cde923-9ab6-4079-b400-75084de57b81 tempest-VolumesGetTest-2043829097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7196d6bb-0715-4efe-953b-f681a97bed2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:21:59 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-25cde923-9ab6-4079-b400-75084de57b81 tempest-VolumesGetTest-2043829097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e87b7eb7-9335-4d41-94d6-6e55874a5cf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:21:59 devstack cinder-volume[88695]: DEBUG cinder.image.glance [None req-25cde923-9ab6-4079-b400-75084de57b81 tempest-VolumesGetTest-2043829097 None] Creating Keystone auth plugin from conf {{(pid=88695) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 05 06:21:59 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-25cde923-9ab6-4079-b400-75084de57b81 tempest-VolumesGetTest-2043829097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e87b7eb7-9335-4d41-94d6-6e55874a5cf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '1a60fcc7-2903-4aa3-bd97-3249f342c196', 'volume_name': 'volume-1a60fcc7-2903-4aa3-bd97-3249f342c196', 'volume_size': 1, 'image_id': '02d74946-ca9b-46cd-a590-fddaad1baed9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/02d74946-ca9b-46cd-a590-fddaad1baed9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '45a6d5bbcac24d598455fe1cd77a6beb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '02d74946-ca9b-46cd-a590-fddaad1baed9', 'created_at': datetime.datetime(2026, 8, 5, 4, 5, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 5, 4, 5, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/02d74946-ca9b-46cd-a590-fddaad1baed9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:21:59 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-25cde923-9ab6-4079-b400-75084de57b81 tempest-VolumesGetTest-2043829097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b296d2c-7cfb-44a8-9e63-289c433aae5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:21:59 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-25cde923-9ab6-4079-b400-75084de57b81 tempest-VolumesGetTest-2043829097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b296d2c-7cfb-44a8-9e63-289c433aae5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:21:59 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-25cde923-9ab6-4079-b400-75084de57b81 tempest-VolumesGetTest-2043829097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33b1a728-dcd7-46eb-8d91-bf1234859669) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:21:59 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-25cde923-9ab6-4079-b400-75084de57b81 tempest-VolumesGetTest-2043829097 None] Volume 1a60fcc7-2903-4aa3-bd97-3249f342c196: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-1a60fcc7-2903-4aa3-bd97-3249f342c196', 'volume_size': 1, 'image_id': '02d74946-ca9b-46cd-a590-fddaad1baed9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/02d74946-ca9b-46cd-a590-fddaad1baed9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '45a6d5bbcac24d598455fe1cd77a6beb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '02d74946-ca9b-46cd-a590-fddaad1baed9', 'created_at': datetime.datetime(2026, 8, 5, 4, 5, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 5, 4, 5, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/02d74946-ca9b-46cd-a590-fddaad1baed9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Aug 05 06:21:59 devstack cinder-volume[88695]: DEBUG cinder.volume.flows.manager.create_volume [None req-25cde923-9ab6-4079-b400-75084de57b81 tempest-VolumesGetTest-2043829097 None] Trying to clone 1a60fcc7-2903-4aa3-bd97-3249f342c196 from image 02d74946-ca9b-46cd-a590-fddaad1baed9 at location (None, [{'url': 'file:///opt/stack/data/glance/images/02d74946-ca9b-46cd-a590-fddaad1baed9', 'metadata': {}}]). {{(pid=88695) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 05 06:22:00 devstack cinder-volume[88695]: DEBUG cinder.image.image_utils [None req-25cde923-9ab6-4079-b400-75084de57b81 tempest-VolumesGetTest-2043829097 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_02d74946-ca9b-46cd-a590-fddaad1baed9__hgluibvdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=88695) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 05 06:22:00 devstack cinder-volume[88695]: INFO cinder.image.image_utils [None req-25cde923-9ab6-4079-b400-75084de57b81 tempest-VolumesGetTest-2043829097 None] Image download 20.69 MB at 20.69 MB/s Aug 05 06:22:00 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5f6acb8-ac5a-46fa-adf3-9be2b882affb]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:22:00 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-25cde923-9ab6-4079-b400-75084de57b81 tempest-VolumesGetTest-2043829097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_02d74946-ca9b-46cd-a590-fddaad1baed9__hgluibvdevstack@QuobyteHD {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:22:00 devstack cinder-volume[88695]: DEBUG oslo_service.periodic_task [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88695) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 06:22:00 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:22:00 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:22:00 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:22:00 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:22:00 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:22:00 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:22:00 devstack sudo[101326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce Aug 05 06:22:00 devstack sudo[101326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:22:00 devstack sudo[101325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_02d74946-ca9b-46cd-a590-fddaad1baed9__hgluibvdevstack@QuobyteHD Aug 05 06:22:00 devstack sudo[101325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:22:00 devstack sudo[101326]: pam_unix(sudo:session): session closed for user root Aug 05 06:22:00 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce" returned: 0 in 0.325s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:22:00 devstack cinder-volume[88695]: DEBUG cinder.manager [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] Notifying Schedulers of capabilities ... {{(pid=88695) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 06:22:00 devstack sudo[101325]: pam_unix(sudo:session): session closed for user root Aug 05 06:22:00 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-25cde923-9ab6-4079-b400-75084de57b81 tempest-VolumesGetTest-2043829097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_02d74946-ca9b-46cd-a590-fddaad1baed9__hgluibvdevstack@QuobyteHD" returned: 0 in 0.426s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:22:00 devstack cinder-volume[88695]: DEBUG cinder.image.image_utils [None req-25cde923-9ab6-4079-b400-75084de57b81 tempest-VolumesGetTest-2043829097 None] Temporary image 02d74946-ca9b-46cd-a590-fddaad1baed9 is fetched for user 193a110855b844cf84d18f71f6fe7b84. {{(pid=88695) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 05 06:22:00 devstack cinder-volume[88695]: DEBUG oslo_service.periodic_task [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] Running periodic task VolumeManager._thread_info {{(pid=88695) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 06:22:00 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] thread count: 28 {{(pid=88695) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 05 06:22:00 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] thread info: [<_MainThread(MainThread, started 134469211893888)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88695) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 05 06:22:00 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[d24bd490-929d-4c10-a8b1-32b566017b1e]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:22:00 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-25cde923-9ab6-4079-b400-75084de57b81 tempest-VolumesGetTest-2043829097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_02d74946-ca9b-46cd-a590-fddaad1baed9__hgluibvdevstack@QuobyteHD {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:22:01 devstack sudo[101336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_02d74946-ca9b-46cd-a590-fddaad1baed9__hgluibvdevstack@QuobyteHD Aug 05 06:22:01 devstack sudo[101336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:22:01 devstack sudo[101336]: pam_unix(sudo:session): session closed for user root Aug 05 06:22:01 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-25cde923-9ab6-4079-b400-75084de57b81 tempest-VolumesGetTest-2043829097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_02d74946-ca9b-46cd-a590-fddaad1baed9__hgluibvdevstack@QuobyteHD" returned: 0 in 0.458s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:22:01 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-25cde923-9ab6-4079-b400-75084de57b81 tempest-VolumesGetTest-2043829097 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:22:01 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-25cde923-9ab6-4079-b400-75084de57b81 tempest-VolumesGetTest-2043829097 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:22:01 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-25cde923-9ab6-4079-b400-75084de57b81 tempest-VolumesGetTest-2043829097 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:21:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-832169225',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a60fcc7-2903-4aa3-bd97-3249f342c196,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='b6175dd98f414599bfa5ef85ee767e37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:21:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:21:59Z,use_quota=True,user_id='193a110855b844cf84d18f71f6fe7b84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)}" {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 06:22:01 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-25cde923-9ab6-4079-b400-75084de57b81 tempest-VolumesGetTest-2043829097 None] Creating volume 1a60fcc7-2903-4aa3-bd97-3249f342c196 {{(pid=88695) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 06:22:01 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-25cde923-9ab6-4079-b400-75084de57b81 tempest-VolumesGetTest-2043829097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:22:01 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-25cde923-9ab6-4079-b400-75084de57b81 tempest-VolumesGetTest-2043829097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:22:01 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-25cde923-9ab6-4079-b400-75084de57b81 tempest-VolumesGetTest-2043829097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:22:01 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-25cde923-9ab6-4079-b400-75084de57b81 tempest-VolumesGetTest-2043829097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:22:01 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-25cde923-9ab6-4079-b400-75084de57b81 tempest-VolumesGetTest-2043829097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:22:01 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-25cde923-9ab6-4079-b400-75084de57b81 tempest-VolumesGetTest-2043829097 None] Selected osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 as target Quobyte volume. {{(pid=88695) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 06:22:01 devstack cinder-volume[88695]: INFO cinder.volume.drivers.remotefs [None req-25cde923-9ab6-4079-b400-75084de57b81 tempest-VolumesGetTest-2043829097 None] casted to osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 Aug 05 06:22:01 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-25cde923-9ab6-4079-b400-75084de57b81 tempest-VolumesGetTest-2043829097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-1a60fcc7-2903-4aa3-bd97-3249f342c196 1073741824 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:22:01 devstack sudo[101348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-1a60fcc7-2903-4aa3-bd97-3249f342c196 1073741824 Aug 05 06:22:01 devstack sudo[101348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:22:02 devstack sudo[101348]: pam_unix(sudo:session): session closed for user root Aug 05 06:22:02 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-25cde923-9ab6-4079-b400-75084de57b81 tempest-VolumesGetTest-2043829097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-1a60fcc7-2903-4aa3-bd97-3249f342c196 1073741824" returned: 0 in 0.612s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:22:02 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-25cde923-9ab6-4079-b400-75084de57b81 tempest-VolumesGetTest-2043829097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-1a60fcc7-2903-4aa3-bd97-3249f342c196 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:22:02 devstack sudo[101355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-1a60fcc7-2903-4aa3-bd97-3249f342c196 Aug 05 06:22:02 devstack sudo[101355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:22:02 devstack cinder-volume[88695]: DEBUG cinder.volume.flows.manager.create_volume [None req-280331df-a122-4cfc-944a-145dd43c85b4 tempest-ProjectReaderTests-115554455 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88695) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 06:22:02 devstack sudo[101355]: pam_unix(sudo:session): session closed for user root Aug 05 06:22:02 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-280331df-a122-4cfc-944a-145dd43c85b4 tempest-ProjectReaderTests-115554455 None] Flow 'volume_create_manager' (9f76355a-df18-4cfd-9c06-b30470cf0e81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:22:02 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-280331df-a122-4cfc-944a-145dd43c85b4 tempest-ProjectReaderTests-115554455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfb0b629-ec2e-4670-8a98-89f65340ef1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:22:02 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-25cde923-9ab6-4079-b400-75084de57b81 tempest-VolumesGetTest-2043829097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-1a60fcc7-2903-4aa3-bd97-3249f342c196" returned: 0 in 0.558s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:22:02 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-25cde923-9ab6-4079-b400-75084de57b81 tempest-VolumesGetTest-2043829097 None] <== create_volume: return (1230ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'} {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 06:22:02 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-25cde923-9ab6-4079-b400-75084de57b81 tempest-VolumesGetTest-2043829097 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.232s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:22:02 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-280331df-a122-4cfc-944a-145dd43c85b4 tempest-ProjectReaderTests-115554455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfb0b629-ec2e-4670-8a98-89f65340ef1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:22:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1560784734',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e37aa7e0-ddfd-4da2-adb4-75cefe30b8d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54e3489dc9a04f93a4b25bfef40b3ec7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:22:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:22:02Z,use_quota=True,user_id='1fcd555a450d4ef1a10d339e5d70de70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:22:02 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-280331df-a122-4cfc-944a-145dd43c85b4 tempest-ProjectReaderTests-115554455 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67be046c-a27c-4616-9223-f0e6528d4a9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:22:02 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-280331df-a122-4cfc-944a-145dd43c85b4 tempest-ProjectReaderTests-115554455 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67be046c-a27c-4616-9223-f0e6528d4a9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:22:02 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-280331df-a122-4cfc-944a-145dd43c85b4 tempest-ProjectReaderTests-115554455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (752fb414-ed39-4512-b6e7-90b3f05c3e9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:22:02 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-280331df-a122-4cfc-944a-145dd43c85b4 tempest-ProjectReaderTests-115554455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (752fb414-ed39-4512-b6e7-90b3f05c3e9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e37aa7e0-ddfd-4da2-adb4-75cefe30b8d8', 'volume_name': 'volume-e37aa7e0-ddfd-4da2-adb4-75cefe30b8d8', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:22:02 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-280331df-a122-4cfc-944a-145dd43c85b4 tempest-ProjectReaderTests-115554455 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1cc8776-7ec4-4a6f-83d1-8d0e77ccc614) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:22:02 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-280331df-a122-4cfc-944a-145dd43c85b4 tempest-ProjectReaderTests-115554455 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1cc8776-7ec4-4a6f-83d1-8d0e77ccc614) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:22:02 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-280331df-a122-4cfc-944a-145dd43c85b4 tempest-ProjectReaderTests-115554455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed42cfc9-111b-4144-8304-963a924359c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:22:02 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-280331df-a122-4cfc-944a-145dd43c85b4 tempest-ProjectReaderTests-115554455 None] Volume e37aa7e0-ddfd-4da2-adb4-75cefe30b8d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e37aa7e0-ddfd-4da2-adb4-75cefe30b8d8', 'volume_size': 1} Aug 05 06:22:02 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-280331df-a122-4cfc-944a-145dd43c85b4 tempest-ProjectReaderTests-115554455 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:22:02 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-280331df-a122-4cfc-944a-145dd43c85b4 tempest-ProjectReaderTests-115554455 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:22:02 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-280331df-a122-4cfc-944a-145dd43c85b4 tempest-ProjectReaderTests-115554455 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:22:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1560784734',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e37aa7e0-ddfd-4da2-adb4-75cefe30b8d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54e3489dc9a04f93a4b25bfef40b3ec7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:22:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:22:02Z,use_quota=True,user_id='1fcd555a450d4ef1a10d339e5d70de70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)}" {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 06:22:02 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-280331df-a122-4cfc-944a-145dd43c85b4 tempest-ProjectReaderTests-115554455 None] Creating volume e37aa7e0-ddfd-4da2-adb4-75cefe30b8d8 {{(pid=88695) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 06:22:02 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-280331df-a122-4cfc-944a-145dd43c85b4 tempest-ProjectReaderTests-115554455 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:22:02 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-280331df-a122-4cfc-944a-145dd43c85b4 tempest-ProjectReaderTests-115554455 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:22:02 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-280331df-a122-4cfc-944a-145dd43c85b4 tempest-ProjectReaderTests-115554455 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:22:02 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-280331df-a122-4cfc-944a-145dd43c85b4 tempest-ProjectReaderTests-115554455 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:22:02 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-280331df-a122-4cfc-944a-145dd43c85b4 tempest-ProjectReaderTests-115554455 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:22:02 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-280331df-a122-4cfc-944a-145dd43c85b4 tempest-ProjectReaderTests-115554455 None] Selected osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 as target Quobyte volume. {{(pid=88695) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 06:22:02 devstack cinder-volume[88695]: INFO cinder.volume.drivers.remotefs [None req-280331df-a122-4cfc-944a-145dd43c85b4 tempest-ProjectReaderTests-115554455 None] casted to osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 Aug 05 06:22:02 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-280331df-a122-4cfc-944a-145dd43c85b4 tempest-ProjectReaderTests-115554455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-e37aa7e0-ddfd-4da2-adb4-75cefe30b8d8 1073741824 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:22:02 devstack sudo[101378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-e37aa7e0-ddfd-4da2-adb4-75cefe30b8d8 1073741824 Aug 05 06:22:02 devstack sudo[101378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:22:02 devstack cinder-volume[88695]: DEBUG cinder.volume.volume_utils [None req-25cde923-9ab6-4079-b400-75084de57b81 tempest-VolumesGetTest-2043829097 None] Attempting download of 02d74946-ca9b-46cd-a590-fddaad1baed9 ((None, [{'url': 'file:///opt/stack/data/glance/images/02d74946-ca9b-46cd-a590-fddaad1baed9', 'metadata': {}}])) to volume 1a60fcc7-2903-4aa3-bd97-3249f342c196. {{(pid=88695) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 05 06:22:02 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[766da011-431b-46a4-82ae-932e8653aa7c]: (4, 'raw') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:22:02 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-25cde923-9ab6-4079-b400-75084de57b81 tempest-VolumesGetTest-2043829097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_02d74946-ca9b-46cd-a590-fddaad1baed9_05rxg_1h {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:22:03 devstack sudo[101384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_02d74946-ca9b-46cd-a590-fddaad1baed9_05rxg_1h Aug 05 06:22:03 devstack sudo[101384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:22:03 devstack sudo[101384]: pam_unix(sudo:session): session closed for user root Aug 05 06:22:03 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-25cde923-9ab6-4079-b400-75084de57b81 tempest-VolumesGetTest-2043829097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_02d74946-ca9b-46cd-a590-fddaad1baed9_05rxg_1h" returned: 0 in 0.489s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:22:03 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-25cde923-9ab6-4079-b400-75084de57b81 tempest-VolumesGetTest-2043829097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_02d74946-ca9b-46cd-a590-fddaad1baed9_05rxg_1h {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:22:03 devstack sudo[101378]: pam_unix(sudo:session): session closed for user root Aug 05 06:22:03 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-280331df-a122-4cfc-944a-145dd43c85b4 tempest-ProjectReaderTests-115554455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-e37aa7e0-ddfd-4da2-adb4-75cefe30b8d8 1073741824" returned: 0 in 0.657s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:22:03 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-280331df-a122-4cfc-944a-145dd43c85b4 tempest-ProjectReaderTests-115554455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-e37aa7e0-ddfd-4da2-adb4-75cefe30b8d8 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:22:03 devstack sudo[101405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-e37aa7e0-ddfd-4da2-adb4-75cefe30b8d8 Aug 05 06:22:03 devstack sudo[101405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:22:03 devstack sudo[101402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_02d74946-ca9b-46cd-a590-fddaad1baed9_05rxg_1h Aug 05 06:22:03 devstack sudo[101402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:22:03 devstack sudo[101405]: pam_unix(sudo:session): session closed for user root Aug 05 06:22:03 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-280331df-a122-4cfc-944a-145dd43c85b4 tempest-ProjectReaderTests-115554455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-e37aa7e0-ddfd-4da2-adb4-75cefe30b8d8" returned: 0 in 0.318s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:22:03 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-280331df-a122-4cfc-944a-145dd43c85b4 tempest-ProjectReaderTests-115554455 None] <== create_volume: return (1042ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'} {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 06:22:03 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-280331df-a122-4cfc-944a-145dd43c85b4 tempest-ProjectReaderTests-115554455 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.049s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:22:03 devstack sudo[101402]: pam_unix(sudo:session): session closed for user root Aug 05 06:22:03 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-25cde923-9ab6-4079-b400-75084de57b81 tempest-VolumesGetTest-2043829097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_02d74946-ca9b-46cd-a590-fddaad1baed9_05rxg_1h" returned: 1 in 0.402s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:22:03 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-25cde923-9ab6-4079-b400-75084de57b81 tempest-VolumesGetTest-2043829097 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_02d74946-ca9b-46cd-a590-fddaad1baed9_05rxg_1h' failed. Not Retrying. {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 05 06:22:03 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[09946ab9-eb0c-4a7e-928d-e7577865e55d]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:22:03 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-25cde923-9ab6-4079-b400-75084de57b81 tempest-VolumesGetTest-2043829097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_02d74946-ca9b-46cd-a590-fddaad1baed9__hgluibvdevstack@QuobyteHD {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:22:03 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-280331df-a122-4cfc-944a-145dd43c85b4 tempest-ProjectReaderTests-115554455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed42cfc9-111b-4144-8304-963a924359c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e37aa7e0-ddfd-4da2-adb4-75cefe30b8d8', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:22:03 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-280331df-a122-4cfc-944a-145dd43c85b4 tempest-ProjectReaderTests-115554455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e72fcab6-67d0-4063-8d76-418dfb236592) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:22:03 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-280331df-a122-4cfc-944a-145dd43c85b4 tempest-ProjectReaderTests-115554455 None] Volume volume-e37aa7e0-ddfd-4da2-adb4-75cefe30b8d8 (e37aa7e0-ddfd-4da2-adb4-75cefe30b8d8): created successfully Aug 05 06:22:03 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-280331df-a122-4cfc-944a-145dd43c85b4 tempest-ProjectReaderTests-115554455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e72fcab6-67d0-4063-8d76-418dfb236592) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:22:03 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-280331df-a122-4cfc-944a-145dd43c85b4 tempest-ProjectReaderTests-115554455 None] Flow 'volume_create_manager' (9f76355a-df18-4cfd-9c06-b30470cf0e81) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:22:03 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-280331df-a122-4cfc-944a-145dd43c85b4 tempest-ProjectReaderTests-115554455 None] Created volume successfully. Aug 05 06:22:03 devstack sudo[101428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_02d74946-ca9b-46cd-a590-fddaad1baed9__hgluibvdevstack@QuobyteHD Aug 05 06:22:03 devstack sudo[101428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:22:04 devstack sudo[101428]: pam_unix(sudo:session): session closed for user root Aug 05 06:22:04 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-25cde923-9ab6-4079-b400-75084de57b81 tempest-VolumesGetTest-2043829097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_02d74946-ca9b-46cd-a590-fddaad1baed9__hgluibvdevstack@QuobyteHD" returned: 0 in 0.344s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:22:04 devstack cinder-volume[88695]: DEBUG cinder.image.image_utils [None req-25cde923-9ab6-4079-b400-75084de57b81 tempest-VolumesGetTest-2043829097 None] 02d74946-ca9b-46cd-a590-fddaad1baed9 was qcow2, converting to qcow2 {{(pid=88695) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 05 06:22:04 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-25cde923-9ab6-4079-b400-75084de57b81 tempest-VolumesGetTest-2043829097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_02d74946-ca9b-46cd-a590-fddaad1baed9__hgluibvdevstack@QuobyteHD /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-1a60fcc7-2903-4aa3-bd97-3249f342c196 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:22:04 devstack sudo[101436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_02d74946-ca9b-46cd-a590-fddaad1baed9__hgluibvdevstack@QuobyteHD /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-1a60fcc7-2903-4aa3-bd97-3249f342c196 Aug 05 06:22:04 devstack sudo[101436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:22:04 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-652507b3-386f-452b-8b59-77927dd52281 tempest-ProjectReaderTests-115554455 None] Acquiring lock "cinder-e37aa7e0-ddfd-4da2-adb4-75cefe30b8d8-delete_volume" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:22:04 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-652507b3-386f-452b-8b59-77927dd52281 tempest-ProjectReaderTests-115554455 None] Lock "cinder-e37aa7e0-ddfd-4da2-adb4-75cefe30b8d8-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:22:04 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-652507b3-386f-452b-8b59-77927dd52281 tempest-ProjectReaderTests-115554455 None] Acquiring lock "cinder-quobyte-e37aa7e0-ddfd-4da2-adb4-75cefe30b8d8" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:22:04 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-652507b3-386f-452b-8b59-77927dd52281 tempest-ProjectReaderTests-115554455 None] Lock "cinder-quobyte-e37aa7e0-ddfd-4da2-adb4-75cefe30b8d8" acquired by "delete_volume" :: waited 0.026s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:22:04 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[60ee62ea-4044-458a-8b9e-3955568cf48b]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:22:04 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-652507b3-386f-452b-8b59-77927dd52281 tempest-ProjectReaderTests-115554455 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-e37aa7e0-ddfd-4da2-adb4-75cefe30b8d8 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:22:05 devstack sudo[101446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-e37aa7e0-ddfd-4da2-adb4-75cefe30b8d8 Aug 05 06:22:05 devstack sudo[101446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:22:05 devstack sudo[101446]: pam_unix(sudo:session): session closed for user root Aug 05 06:22:05 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-652507b3-386f-452b-8b59-77927dd52281 tempest-ProjectReaderTests-115554455 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-e37aa7e0-ddfd-4da2-adb4-75cefe30b8d8" returned: 0 in 0.540s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:22:05 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-652507b3-386f-452b-8b59-77927dd52281 tempest-ProjectReaderTests-115554455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-e37aa7e0-ddfd-4da2-adb4-75cefe30b8d8 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:22:05 devstack sudo[101451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-e37aa7e0-ddfd-4da2-adb4-75cefe30b8d8 Aug 05 06:22:05 devstack sudo[101451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:22:05 devstack sudo[101451]: pam_unix(sudo:session): session closed for user root Aug 05 06:22:05 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-652507b3-386f-452b-8b59-77927dd52281 tempest-ProjectReaderTests-115554455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-e37aa7e0-ddfd-4da2-adb4-75cefe30b8d8" returned: 0 in 0.293s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:22:05 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-652507b3-386f-452b-8b59-77927dd52281 tempest-ProjectReaderTests-115554455 None] Lock "cinder-quobyte-e37aa7e0-ddfd-4da2-adb4-75cefe30b8d8" released by "delete_volume" :: held 0.893s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:22:05 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-652507b3-386f-452b-8b59-77927dd52281 tempest-ProjectReaderTests-115554455 None] Created reservations ['8f56e301-7baa-4a8a-b894-aa953ae3d231', '5356f7b7-8eb9-49e9-9e74-25b515806dff', '221a9463-6b8f-4798-85aa-532b7f1eee29', '52f84274-1ac6-4132-abe3-bbde5474ce51'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:22:05 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-652507b3-386f-452b-8b59-77927dd52281 tempest-ProjectReaderTests-115554455 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:22:05 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-652507b3-386f-452b-8b59-77927dd52281 tempest-ProjectReaderTests-115554455 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:22:05 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-652507b3-386f-452b-8b59-77927dd52281 tempest-ProjectReaderTests-115554455 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:22:05 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-652507b3-386f-452b-8b59-77927dd52281 tempest-ProjectReaderTests-115554455 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:22:05 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-652507b3-386f-452b-8b59-77927dd52281 tempest-ProjectReaderTests-115554455 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:22:05 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-652507b3-386f-452b-8b59-77927dd52281 tempest-ProjectReaderTests-115554455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:22:06 devstack sudo[101454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce Aug 05 06:22:06 devstack sudo[101454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:22:06 devstack sudo[101454]: pam_unix(sudo:session): session closed for user root Aug 05 06:22:06 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-652507b3-386f-452b-8b59-77927dd52281 tempest-ProjectReaderTests-115554455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce" returned: 0 in 0.334s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:22:06 devstack cinder-volume[88695]: DEBUG cinder.manager [None req-652507b3-386f-452b-8b59-77927dd52281 tempest-ProjectReaderTests-115554455 None] Notifying Schedulers of capabilities ... {{(pid=88695) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 06:22:06 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-652507b3-386f-452b-8b59-77927dd52281 tempest-ProjectReaderTests-115554455 None] Deleted volume successfully. Aug 05 06:22:06 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-652507b3-386f-452b-8b59-77927dd52281 tempest-ProjectReaderTests-115554455 None] Lock "cinder-e37aa7e0-ddfd-4da2-adb4-75cefe30b8d8-delete_volume" released by "delete_volume" :: held 1.579s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:22:06 devstack sudo[101436]: pam_unix(sudo:session): session closed for user root Aug 05 06:22:06 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-25cde923-9ab6-4079-b400-75084de57b81 tempest-VolumesGetTest-2043829097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_02d74946-ca9b-46cd-a590-fddaad1baed9__hgluibvdevstack@QuobyteHD /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-1a60fcc7-2903-4aa3-bd97-3249f342c196" returned: 0 in 2.203s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:22:06 devstack cinder-volume[88695]: DEBUG cinder.image.image_utils [None req-25cde923-9ab6-4079-b400-75084de57b81 tempest-VolumesGetTest-2043829097 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_02d74946-ca9b-46cd-a590-fddaad1baed9__hgluibvdevstack@QuobyteHD, size 112.00 MB, duration 2.20 sec, destination /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-1a60fcc7-2903-4aa3-bd97-3249f342c196 {{(pid=88695) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 05 06:22:06 devstack cinder-volume[88695]: INFO cinder.image.image_utils [None req-25cde923-9ab6-4079-b400-75084de57b81 tempest-VolumesGetTest-2043829097 None] Converted 112.00 MB image at 50.83 MB/s Aug 05 06:22:06 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-25cde923-9ab6-4079-b400-75084de57b81 tempest-VolumesGetTest-2043829097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-1a60fcc7-2903-4aa3-bd97-3249f342c196 1G {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:22:06 devstack sudo[101457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-1a60fcc7-2903-4aa3-bd97-3249f342c196 1G Aug 05 06:22:06 devstack sudo[101457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:22:06 devstack cinder-volume[88695]: DEBUG cinder.volume.flows.manager.create_volume [None req-58e6c46b-1ba6-42e6-a35b-143b25fabdb6 tempest-ProjectReaderTests-115554455 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88695) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 06:22:06 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-58e6c46b-1ba6-42e6-a35b-143b25fabdb6 tempest-ProjectReaderTests-115554455 None] Flow 'volume_create_manager' (a47edfc1-3d07-47eb-980a-ac17bd7ee3b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:22:06 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-58e6c46b-1ba6-42e6-a35b-143b25fabdb6 tempest-ProjectReaderTests-115554455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e240eaa7-6013-46b6-90fd-6b5ce6cf6004) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:22:06 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-58e6c46b-1ba6-42e6-a35b-143b25fabdb6 tempest-ProjectReaderTests-115554455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e240eaa7-6013-46b6-90fd-6b5ce6cf6004) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:22:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-345699016',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1012963b-1652-4752-a9a8-50db2b02a00e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54e3489dc9a04f93a4b25bfef40b3ec7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:22:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:22:07Z,use_quota=True,user_id='1fcd555a450d4ef1a10d339e5d70de70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:22:06 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-58e6c46b-1ba6-42e6-a35b-143b25fabdb6 tempest-ProjectReaderTests-115554455 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10eb0fa7-6511-42cb-ae3b-2812701e72e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:22:06 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-58e6c46b-1ba6-42e6-a35b-143b25fabdb6 tempest-ProjectReaderTests-115554455 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10eb0fa7-6511-42cb-ae3b-2812701e72e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:22:06 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-58e6c46b-1ba6-42e6-a35b-143b25fabdb6 tempest-ProjectReaderTests-115554455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ba7ab8a-39d7-4808-abbe-2b0e0d5a00ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:22:06 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-58e6c46b-1ba6-42e6-a35b-143b25fabdb6 tempest-ProjectReaderTests-115554455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ba7ab8a-39d7-4808-abbe-2b0e0d5a00ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1012963b-1652-4752-a9a8-50db2b02a00e', 'volume_name': 'volume-1012963b-1652-4752-a9a8-50db2b02a00e', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:22:06 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-58e6c46b-1ba6-42e6-a35b-143b25fabdb6 tempest-ProjectReaderTests-115554455 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (167853ff-da03-4ac3-90f8-30feab124c22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:22:06 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-58e6c46b-1ba6-42e6-a35b-143b25fabdb6 tempest-ProjectReaderTests-115554455 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (167853ff-da03-4ac3-90f8-30feab124c22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:22:06 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-58e6c46b-1ba6-42e6-a35b-143b25fabdb6 tempest-ProjectReaderTests-115554455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07aaa95d-a759-4cf8-b0d9-7467e6130645) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:22:06 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-58e6c46b-1ba6-42e6-a35b-143b25fabdb6 tempest-ProjectReaderTests-115554455 None] Volume 1012963b-1652-4752-a9a8-50db2b02a00e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1012963b-1652-4752-a9a8-50db2b02a00e', 'volume_size': 1} Aug 05 06:22:06 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-58e6c46b-1ba6-42e6-a35b-143b25fabdb6 tempest-ProjectReaderTests-115554455 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:22:06 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-58e6c46b-1ba6-42e6-a35b-143b25fabdb6 tempest-ProjectReaderTests-115554455 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:22:06 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-58e6c46b-1ba6-42e6-a35b-143b25fabdb6 tempest-ProjectReaderTests-115554455 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:22:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-345699016',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1012963b-1652-4752-a9a8-50db2b02a00e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54e3489dc9a04f93a4b25bfef40b3ec7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:22:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:22:07Z,use_quota=True,user_id='1fcd555a450d4ef1a10d339e5d70de70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)}" {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 06:22:06 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-58e6c46b-1ba6-42e6-a35b-143b25fabdb6 tempest-ProjectReaderTests-115554455 None] Creating volume 1012963b-1652-4752-a9a8-50db2b02a00e {{(pid=88695) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 06:22:06 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-58e6c46b-1ba6-42e6-a35b-143b25fabdb6 tempest-ProjectReaderTests-115554455 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:22:06 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-58e6c46b-1ba6-42e6-a35b-143b25fabdb6 tempest-ProjectReaderTests-115554455 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:22:06 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-58e6c46b-1ba6-42e6-a35b-143b25fabdb6 tempest-ProjectReaderTests-115554455 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:22:06 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-58e6c46b-1ba6-42e6-a35b-143b25fabdb6 tempest-ProjectReaderTests-115554455 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:22:06 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-58e6c46b-1ba6-42e6-a35b-143b25fabdb6 tempest-ProjectReaderTests-115554455 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:22:06 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-58e6c46b-1ba6-42e6-a35b-143b25fabdb6 tempest-ProjectReaderTests-115554455 None] Selected osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 as target Quobyte volume. {{(pid=88695) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 06:22:06 devstack cinder-volume[88695]: INFO cinder.volume.drivers.remotefs [None req-58e6c46b-1ba6-42e6-a35b-143b25fabdb6 tempest-ProjectReaderTests-115554455 None] casted to osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 Aug 05 06:22:06 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-58e6c46b-1ba6-42e6-a35b-143b25fabdb6 tempest-ProjectReaderTests-115554455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-1012963b-1652-4752-a9a8-50db2b02a00e 1073741824 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:22:06 devstack sudo[101463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-1012963b-1652-4752-a9a8-50db2b02a00e 1073741824 Aug 05 06:22:06 devstack sudo[101463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:22:06 devstack sudo[101457]: pam_unix(sudo:session): session closed for user root Aug 05 06:22:06 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-25cde923-9ab6-4079-b400-75084de57b81 tempest-VolumesGetTest-2043829097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-1a60fcc7-2903-4aa3-bd97-3249f342c196 1G" returned: 0 in 0.451s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:22:06 devstack cinder-volume[88695]: DEBUG cinder.volume.volume_utils [None req-25cde923-9ab6-4079-b400-75084de57b81 tempest-VolumesGetTest-2043829097 None] Downloaded image 02d74946-ca9b-46cd-a590-fddaad1baed9 ((None, [{'url': 'file:///opt/stack/data/glance/images/02d74946-ca9b-46cd-a590-fddaad1baed9', 'metadata': {}}])) to volume 1a60fcc7-2903-4aa3-bd97-3249f342c196 successfully. {{(pid=88695) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 05 06:22:06 devstack cinder-volume[88695]: DEBUG cinder.image.image_utils [None req-25cde923-9ab6-4079-b400-75084de57b81 tempest-VolumesGetTest-2043829097 None] Temporary image 02d74946-ca9b-46cd-a590-fddaad1baed9 for user 193a110855b844cf84d18f71f6fe7b84 is deleted. {{(pid=88695) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 05 06:22:06 devstack cinder-volume[88695]: DEBUG cinder.volume.volume_utils [None req-25cde923-9ab6-4079-b400-75084de57b81 tempest-VolumesGetTest-2043829097 None] Marking volume 1a60fcc7-2903-4aa3-bd97-3249f342c196 as bootable. {{(pid=88695) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 05 06:22:06 devstack cinder-volume[88695]: DEBUG cinder.volume.flows.manager.create_volume [None req-25cde923-9ab6-4079-b400-75084de57b81 tempest-VolumesGetTest-2043829097 None] Copying metadata from image 02d74946-ca9b-46cd-a590-fddaad1baed9 to 1a60fcc7-2903-4aa3-bd97-3249f342c196. {{(pid=88695) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 05 06:22:06 devstack cinder-volume[88695]: DEBUG cinder.volume.flows.manager.create_volume [None req-25cde923-9ab6-4079-b400-75084de57b81 tempest-VolumesGetTest-2043829097 None] Creating volume glance metadata for volume 1a60fcc7-2903-4aa3-bd97-3249f342c196 backed by image 02d74946-ca9b-46cd-a590-fddaad1baed9 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '02d74946-ca9b-46cd-a590-fddaad1baed9', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88695) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 05 06:22:06 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-25cde923-9ab6-4079-b400-75084de57b81 tempest-VolumesGetTest-2043829097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33b1a728-dcd7-46eb-8d91-bf1234859669) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a60fcc7-2903-4aa3-bd97-3249f342c196', 'volume_size': 1, 'image_id': '02d74946-ca9b-46cd-a590-fddaad1baed9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/02d74946-ca9b-46cd-a590-fddaad1baed9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '45a6d5bbcac24d598455fe1cd77a6beb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '02d74946-ca9b-46cd-a590-fddaad1baed9', 'created_at': datetime.datetime(2026, 8, 5, 4, 5, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 5, 4, 5, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/02d74946-ca9b-46cd-a590-fddaad1baed9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:22:06 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-25cde923-9ab6-4079-b400-75084de57b81 tempest-VolumesGetTest-2043829097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a77738c-36c5-42e8-915f-6d026d8ef28c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:22:07 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-25cde923-9ab6-4079-b400-75084de57b81 tempest-VolumesGetTest-2043829097 None] Volume volume-1a60fcc7-2903-4aa3-bd97-3249f342c196 (1a60fcc7-2903-4aa3-bd97-3249f342c196): created successfully Aug 05 06:22:07 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-25cde923-9ab6-4079-b400-75084de57b81 tempest-VolumesGetTest-2043829097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a77738c-36c5-42e8-915f-6d026d8ef28c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:22:07 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-25cde923-9ab6-4079-b400-75084de57b81 tempest-VolumesGetTest-2043829097 None] Flow 'volume_create_manager' (dabae7d3-7b66-4b69-923e-7116bc24765c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:22:07 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-25cde923-9ab6-4079-b400-75084de57b81 tempest-VolumesGetTest-2043829097 None] Created volume successfully. Aug 05 06:22:07 devstack sudo[101463]: pam_unix(sudo:session): session closed for user root Aug 05 06:22:07 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-58e6c46b-1ba6-42e6-a35b-143b25fabdb6 tempest-ProjectReaderTests-115554455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-1012963b-1652-4752-a9a8-50db2b02a00e 1073741824" returned: 0 in 0.530s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:22:07 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-58e6c46b-1ba6-42e6-a35b-143b25fabdb6 tempest-ProjectReaderTests-115554455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-1012963b-1652-4752-a9a8-50db2b02a00e {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:22:07 devstack sudo[101469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-1012963b-1652-4752-a9a8-50db2b02a00e Aug 05 06:22:07 devstack sudo[101469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:22:07 devstack sudo[101469]: pam_unix(sudo:session): session closed for user root Aug 05 06:22:07 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-58e6c46b-1ba6-42e6-a35b-143b25fabdb6 tempest-ProjectReaderTests-115554455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-1012963b-1652-4752-a9a8-50db2b02a00e" returned: 0 in 0.342s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:22:07 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-58e6c46b-1ba6-42e6-a35b-143b25fabdb6 tempest-ProjectReaderTests-115554455 None] <== create_volume: return (918ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'} {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 06:22:07 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-58e6c46b-1ba6-42e6-a35b-143b25fabdb6 tempest-ProjectReaderTests-115554455 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.921s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:22:07 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-58e6c46b-1ba6-42e6-a35b-143b25fabdb6 tempest-ProjectReaderTests-115554455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07aaa95d-a759-4cf8-b0d9-7467e6130645) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1012963b-1652-4752-a9a8-50db2b02a00e', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:22:07 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-58e6c46b-1ba6-42e6-a35b-143b25fabdb6 tempest-ProjectReaderTests-115554455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0eb9643-caf4-4811-be7b-9b1f590ad3d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:22:07 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-58e6c46b-1ba6-42e6-a35b-143b25fabdb6 tempest-ProjectReaderTests-115554455 None] Volume volume-1012963b-1652-4752-a9a8-50db2b02a00e (1012963b-1652-4752-a9a8-50db2b02a00e): created successfully Aug 05 06:22:07 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-58e6c46b-1ba6-42e6-a35b-143b25fabdb6 tempest-ProjectReaderTests-115554455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0eb9643-caf4-4811-be7b-9b1f590ad3d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:22:07 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-58e6c46b-1ba6-42e6-a35b-143b25fabdb6 tempest-ProjectReaderTests-115554455 None] Flow 'volume_create_manager' (a47edfc1-3d07-47eb-980a-ac17bd7ee3b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:22:07 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-58e6c46b-1ba6-42e6-a35b-143b25fabdb6 tempest-ProjectReaderTests-115554455 None] Created volume successfully. Aug 05 06:22:08 devstack cinder-volume[88695]: DEBUG cinder.volume.flows.manager.create_volume [None req-45ce880b-c407-49a2-ac3c-3c5d6f4de592 tempest-VolumesGetTest-2043829097 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88695) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 06:22:08 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-45ce880b-c407-49a2-ac3c-3c5d6f4de592 tempest-VolumesGetTest-2043829097 None] Flow 'volume_create_manager' (02b91834-3c20-4d47-a51e-1f9c105862e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:22:08 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-45ce880b-c407-49a2-ac3c-3c5d6f4de592 tempest-VolumesGetTest-2043829097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2c9e6bf-27fa-4c3f-97b9-aaf8bc2a1184) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:22:08 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-45ce880b-c407-49a2-ac3c-3c5d6f4de592 tempest-VolumesGetTest-2043829097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2c9e6bf-27fa-4c3f-97b9-aaf8bc2a1184) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:22:08Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1874907965',display_name='tempest-VolumesGetTest-Volume-539802872',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e232379e-af36-476a-b306-0fff102c7ee4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6175dd98f414599bfa5ef85ee767e37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:22:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:22:08Z,use_quota=True,user_id='193a110855b844cf84d18f71f6fe7b84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:22:08 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-45ce880b-c407-49a2-ac3c-3c5d6f4de592 tempest-VolumesGetTest-2043829097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2495dc6-548f-4dc0-b3e1-2b51304f9c11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:22:08 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-45ce880b-c407-49a2-ac3c-3c5d6f4de592 tempest-VolumesGetTest-2043829097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2495dc6-548f-4dc0-b3e1-2b51304f9c11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:22:08 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-45ce880b-c407-49a2-ac3c-3c5d6f4de592 tempest-VolumesGetTest-2043829097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73da0813-b942-4718-86bd-f420eb32313b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:22:08 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-45ce880b-c407-49a2-ac3c-3c5d6f4de592 tempest-VolumesGetTest-2043829097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73da0813-b942-4718-86bd-f420eb32313b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e232379e-af36-476a-b306-0fff102c7ee4', 'volume_name': 'volume-e232379e-af36-476a-b306-0fff102c7ee4', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:22:08 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-45ce880b-c407-49a2-ac3c-3c5d6f4de592 tempest-VolumesGetTest-2043829097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b91d995-8970-4fcd-b7e1-d4e12aab6398) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:22:08 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-45ce880b-c407-49a2-ac3c-3c5d6f4de592 tempest-VolumesGetTest-2043829097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b91d995-8970-4fcd-b7e1-d4e12aab6398) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:22:08 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-45ce880b-c407-49a2-ac3c-3c5d6f4de592 tempest-VolumesGetTest-2043829097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8deb22ef-942d-4747-9713-3a4f740d3837) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:22:08 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-45ce880b-c407-49a2-ac3c-3c5d6f4de592 tempest-VolumesGetTest-2043829097 None] Volume e232379e-af36-476a-b306-0fff102c7ee4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e232379e-af36-476a-b306-0fff102c7ee4', 'volume_size': 1} Aug 05 06:22:08 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-45ce880b-c407-49a2-ac3c-3c5d6f4de592 tempest-VolumesGetTest-2043829097 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:22:08 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-45ce880b-c407-49a2-ac3c-3c5d6f4de592 tempest-VolumesGetTest-2043829097 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:22:08 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-45ce880b-c407-49a2-ac3c-3c5d6f4de592 tempest-VolumesGetTest-2043829097 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:22:08Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1874907965',display_name='tempest-VolumesGetTest-Volume-539802872',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e232379e-af36-476a-b306-0fff102c7ee4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6175dd98f414599bfa5ef85ee767e37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:22:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:22:08Z,use_quota=True,user_id='193a110855b844cf84d18f71f6fe7b84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)}" {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 06:22:08 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-45ce880b-c407-49a2-ac3c-3c5d6f4de592 tempest-VolumesGetTest-2043829097 None] Creating volume e232379e-af36-476a-b306-0fff102c7ee4 {{(pid=88695) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 06:22:08 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-45ce880b-c407-49a2-ac3c-3c5d6f4de592 tempest-VolumesGetTest-2043829097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:22:08 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-45ce880b-c407-49a2-ac3c-3c5d6f4de592 tempest-VolumesGetTest-2043829097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:22:08 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-45ce880b-c407-49a2-ac3c-3c5d6f4de592 tempest-VolumesGetTest-2043829097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:22:08 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-45ce880b-c407-49a2-ac3c-3c5d6f4de592 tempest-VolumesGetTest-2043829097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:22:08 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-45ce880b-c407-49a2-ac3c-3c5d6f4de592 tempest-VolumesGetTest-2043829097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:22:08 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-45ce880b-c407-49a2-ac3c-3c5d6f4de592 tempest-VolumesGetTest-2043829097 None] Selected osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 as target Quobyte volume. {{(pid=88695) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 06:22:08 devstack cinder-volume[88695]: INFO cinder.volume.drivers.remotefs [None req-45ce880b-c407-49a2-ac3c-3c5d6f4de592 tempest-VolumesGetTest-2043829097 None] casted to osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 Aug 05 06:22:08 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-45ce880b-c407-49a2-ac3c-3c5d6f4de592 tempest-VolumesGetTest-2043829097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-e232379e-af36-476a-b306-0fff102c7ee4 1073741824 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:22:08 devstack sudo[101475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-e232379e-af36-476a-b306-0fff102c7ee4 1073741824 Aug 05 06:22:08 devstack sudo[101475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:22:08 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-8cbe5942-c9e3-4062-a1ba-8ec6e8206479 tempest-ProjectReaderTests-115554455 None] Acquiring lock "cinder-1012963b-1652-4752-a9a8-50db2b02a00e-delete_volume" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:22:08 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-8cbe5942-c9e3-4062-a1ba-8ec6e8206479 tempest-ProjectReaderTests-115554455 None] Lock "cinder-1012963b-1652-4752-a9a8-50db2b02a00e-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:22:08 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-8cbe5942-c9e3-4062-a1ba-8ec6e8206479 tempest-ProjectReaderTests-115554455 None] Acquiring lock "cinder-quobyte-1012963b-1652-4752-a9a8-50db2b02a00e" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:22:08 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-8cbe5942-c9e3-4062-a1ba-8ec6e8206479 tempest-ProjectReaderTests-115554455 None] Lock "cinder-quobyte-1012963b-1652-4752-a9a8-50db2b02a00e" acquired by "delete_volume" :: waited 0.026s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:22:08 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8d7be11-ffcc-4e18-b346-99e7e8deaaaf]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:22:08 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-8cbe5942-c9e3-4062-a1ba-8ec6e8206479 tempest-ProjectReaderTests-115554455 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-1012963b-1652-4752-a9a8-50db2b02a00e {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:22:09 devstack sudo[101479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-1012963b-1652-4752-a9a8-50db2b02a00e Aug 05 06:22:09 devstack sudo[101479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:22:09 devstack sudo[101475]: pam_unix(sudo:session): session closed for user root Aug 05 06:22:09 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-45ce880b-c407-49a2-ac3c-3c5d6f4de592 tempest-VolumesGetTest-2043829097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-e232379e-af36-476a-b306-0fff102c7ee4 1073741824" returned: 0 in 0.546s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:22:09 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-45ce880b-c407-49a2-ac3c-3c5d6f4de592 tempest-VolumesGetTest-2043829097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-e232379e-af36-476a-b306-0fff102c7ee4 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:22:09 devstack sudo[101483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-e232379e-af36-476a-b306-0fff102c7ee4 Aug 05 06:22:09 devstack sudo[101483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:22:09 devstack sudo[101479]: pam_unix(sudo:session): session closed for user root Aug 05 06:22:09 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-8cbe5942-c9e3-4062-a1ba-8ec6e8206479 tempest-ProjectReaderTests-115554455 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-1012963b-1652-4752-a9a8-50db2b02a00e" returned: 0 in 0.419s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:22:09 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-8cbe5942-c9e3-4062-a1ba-8ec6e8206479 tempest-ProjectReaderTests-115554455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-1012963b-1652-4752-a9a8-50db2b02a00e {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:22:09 devstack sudo[101488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-1012963b-1652-4752-a9a8-50db2b02a00e Aug 05 06:22:09 devstack sudo[101488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:22:09 devstack sudo[101483]: pam_unix(sudo:session): session closed for user root Aug 05 06:22:09 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-45ce880b-c407-49a2-ac3c-3c5d6f4de592 tempest-VolumesGetTest-2043829097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-e232379e-af36-476a-b306-0fff102c7ee4" returned: 0 in 0.266s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:22:09 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-45ce880b-c407-49a2-ac3c-3c5d6f4de592 tempest-VolumesGetTest-2043829097 None] <== create_volume: return (875ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'} {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 06:22:09 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-45ce880b-c407-49a2-ac3c-3c5d6f4de592 tempest-VolumesGetTest-2043829097 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.878s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:22:09 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-45ce880b-c407-49a2-ac3c-3c5d6f4de592 tempest-VolumesGetTest-2043829097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8deb22ef-942d-4747-9713-3a4f740d3837) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e232379e-af36-476a-b306-0fff102c7ee4', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:22:09 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-45ce880b-c407-49a2-ac3c-3c5d6f4de592 tempest-VolumesGetTest-2043829097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08b7f7a0-afc4-4b0f-80c3-dce35858495d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:22:09 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-45ce880b-c407-49a2-ac3c-3c5d6f4de592 tempest-VolumesGetTest-2043829097 None] Volume volume-e232379e-af36-476a-b306-0fff102c7ee4 (e232379e-af36-476a-b306-0fff102c7ee4): created successfully Aug 05 06:22:09 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-45ce880b-c407-49a2-ac3c-3c5d6f4de592 tempest-VolumesGetTest-2043829097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08b7f7a0-afc4-4b0f-80c3-dce35858495d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:22:09 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-45ce880b-c407-49a2-ac3c-3c5d6f4de592 tempest-VolumesGetTest-2043829097 None] Flow 'volume_create_manager' (02b91834-3c20-4d47-a51e-1f9c105862e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:22:09 devstack cinder-volume[88695]: DEBUG dbcounter [-] [88695] Writing DB stats cinder:UPDATE=171,cinder:DELETE=18,cinder:SELECT=125,cinder:INSERT=48 {{(pid=88695) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 06:22:09 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-45ce880b-c407-49a2-ac3c-3c5d6f4de592 tempest-VolumesGetTest-2043829097 None] Created volume successfully. Aug 05 06:22:09 devstack cinder-volume[88695]: DEBUG dbcounter [-] [88695] Writing DB stats cinder:SELECT=153,cinder:DELETE=13,cinder:UPDATE=182,cinder:INSERT=48 {{(pid=88695) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 06:22:09 devstack sudo[101488]: pam_unix(sudo:session): session closed for user root Aug 05 06:22:09 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-8cbe5942-c9e3-4062-a1ba-8ec6e8206479 tempest-ProjectReaderTests-115554455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-1012963b-1652-4752-a9a8-50db2b02a00e" returned: 0 in 0.259s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:22:09 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-8cbe5942-c9e3-4062-a1ba-8ec6e8206479 tempest-ProjectReaderTests-115554455 None] Lock "cinder-quobyte-1012963b-1652-4752-a9a8-50db2b02a00e" released by "delete_volume" :: held 0.745s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:22:09 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-8cbe5942-c9e3-4062-a1ba-8ec6e8206479 tempest-ProjectReaderTests-115554455 None] Created reservations ['6d553623-5f14-4edf-83da-b6ef02abca1f', 'a9f2e62c-874d-4e09-a369-03e6fd4ba5c9', 'fd8c4c50-b862-4e34-b85f-6e1c34fdf89f', 'c58776ad-6866-449d-a4aa-9b2591de080f'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:22:09 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-8cbe5942-c9e3-4062-a1ba-8ec6e8206479 tempest-ProjectReaderTests-115554455 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:22:09 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-8cbe5942-c9e3-4062-a1ba-8ec6e8206479 tempest-ProjectReaderTests-115554455 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:22:09 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-8cbe5942-c9e3-4062-a1ba-8ec6e8206479 tempest-ProjectReaderTests-115554455 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:22:09 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-8cbe5942-c9e3-4062-a1ba-8ec6e8206479 tempest-ProjectReaderTests-115554455 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:22:09 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-8cbe5942-c9e3-4062-a1ba-8ec6e8206479 tempest-ProjectReaderTests-115554455 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:22:09 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-8cbe5942-c9e3-4062-a1ba-8ec6e8206479 tempest-ProjectReaderTests-115554455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:22:09 devstack sudo[101492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce Aug 05 06:22:09 devstack sudo[101492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:22:10 devstack sudo[101492]: pam_unix(sudo:session): session closed for user root Aug 05 06:22:10 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-8cbe5942-c9e3-4062-a1ba-8ec6e8206479 tempest-ProjectReaderTests-115554455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce" returned: 0 in 0.269s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:22:10 devstack cinder-volume[88695]: DEBUG cinder.manager [None req-8cbe5942-c9e3-4062-a1ba-8ec6e8206479 tempest-ProjectReaderTests-115554455 None] Notifying Schedulers of capabilities ... {{(pid=88695) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 06:22:10 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-8cbe5942-c9e3-4062-a1ba-8ec6e8206479 tempest-ProjectReaderTests-115554455 None] Deleted volume successfully. Aug 05 06:22:10 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-8cbe5942-c9e3-4062-a1ba-8ec6e8206479 tempest-ProjectReaderTests-115554455 None] Lock "cinder-1012963b-1652-4752-a9a8-50db2b02a00e-delete_volume" released by "delete_volume" :: held 1.251s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:22:10 devstack cinder-volume[88695]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0cfd270-97e1-4b96-8057-0e9b3ae2464d tempest-ProjectReaderTests-115554455 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88695) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 06:22:10 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-e0cfd270-97e1-4b96-8057-0e9b3ae2464d tempest-ProjectReaderTests-115554455 None] Flow 'volume_create_manager' (a8c580e0-1b0f-47a2-bf5f-e12a8140b342) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:22:10 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-e0cfd270-97e1-4b96-8057-0e9b3ae2464d tempest-ProjectReaderTests-115554455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2270413e-416c-4ce2-9ef2-a1bdae4bd46b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:22:10 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-e0cfd270-97e1-4b96-8057-0e9b3ae2464d tempest-ProjectReaderTests-115554455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2270413e-416c-4ce2-9ef2-a1bdae4bd46b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:22:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-617964749',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81d1f5dd-30ee-49a7-8d9d-d400c2f97712,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54e3489dc9a04f93a4b25bfef40b3ec7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:22:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:22:10Z,use_quota=True,user_id='1fcd555a450d4ef1a10d339e5d70de70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:22:10 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-e0cfd270-97e1-4b96-8057-0e9b3ae2464d tempest-ProjectReaderTests-115554455 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a407dca-29d6-4db4-9f8d-8772421a1f1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:22:10 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-e0cfd270-97e1-4b96-8057-0e9b3ae2464d tempest-ProjectReaderTests-115554455 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a407dca-29d6-4db4-9f8d-8772421a1f1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:22:10 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-e0cfd270-97e1-4b96-8057-0e9b3ae2464d tempest-ProjectReaderTests-115554455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a3d6cec-451c-4d54-b3e6-d4e920ee9f94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:22:10 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-e0cfd270-97e1-4b96-8057-0e9b3ae2464d tempest-ProjectReaderTests-115554455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a3d6cec-451c-4d54-b3e6-d4e920ee9f94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '81d1f5dd-30ee-49a7-8d9d-d400c2f97712', 'volume_name': 'volume-81d1f5dd-30ee-49a7-8d9d-d400c2f97712', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:22:10 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-e0cfd270-97e1-4b96-8057-0e9b3ae2464d tempest-ProjectReaderTests-115554455 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (198823cc-abdb-4a2f-ac51-0e0d9aff2313) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:22:10 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-e0cfd270-97e1-4b96-8057-0e9b3ae2464d tempest-ProjectReaderTests-115554455 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (198823cc-abdb-4a2f-ac51-0e0d9aff2313) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:22:10 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-e0cfd270-97e1-4b96-8057-0e9b3ae2464d tempest-ProjectReaderTests-115554455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8430c07d-370b-49af-a9aa-90ed851ba6b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:22:10 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-e0cfd270-97e1-4b96-8057-0e9b3ae2464d tempest-ProjectReaderTests-115554455 None] Volume 81d1f5dd-30ee-49a7-8d9d-d400c2f97712: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-81d1f5dd-30ee-49a7-8d9d-d400c2f97712', 'volume_size': 1} Aug 05 06:22:10 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-e0cfd270-97e1-4b96-8057-0e9b3ae2464d tempest-ProjectReaderTests-115554455 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:22:10 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-e0cfd270-97e1-4b96-8057-0e9b3ae2464d tempest-ProjectReaderTests-115554455 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:22:10 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-e0cfd270-97e1-4b96-8057-0e9b3ae2464d tempest-ProjectReaderTests-115554455 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:22:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-617964749',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81d1f5dd-30ee-49a7-8d9d-d400c2f97712,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54e3489dc9a04f93a4b25bfef40b3ec7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:22:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:22:10Z,use_quota=True,user_id='1fcd555a450d4ef1a10d339e5d70de70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)}" {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 06:22:10 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-e0cfd270-97e1-4b96-8057-0e9b3ae2464d tempest-ProjectReaderTests-115554455 None] Creating volume 81d1f5dd-30ee-49a7-8d9d-d400c2f97712 {{(pid=88695) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 06:22:10 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-e0cfd270-97e1-4b96-8057-0e9b3ae2464d tempest-ProjectReaderTests-115554455 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:22:10 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-e0cfd270-97e1-4b96-8057-0e9b3ae2464d tempest-ProjectReaderTests-115554455 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:22:10 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-e0cfd270-97e1-4b96-8057-0e9b3ae2464d tempest-ProjectReaderTests-115554455 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:22:10 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-e0cfd270-97e1-4b96-8057-0e9b3ae2464d tempest-ProjectReaderTests-115554455 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:22:10 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-e0cfd270-97e1-4b96-8057-0e9b3ae2464d tempest-ProjectReaderTests-115554455 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:22:10 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-e0cfd270-97e1-4b96-8057-0e9b3ae2464d tempest-ProjectReaderTests-115554455 None] Selected osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 as target Quobyte volume. {{(pid=88695) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 06:22:10 devstack cinder-volume[88695]: INFO cinder.volume.drivers.remotefs [None req-e0cfd270-97e1-4b96-8057-0e9b3ae2464d tempest-ProjectReaderTests-115554455 None] casted to osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 Aug 05 06:22:10 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-e0cfd270-97e1-4b96-8057-0e9b3ae2464d tempest-ProjectReaderTests-115554455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-81d1f5dd-30ee-49a7-8d9d-d400c2f97712 1073741824 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:22:10 devstack sudo[101496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-81d1f5dd-30ee-49a7-8d9d-d400c2f97712 1073741824 Aug 05 06:22:10 devstack sudo[101496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:22:10 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-710fa498-d1ba-466a-b5b9-8310375235d8 tempest-VolumesGetTest-2043829097 None] Acquiring lock "cinder-e232379e-af36-476a-b306-0fff102c7ee4-delete_volume" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:22:10 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-710fa498-d1ba-466a-b5b9-8310375235d8 tempest-VolumesGetTest-2043829097 None] Lock "cinder-e232379e-af36-476a-b306-0fff102c7ee4-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:22:10 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-710fa498-d1ba-466a-b5b9-8310375235d8 tempest-VolumesGetTest-2043829097 None] Acquiring lock "cinder-quobyte-e232379e-af36-476a-b306-0fff102c7ee4" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:22:10 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-710fa498-d1ba-466a-b5b9-8310375235d8 tempest-VolumesGetTest-2043829097 None] Lock "cinder-quobyte-e232379e-af36-476a-b306-0fff102c7ee4" acquired by "delete_volume" :: waited 0.021s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:22:10 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[37dab5aa-e6bd-42b2-91d7-ef46cadfd03a]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:22:10 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-710fa498-d1ba-466a-b5b9-8310375235d8 tempest-VolumesGetTest-2043829097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-e232379e-af36-476a-b306-0fff102c7ee4 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:22:10 devstack sudo[101501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-e232379e-af36-476a-b306-0fff102c7ee4 Aug 05 06:22:10 devstack sudo[101501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:22:11 devstack sudo[101496]: pam_unix(sudo:session): session closed for user root Aug 05 06:22:11 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-e0cfd270-97e1-4b96-8057-0e9b3ae2464d tempest-ProjectReaderTests-115554455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-81d1f5dd-30ee-49a7-8d9d-d400c2f97712 1073741824" returned: 0 in 0.499s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:22:11 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-e0cfd270-97e1-4b96-8057-0e9b3ae2464d tempest-ProjectReaderTests-115554455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-81d1f5dd-30ee-49a7-8d9d-d400c2f97712 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:22:11 devstack sudo[101503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-81d1f5dd-30ee-49a7-8d9d-d400c2f97712 Aug 05 06:22:11 devstack sudo[101503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:22:11 devstack sudo[101501]: pam_unix(sudo:session): session closed for user root Aug 05 06:22:11 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-710fa498-d1ba-466a-b5b9-8310375235d8 tempest-VolumesGetTest-2043829097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-e232379e-af36-476a-b306-0fff102c7ee4" returned: 0 in 0.410s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:22:11 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-710fa498-d1ba-466a-b5b9-8310375235d8 tempest-VolumesGetTest-2043829097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-e232379e-af36-476a-b306-0fff102c7ee4 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:22:11 devstack sudo[101508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-e232379e-af36-476a-b306-0fff102c7ee4 Aug 05 06:22:11 devstack sudo[101508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:22:11 devstack sudo[101503]: pam_unix(sudo:session): session closed for user root Aug 05 06:22:11 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-e0cfd270-97e1-4b96-8057-0e9b3ae2464d tempest-ProjectReaderTests-115554455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-81d1f5dd-30ee-49a7-8d9d-d400c2f97712" returned: 0 in 0.265s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:22:11 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-e0cfd270-97e1-4b96-8057-0e9b3ae2464d tempest-ProjectReaderTests-115554455 None] <== create_volume: return (811ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'} {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 06:22:11 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-e0cfd270-97e1-4b96-8057-0e9b3ae2464d tempest-ProjectReaderTests-115554455 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.814s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:22:11 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-e0cfd270-97e1-4b96-8057-0e9b3ae2464d tempest-ProjectReaderTests-115554455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8430c07d-370b-49af-a9aa-90ed851ba6b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-81d1f5dd-30ee-49a7-8d9d-d400c2f97712', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:22:11 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-e0cfd270-97e1-4b96-8057-0e9b3ae2464d tempest-ProjectReaderTests-115554455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecff166a-1688-4c43-9225-2d2b8bf36c5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:22:11 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-e0cfd270-97e1-4b96-8057-0e9b3ae2464d tempest-ProjectReaderTests-115554455 None] Volume volume-81d1f5dd-30ee-49a7-8d9d-d400c2f97712 (81d1f5dd-30ee-49a7-8d9d-d400c2f97712): created successfully Aug 05 06:22:11 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-e0cfd270-97e1-4b96-8057-0e9b3ae2464d tempest-ProjectReaderTests-115554455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecff166a-1688-4c43-9225-2d2b8bf36c5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:22:11 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-e0cfd270-97e1-4b96-8057-0e9b3ae2464d tempest-ProjectReaderTests-115554455 None] Flow 'volume_create_manager' (a8c580e0-1b0f-47a2-bf5f-e12a8140b342) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:22:11 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-e0cfd270-97e1-4b96-8057-0e9b3ae2464d tempest-ProjectReaderTests-115554455 None] Created volume successfully. Aug 05 06:22:11 devstack sudo[101508]: pam_unix(sudo:session): session closed for user root Aug 05 06:22:11 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-710fa498-d1ba-466a-b5b9-8310375235d8 tempest-VolumesGetTest-2043829097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-e232379e-af36-476a-b306-0fff102c7ee4" returned: 0 in 0.299s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:22:11 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-710fa498-d1ba-466a-b5b9-8310375235d8 tempest-VolumesGetTest-2043829097 None] Lock "cinder-quobyte-e232379e-af36-476a-b306-0fff102c7ee4" released by "delete_volume" :: held 0.752s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:22:11 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-710fa498-d1ba-466a-b5b9-8310375235d8 tempest-VolumesGetTest-2043829097 None] Created reservations ['14a5dd22-d5ee-49d6-831e-3edf75fd0c39', '8be67550-faac-46d6-adfe-0949216ce9b1', '0391bee7-c891-42f5-8592-687f3f2aada5', '57d77a92-7540-469a-8df4-2fc07ce72202'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:22:11 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-710fa498-d1ba-466a-b5b9-8310375235d8 tempest-VolumesGetTest-2043829097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:22:11 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-710fa498-d1ba-466a-b5b9-8310375235d8 tempest-VolumesGetTest-2043829097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:22:11 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-710fa498-d1ba-466a-b5b9-8310375235d8 tempest-VolumesGetTest-2043829097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:22:11 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-710fa498-d1ba-466a-b5b9-8310375235d8 tempest-VolumesGetTest-2043829097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:22:11 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-710fa498-d1ba-466a-b5b9-8310375235d8 tempest-VolumesGetTest-2043829097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:22:11 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-710fa498-d1ba-466a-b5b9-8310375235d8 tempest-VolumesGetTest-2043829097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:22:11 devstack sudo[101512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce Aug 05 06:22:11 devstack sudo[101512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:22:11 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-7be18a5d-ca32-44d8-9bc0-2220712ba2bc tempest-VolumesGetTest-2043829097 None] Acquiring lock "cinder-1a60fcc7-2903-4aa3-bd97-3249f342c196-delete_volume" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:22:11 devstack sudo[101512]: pam_unix(sudo:session): session closed for user root Aug 05 06:22:12 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-7be18a5d-ca32-44d8-9bc0-2220712ba2bc tempest-VolumesGetTest-2043829097 None] Lock "cinder-1a60fcc7-2903-4aa3-bd97-3249f342c196-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:22:12 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-710fa498-d1ba-466a-b5b9-8310375235d8 tempest-VolumesGetTest-2043829097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce" returned: 0 in 0.297s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:22:12 devstack cinder-volume[88695]: DEBUG cinder.manager [None req-710fa498-d1ba-466a-b5b9-8310375235d8 tempest-VolumesGetTest-2043829097 None] Notifying Schedulers of capabilities ... {{(pid=88695) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 06:22:12 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-710fa498-d1ba-466a-b5b9-8310375235d8 tempest-VolumesGetTest-2043829097 None] Deleted volume successfully. Aug 05 06:22:12 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-7be18a5d-ca32-44d8-9bc0-2220712ba2bc tempest-VolumesGetTest-2043829097 None] Acquiring lock "cinder-quobyte-1a60fcc7-2903-4aa3-bd97-3249f342c196" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:22:12 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-710fa498-d1ba-466a-b5b9-8310375235d8 tempest-VolumesGetTest-2043829097 None] Lock "cinder-e232379e-af36-476a-b306-0fff102c7ee4-delete_volume" released by "delete_volume" :: held 1.312s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:22:12 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-7be18a5d-ca32-44d8-9bc0-2220712ba2bc tempest-VolumesGetTest-2043829097 None] Lock "cinder-quobyte-1a60fcc7-2903-4aa3-bd97-3249f342c196" acquired by "delete_volume" :: waited 0.024s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:22:12 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2f0684d-14ac-4d76-85f6-088820b3d38b]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:22:12 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-7be18a5d-ca32-44d8-9bc0-2220712ba2bc tempest-VolumesGetTest-2043829097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-1a60fcc7-2903-4aa3-bd97-3249f342c196 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:22:12 devstack sudo[101515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-1a60fcc7-2903-4aa3-bd97-3249f342c196 Aug 05 06:22:12 devstack sudo[101515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:22:12 devstack sudo[101515]: pam_unix(sudo:session): session closed for user root Aug 05 06:22:12 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-7be18a5d-ca32-44d8-9bc0-2220712ba2bc tempest-VolumesGetTest-2043829097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-1a60fcc7-2903-4aa3-bd97-3249f342c196" returned: 0 in 0.398s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:22:12 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-7be18a5d-ca32-44d8-9bc0-2220712ba2bc tempest-VolumesGetTest-2043829097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-1a60fcc7-2903-4aa3-bd97-3249f342c196 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:22:12 devstack sudo[101520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-1a60fcc7-2903-4aa3-bd97-3249f342c196 Aug 05 06:22:12 devstack sudo[101520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:22:12 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-def4dc95-e74b-4b8f-ba8a-40be7fa19633 tempest-ProjectReaderTests-115554455 None] Acquiring lock "cinder-81d1f5dd-30ee-49a7-8d9d-d400c2f97712-delete_volume" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:22:12 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-def4dc95-e74b-4b8f-ba8a-40be7fa19633 tempest-ProjectReaderTests-115554455 None] Lock "cinder-81d1f5dd-30ee-49a7-8d9d-d400c2f97712-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:22:12 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-def4dc95-e74b-4b8f-ba8a-40be7fa19633 tempest-ProjectReaderTests-115554455 None] Acquiring lock "cinder-quobyte-81d1f5dd-30ee-49a7-8d9d-d400c2f97712" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:22:12 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-def4dc95-e74b-4b8f-ba8a-40be7fa19633 tempest-ProjectReaderTests-115554455 None] Lock "cinder-quobyte-81d1f5dd-30ee-49a7-8d9d-d400c2f97712" acquired by "delete_volume" :: waited 0.017s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:22:12 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ad7637d-d3f6-4a87-8c07-cc634f172880]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:22:12 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-def4dc95-e74b-4b8f-ba8a-40be7fa19633 tempest-ProjectReaderTests-115554455 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-81d1f5dd-30ee-49a7-8d9d-d400c2f97712 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:22:12 devstack sudo[101522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-81d1f5dd-30ee-49a7-8d9d-d400c2f97712 Aug 05 06:22:12 devstack sudo[101522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:22:12 devstack sudo[101520]: pam_unix(sudo:session): session closed for user root Aug 05 06:22:12 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-7be18a5d-ca32-44d8-9bc0-2220712ba2bc tempest-VolumesGetTest-2043829097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-1a60fcc7-2903-4aa3-bd97-3249f342c196" returned: 0 in 0.343s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:22:12 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-7be18a5d-ca32-44d8-9bc0-2220712ba2bc tempest-VolumesGetTest-2043829097 None] Lock "cinder-quobyte-1a60fcc7-2903-4aa3-bd97-3249f342c196" released by "delete_volume" :: held 0.787s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:22:12 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-7be18a5d-ca32-44d8-9bc0-2220712ba2bc tempest-VolumesGetTest-2043829097 None] Created reservations ['8e7d44d5-c5a5-4368-8f64-a360b3813af8', 'b9d9d56b-4cf9-43c5-a553-5ff07bfe369f', '2278e625-afa7-4e56-95ac-180489e405b4', '3e8aabeb-6055-431b-a3d7-885f5ac7c38d'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:22:12 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-7be18a5d-ca32-44d8-9bc0-2220712ba2bc tempest-VolumesGetTest-2043829097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:22:12 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-7be18a5d-ca32-44d8-9bc0-2220712ba2bc tempest-VolumesGetTest-2043829097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:22:12 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-7be18a5d-ca32-44d8-9bc0-2220712ba2bc tempest-VolumesGetTest-2043829097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:22:13 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-7be18a5d-ca32-44d8-9bc0-2220712ba2bc tempest-VolumesGetTest-2043829097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:22:13 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-7be18a5d-ca32-44d8-9bc0-2220712ba2bc tempest-VolumesGetTest-2043829097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:22:13 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-7be18a5d-ca32-44d8-9bc0-2220712ba2bc tempest-VolumesGetTest-2043829097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:22:13 devstack sudo[101549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce Aug 05 06:22:13 devstack sudo[101549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:22:13 devstack sudo[101522]: pam_unix(sudo:session): session closed for user root Aug 05 06:22:13 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-def4dc95-e74b-4b8f-ba8a-40be7fa19633 tempest-ProjectReaderTests-115554455 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-81d1f5dd-30ee-49a7-8d9d-d400c2f97712" returned: 0 in 0.438s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:22:13 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-def4dc95-e74b-4b8f-ba8a-40be7fa19633 tempest-ProjectReaderTests-115554455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-81d1f5dd-30ee-49a7-8d9d-d400c2f97712 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:22:13 devstack sudo[101554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-81d1f5dd-30ee-49a7-8d9d-d400c2f97712 Aug 05 06:22:13 devstack sudo[101554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:22:13 devstack sudo[101549]: pam_unix(sudo:session): session closed for user root Aug 05 06:22:13 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-7be18a5d-ca32-44d8-9bc0-2220712ba2bc tempest-VolumesGetTest-2043829097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce" returned: 0 in 0.354s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:22:13 devstack cinder-volume[88695]: DEBUG cinder.manager [None req-7be18a5d-ca32-44d8-9bc0-2220712ba2bc tempest-VolumesGetTest-2043829097 None] Notifying Schedulers of capabilities ... {{(pid=88695) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 06:22:13 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-7be18a5d-ca32-44d8-9bc0-2220712ba2bc tempest-VolumesGetTest-2043829097 None] Deleted volume successfully. Aug 05 06:22:13 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-7be18a5d-ca32-44d8-9bc0-2220712ba2bc tempest-VolumesGetTest-2043829097 None] Lock "cinder-1a60fcc7-2903-4aa3-bd97-3249f342c196-delete_volume" released by "delete_volume" :: held 1.408s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:22:13 devstack sudo[101554]: pam_unix(sudo:session): session closed for user root Aug 05 06:22:13 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-def4dc95-e74b-4b8f-ba8a-40be7fa19633 tempest-ProjectReaderTests-115554455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-81d1f5dd-30ee-49a7-8d9d-d400c2f97712" returned: 0 in 0.342s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:22:13 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-def4dc95-e74b-4b8f-ba8a-40be7fa19633 tempest-ProjectReaderTests-115554455 None] Lock "cinder-quobyte-81d1f5dd-30ee-49a7-8d9d-d400c2f97712" released by "delete_volume" :: held 0.832s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:22:13 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-def4dc95-e74b-4b8f-ba8a-40be7fa19633 tempest-ProjectReaderTests-115554455 None] Created reservations ['ed85d0a3-adc4-46fb-95a0-020db05a73da', '29fc9649-06e6-47f8-9aaf-1816a05697d5', '08adac32-4cd1-4d85-9462-3cd15c9d1357', '3d39384a-fe0a-4c1e-b14a-60035b02d638'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:22:13 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-def4dc95-e74b-4b8f-ba8a-40be7fa19633 tempest-ProjectReaderTests-115554455 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:22:13 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-def4dc95-e74b-4b8f-ba8a-40be7fa19633 tempest-ProjectReaderTests-115554455 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:22:13 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-def4dc95-e74b-4b8f-ba8a-40be7fa19633 tempest-ProjectReaderTests-115554455 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:22:13 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-def4dc95-e74b-4b8f-ba8a-40be7fa19633 tempest-ProjectReaderTests-115554455 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:22:13 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-def4dc95-e74b-4b8f-ba8a-40be7fa19633 tempest-ProjectReaderTests-115554455 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:22:13 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-def4dc95-e74b-4b8f-ba8a-40be7fa19633 tempest-ProjectReaderTests-115554455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:22:13 devstack sudo[101558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce Aug 05 06:22:13 devstack sudo[101558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:22:14 devstack sudo[101558]: pam_unix(sudo:session): session closed for user root Aug 05 06:22:14 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-def4dc95-e74b-4b8f-ba8a-40be7fa19633 tempest-ProjectReaderTests-115554455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce" returned: 0 in 0.340s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:22:14 devstack cinder-volume[88695]: DEBUG cinder.manager [None req-def4dc95-e74b-4b8f-ba8a-40be7fa19633 tempest-ProjectReaderTests-115554455 None] Notifying Schedulers of capabilities ... {{(pid=88695) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 06:22:14 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-def4dc95-e74b-4b8f-ba8a-40be7fa19633 tempest-ProjectReaderTests-115554455 None] Deleted volume successfully. Aug 05 06:22:14 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-def4dc95-e74b-4b8f-ba8a-40be7fa19633 tempest-ProjectReaderTests-115554455 None] Lock "cinder-81d1f5dd-30ee-49a7-8d9d-d400c2f97712-delete_volume" released by "delete_volume" :: held 1.458s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:22:14 devstack cinder-volume[88695]: DEBUG cinder.volume.flows.manager.create_volume [None req-19966f0f-a202-425a-9a1a-38c737030a3e tempest-ProjectReaderTests-115554455 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88695) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 06:22:14 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-19966f0f-a202-425a-9a1a-38c737030a3e tempest-ProjectReaderTests-115554455 None] Flow 'volume_create_manager' (ca617595-a313-4610-81be-5948df7016f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:22:14 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-19966f0f-a202-425a-9a1a-38c737030a3e tempest-ProjectReaderTests-115554455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7600f8ee-ba19-4739-838b-2ea1eeadd4b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:22:14 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-19966f0f-a202-425a-9a1a-38c737030a3e tempest-ProjectReaderTests-115554455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7600f8ee-ba19-4739-838b-2ea1eeadd4b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:22:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-126470640',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a82bf2d-d627-4a6d-9d59-5ea7d079ddbf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54e3489dc9a04f93a4b25bfef40b3ec7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:22:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:22:14Z,use_quota=True,user_id='1fcd555a450d4ef1a10d339e5d70de70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:22:14 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-19966f0f-a202-425a-9a1a-38c737030a3e tempest-ProjectReaderTests-115554455 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de95484c-10ff-4925-aa03-fbbfea80a51e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:22:14 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-19966f0f-a202-425a-9a1a-38c737030a3e tempest-ProjectReaderTests-115554455 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de95484c-10ff-4925-aa03-fbbfea80a51e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:22:14 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-19966f0f-a202-425a-9a1a-38c737030a3e tempest-ProjectReaderTests-115554455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e7932aa-be02-4bef-b344-6549a81d0ec8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:22:14 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-19966f0f-a202-425a-9a1a-38c737030a3e tempest-ProjectReaderTests-115554455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e7932aa-be02-4bef-b344-6549a81d0ec8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5a82bf2d-d627-4a6d-9d59-5ea7d079ddbf', 'volume_name': 'volume-5a82bf2d-d627-4a6d-9d59-5ea7d079ddbf', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:22:14 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-19966f0f-a202-425a-9a1a-38c737030a3e tempest-ProjectReaderTests-115554455 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54161c84-1117-404b-9635-f86f370de90f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:22:14 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-19966f0f-a202-425a-9a1a-38c737030a3e tempest-ProjectReaderTests-115554455 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54161c84-1117-404b-9635-f86f370de90f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:22:14 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-19966f0f-a202-425a-9a1a-38c737030a3e tempest-ProjectReaderTests-115554455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca543814-e042-4941-b134-f2d8817e19a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:22:14 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-19966f0f-a202-425a-9a1a-38c737030a3e tempest-ProjectReaderTests-115554455 None] Volume 5a82bf2d-d627-4a6d-9d59-5ea7d079ddbf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5a82bf2d-d627-4a6d-9d59-5ea7d079ddbf', 'volume_size': 1} Aug 05 06:22:14 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-19966f0f-a202-425a-9a1a-38c737030a3e tempest-ProjectReaderTests-115554455 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:22:14 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-19966f0f-a202-425a-9a1a-38c737030a3e tempest-ProjectReaderTests-115554455 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:22:14 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-19966f0f-a202-425a-9a1a-38c737030a3e tempest-ProjectReaderTests-115554455 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:22:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-126470640',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a82bf2d-d627-4a6d-9d59-5ea7d079ddbf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54e3489dc9a04f93a4b25bfef40b3ec7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:22:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:22:14Z,use_quota=True,user_id='1fcd555a450d4ef1a10d339e5d70de70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)}" {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 06:22:14 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-19966f0f-a202-425a-9a1a-38c737030a3e tempest-ProjectReaderTests-115554455 None] Creating volume 5a82bf2d-d627-4a6d-9d59-5ea7d079ddbf {{(pid=88695) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 06:22:14 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-19966f0f-a202-425a-9a1a-38c737030a3e tempest-ProjectReaderTests-115554455 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:22:14 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-19966f0f-a202-425a-9a1a-38c737030a3e tempest-ProjectReaderTests-115554455 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:22:14 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-19966f0f-a202-425a-9a1a-38c737030a3e tempest-ProjectReaderTests-115554455 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:22:14 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-19966f0f-a202-425a-9a1a-38c737030a3e tempest-ProjectReaderTests-115554455 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:22:14 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-19966f0f-a202-425a-9a1a-38c737030a3e tempest-ProjectReaderTests-115554455 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:22:14 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-19966f0f-a202-425a-9a1a-38c737030a3e tempest-ProjectReaderTests-115554455 None] Selected osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 as target Quobyte volume. {{(pid=88695) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 06:22:14 devstack cinder-volume[88695]: INFO cinder.volume.drivers.remotefs [None req-19966f0f-a202-425a-9a1a-38c737030a3e tempest-ProjectReaderTests-115554455 None] casted to osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 Aug 05 06:22:14 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-19966f0f-a202-425a-9a1a-38c737030a3e tempest-ProjectReaderTests-115554455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-5a82bf2d-d627-4a6d-9d59-5ea7d079ddbf 1073741824 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:22:14 devstack sudo[101561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-5a82bf2d-d627-4a6d-9d59-5ea7d079ddbf 1073741824 Aug 05 06:22:14 devstack sudo[101561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:22:14 devstack sudo[101561]: pam_unix(sudo:session): session closed for user root Aug 05 06:22:14 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-19966f0f-a202-425a-9a1a-38c737030a3e tempest-ProjectReaderTests-115554455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-5a82bf2d-d627-4a6d-9d59-5ea7d079ddbf 1073741824" returned: 0 in 0.468s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:22:14 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-19966f0f-a202-425a-9a1a-38c737030a3e tempest-ProjectReaderTests-115554455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-5a82bf2d-d627-4a6d-9d59-5ea7d079ddbf {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:22:15 devstack sudo[101567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-5a82bf2d-d627-4a6d-9d59-5ea7d079ddbf Aug 05 06:22:15 devstack sudo[101567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:22:15 devstack sudo[101567]: pam_unix(sudo:session): session closed for user root Aug 05 06:22:15 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-19966f0f-a202-425a-9a1a-38c737030a3e tempest-ProjectReaderTests-115554455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-5a82bf2d-d627-4a6d-9d59-5ea7d079ddbf" returned: 0 in 0.283s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:22:15 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-19966f0f-a202-425a-9a1a-38c737030a3e tempest-ProjectReaderTests-115554455 None] <== create_volume: return (794ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'} {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 06:22:15 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-19966f0f-a202-425a-9a1a-38c737030a3e tempest-ProjectReaderTests-115554455 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.797s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:22:15 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-19966f0f-a202-425a-9a1a-38c737030a3e tempest-ProjectReaderTests-115554455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca543814-e042-4941-b134-f2d8817e19a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a82bf2d-d627-4a6d-9d59-5ea7d079ddbf', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:22:15 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-19966f0f-a202-425a-9a1a-38c737030a3e tempest-ProjectReaderTests-115554455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e8cd63f-5516-4bd6-be95-910b16038bf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:22:15 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-19966f0f-a202-425a-9a1a-38c737030a3e tempest-ProjectReaderTests-115554455 None] Volume volume-5a82bf2d-d627-4a6d-9d59-5ea7d079ddbf (5a82bf2d-d627-4a6d-9d59-5ea7d079ddbf): created successfully Aug 05 06:22:15 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-19966f0f-a202-425a-9a1a-38c737030a3e tempest-ProjectReaderTests-115554455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e8cd63f-5516-4bd6-be95-910b16038bf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:22:15 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-19966f0f-a202-425a-9a1a-38c737030a3e tempest-ProjectReaderTests-115554455 None] Flow 'volume_create_manager' (ca617595-a313-4610-81be-5948df7016f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:22:15 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-19966f0f-a202-425a-9a1a-38c737030a3e tempest-ProjectReaderTests-115554455 None] Created volume successfully. Aug 05 06:22:16 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-10a01f70-5fa1-4fa3-acd7-25efda06a733 tempest-ProjectReaderTests-115554455 None] Acquiring lock "cinder-5a82bf2d-d627-4a6d-9d59-5ea7d079ddbf-delete_volume" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:22:16 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-10a01f70-5fa1-4fa3-acd7-25efda06a733 tempest-ProjectReaderTests-115554455 None] Lock "cinder-5a82bf2d-d627-4a6d-9d59-5ea7d079ddbf-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:22:16 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-10a01f70-5fa1-4fa3-acd7-25efda06a733 tempest-ProjectReaderTests-115554455 None] Acquiring lock "cinder-quobyte-5a82bf2d-d627-4a6d-9d59-5ea7d079ddbf" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:22:16 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-10a01f70-5fa1-4fa3-acd7-25efda06a733 tempest-ProjectReaderTests-115554455 None] Lock "cinder-quobyte-5a82bf2d-d627-4a6d-9d59-5ea7d079ddbf" acquired by "delete_volume" :: waited 0.025s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:22:16 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[a56dfc43-af9c-4c3f-a117-a2fdcad945e2]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:22:16 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-10a01f70-5fa1-4fa3-acd7-25efda06a733 tempest-ProjectReaderTests-115554455 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-5a82bf2d-d627-4a6d-9d59-5ea7d079ddbf {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:22:16 devstack cinder-volume[88695]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf8693c9-1642-4042-89ab-b04e02bd39c6 tempest-VolumesSnapshotNegativeTestJSON-1733839629 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88695) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 06:22:16 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-cf8693c9-1642-4042-89ab-b04e02bd39c6 tempest-VolumesSnapshotNegativeTestJSON-1733839629 None] Flow 'volume_create_manager' (61a8fc16-fc0b-4545-a119-9fb23da34bf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:22:16 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-cf8693c9-1642-4042-89ab-b04e02bd39c6 tempest-VolumesSnapshotNegativeTestJSON-1733839629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e092ec9-dcdc-42d9-8c50-bfc310853d4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:22:16 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-cf8693c9-1642-4042-89ab-b04e02bd39c6 tempest-VolumesSnapshotNegativeTestJSON-1733839629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e092ec9-dcdc-42d9-8c50-bfc310853d4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:22:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1438605340',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e382944-1d89-45ab-bc6d-5546cdfd333d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48ddbc73e31441639d4b7c738d2e7e58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:22:17Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:22:17Z,use_quota=True,user_id='79c6698e342f42238d69e8dabee5f130',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:22:16 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-cf8693c9-1642-4042-89ab-b04e02bd39c6 tempest-VolumesSnapshotNegativeTestJSON-1733839629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1548314-2d14-4f75-91da-e4ddf75e1137) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:22:16 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-cf8693c9-1642-4042-89ab-b04e02bd39c6 tempest-VolumesSnapshotNegativeTestJSON-1733839629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1548314-2d14-4f75-91da-e4ddf75e1137) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:22:16 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-cf8693c9-1642-4042-89ab-b04e02bd39c6 tempest-VolumesSnapshotNegativeTestJSON-1733839629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (baf74a77-5237-4b7e-b221-e3b7236ebac4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:22:16 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-cf8693c9-1642-4042-89ab-b04e02bd39c6 tempest-VolumesSnapshotNegativeTestJSON-1733839629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (baf74a77-5237-4b7e-b221-e3b7236ebac4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e382944-1d89-45ab-bc6d-5546cdfd333d', 'volume_name': 'volume-9e382944-1d89-45ab-bc6d-5546cdfd333d', 'volume_size': 2}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:22:16 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-cf8693c9-1642-4042-89ab-b04e02bd39c6 tempest-VolumesSnapshotNegativeTestJSON-1733839629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ed2f78f-782b-4d13-b84e-ddebb1e4da13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:22:16 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-cf8693c9-1642-4042-89ab-b04e02bd39c6 tempest-VolumesSnapshotNegativeTestJSON-1733839629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ed2f78f-782b-4d13-b84e-ddebb1e4da13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:22:16 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-cf8693c9-1642-4042-89ab-b04e02bd39c6 tempest-VolumesSnapshotNegativeTestJSON-1733839629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (675d6a00-0317-4828-a7ec-91cf2da2f46e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:22:16 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-cf8693c9-1642-4042-89ab-b04e02bd39c6 tempest-VolumesSnapshotNegativeTestJSON-1733839629 None] Volume 9e382944-1d89-45ab-bc6d-5546cdfd333d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e382944-1d89-45ab-bc6d-5546cdfd333d', 'volume_size': 2} Aug 05 06:22:16 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-cf8693c9-1642-4042-89ab-b04e02bd39c6 tempest-VolumesSnapshotNegativeTestJSON-1733839629 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:22:16 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-cf8693c9-1642-4042-89ab-b04e02bd39c6 tempest-VolumesSnapshotNegativeTestJSON-1733839629 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:22:16 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-cf8693c9-1642-4042-89ab-b04e02bd39c6 tempest-VolumesSnapshotNegativeTestJSON-1733839629 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:22:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1438605340',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e382944-1d89-45ab-bc6d-5546cdfd333d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48ddbc73e31441639d4b7c738d2e7e58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:22:17Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:22:17Z,use_quota=True,user_id='79c6698e342f42238d69e8dabee5f130',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)}" {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 06:22:16 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-cf8693c9-1642-4042-89ab-b04e02bd39c6 tempest-VolumesSnapshotNegativeTestJSON-1733839629 None] Creating volume 9e382944-1d89-45ab-bc6d-5546cdfd333d {{(pid=88695) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 06:22:16 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-cf8693c9-1642-4042-89ab-b04e02bd39c6 tempest-VolumesSnapshotNegativeTestJSON-1733839629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:22:16 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-cf8693c9-1642-4042-89ab-b04e02bd39c6 tempest-VolumesSnapshotNegativeTestJSON-1733839629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:22:16 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-cf8693c9-1642-4042-89ab-b04e02bd39c6 tempest-VolumesSnapshotNegativeTestJSON-1733839629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:22:16 devstack sudo[101570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-5a82bf2d-d627-4a6d-9d59-5ea7d079ddbf Aug 05 06:22:16 devstack sudo[101570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:22:16 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-cf8693c9-1642-4042-89ab-b04e02bd39c6 tempest-VolumesSnapshotNegativeTestJSON-1733839629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:22:16 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-cf8693c9-1642-4042-89ab-b04e02bd39c6 tempest-VolumesSnapshotNegativeTestJSON-1733839629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:22:16 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-cf8693c9-1642-4042-89ab-b04e02bd39c6 tempest-VolumesSnapshotNegativeTestJSON-1733839629 None] Selected osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 as target Quobyte volume. {{(pid=88695) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 06:22:16 devstack cinder-volume[88695]: INFO cinder.volume.drivers.remotefs [None req-cf8693c9-1642-4042-89ab-b04e02bd39c6 tempest-VolumesSnapshotNegativeTestJSON-1733839629 None] casted to osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 Aug 05 06:22:16 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-cf8693c9-1642-4042-89ab-b04e02bd39c6 tempest-VolumesSnapshotNegativeTestJSON-1733839629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9e382944-1d89-45ab-bc6d-5546cdfd333d 2147483648 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:22:16 devstack sudo[101572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9e382944-1d89-45ab-bc6d-5546cdfd333d 2147483648 Aug 05 06:22:16 devstack sudo[101572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:22:17 devstack sudo[101570]: pam_unix(sudo:session): session closed for user root Aug 05 06:22:17 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-10a01f70-5fa1-4fa3-acd7-25efda06a733 tempest-ProjectReaderTests-115554455 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-5a82bf2d-d627-4a6d-9d59-5ea7d079ddbf" returned: 0 in 0.408s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:22:17 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-10a01f70-5fa1-4fa3-acd7-25efda06a733 tempest-ProjectReaderTests-115554455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-5a82bf2d-d627-4a6d-9d59-5ea7d079ddbf {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:22:17 devstack sudo[101605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-5a82bf2d-d627-4a6d-9d59-5ea7d079ddbf Aug 05 06:22:17 devstack sudo[101605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:22:17 devstack sudo[101572]: pam_unix(sudo:session): session closed for user root Aug 05 06:22:17 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-cf8693c9-1642-4042-89ab-b04e02bd39c6 tempest-VolumesSnapshotNegativeTestJSON-1733839629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9e382944-1d89-45ab-bc6d-5546cdfd333d 2147483648" returned: 0 in 0.530s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:22:17 devstack sudo[101605]: pam_unix(sudo:session): session closed for user root Aug 05 06:22:17 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-10a01f70-5fa1-4fa3-acd7-25efda06a733 tempest-ProjectReaderTests-115554455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-5a82bf2d-d627-4a6d-9d59-5ea7d079ddbf" returned: 0 in 0.288s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:22:17 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-cf8693c9-1642-4042-89ab-b04e02bd39c6 tempest-VolumesSnapshotNegativeTestJSON-1733839629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9e382944-1d89-45ab-bc6d-5546cdfd333d {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:22:17 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-10a01f70-5fa1-4fa3-acd7-25efda06a733 tempest-ProjectReaderTests-115554455 None] Lock "cinder-quobyte-5a82bf2d-d627-4a6d-9d59-5ea7d079ddbf" released by "delete_volume" :: held 0.765s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:22:17 devstack sudo[101608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9e382944-1d89-45ab-bc6d-5546cdfd333d Aug 05 06:22:17 devstack sudo[101608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:22:17 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-10a01f70-5fa1-4fa3-acd7-25efda06a733 tempest-ProjectReaderTests-115554455 None] Created reservations ['cc38ec68-9665-4c14-ac6b-d5f4bc781a6b', 'e19e56e1-1c39-4a08-9378-a4283273e9ef', '2b7263f6-9609-4ddd-a37b-4dea6c9ed0d5', 'cceb0b1c-405d-4eba-8485-85c54b841087'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:22:17 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-10a01f70-5fa1-4fa3-acd7-25efda06a733 tempest-ProjectReaderTests-115554455 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:22:17 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-10a01f70-5fa1-4fa3-acd7-25efda06a733 tempest-ProjectReaderTests-115554455 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:22:17 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-10a01f70-5fa1-4fa3-acd7-25efda06a733 tempest-ProjectReaderTests-115554455 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:22:17 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-10a01f70-5fa1-4fa3-acd7-25efda06a733 tempest-ProjectReaderTests-115554455 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:22:17 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-10a01f70-5fa1-4fa3-acd7-25efda06a733 tempest-ProjectReaderTests-115554455 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:22:17 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-10a01f70-5fa1-4fa3-acd7-25efda06a733 tempest-ProjectReaderTests-115554455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:22:17 devstack sudo[101610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce Aug 05 06:22:17 devstack sudo[101610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:22:17 devstack sudo[101608]: pam_unix(sudo:session): session closed for user root Aug 05 06:22:17 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-cf8693c9-1642-4042-89ab-b04e02bd39c6 tempest-VolumesSnapshotNegativeTestJSON-1733839629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9e382944-1d89-45ab-bc6d-5546cdfd333d" returned: 0 in 0.258s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:22:17 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-cf8693c9-1642-4042-89ab-b04e02bd39c6 tempest-VolumesSnapshotNegativeTestJSON-1733839629 None] <== create_volume: return (856ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'} {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 06:22:17 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-cf8693c9-1642-4042-89ab-b04e02bd39c6 tempest-VolumesSnapshotNegativeTestJSON-1733839629 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.858s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:22:17 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-cf8693c9-1642-4042-89ab-b04e02bd39c6 tempest-VolumesSnapshotNegativeTestJSON-1733839629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (675d6a00-0317-4828-a7ec-91cf2da2f46e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e382944-1d89-45ab-bc6d-5546cdfd333d', 'volume_size': 2}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:22:17 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-cf8693c9-1642-4042-89ab-b04e02bd39c6 tempest-VolumesSnapshotNegativeTestJSON-1733839629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0aa4b2e3-f203-4473-bf0a-4309bcc0193d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:22:17 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-cf8693c9-1642-4042-89ab-b04e02bd39c6 tempest-VolumesSnapshotNegativeTestJSON-1733839629 None] Volume volume-9e382944-1d89-45ab-bc6d-5546cdfd333d (9e382944-1d89-45ab-bc6d-5546cdfd333d): created successfully Aug 05 06:22:17 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-cf8693c9-1642-4042-89ab-b04e02bd39c6 tempest-VolumesSnapshotNegativeTestJSON-1733839629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0aa4b2e3-f203-4473-bf0a-4309bcc0193d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:22:17 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-cf8693c9-1642-4042-89ab-b04e02bd39c6 tempest-VolumesSnapshotNegativeTestJSON-1733839629 None] Flow 'volume_create_manager' (61a8fc16-fc0b-4545-a119-9fb23da34bf8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:22:17 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-cf8693c9-1642-4042-89ab-b04e02bd39c6 tempest-VolumesSnapshotNegativeTestJSON-1733839629 None] Created volume successfully. Aug 05 06:22:17 devstack sudo[101610]: pam_unix(sudo:session): session closed for user root Aug 05 06:22:17 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-10a01f70-5fa1-4fa3-acd7-25efda06a733 tempest-ProjectReaderTests-115554455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce" returned: 0 in 0.267s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:22:17 devstack cinder-volume[88695]: DEBUG cinder.manager [None req-10a01f70-5fa1-4fa3-acd7-25efda06a733 tempest-ProjectReaderTests-115554455 None] Notifying Schedulers of capabilities ... {{(pid=88695) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 06:22:17 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-10a01f70-5fa1-4fa3-acd7-25efda06a733 tempest-ProjectReaderTests-115554455 None] Deleted volume successfully. Aug 05 06:22:17 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-10a01f70-5fa1-4fa3-acd7-25efda06a733 tempest-ProjectReaderTests-115554455 None] Lock "cinder-5a82bf2d-d627-4a6d-9d59-5ea7d079ddbf-delete_volume" released by "delete_volume" :: held 1.252s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:22:18 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-982df2ef-e36f-40de-974f-9d8d9933970f tempest-VolumesSnapshotNegativeTestJSON-1733839629 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:22:18 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-982df2ef-e36f-40de-974f-9d8d9933970f tempest-VolumesSnapshotNegativeTestJSON-1733839629 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:22:18 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-982df2ef-e36f-40de-974f-9d8d9933970f tempest-VolumesSnapshotNegativeTestJSON-1733839629 None] Creating offline snapshot 74b40334-c32f-4846-a5c8-9b65d8e42a1f of volume 9e382944-1d89-45ab-bc6d-5546cdfd333d {{(pid=88695) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 06:22:18 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[51a633e1-5232-4012-9600-57b5c57dbd11]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:22:18 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-982df2ef-e36f-40de-974f-9d8d9933970f tempest-VolumesSnapshotNegativeTestJSON-1733839629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9e382944-1d89-45ab-bc6d-5546cdfd333d {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:22:19 devstack sudo[101615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9e382944-1d89-45ab-bc6d-5546cdfd333d Aug 05 06:22:19 devstack sudo[101615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:22:19 devstack sudo[101615]: pam_unix(sudo:session): session closed for user root Aug 05 06:22:19 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-982df2ef-e36f-40de-974f-9d8d9933970f tempest-VolumesSnapshotNegativeTestJSON-1733839629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9e382944-1d89-45ab-bc6d-5546cdfd333d" returned: 0 in 0.374s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:22:19 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-982df2ef-e36f-40de-974f-9d8d9933970f tempest-VolumesSnapshotNegativeTestJSON-1733839629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9e382944-1d89-45ab-bc6d-5546cdfd333d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9e382944-1d89-45ab-bc6d-5546cdfd333d.74b40334-c32f-4846-a5c8-9b65d8e42a1f 2G {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:22:19 devstack sudo[101620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9e382944-1d89-45ab-bc6d-5546cdfd333d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9e382944-1d89-45ab-bc6d-5546cdfd333d.74b40334-c32f-4846-a5c8-9b65d8e42a1f 2G Aug 05 06:22:19 devstack sudo[101620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:22:19 devstack sudo[101620]: pam_unix(sudo:session): session closed for user root Aug 05 06:22:19 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-982df2ef-e36f-40de-974f-9d8d9933970f tempest-VolumesSnapshotNegativeTestJSON-1733839629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9e382944-1d89-45ab-bc6d-5546cdfd333d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9e382944-1d89-45ab-bc6d-5546cdfd333d.74b40334-c32f-4846-a5c8-9b65d8e42a1f 2G" returned: 0 in 0.393s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:22:19 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-982df2ef-e36f-40de-974f-9d8d9933970f tempest-VolumesSnapshotNegativeTestJSON-1733839629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e382944-1d89-45ab-bc6d-5546cdfd333d -F qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9e382944-1d89-45ab-bc6d-5546cdfd333d.74b40334-c32f-4846-a5c8-9b65d8e42a1f {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:22:19 devstack sudo[101625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e382944-1d89-45ab-bc6d-5546cdfd333d -F qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9e382944-1d89-45ab-bc6d-5546cdfd333d.74b40334-c32f-4846-a5c8-9b65d8e42a1f Aug 05 06:22:19 devstack sudo[101625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:22:20 devstack sudo[101625]: pam_unix(sudo:session): session closed for user root Aug 05 06:22:20 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-982df2ef-e36f-40de-974f-9d8d9933970f tempest-VolumesSnapshotNegativeTestJSON-1733839629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e382944-1d89-45ab-bc6d-5546cdfd333d -F qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9e382944-1d89-45ab-bc6d-5546cdfd333d.74b40334-c32f-4846-a5c8-9b65d8e42a1f" returned: 0 in 0.278s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:22:20 devstack cinder-volume[88695]: WARNING cinder.volume.drivers.remotefs [None req-982df2ef-e36f-40de-974f-9d8d9933970f tempest-VolumesSnapshotNegativeTestJSON-1733839629 None] /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9e382944-1d89-45ab-bc6d-5546cdfd333d.74b40334-c32f-4846-a5c8-9b65d8e42a1f is being set with open permissions: ugo+rw Aug 05 06:22:20 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-982df2ef-e36f-40de-974f-9d8d9933970f tempest-VolumesSnapshotNegativeTestJSON-1733839629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9e382944-1d89-45ab-bc6d-5546cdfd333d.74b40334-c32f-4846-a5c8-9b65d8e42a1f {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:22:20 devstack sudo[101630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9e382944-1d89-45ab-bc6d-5546cdfd333d.74b40334-c32f-4846-a5c8-9b65d8e42a1f Aug 05 06:22:20 devstack sudo[101630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:22:20 devstack sudo[101630]: pam_unix(sudo:session): session closed for user root Aug 05 06:22:20 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-982df2ef-e36f-40de-974f-9d8d9933970f tempest-VolumesSnapshotNegativeTestJSON-1733839629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9e382944-1d89-45ab-bc6d-5546cdfd333d.74b40334-c32f-4846-a5c8-9b65d8e42a1f" returned: 0 in 0.252s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:22:20 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-982df2ef-e36f-40de-974f-9d8d9933970f tempest-VolumesSnapshotNegativeTestJSON-1733839629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9e382944-1d89-45ab-bc6d-5546cdfd333d.info {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:22:20 devstack sudo[101633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9e382944-1d89-45ab-bc6d-5546cdfd333d.info Aug 05 06:22:20 devstack sudo[101633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:22:20 devstack sudo[101633]: pam_unix(sudo:session): session closed for user root Aug 05 06:22:20 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-982df2ef-e36f-40de-974f-9d8d9933970f tempest-VolumesSnapshotNegativeTestJSON-1733839629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9e382944-1d89-45ab-bc6d-5546cdfd333d.info" returned: 0 in 0.255s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:22:20 devstack cinder-volume[88695]: WARNING cinder.volume.drivers.remotefs [None req-982df2ef-e36f-40de-974f-9d8d9933970f tempest-VolumesSnapshotNegativeTestJSON-1733839629 None] /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9e382944-1d89-45ab-bc6d-5546cdfd333d.info is being set with open permissions: ugo+rw Aug 05 06:22:20 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-982df2ef-e36f-40de-974f-9d8d9933970f tempest-VolumesSnapshotNegativeTestJSON-1733839629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9e382944-1d89-45ab-bc6d-5546cdfd333d.info {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:22:20 devstack sudo[101636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9e382944-1d89-45ab-bc6d-5546cdfd333d.info Aug 05 06:22:20 devstack sudo[101636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:22:20 devstack sudo[101636]: pam_unix(sudo:session): session closed for user root Aug 05 06:22:20 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-982df2ef-e36f-40de-974f-9d8d9933970f tempest-VolumesSnapshotNegativeTestJSON-1733839629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9e382944-1d89-45ab-bc6d-5546cdfd333d.info" returned: 0 in 0.239s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:22:20 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-982df2ef-e36f-40de-974f-9d8d9933970f tempest-VolumesSnapshotNegativeTestJSON-1733839629 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.890s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:22:20 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-982df2ef-e36f-40de-974f-9d8d9933970f tempest-VolumesSnapshotNegativeTestJSON-1733839629 None] Create snapshot completed successfully Aug 05 06:22:21 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-530273ea-07fd-44e0-9d2d-f5c8ed2b9b02 tempest-VolumesSnapshotNegativeTestJSON-1733839629 None] Acquiring lock "cinder-74b40334-c32f-4846-a5c8-9b65d8e42a1f-delete_snapshot" by "delete_snapshot" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:22:21 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-530273ea-07fd-44e0-9d2d-f5c8ed2b9b02 tempest-VolumesSnapshotNegativeTestJSON-1733839629 None] Lock "cinder-74b40334-c32f-4846-a5c8-9b65d8e42a1f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:22:21 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-530273ea-07fd-44e0-9d2d-f5c8ed2b9b02 tempest-VolumesSnapshotNegativeTestJSON-1733839629 None] Acquiring lock "cinder-quobyte-9e382944-1d89-45ab-bc6d-5546cdfd333d" by "delete_snapshot" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:22:21 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-530273ea-07fd-44e0-9d2d-f5c8ed2b9b02 tempest-VolumesSnapshotNegativeTestJSON-1733839629 None] Lock "cinder-quobyte-9e382944-1d89-45ab-bc6d-5546cdfd333d" acquired by "delete_snapshot" :: waited 0.013s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:22:21 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-530273ea-07fd-44e0-9d2d-f5c8ed2b9b02 tempest-VolumesSnapshotNegativeTestJSON-1733839629 None] Acquiring lock "cinder-quobyte-74b40334-c32f-4846-a5c8-9b65d8e42a1f" by "_delete_snapshot" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:22:21 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-530273ea-07fd-44e0-9d2d-f5c8ed2b9b02 tempest-VolumesSnapshotNegativeTestJSON-1733839629 None] Lock "cinder-quobyte-74b40334-c32f-4846-a5c8-9b65d8e42a1f" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:22:21 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-530273ea-07fd-44e0-9d2d-f5c8ed2b9b02 tempest-VolumesSnapshotNegativeTestJSON-1733839629 None] Deleting offline snapshot 74b40334-c32f-4846-a5c8-9b65d8e42a1f of volume 9e382944-1d89-45ab-bc6d-5546cdfd333d {{(pid=88695) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 06:22:21 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-530273ea-07fd-44e0-9d2d-f5c8ed2b9b02 tempest-VolumesSnapshotNegativeTestJSON-1733839629 None] snapshot_file for this snap is: volume-9e382944-1d89-45ab-bc6d-5546cdfd333d.74b40334-c32f-4846-a5c8-9b65d8e42a1f {{(pid=88695) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 06:22:21 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[08e06b27-023c-45e6-b541-c36f073114f9]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:22:21 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-530273ea-07fd-44e0-9d2d-f5c8ed2b9b02 tempest-VolumesSnapshotNegativeTestJSON-1733839629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9e382944-1d89-45ab-bc6d-5546cdfd333d.74b40334-c32f-4846-a5c8-9b65d8e42a1f {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:22:21 devstack sudo[101639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9e382944-1d89-45ab-bc6d-5546cdfd333d.74b40334-c32f-4846-a5c8-9b65d8e42a1f Aug 05 06:22:21 devstack sudo[101639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:22:21 devstack sudo[101639]: pam_unix(sudo:session): session closed for user root Aug 05 06:22:21 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-530273ea-07fd-44e0-9d2d-f5c8ed2b9b02 tempest-VolumesSnapshotNegativeTestJSON-1733839629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9e382944-1d89-45ab-bc6d-5546cdfd333d.74b40334-c32f-4846-a5c8-9b65d8e42a1f" returned: 0 in 0.371s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:22:21 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-530273ea-07fd-44e0-9d2d-f5c8ed2b9b02 tempest-VolumesSnapshotNegativeTestJSON-1733839629 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9e382944-1d89-45ab-bc6d-5546cdfd333d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88695) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 06:22:21 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aa8f68c-a308-4f67-83d0-d93dd9b11d78]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:22:21 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-530273ea-07fd-44e0-9d2d-f5c8ed2b9b02 tempest-VolumesSnapshotNegativeTestJSON-1733839629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9e382944-1d89-45ab-bc6d-5546cdfd333d {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:22:21 devstack sudo[101644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9e382944-1d89-45ab-bc6d-5546cdfd333d Aug 05 06:22:21 devstack sudo[101644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:22:21 devstack sudo[101644]: pam_unix(sudo:session): session closed for user root Aug 05 06:22:21 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-530273ea-07fd-44e0-9d2d-f5c8ed2b9b02 tempest-VolumesSnapshotNegativeTestJSON-1733839629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9e382944-1d89-45ab-bc6d-5546cdfd333d" returned: 0 in 0.346s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:22:21 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-530273ea-07fd-44e0-9d2d-f5c8ed2b9b02 tempest-VolumesSnapshotNegativeTestJSON-1733839629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9e382944-1d89-45ab-bc6d-5546cdfd333d.74b40334-c32f-4846-a5c8-9b65d8e42a1f {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:22:21 devstack sudo[101649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9e382944-1d89-45ab-bc6d-5546cdfd333d.74b40334-c32f-4846-a5c8-9b65d8e42a1f Aug 05 06:22:21 devstack sudo[101649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:22:22 devstack sudo[101649]: pam_unix(sudo:session): session closed for user root Aug 05 06:22:22 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-530273ea-07fd-44e0-9d2d-f5c8ed2b9b02 tempest-VolumesSnapshotNegativeTestJSON-1733839629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9e382944-1d89-45ab-bc6d-5546cdfd333d.74b40334-c32f-4846-a5c8-9b65d8e42a1f" returned: 0 in 0.350s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:22:22 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-530273ea-07fd-44e0-9d2d-f5c8ed2b9b02 tempest-VolumesSnapshotNegativeTestJSON-1733839629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9e382944-1d89-45ab-bc6d-5546cdfd333d.74b40334-c32f-4846-a5c8-9b65d8e42a1f {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:22:22 devstack sudo[101654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9e382944-1d89-45ab-bc6d-5546cdfd333d.74b40334-c32f-4846-a5c8-9b65d8e42a1f Aug 05 06:22:22 devstack sudo[101654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:22:22 devstack sudo[101654]: pam_unix(sudo:session): session closed for user root Aug 05 06:22:22 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-530273ea-07fd-44e0-9d2d-f5c8ed2b9b02 tempest-VolumesSnapshotNegativeTestJSON-1733839629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9e382944-1d89-45ab-bc6d-5546cdfd333d.74b40334-c32f-4846-a5c8-9b65d8e42a1f" returned: 0 in 0.255s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:22:22 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-530273ea-07fd-44e0-9d2d-f5c8ed2b9b02 tempest-VolumesSnapshotNegativeTestJSON-1733839629 None] Lock "cinder-quobyte-74b40334-c32f-4846-a5c8-9b65d8e42a1f" released by "_delete_snapshot" :: held 1.428s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:22:22 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-530273ea-07fd-44e0-9d2d-f5c8ed2b9b02 tempest-VolumesSnapshotNegativeTestJSON-1733839629 None] Lock "cinder-quobyte-9e382944-1d89-45ab-bc6d-5546cdfd333d" released by "delete_snapshot" :: held 1.451s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:22:22 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-530273ea-07fd-44e0-9d2d-f5c8ed2b9b02 tempest-VolumesSnapshotNegativeTestJSON-1733839629 None] Created reservations ['fcf661ef-e364-4a4e-9300-b84606ad421b', '19da1975-830c-49e1-9504-e5703420f11c', '63287530-cd98-4b17-8596-16eb8f1969fd', 'f56cebc4-2383-42f5-9638-0716e3973095'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:22:22 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-530273ea-07fd-44e0-9d2d-f5c8ed2b9b02 tempest-VolumesSnapshotNegativeTestJSON-1733839629 None] Delete snapshot completed successfully. Aug 05 06:22:22 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-530273ea-07fd-44e0-9d2d-f5c8ed2b9b02 tempest-VolumesSnapshotNegativeTestJSON-1733839629 None] Lock "cinder-74b40334-c32f-4846-a5c8-9b65d8e42a1f-delete_snapshot" released by "delete_snapshot" :: held 1.591s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:22:23 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-9cb82efe-2c04-4926-9ad0-a19f3dd03e88 tempest-VolumesSnapshotNegativeTestJSON-1733839629 None] Acquiring lock "cinder-9e382944-1d89-45ab-bc6d-5546cdfd333d-delete_volume" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:22:23 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-9cb82efe-2c04-4926-9ad0-a19f3dd03e88 tempest-VolumesSnapshotNegativeTestJSON-1733839629 None] Lock "cinder-9e382944-1d89-45ab-bc6d-5546cdfd333d-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:22:23 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-9cb82efe-2c04-4926-9ad0-a19f3dd03e88 tempest-VolumesSnapshotNegativeTestJSON-1733839629 None] Acquiring lock "cinder-quobyte-9e382944-1d89-45ab-bc6d-5546cdfd333d" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:22:23 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-9cb82efe-2c04-4926-9ad0-a19f3dd03e88 tempest-VolumesSnapshotNegativeTestJSON-1733839629 None] Lock "cinder-quobyte-9e382944-1d89-45ab-bc6d-5546cdfd333d" acquired by "delete_volume" :: waited 0.018s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:22:23 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[501efa2c-08cb-4fce-99ac-26baf01a66bd]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:22:23 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-9cb82efe-2c04-4926-9ad0-a19f3dd03e88 tempest-VolumesSnapshotNegativeTestJSON-1733839629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9e382944-1d89-45ab-bc6d-5546cdfd333d {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:22:23 devstack sudo[101657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9e382944-1d89-45ab-bc6d-5546cdfd333d Aug 05 06:22:23 devstack sudo[101657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:22:23 devstack sudo[101657]: pam_unix(sudo:session): session closed for user root Aug 05 06:22:23 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-9cb82efe-2c04-4926-9ad0-a19f3dd03e88 tempest-VolumesSnapshotNegativeTestJSON-1733839629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9e382944-1d89-45ab-bc6d-5546cdfd333d" returned: 0 in 0.374s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:22:23 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-9cb82efe-2c04-4926-9ad0-a19f3dd03e88 tempest-VolumesSnapshotNegativeTestJSON-1733839629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9e382944-1d89-45ab-bc6d-5546cdfd333d {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:22:23 devstack sudo[101662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9e382944-1d89-45ab-bc6d-5546cdfd333d Aug 05 06:22:23 devstack sudo[101662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:22:24 devstack sudo[101662]: pam_unix(sudo:session): session closed for user root Aug 05 06:22:24 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-9cb82efe-2c04-4926-9ad0-a19f3dd03e88 tempest-VolumesSnapshotNegativeTestJSON-1733839629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9e382944-1d89-45ab-bc6d-5546cdfd333d" returned: 0 in 0.284s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:22:24 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-9cb82efe-2c04-4926-9ad0-a19f3dd03e88 tempest-VolumesSnapshotNegativeTestJSON-1733839629 None] Lock "cinder-quobyte-9e382944-1d89-45ab-bc6d-5546cdfd333d" released by "delete_volume" :: held 0.728s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:22:24 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-9cb82efe-2c04-4926-9ad0-a19f3dd03e88 tempest-VolumesSnapshotNegativeTestJSON-1733839629 None] Created reservations ['c675646f-67b4-47cb-b05d-8258356eea03', '56117de0-5094-4305-9b58-bd70d262f589', '31636dbe-b4a8-4e18-96b6-47dd8c1fd57e', 'd62fd406-fb68-462d-81be-f8b2eff4d8f3'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:22:24 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-9cb82efe-2c04-4926-9ad0-a19f3dd03e88 tempest-VolumesSnapshotNegativeTestJSON-1733839629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:22:24 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-9cb82efe-2c04-4926-9ad0-a19f3dd03e88 tempest-VolumesSnapshotNegativeTestJSON-1733839629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:22:24 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-9cb82efe-2c04-4926-9ad0-a19f3dd03e88 tempest-VolumesSnapshotNegativeTestJSON-1733839629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:22:24 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-9cb82efe-2c04-4926-9ad0-a19f3dd03e88 tempest-VolumesSnapshotNegativeTestJSON-1733839629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:22:24 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-9cb82efe-2c04-4926-9ad0-a19f3dd03e88 tempest-VolumesSnapshotNegativeTestJSON-1733839629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:22:24 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-9cb82efe-2c04-4926-9ad0-a19f3dd03e88 tempest-VolumesSnapshotNegativeTestJSON-1733839629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:22:24 devstack sudo[101665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce Aug 05 06:22:24 devstack sudo[101665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:22:24 devstack sudo[101665]: pam_unix(sudo:session): session closed for user root Aug 05 06:22:24 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-9cb82efe-2c04-4926-9ad0-a19f3dd03e88 tempest-VolumesSnapshotNegativeTestJSON-1733839629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce" returned: 0 in 0.272s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:22:24 devstack cinder-volume[88695]: DEBUG cinder.manager [None req-9cb82efe-2c04-4926-9ad0-a19f3dd03e88 tempest-VolumesSnapshotNegativeTestJSON-1733839629 None] Notifying Schedulers of capabilities ... {{(pid=88695) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 06:22:24 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-9cb82efe-2c04-4926-9ad0-a19f3dd03e88 tempest-VolumesSnapshotNegativeTestJSON-1733839629 None] Deleted volume successfully. Aug 05 06:22:24 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-9cb82efe-2c04-4926-9ad0-a19f3dd03e88 tempest-VolumesSnapshotNegativeTestJSON-1733839629 None] Lock "cinder-9e382944-1d89-45ab-bc6d-5546cdfd333d-delete_volume" released by "delete_volume" :: held 1.217s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:22:32 devstack cinder-volume[88695]: INFO cinder.volume.manager [req-5cfdfa25-ee24-49d7-9f01-4b81d490ca60 req-2945bb79-9491-4df3-962e-9c98bf9f26cc tempest-AttachVolumeNegativeTest-1368352343 None] Terminate volume connection completed successfully. Aug 05 06:22:32 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [req-5cfdfa25-ee24-49d7-9f01-4b81d490ca60 req-2945bb79-9491-4df3-962e-9c98bf9f26cc tempest-AttachVolumeNegativeTest-1368352343 None] Deleting attachment e52e0cd1-e596-409a-a5b9-a7ac309435a2. {{(pid=88695) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 05 06:22:42 devstack cinder-volume[88695]: DEBUG dbcounter [-] [88695] Writing DB stats cinder:SELECT=43,cinder:INSERT=19,cinder:UPDATE=67,cinder:DELETE=5 {{(pid=88695) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 06:22:42 devstack cinder-volume[88695]: DEBUG dbcounter [-] [88695] Writing DB stats cinder:SELECT=47,cinder:INSERT=13,cinder:UPDATE=60,cinder:DELETE=5 {{(pid=88695) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 06:22:54 devstack cinder-volume[88695]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ed9a408-92fe-4154-83ad-44b7205c75f6 tempest-TestInstancesWithCinderVolumes-74752822 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88695) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 06:22:54 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-1ed9a408-92fe-4154-83ad-44b7205c75f6 tempest-TestInstancesWithCinderVolumes-74752822 None] Flow 'volume_create_manager' (ad6a6ab3-ad34-4252-8749-656087524e60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:22:54 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-1ed9a408-92fe-4154-83ad-44b7205c75f6 tempest-TestInstancesWithCinderVolumes-74752822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53ad7848-14ab-4cc7-875c-90cb662222b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:22:54 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-1ed9a408-92fe-4154-83ad-44b7205c75f6 tempest-TestInstancesWithCinderVolumes-74752822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53ad7848-14ab-4cc7-875c-90cb662222b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:22:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-536557376',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9aae2421-130c-4aca-af18-98a124cc2b7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed18efdde4a84380b7c654cc389fabe9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:22:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:22:54Z,use_quota=True,user_id='101af7f56624495792e02850c35eab79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(570a7987-663e-49a6-9b2e-a5a483c79a1c),volume_type_id=570a7987-663e-49a6-9b2e-a5a483c79a1c)' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:22:54 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-1ed9a408-92fe-4154-83ad-44b7205c75f6 tempest-TestInstancesWithCinderVolumes-74752822 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd03b510-6457-4cd7-9468-250e062e2284) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:22:54 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-1ed9a408-92fe-4154-83ad-44b7205c75f6 tempest-TestInstancesWithCinderVolumes-74752822 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd03b510-6457-4cd7-9468-250e062e2284) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:22:54 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-1ed9a408-92fe-4154-83ad-44b7205c75f6 tempest-TestInstancesWithCinderVolumes-74752822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b964498-7cdd-4f92-83c3-2eb5c010f835) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:22:54 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-1ed9a408-92fe-4154-83ad-44b7205c75f6 tempest-TestInstancesWithCinderVolumes-74752822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b964498-7cdd-4f92-83c3-2eb5c010f835) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9aae2421-130c-4aca-af18-98a124cc2b7e', 'volume_name': 'volume-9aae2421-130c-4aca-af18-98a124cc2b7e', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:22:54 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-1ed9a408-92fe-4154-83ad-44b7205c75f6 tempest-TestInstancesWithCinderVolumes-74752822 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea459b84-3133-4c1f-80e2-24c30b4b56b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:22:54 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-1ed9a408-92fe-4154-83ad-44b7205c75f6 tempest-TestInstancesWithCinderVolumes-74752822 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea459b84-3133-4c1f-80e2-24c30b4b56b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:22:54 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-1ed9a408-92fe-4154-83ad-44b7205c75f6 tempest-TestInstancesWithCinderVolumes-74752822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd8aeb87-9eb1-408f-aa29-78108422582c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:22:54 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-1ed9a408-92fe-4154-83ad-44b7205c75f6 tempest-TestInstancesWithCinderVolumes-74752822 None] Volume 9aae2421-130c-4aca-af18-98a124cc2b7e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9aae2421-130c-4aca-af18-98a124cc2b7e', 'volume_size': 1} Aug 05 06:22:54 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-1ed9a408-92fe-4154-83ad-44b7205c75f6 tempest-TestInstancesWithCinderVolumes-74752822 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:22:54 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-1ed9a408-92fe-4154-83ad-44b7205c75f6 tempest-TestInstancesWithCinderVolumes-74752822 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:22:54 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-1ed9a408-92fe-4154-83ad-44b7205c75f6 tempest-TestInstancesWithCinderVolumes-74752822 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:22:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-536557376',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9aae2421-130c-4aca-af18-98a124cc2b7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed18efdde4a84380b7c654cc389fabe9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:22:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:22:54Z,use_quota=True,user_id='101af7f56624495792e02850c35eab79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(570a7987-663e-49a6-9b2e-a5a483c79a1c),volume_type_id=570a7987-663e-49a6-9b2e-a5a483c79a1c)}" {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 06:22:54 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-1ed9a408-92fe-4154-83ad-44b7205c75f6 tempest-TestInstancesWithCinderVolumes-74752822 None] Creating volume 9aae2421-130c-4aca-af18-98a124cc2b7e {{(pid=88695) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 06:22:54 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-1ed9a408-92fe-4154-83ad-44b7205c75f6 tempest-TestInstancesWithCinderVolumes-74752822 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:22:54 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-1ed9a408-92fe-4154-83ad-44b7205c75f6 tempest-TestInstancesWithCinderVolumes-74752822 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:22:54 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-1ed9a408-92fe-4154-83ad-44b7205c75f6 tempest-TestInstancesWithCinderVolumes-74752822 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:22:54 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-1ed9a408-92fe-4154-83ad-44b7205c75f6 tempest-TestInstancesWithCinderVolumes-74752822 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:22:54 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-1ed9a408-92fe-4154-83ad-44b7205c75f6 tempest-TestInstancesWithCinderVolumes-74752822 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:22:54 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-1ed9a408-92fe-4154-83ad-44b7205c75f6 tempest-TestInstancesWithCinderVolumes-74752822 None] Selected osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 as target Quobyte volume. {{(pid=88695) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 06:22:54 devstack cinder-volume[88695]: INFO cinder.volume.drivers.remotefs [None req-1ed9a408-92fe-4154-83ad-44b7205c75f6 tempest-TestInstancesWithCinderVolumes-74752822 None] casted to osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 Aug 05 06:22:54 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-1ed9a408-92fe-4154-83ad-44b7205c75f6 tempest-TestInstancesWithCinderVolumes-74752822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9aae2421-130c-4aca-af18-98a124cc2b7e 1073741824 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:22:54 devstack sudo[101892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9aae2421-130c-4aca-af18-98a124cc2b7e 1073741824 Aug 05 06:22:54 devstack sudo[101892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:22:54 devstack cinder-volume[88695]: DEBUG cinder.volume.flows.manager.create_volume [None req-747ba597-c218-48a6-b6a4-444dc72aea3c tempest-TestInstancesWithCinderVolumes-74752822 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88695) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 06:22:54 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-747ba597-c218-48a6-b6a4-444dc72aea3c tempest-TestInstancesWithCinderVolumes-74752822 None] Flow 'volume_create_manager' (b6597542-8afa-4103-bd67-dda435239698) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:22:54 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-747ba597-c218-48a6-b6a4-444dc72aea3c tempest-TestInstancesWithCinderVolumes-74752822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0ad33f1-1765-4307-9199-d230f64d859d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:22:54 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-747ba597-c218-48a6-b6a4-444dc72aea3c tempest-TestInstancesWithCinderVolumes-74752822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0ad33f1-1765-4307-9199-d230f64d859d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:22:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-542960843',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e294a7ba-44ca-4a90-8641-f713a9548ef4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed18efdde4a84380b7c654cc389fabe9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:22:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:22:55Z,use_quota=True,user_id='101af7f56624495792e02850c35eab79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca77f7cb-6caf-4dee-a00a-5a66f2324e4e),volume_type_id=ca77f7cb-6caf-4dee-a00a-5a66f2324e4e)' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:22:54 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-747ba597-c218-48a6-b6a4-444dc72aea3c tempest-TestInstancesWithCinderVolumes-74752822 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8cc64d7c-6351-4456-9ba5-bb801c24d0f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:22:54 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-747ba597-c218-48a6-b6a4-444dc72aea3c tempest-TestInstancesWithCinderVolumes-74752822 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8cc64d7c-6351-4456-9ba5-bb801c24d0f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:22:54 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-747ba597-c218-48a6-b6a4-444dc72aea3c tempest-TestInstancesWithCinderVolumes-74752822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b155e84-5a06-4b33-b405-43367f943c11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:22:54 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-747ba597-c218-48a6-b6a4-444dc72aea3c tempest-TestInstancesWithCinderVolumes-74752822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b155e84-5a06-4b33-b405-43367f943c11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e294a7ba-44ca-4a90-8641-f713a9548ef4', 'volume_name': 'volume-e294a7ba-44ca-4a90-8641-f713a9548ef4', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:22:54 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-747ba597-c218-48a6-b6a4-444dc72aea3c tempest-TestInstancesWithCinderVolumes-74752822 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (744bfa93-0f76-4502-93cd-b4d6e74c40fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:22:54 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-747ba597-c218-48a6-b6a4-444dc72aea3c tempest-TestInstancesWithCinderVolumes-74752822 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (744bfa93-0f76-4502-93cd-b4d6e74c40fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:22:54 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-747ba597-c218-48a6-b6a4-444dc72aea3c tempest-TestInstancesWithCinderVolumes-74752822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3555a88-70f6-4a42-94ae-634936c16b5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:22:54 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-747ba597-c218-48a6-b6a4-444dc72aea3c tempest-TestInstancesWithCinderVolumes-74752822 None] Volume e294a7ba-44ca-4a90-8641-f713a9548ef4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e294a7ba-44ca-4a90-8641-f713a9548ef4', 'volume_size': 1} Aug 05 06:22:54 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-747ba597-c218-48a6-b6a4-444dc72aea3c tempest-TestInstancesWithCinderVolumes-74752822 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:22:55 devstack sudo[101892]: pam_unix(sudo:session): session closed for user root Aug 05 06:22:55 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-1ed9a408-92fe-4154-83ad-44b7205c75f6 tempest-TestInstancesWithCinderVolumes-74752822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9aae2421-130c-4aca-af18-98a124cc2b7e 1073741824" returned: 0 in 0.603s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:22:55 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-1ed9a408-92fe-4154-83ad-44b7205c75f6 tempest-TestInstancesWithCinderVolumes-74752822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9aae2421-130c-4aca-af18-98a124cc2b7e {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:22:55 devstack sudo[101898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9aae2421-130c-4aca-af18-98a124cc2b7e Aug 05 06:22:55 devstack sudo[101898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:22:55 devstack sudo[101898]: pam_unix(sudo:session): session closed for user root Aug 05 06:22:55 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-1ed9a408-92fe-4154-83ad-44b7205c75f6 tempest-TestInstancesWithCinderVolumes-74752822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9aae2421-130c-4aca-af18-98a124cc2b7e" returned: 0 in 0.276s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:22:55 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-1ed9a408-92fe-4154-83ad-44b7205c75f6 tempest-TestInstancesWithCinderVolumes-74752822 None] <== create_volume: return (1001ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'} {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 06:22:55 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-1ed9a408-92fe-4154-83ad-44b7205c75f6 tempest-TestInstancesWithCinderVolumes-74752822 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.003s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:22:55 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-747ba597-c218-48a6-b6a4-444dc72aea3c tempest-TestInstancesWithCinderVolumes-74752822 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.526s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:22:55 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-747ba597-c218-48a6-b6a4-444dc72aea3c tempest-TestInstancesWithCinderVolumes-74752822 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:22:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-542960843',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e294a7ba-44ca-4a90-8641-f713a9548ef4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed18efdde4a84380b7c654cc389fabe9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:22:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:22:55Z,use_quota=True,user_id='101af7f56624495792e02850c35eab79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca77f7cb-6caf-4dee-a00a-5a66f2324e4e),volume_type_id=ca77f7cb-6caf-4dee-a00a-5a66f2324e4e)}" {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 06:22:55 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-747ba597-c218-48a6-b6a4-444dc72aea3c tempest-TestInstancesWithCinderVolumes-74752822 None] Creating volume e294a7ba-44ca-4a90-8641-f713a9548ef4 {{(pid=88695) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 06:22:55 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-747ba597-c218-48a6-b6a4-444dc72aea3c tempest-TestInstancesWithCinderVolumes-74752822 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:22:55 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-747ba597-c218-48a6-b6a4-444dc72aea3c tempest-TestInstancesWithCinderVolumes-74752822 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:22:55 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-747ba597-c218-48a6-b6a4-444dc72aea3c tempest-TestInstancesWithCinderVolumes-74752822 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:22:55 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-747ba597-c218-48a6-b6a4-444dc72aea3c tempest-TestInstancesWithCinderVolumes-74752822 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:22:55 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-747ba597-c218-48a6-b6a4-444dc72aea3c tempest-TestInstancesWithCinderVolumes-74752822 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:22:55 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-747ba597-c218-48a6-b6a4-444dc72aea3c tempest-TestInstancesWithCinderVolumes-74752822 None] Selected osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 as target Quobyte volume. {{(pid=88695) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 06:22:55 devstack cinder-volume[88695]: INFO cinder.volume.drivers.remotefs [None req-747ba597-c218-48a6-b6a4-444dc72aea3c tempest-TestInstancesWithCinderVolumes-74752822 None] casted to osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 Aug 05 06:22:55 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-747ba597-c218-48a6-b6a4-444dc72aea3c tempest-TestInstancesWithCinderVolumes-74752822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-e294a7ba-44ca-4a90-8641-f713a9548ef4 1073741824 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:22:55 devstack sudo[101901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-e294a7ba-44ca-4a90-8641-f713a9548ef4 1073741824 Aug 05 06:22:55 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-1ed9a408-92fe-4154-83ad-44b7205c75f6 tempest-TestInstancesWithCinderVolumes-74752822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd8aeb87-9eb1-408f-aa29-78108422582c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9aae2421-130c-4aca-af18-98a124cc2b7e', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:22:55 devstack sudo[101901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:22:55 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-1ed9a408-92fe-4154-83ad-44b7205c75f6 tempest-TestInstancesWithCinderVolumes-74752822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b8b9aa3-5633-42c0-9cc5-747d561af93c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:22:55 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-1ed9a408-92fe-4154-83ad-44b7205c75f6 tempest-TestInstancesWithCinderVolumes-74752822 None] Volume volume-9aae2421-130c-4aca-af18-98a124cc2b7e (9aae2421-130c-4aca-af18-98a124cc2b7e): created successfully Aug 05 06:22:55 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-1ed9a408-92fe-4154-83ad-44b7205c75f6 tempest-TestInstancesWithCinderVolumes-74752822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b8b9aa3-5633-42c0-9cc5-747d561af93c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:22:55 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-1ed9a408-92fe-4154-83ad-44b7205c75f6 tempest-TestInstancesWithCinderVolumes-74752822 None] Flow 'volume_create_manager' (ad6a6ab3-ad34-4252-8749-656087524e60) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:22:55 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-1ed9a408-92fe-4154-83ad-44b7205c75f6 tempest-TestInstancesWithCinderVolumes-74752822 None] Created volume successfully. Aug 05 06:22:55 devstack cinder-volume[88695]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2bb64d6-a3ff-4573-a4e0-73d5795733bd tempest-TestInstancesWithCinderVolumes-74752822 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88695) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 06:22:55 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-e2bb64d6-a3ff-4573-a4e0-73d5795733bd tempest-TestInstancesWithCinderVolumes-74752822 None] Flow 'volume_create_manager' (fb9f64d6-534e-40b7-b28e-730911c27717) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:22:55 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-e2bb64d6-a3ff-4573-a4e0-73d5795733bd tempest-TestInstancesWithCinderVolumes-74752822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38ca7aff-c2ba-45f5-bbd6-f9e4b6f0ff64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:22:55 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-e2bb64d6-a3ff-4573-a4e0-73d5795733bd tempest-TestInstancesWithCinderVolumes-74752822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38ca7aff-c2ba-45f5-bbd6-f9e4b6f0ff64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:22:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1471577314',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3e73e77-1d10-4f48-a416-2c9a8555c137,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed18efdde4a84380b7c654cc389fabe9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:22:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:22:56Z,use_quota=True,user_id='101af7f56624495792e02850c35eab79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ec5f2f6-1377-4e42-97bc-7963f3479f20),volume_type_id=2ec5f2f6-1377-4e42-97bc-7963f3479f20)' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:22:55 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-e2bb64d6-a3ff-4573-a4e0-73d5795733bd tempest-TestInstancesWithCinderVolumes-74752822 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f64834e-0ffa-4108-9be9-a962b1a6f9b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:22:55 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-e2bb64d6-a3ff-4573-a4e0-73d5795733bd tempest-TestInstancesWithCinderVolumes-74752822 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f64834e-0ffa-4108-9be9-a962b1a6f9b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:22:55 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-e2bb64d6-a3ff-4573-a4e0-73d5795733bd tempest-TestInstancesWithCinderVolumes-74752822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f43d6aec-aa76-471e-b4ae-1214e888636b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:22:55 devstack cinder-volume[88695]: DEBUG cinder.image.glance [None req-e2bb64d6-a3ff-4573-a4e0-73d5795733bd tempest-TestInstancesWithCinderVolumes-74752822 None] Creating Keystone auth plugin from conf {{(pid=88695) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 05 06:22:55 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-e2bb64d6-a3ff-4573-a4e0-73d5795733bd tempest-TestInstancesWithCinderVolumes-74752822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f43d6aec-aa76-471e-b4ae-1214e888636b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f3e73e77-1d10-4f48-a416-2c9a8555c137', 'volume_name': 'volume-f3e73e77-1d10-4f48-a416-2c9a8555c137', 'volume_size': 1, 'image_id': 'e63da8da-ff94-4a77-a138-f074f83beb91', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e63da8da-ff94-4a77-a138-f074f83beb91', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--2101754160', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ed18efdde4a84380b7c654cc389fabe9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e63da8da-ff94-4a77-a138-f074f83beb91', 'created_at': datetime.datetime(2026, 8, 5, 4, 22, 52, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 5, 4, 22, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e63da8da-ff94-4a77-a138-f074f83beb91/file', 'properties': {}}, 'image_service': }' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:22:55 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-e2bb64d6-a3ff-4573-a4e0-73d5795733bd tempest-TestInstancesWithCinderVolumes-74752822 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d61c5f7-b14b-4629-9252-61faba525ff1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:22:55 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-e2bb64d6-a3ff-4573-a4e0-73d5795733bd tempest-TestInstancesWithCinderVolumes-74752822 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d61c5f7-b14b-4629-9252-61faba525ff1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:22:56 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-e2bb64d6-a3ff-4573-a4e0-73d5795733bd tempest-TestInstancesWithCinderVolumes-74752822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ce3830b-a65f-4a61-88b1-699f9ba8ae63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:22:56 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-e2bb64d6-a3ff-4573-a4e0-73d5795733bd tempest-TestInstancesWithCinderVolumes-74752822 None] Volume f3e73e77-1d10-4f48-a416-2c9a8555c137: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f3e73e77-1d10-4f48-a416-2c9a8555c137', 'volume_size': 1, 'image_id': 'e63da8da-ff94-4a77-a138-f074f83beb91', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e63da8da-ff94-4a77-a138-f074f83beb91', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--2101754160', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ed18efdde4a84380b7c654cc389fabe9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e63da8da-ff94-4a77-a138-f074f83beb91', 'created_at': datetime.datetime(2026, 8, 5, 4, 22, 52, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 5, 4, 22, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e63da8da-ff94-4a77-a138-f074f83beb91/file', 'properties': {}}, 'image_service': } Aug 05 06:22:56 devstack cinder-volume[88695]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2bb64d6-a3ff-4573-a4e0-73d5795733bd tempest-TestInstancesWithCinderVolumes-74752822 None] Trying to clone f3e73e77-1d10-4f48-a416-2c9a8555c137 from image e63da8da-ff94-4a77-a138-f074f83beb91 at location (None, [{'url': 'file:///opt/stack/data/glance/images/e63da8da-ff94-4a77-a138-f074f83beb91', 'metadata': {}}]). {{(pid=88695) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 05 06:22:56 devstack sudo[101901]: pam_unix(sudo:session): session closed for user root Aug 05 06:22:56 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-747ba597-c218-48a6-b6a4-444dc72aea3c tempest-TestInstancesWithCinderVolumes-74752822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-e294a7ba-44ca-4a90-8641-f713a9548ef4 1073741824" returned: 0 in 0.517s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:22:56 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-747ba597-c218-48a6-b6a4-444dc72aea3c tempest-TestInstancesWithCinderVolumes-74752822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-e294a7ba-44ca-4a90-8641-f713a9548ef4 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:22:56 devstack sudo[101907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-e294a7ba-44ca-4a90-8641-f713a9548ef4 Aug 05 06:22:56 devstack sudo[101907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:22:56 devstack sudo[101907]: pam_unix(sudo:session): session closed for user root Aug 05 06:22:56 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-747ba597-c218-48a6-b6a4-444dc72aea3c tempest-TestInstancesWithCinderVolumes-74752822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-e294a7ba-44ca-4a90-8641-f713a9548ef4" returned: 0 in 0.304s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:22:56 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-747ba597-c218-48a6-b6a4-444dc72aea3c tempest-TestInstancesWithCinderVolumes-74752822 None] <== create_volume: return (875ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'} {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 06:22:56 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-747ba597-c218-48a6-b6a4-444dc72aea3c tempest-TestInstancesWithCinderVolumes-74752822 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.878s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:22:56 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-747ba597-c218-48a6-b6a4-444dc72aea3c tempest-TestInstancesWithCinderVolumes-74752822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3555a88-70f6-4a42-94ae-634936c16b5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e294a7ba-44ca-4a90-8641-f713a9548ef4', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:22:56 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-747ba597-c218-48a6-b6a4-444dc72aea3c tempest-TestInstancesWithCinderVolumes-74752822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce0dc81a-3e2d-4cbc-bf5b-ef7fd89f837f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:22:56 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-747ba597-c218-48a6-b6a4-444dc72aea3c tempest-TestInstancesWithCinderVolumes-74752822 None] Volume volume-e294a7ba-44ca-4a90-8641-f713a9548ef4 (e294a7ba-44ca-4a90-8641-f713a9548ef4): created successfully Aug 05 06:22:56 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-747ba597-c218-48a6-b6a4-444dc72aea3c tempest-TestInstancesWithCinderVolumes-74752822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce0dc81a-3e2d-4cbc-bf5b-ef7fd89f837f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:22:56 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-747ba597-c218-48a6-b6a4-444dc72aea3c tempest-TestInstancesWithCinderVolumes-74752822 None] Flow 'volume_create_manager' (b6597542-8afa-4103-bd67-dda435239698) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:22:56 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-747ba597-c218-48a6-b6a4-444dc72aea3c tempest-TestInstancesWithCinderVolumes-74752822 None] Created volume successfully. Aug 05 06:22:59 devstack cinder-volume[88695]: DEBUG cinder.image.image_utils [None req-e2bb64d6-a3ff-4573-a4e0-73d5795733bd tempest-TestInstancesWithCinderVolumes-74752822 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_e63da8da-ff94-4a77-a138-f074f83beb91_2jrjjjp8devstack@QuobyteHD, size 20.69 MB, duration 3.13 sec {{(pid=88695) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 05 06:22:59 devstack cinder-volume[88695]: INFO cinder.image.image_utils [None req-e2bb64d6-a3ff-4573-a4e0-73d5795733bd tempest-TestInstancesWithCinderVolumes-74752822 None] Image download 20.69 MB at 6.60 MB/s Aug 05 06:22:59 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[a226873d-6f02-49c9-a6a6-7b893bf6d296]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:22:59 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-e2bb64d6-a3ff-4573-a4e0-73d5795733bd tempest-TestInstancesWithCinderVolumes-74752822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e63da8da-ff94-4a77-a138-f074f83beb91_2jrjjjp8devstack@QuobyteHD {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:22:59 devstack sudo[101926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e63da8da-ff94-4a77-a138-f074f83beb91_2jrjjjp8devstack@QuobyteHD Aug 05 06:22:59 devstack sudo[101926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:22:59 devstack sudo[101926]: pam_unix(sudo:session): session closed for user root Aug 05 06:22:59 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-e2bb64d6-a3ff-4573-a4e0-73d5795733bd tempest-TestInstancesWithCinderVolumes-74752822 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e63da8da-ff94-4a77-a138-f074f83beb91_2jrjjjp8devstack@QuobyteHD" returned: 0 in 0.342s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:22:59 devstack cinder-volume[88695]: DEBUG cinder.image.image_utils [None req-e2bb64d6-a3ff-4573-a4e0-73d5795733bd tempest-TestInstancesWithCinderVolumes-74752822 None] Temporary image e63da8da-ff94-4a77-a138-f074f83beb91 is fetched for user 101af7f56624495792e02850c35eab79. {{(pid=88695) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 05 06:22:59 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f948889-4ae8-41f0-8572-06735e46abe7]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:22:59 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-e2bb64d6-a3ff-4573-a4e0-73d5795733bd tempest-TestInstancesWithCinderVolumes-74752822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e63da8da-ff94-4a77-a138-f074f83beb91_2jrjjjp8devstack@QuobyteHD {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:22:59 devstack sudo[101931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e63da8da-ff94-4a77-a138-f074f83beb91_2jrjjjp8devstack@QuobyteHD Aug 05 06:22:59 devstack sudo[101931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:22:59 devstack sudo[101931]: pam_unix(sudo:session): session closed for user root Aug 05 06:22:59 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-e2bb64d6-a3ff-4573-a4e0-73d5795733bd tempest-TestInstancesWithCinderVolumes-74752822 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e63da8da-ff94-4a77-a138-f074f83beb91_2jrjjjp8devstack@QuobyteHD" returned: 0 in 0.330s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:22:59 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-e2bb64d6-a3ff-4573-a4e0-73d5795733bd tempest-TestInstancesWithCinderVolumes-74752822 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:22:59 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-e2bb64d6-a3ff-4573-a4e0-73d5795733bd tempest-TestInstancesWithCinderVolumes-74752822 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:22:59 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-e2bb64d6-a3ff-4573-a4e0-73d5795733bd tempest-TestInstancesWithCinderVolumes-74752822 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:22:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1471577314',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3e73e77-1d10-4f48-a416-2c9a8555c137,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed18efdde4a84380b7c654cc389fabe9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:22:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:22:56Z,use_quota=True,user_id='101af7f56624495792e02850c35eab79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ec5f2f6-1377-4e42-97bc-7963f3479f20),volume_type_id=2ec5f2f6-1377-4e42-97bc-7963f3479f20)}" {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 06:22:59 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-e2bb64d6-a3ff-4573-a4e0-73d5795733bd tempest-TestInstancesWithCinderVolumes-74752822 None] Creating volume f3e73e77-1d10-4f48-a416-2c9a8555c137 {{(pid=88695) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 06:22:59 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-e2bb64d6-a3ff-4573-a4e0-73d5795733bd tempest-TestInstancesWithCinderVolumes-74752822 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:22:59 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-e2bb64d6-a3ff-4573-a4e0-73d5795733bd tempest-TestInstancesWithCinderVolumes-74752822 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:22:59 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-e2bb64d6-a3ff-4573-a4e0-73d5795733bd tempest-TestInstancesWithCinderVolumes-74752822 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:22:59 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-e2bb64d6-a3ff-4573-a4e0-73d5795733bd tempest-TestInstancesWithCinderVolumes-74752822 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:22:59 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-e2bb64d6-a3ff-4573-a4e0-73d5795733bd tempest-TestInstancesWithCinderVolumes-74752822 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:22:59 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-e2bb64d6-a3ff-4573-a4e0-73d5795733bd tempest-TestInstancesWithCinderVolumes-74752822 None] Selected osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 as target Quobyte volume. {{(pid=88695) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 06:22:59 devstack cinder-volume[88695]: INFO cinder.volume.drivers.remotefs [None req-e2bb64d6-a3ff-4573-a4e0-73d5795733bd tempest-TestInstancesWithCinderVolumes-74752822 None] casted to osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 Aug 05 06:22:59 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-e2bb64d6-a3ff-4573-a4e0-73d5795733bd tempest-TestInstancesWithCinderVolumes-74752822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-f3e73e77-1d10-4f48-a416-2c9a8555c137 1073741824 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:22:59 devstack sudo[101936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-f3e73e77-1d10-4f48-a416-2c9a8555c137 1073741824 Aug 05 06:22:59 devstack sudo[101936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:23:00 devstack sudo[101936]: pam_unix(sudo:session): session closed for user root Aug 05 06:23:00 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-e2bb64d6-a3ff-4573-a4e0-73d5795733bd tempest-TestInstancesWithCinderVolumes-74752822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-f3e73e77-1d10-4f48-a416-2c9a8555c137 1073741824" returned: 0 in 0.408s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:23:00 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-e2bb64d6-a3ff-4573-a4e0-73d5795733bd tempest-TestInstancesWithCinderVolumes-74752822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-f3e73e77-1d10-4f48-a416-2c9a8555c137 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:23:00 devstack cinder-volume[88695]: DEBUG oslo_service.periodic_task [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88695) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 06:23:00 devstack sudo[101942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-f3e73e77-1d10-4f48-a416-2c9a8555c137 Aug 05 06:23:00 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:23:00 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:23:00 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:23:00 devstack sudo[101942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:23:00 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:23:00 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:23:00 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:23:00 devstack sudo[101944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce Aug 05 06:23:00 devstack sudo[101944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:23:00 devstack sudo[101942]: pam_unix(sudo:session): session closed for user root Aug 05 06:23:00 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-e2bb64d6-a3ff-4573-a4e0-73d5795733bd tempest-TestInstancesWithCinderVolumes-74752822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-f3e73e77-1d10-4f48-a416-2c9a8555c137" returned: 0 in 0.254s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:23:00 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-e2bb64d6-a3ff-4573-a4e0-73d5795733bd tempest-TestInstancesWithCinderVolumes-74752822 None] <== create_volume: return (701ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'} {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 06:23:00 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-e2bb64d6-a3ff-4573-a4e0-73d5795733bd tempest-TestInstancesWithCinderVolumes-74752822 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.704s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:23:00 devstack sudo[101944]: pam_unix(sudo:session): session closed for user root Aug 05 06:23:00 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce" returned: 0 in 0.246s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:23:00 devstack cinder-volume[88695]: DEBUG cinder.manager [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] Notifying Schedulers of capabilities ... {{(pid=88695) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 06:23:00 devstack cinder-volume[88695]: DEBUG cinder.volume.volume_utils [None req-e2bb64d6-a3ff-4573-a4e0-73d5795733bd tempest-TestInstancesWithCinderVolumes-74752822 None] Attempting download of e63da8da-ff94-4a77-a138-f074f83beb91 ((None, [{'url': 'file:///opt/stack/data/glance/images/e63da8da-ff94-4a77-a138-f074f83beb91', 'metadata': {}}])) to volume f3e73e77-1d10-4f48-a416-2c9a8555c137. {{(pid=88695) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 05 06:23:00 devstack cinder-volume[88695]: DEBUG oslo_service.periodic_task [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] Running periodic task VolumeManager._thread_info {{(pid=88695) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 06:23:00 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] thread count: 28 {{(pid=88695) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 05 06:23:00 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] thread info: [<_MainThread(MainThread, started 134469211893888)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88695) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 05 06:23:00 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc39fb09-4793-4ae3-ac06-1f9c7e15194e]: (4, 'raw') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:23:00 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-e2bb64d6-a3ff-4573-a4e0-73d5795733bd tempest-TestInstancesWithCinderVolumes-74752822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e63da8da-ff94-4a77-a138-f074f83beb91_8fd_9sl3 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:23:00 devstack sudo[101948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e63da8da-ff94-4a77-a138-f074f83beb91_8fd_9sl3 Aug 05 06:23:00 devstack sudo[101948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:23:01 devstack sudo[101948]: pam_unix(sudo:session): session closed for user root Aug 05 06:23:01 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-e2bb64d6-a3ff-4573-a4e0-73d5795733bd tempest-TestInstancesWithCinderVolumes-74752822 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e63da8da-ff94-4a77-a138-f074f83beb91_8fd_9sl3" returned: 0 in 0.324s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:23:01 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-e2bb64d6-a3ff-4573-a4e0-73d5795733bd tempest-TestInstancesWithCinderVolumes-74752822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e63da8da-ff94-4a77-a138-f074f83beb91_8fd_9sl3 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:23:01 devstack sudo[101952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e63da8da-ff94-4a77-a138-f074f83beb91_8fd_9sl3 Aug 05 06:23:01 devstack sudo[101952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:23:01 devstack sudo[101952]: pam_unix(sudo:session): session closed for user root Aug 05 06:23:01 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-e2bb64d6-a3ff-4573-a4e0-73d5795733bd tempest-TestInstancesWithCinderVolumes-74752822 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e63da8da-ff94-4a77-a138-f074f83beb91_8fd_9sl3" returned: 1 in 0.327s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:23:01 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-e2bb64d6-a3ff-4573-a4e0-73d5795733bd tempest-TestInstancesWithCinderVolumes-74752822 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e63da8da-ff94-4a77-a138-f074f83beb91_8fd_9sl3' failed. Not Retrying. {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 05 06:23:01 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd1dbc12-cbfc-4fa2-9760-3393b12ac2a8]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:23:01 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-e2bb64d6-a3ff-4573-a4e0-73d5795733bd tempest-TestInstancesWithCinderVolumes-74752822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e63da8da-ff94-4a77-a138-f074f83beb91_2jrjjjp8devstack@QuobyteHD {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:23:01 devstack sudo[101956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e63da8da-ff94-4a77-a138-f074f83beb91_2jrjjjp8devstack@QuobyteHD Aug 05 06:23:01 devstack sudo[101956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:23:01 devstack sudo[101956]: pam_unix(sudo:session): session closed for user root Aug 05 06:23:01 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-e2bb64d6-a3ff-4573-a4e0-73d5795733bd tempest-TestInstancesWithCinderVolumes-74752822 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e63da8da-ff94-4a77-a138-f074f83beb91_2jrjjjp8devstack@QuobyteHD" returned: 0 in 0.340s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:23:01 devstack cinder-volume[88695]: DEBUG cinder.image.image_utils [None req-e2bb64d6-a3ff-4573-a4e0-73d5795733bd tempest-TestInstancesWithCinderVolumes-74752822 None] e63da8da-ff94-4a77-a138-f074f83beb91 was qcow2, converting to qcow2 {{(pid=88695) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 05 06:23:01 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-e2bb64d6-a3ff-4573-a4e0-73d5795733bd tempest-TestInstancesWithCinderVolumes-74752822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e63da8da-ff94-4a77-a138-f074f83beb91_2jrjjjp8devstack@QuobyteHD /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-f3e73e77-1d10-4f48-a416-2c9a8555c137 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:23:01 devstack sudo[101962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e63da8da-ff94-4a77-a138-f074f83beb91_2jrjjjp8devstack@QuobyteHD /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-f3e73e77-1d10-4f48-a416-2c9a8555c137 Aug 05 06:23:01 devstack sudo[101962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:23:03 devstack sudo[101962]: pam_unix(sudo:session): session closed for user root Aug 05 06:23:03 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-e2bb64d6-a3ff-4573-a4e0-73d5795733bd tempest-TestInstancesWithCinderVolumes-74752822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e63da8da-ff94-4a77-a138-f074f83beb91_2jrjjjp8devstack@QuobyteHD /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-f3e73e77-1d10-4f48-a416-2c9a8555c137" returned: 0 in 1.685s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:23:03 devstack cinder-volume[88695]: DEBUG cinder.image.image_utils [None req-e2bb64d6-a3ff-4573-a4e0-73d5795733bd tempest-TestInstancesWithCinderVolumes-74752822 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_e63da8da-ff94-4a77-a138-f074f83beb91_2jrjjjp8devstack@QuobyteHD, size 112.00 MB, duration 1.69 sec, destination /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-f3e73e77-1d10-4f48-a416-2c9a8555c137 {{(pid=88695) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 05 06:23:03 devstack cinder-volume[88695]: INFO cinder.image.image_utils [None req-e2bb64d6-a3ff-4573-a4e0-73d5795733bd tempest-TestInstancesWithCinderVolumes-74752822 None] Converted 112.00 MB image at 66.40 MB/s Aug 05 06:23:03 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-e2bb64d6-a3ff-4573-a4e0-73d5795733bd tempest-TestInstancesWithCinderVolumes-74752822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-f3e73e77-1d10-4f48-a416-2c9a8555c137 1G {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:23:03 devstack sudo[101982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-f3e73e77-1d10-4f48-a416-2c9a8555c137 1G Aug 05 06:23:03 devstack sudo[101982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:23:03 devstack sudo[101982]: pam_unix(sudo:session): session closed for user root Aug 05 06:23:03 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-e2bb64d6-a3ff-4573-a4e0-73d5795733bd tempest-TestInstancesWithCinderVolumes-74752822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-f3e73e77-1d10-4f48-a416-2c9a8555c137 1G" returned: 0 in 0.342s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:23:03 devstack cinder-volume[88695]: DEBUG cinder.volume.volume_utils [None req-e2bb64d6-a3ff-4573-a4e0-73d5795733bd tempest-TestInstancesWithCinderVolumes-74752822 None] Downloaded image e63da8da-ff94-4a77-a138-f074f83beb91 ((None, [{'url': 'file:///opt/stack/data/glance/images/e63da8da-ff94-4a77-a138-f074f83beb91', 'metadata': {}}])) to volume f3e73e77-1d10-4f48-a416-2c9a8555c137 successfully. {{(pid=88695) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 05 06:23:03 devstack cinder-volume[88695]: DEBUG cinder.image.image_utils [None req-e2bb64d6-a3ff-4573-a4e0-73d5795733bd tempest-TestInstancesWithCinderVolumes-74752822 None] Temporary image e63da8da-ff94-4a77-a138-f074f83beb91 for user 101af7f56624495792e02850c35eab79 is deleted. {{(pid=88695) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 05 06:23:03 devstack cinder-volume[88695]: DEBUG cinder.volume.volume_utils [None req-e2bb64d6-a3ff-4573-a4e0-73d5795733bd tempest-TestInstancesWithCinderVolumes-74752822 None] Marking volume f3e73e77-1d10-4f48-a416-2c9a8555c137 as bootable. {{(pid=88695) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 05 06:23:03 devstack cinder-volume[88695]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2bb64d6-a3ff-4573-a4e0-73d5795733bd tempest-TestInstancesWithCinderVolumes-74752822 None] Copying metadata from image e63da8da-ff94-4a77-a138-f074f83beb91 to f3e73e77-1d10-4f48-a416-2c9a8555c137. {{(pid=88695) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 05 06:23:03 devstack cinder-volume[88695]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2bb64d6-a3ff-4573-a4e0-73d5795733bd tempest-TestInstancesWithCinderVolumes-74752822 None] Creating volume glance metadata for volume f3e73e77-1d10-4f48-a416-2c9a8555c137 backed by image e63da8da-ff94-4a77-a138-f074f83beb91 with: {'image_id': 'e63da8da-ff94-4a77-a138-f074f83beb91', 'image_name': 'tempest-scenario-img--2101754160', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88695) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 05 06:23:03 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-e2bb64d6-a3ff-4573-a4e0-73d5795733bd tempest-TestInstancesWithCinderVolumes-74752822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ce3830b-a65f-4a61-88b1-699f9ba8ae63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f3e73e77-1d10-4f48-a416-2c9a8555c137', 'volume_size': 1, 'image_id': 'e63da8da-ff94-4a77-a138-f074f83beb91', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e63da8da-ff94-4a77-a138-f074f83beb91', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--2101754160', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ed18efdde4a84380b7c654cc389fabe9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e63da8da-ff94-4a77-a138-f074f83beb91', 'created_at': datetime.datetime(2026, 8, 5, 4, 22, 52, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 5, 4, 22, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e63da8da-ff94-4a77-a138-f074f83beb91/file', 'properties': {}}, 'image_service': }' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:23:03 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-e2bb64d6-a3ff-4573-a4e0-73d5795733bd tempest-TestInstancesWithCinderVolumes-74752822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf3e46bd-771a-4e1d-a266-a1bca4a6f93d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:23:03 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-e2bb64d6-a3ff-4573-a4e0-73d5795733bd tempest-TestInstancesWithCinderVolumes-74752822 None] Volume volume-f3e73e77-1d10-4f48-a416-2c9a8555c137 (f3e73e77-1d10-4f48-a416-2c9a8555c137): created successfully Aug 05 06:23:03 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-e2bb64d6-a3ff-4573-a4e0-73d5795733bd tempest-TestInstancesWithCinderVolumes-74752822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf3e46bd-771a-4e1d-a266-a1bca4a6f93d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:23:03 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-e2bb64d6-a3ff-4573-a4e0-73d5795733bd tempest-TestInstancesWithCinderVolumes-74752822 None] Flow 'volume_create_manager' (fb9f64d6-534e-40b7-b28e-730911c27717) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:23:03 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-e2bb64d6-a3ff-4573-a4e0-73d5795733bd tempest-TestInstancesWithCinderVolumes-74752822 None] Created volume successfully. Aug 05 06:23:06 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [req-77e0fb0a-f7ec-430d-a962-5dab31fb11d1 req-5e7d9079-b2a5-4496-9c5f-5aa0abc3bfce tempest-TestInstancesWithCinderVolumes-74752822 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:23:06 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [req-77e0fb0a-f7ec-430d-a962-5dab31fb11d1 req-5e7d9079-b2a5-4496-9c5f-5aa0abc3bfce tempest-TestInstancesWithCinderVolumes-74752822 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:23:06 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [req-77e0fb0a-f7ec-430d-a962-5dab31fb11d1 req-5e7d9079-b2a5-4496-9c5f-5aa0abc3bfce tempest-TestInstancesWithCinderVolumes-74752822 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:23:06 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [req-77e0fb0a-f7ec-430d-a962-5dab31fb11d1 req-5e7d9079-b2a5-4496-9c5f-5aa0abc3bfce tempest-TestInstancesWithCinderVolumes-74752822 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087', 'name': 'volume-f3e73e77-1d10-4f48-a416-2c9a8555c137', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f5e70ef7-5b68-4612-9ad0-a4893a21c43e', 'enforce_multipath': True} {{(pid=88695) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 05 06:23:06 devstack cinder-volume[88695]: INFO cinder.volume.manager [req-77e0fb0a-f7ec-430d-a962-5dab31fb11d1 req-5e7d9079-b2a5-4496-9c5f-5aa0abc3bfce tempest-TestInstancesWithCinderVolumes-74752822 None] attachment_update completed successfully. Aug 05 06:23:10 devstack cinder-volume[88695]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa149682-7a5d-4b3a-a166-84857be0d2be tempest-AttachVolumeNegativeTest-1368352343 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88695) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 06:23:10 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-fa149682-7a5d-4b3a-a166-84857be0d2be tempest-AttachVolumeNegativeTest-1368352343 None] Flow 'volume_create_manager' (437204a4-f258-4652-b8b7-078408b55f03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:23:10 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-fa149682-7a5d-4b3a-a166-84857be0d2be tempest-AttachVolumeNegativeTest-1368352343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a66d2ee4-215c-4899-b65e-5d5d97d557c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:23:10 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-fa149682-7a5d-4b3a-a166-84857be0d2be tempest-AttachVolumeNegativeTest-1368352343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a66d2ee4-215c-4899-b65e-5d5d97d557c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:23:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1733996642',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=deee4520-52f8-4770-9505-74a052710fe5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f582f538cec4452a5f67cec7936e431',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:23:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:23:11Z,use_quota=True,user_id='7af00ab35f0247e98b9718283cbcd42c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:23:10 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-fa149682-7a5d-4b3a-a166-84857be0d2be tempest-AttachVolumeNegativeTest-1368352343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9715d292-5b3e-476d-8e7a-e2407deb97b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:23:10 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-fa149682-7a5d-4b3a-a166-84857be0d2be tempest-AttachVolumeNegativeTest-1368352343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9715d292-5b3e-476d-8e7a-e2407deb97b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:23:10 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-fa149682-7a5d-4b3a-a166-84857be0d2be tempest-AttachVolumeNegativeTest-1368352343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3af77a4e-9676-465b-a9ad-2cbb3ba4e3c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:23:10 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-fa149682-7a5d-4b3a-a166-84857be0d2be tempest-AttachVolumeNegativeTest-1368352343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3af77a4e-9676-465b-a9ad-2cbb3ba4e3c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'deee4520-52f8-4770-9505-74a052710fe5', 'volume_name': 'volume-deee4520-52f8-4770-9505-74a052710fe5', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:23:10 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-fa149682-7a5d-4b3a-a166-84857be0d2be tempest-AttachVolumeNegativeTest-1368352343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1cc88072-d567-4da0-bd09-14da825a23ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:23:10 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-fa149682-7a5d-4b3a-a166-84857be0d2be tempest-AttachVolumeNegativeTest-1368352343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1cc88072-d567-4da0-bd09-14da825a23ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:23:10 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-fa149682-7a5d-4b3a-a166-84857be0d2be tempest-AttachVolumeNegativeTest-1368352343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31d3f52e-0fc4-403e-9cc1-414e8c2c2362) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:23:10 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-fa149682-7a5d-4b3a-a166-84857be0d2be tempest-AttachVolumeNegativeTest-1368352343 None] Volume deee4520-52f8-4770-9505-74a052710fe5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-deee4520-52f8-4770-9505-74a052710fe5', 'volume_size': 1} Aug 05 06:23:10 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-fa149682-7a5d-4b3a-a166-84857be0d2be tempest-AttachVolumeNegativeTest-1368352343 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:23:10 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-fa149682-7a5d-4b3a-a166-84857be0d2be tempest-AttachVolumeNegativeTest-1368352343 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:23:10 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-fa149682-7a5d-4b3a-a166-84857be0d2be tempest-AttachVolumeNegativeTest-1368352343 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:23:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1733996642',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=deee4520-52f8-4770-9505-74a052710fe5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f582f538cec4452a5f67cec7936e431',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:23:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:23:11Z,use_quota=True,user_id='7af00ab35f0247e98b9718283cbcd42c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)}" {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 06:23:10 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-fa149682-7a5d-4b3a-a166-84857be0d2be tempest-AttachVolumeNegativeTest-1368352343 None] Creating volume deee4520-52f8-4770-9505-74a052710fe5 {{(pid=88695) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 06:23:10 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-fa149682-7a5d-4b3a-a166-84857be0d2be tempest-AttachVolumeNegativeTest-1368352343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:23:10 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-fa149682-7a5d-4b3a-a166-84857be0d2be tempest-AttachVolumeNegativeTest-1368352343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:23:10 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-fa149682-7a5d-4b3a-a166-84857be0d2be tempest-AttachVolumeNegativeTest-1368352343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:23:10 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-fa149682-7a5d-4b3a-a166-84857be0d2be tempest-AttachVolumeNegativeTest-1368352343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:23:10 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-fa149682-7a5d-4b3a-a166-84857be0d2be tempest-AttachVolumeNegativeTest-1368352343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:23:10 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-fa149682-7a5d-4b3a-a166-84857be0d2be tempest-AttachVolumeNegativeTest-1368352343 None] Selected osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 as target Quobyte volume. {{(pid=88695) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 06:23:10 devstack cinder-volume[88695]: INFO cinder.volume.drivers.remotefs [None req-fa149682-7a5d-4b3a-a166-84857be0d2be tempest-AttachVolumeNegativeTest-1368352343 None] casted to osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 Aug 05 06:23:10 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-fa149682-7a5d-4b3a-a166-84857be0d2be tempest-AttachVolumeNegativeTest-1368352343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-deee4520-52f8-4770-9505-74a052710fe5 1073741824 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:23:10 devstack sudo[102461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-deee4520-52f8-4770-9505-74a052710fe5 1073741824 Aug 05 06:23:10 devstack sudo[102461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:23:11 devstack sudo[102461]: pam_unix(sudo:session): session closed for user root Aug 05 06:23:11 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-fa149682-7a5d-4b3a-a166-84857be0d2be tempest-AttachVolumeNegativeTest-1368352343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-deee4520-52f8-4770-9505-74a052710fe5 1073741824" returned: 0 in 0.506s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:23:11 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-fa149682-7a5d-4b3a-a166-84857be0d2be tempest-AttachVolumeNegativeTest-1368352343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-deee4520-52f8-4770-9505-74a052710fe5 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:23:11 devstack sudo[102469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-deee4520-52f8-4770-9505-74a052710fe5 Aug 05 06:23:11 devstack sudo[102469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:23:11 devstack sudo[102469]: pam_unix(sudo:session): session closed for user root Aug 05 06:23:11 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-fa149682-7a5d-4b3a-a166-84857be0d2be tempest-AttachVolumeNegativeTest-1368352343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-deee4520-52f8-4770-9505-74a052710fe5" returned: 0 in 0.308s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:23:11 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-fa149682-7a5d-4b3a-a166-84857be0d2be tempest-AttachVolumeNegativeTest-1368352343 None] <== create_volume: return (890ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'} {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 06:23:11 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-fa149682-7a5d-4b3a-a166-84857be0d2be tempest-AttachVolumeNegativeTest-1368352343 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.893s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:23:11 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-fa149682-7a5d-4b3a-a166-84857be0d2be tempest-AttachVolumeNegativeTest-1368352343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31d3f52e-0fc4-403e-9cc1-414e8c2c2362) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-deee4520-52f8-4770-9505-74a052710fe5', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:23:11 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-fa149682-7a5d-4b3a-a166-84857be0d2be tempest-AttachVolumeNegativeTest-1368352343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (baea613f-f137-4895-919c-089a77fd0b88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:23:11 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-fa149682-7a5d-4b3a-a166-84857be0d2be tempest-AttachVolumeNegativeTest-1368352343 None] Volume volume-deee4520-52f8-4770-9505-74a052710fe5 (deee4520-52f8-4770-9505-74a052710fe5): created successfully Aug 05 06:23:11 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-fa149682-7a5d-4b3a-a166-84857be0d2be tempest-AttachVolumeNegativeTest-1368352343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (baea613f-f137-4895-919c-089a77fd0b88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:23:11 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-fa149682-7a5d-4b3a-a166-84857be0d2be tempest-AttachVolumeNegativeTest-1368352343 None] Flow 'volume_create_manager' (437204a4-f258-4652-b8b7-078408b55f03) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:23:11 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-fa149682-7a5d-4b3a-a166-84857be0d2be tempest-AttachVolumeNegativeTest-1368352343 None] Created volume successfully. Aug 05 06:23:13 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [req-eef0ce2e-a119-44fd-90e5-077c80f4895e req-c08271fe-2e9c-43ae-b643-972d6d21ef4b tempest-AttachVolumeNegativeTest-1368352343 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:23:13 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [req-eef0ce2e-a119-44fd-90e5-077c80f4895e req-c08271fe-2e9c-43ae-b643-972d6d21ef4b tempest-AttachVolumeNegativeTest-1368352343 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:23:13 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [req-eef0ce2e-a119-44fd-90e5-077c80f4895e req-c08271fe-2e9c-43ae-b643-972d6d21ef4b tempest-AttachVolumeNegativeTest-1368352343 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:23:13 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [req-eef0ce2e-a119-44fd-90e5-077c80f4895e req-c08271fe-2e9c-43ae-b643-972d6d21ef4b tempest-AttachVolumeNegativeTest-1368352343 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087', 'name': 'volume-deee4520-52f8-4770-9505-74a052710fe5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '09030d38-58f4-4815-ab05-27e8936e5043', 'enforce_multipath': True} {{(pid=88695) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 05 06:23:13 devstack cinder-volume[88695]: INFO cinder.volume.manager [req-eef0ce2e-a119-44fd-90e5-077c80f4895e req-c08271fe-2e9c-43ae-b643-972d6d21ef4b tempest-AttachVolumeNegativeTest-1368352343 None] attachment_update completed successfully. Aug 05 06:23:16 devstack cinder-volume[88695]: INFO cinder.volume.manager [req-3f65dfcb-26aa-42be-874c-a2439aeb0f5d req-004a3a77-d45e-45ef-9507-2acce084add7 tempest-AttachVolumeNegativeTest-1368352343 None] Terminate volume connection completed successfully. Aug 05 06:23:16 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [req-3f65dfcb-26aa-42be-874c-a2439aeb0f5d req-004a3a77-d45e-45ef-9507-2acce084add7 tempest-AttachVolumeNegativeTest-1368352343 None] Deleting attachment 09030d38-58f4-4815-ab05-27e8936e5043. {{(pid=88695) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 05 06:23:26 devstack cinder-volume[88695]: DEBUG dbcounter [-] [88695] Writing DB stats cinder:SELECT=27,cinder:UPDATE=16,cinder:DELETE=2,cinder:INSERT=6 {{(pid=88695) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 06:23:26 devstack cinder-volume[88695]: DEBUG dbcounter [-] [88695] Writing DB stats cinder:UPDATE=17,cinder:SELECT=28,cinder:INSERT=7,cinder:DELETE=2 {{(pid=88695) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 06:23:41 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [req-ff1b6229-1ea3-4ef6-985f-a86166c3010d req-3ed64a30-5a02-46a6-b70b-2c6bb8dc83ac tempest-TestInstancesWithCinderVolumes-74752822 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:23:41 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [req-ff1b6229-1ea3-4ef6-985f-a86166c3010d req-3ed64a30-5a02-46a6-b70b-2c6bb8dc83ac tempest-TestInstancesWithCinderVolumes-74752822 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:23:41 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [req-ff1b6229-1ea3-4ef6-985f-a86166c3010d req-3ed64a30-5a02-46a6-b70b-2c6bb8dc83ac tempest-TestInstancesWithCinderVolumes-74752822 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.025s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:23:41 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [req-ff1b6229-1ea3-4ef6-985f-a86166c3010d req-3ed64a30-5a02-46a6-b70b-2c6bb8dc83ac tempest-TestInstancesWithCinderVolumes-74752822 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087', 'name': 'volume-9aae2421-130c-4aca-af18-98a124cc2b7e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5ab5e0b0-5220-49b9-8306-f134eadd3291', 'enforce_multipath': True} {{(pid=88695) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 05 06:23:41 devstack cinder-volume[88695]: INFO cinder.volume.manager [req-ff1b6229-1ea3-4ef6-985f-a86166c3010d req-3ed64a30-5a02-46a6-b70b-2c6bb8dc83ac tempest-TestInstancesWithCinderVolumes-74752822 None] attachment_update completed successfully. Aug 05 06:23:44 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [req-070000a0-bd74-413b-8a08-2505d2dc9fea req-c6b240ef-b182-402b-a978-78435e4820b1 tempest-TestInstancesWithCinderVolumes-74752822 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:23:44 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [req-070000a0-bd74-413b-8a08-2505d2dc9fea req-c6b240ef-b182-402b-a978-78435e4820b1 tempest-TestInstancesWithCinderVolumes-74752822 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:23:44 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [req-070000a0-bd74-413b-8a08-2505d2dc9fea req-c6b240ef-b182-402b-a978-78435e4820b1 tempest-TestInstancesWithCinderVolumes-74752822 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:23:44 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [req-070000a0-bd74-413b-8a08-2505d2dc9fea req-c6b240ef-b182-402b-a978-78435e4820b1 tempest-TestInstancesWithCinderVolumes-74752822 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087', 'name': 'volume-e294a7ba-44ca-4a90-8641-f713a9548ef4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '114ee378-b55b-4f3c-8944-67f170523095', 'enforce_multipath': True} {{(pid=88695) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 05 06:23:44 devstack cinder-volume[88695]: INFO cinder.volume.manager [req-070000a0-bd74-413b-8a08-2505d2dc9fea req-c6b240ef-b182-402b-a978-78435e4820b1 tempest-TestInstancesWithCinderVolumes-74752822 None] attachment_update completed successfully. Aug 05 06:23:49 devstack cinder-volume[88695]: INFO cinder.volume.manager [req-eeeff8b5-89c7-42a3-a132-06a118ce23da req-1cf97566-2c30-4885-858f-0702d67f2bd1 tempest-TestInstancesWithCinderVolumes-74752822 None] Terminate volume connection completed successfully. Aug 05 06:23:49 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [req-eeeff8b5-89c7-42a3-a132-06a118ce23da req-1cf97566-2c30-4885-858f-0702d67f2bd1 tempest-TestInstancesWithCinderVolumes-74752822 None] Deleting attachment 5ab5e0b0-5220-49b9-8306-f134eadd3291. {{(pid=88695) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 05 06:23:49 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-380027ac-219a-4fd5-8c3d-39f1a4768622 tempest-TestInstancesWithCinderVolumes-74752822 None] Acquiring lock "cinder-9aae2421-130c-4aca-af18-98a124cc2b7e-delete_volume" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:23:49 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-380027ac-219a-4fd5-8c3d-39f1a4768622 tempest-TestInstancesWithCinderVolumes-74752822 None] Lock "cinder-9aae2421-130c-4aca-af18-98a124cc2b7e-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:23:50 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-380027ac-219a-4fd5-8c3d-39f1a4768622 tempest-TestInstancesWithCinderVolumes-74752822 None] Acquiring lock "cinder-quobyte-9aae2421-130c-4aca-af18-98a124cc2b7e" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:23:50 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-380027ac-219a-4fd5-8c3d-39f1a4768622 tempest-TestInstancesWithCinderVolumes-74752822 None] Lock "cinder-quobyte-9aae2421-130c-4aca-af18-98a124cc2b7e" acquired by "delete_volume" :: waited 0.020s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:23:50 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec3870ed-ff57-4a12-9b99-99e5403628a1]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:23:50 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-380027ac-219a-4fd5-8c3d-39f1a4768622 tempest-TestInstancesWithCinderVolumes-74752822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9aae2421-130c-4aca-af18-98a124cc2b7e {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:23:50 devstack sudo[102811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9aae2421-130c-4aca-af18-98a124cc2b7e Aug 05 06:23:50 devstack sudo[102811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:23:50 devstack sudo[102811]: pam_unix(sudo:session): session closed for user root Aug 05 06:23:50 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-380027ac-219a-4fd5-8c3d-39f1a4768622 tempest-TestInstancesWithCinderVolumes-74752822 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9aae2421-130c-4aca-af18-98a124cc2b7e" returned: 0 in 0.447s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:23:50 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-380027ac-219a-4fd5-8c3d-39f1a4768622 tempest-TestInstancesWithCinderVolumes-74752822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9aae2421-130c-4aca-af18-98a124cc2b7e {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:23:50 devstack sudo[102818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9aae2421-130c-4aca-af18-98a124cc2b7e Aug 05 06:23:50 devstack sudo[102818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:23:50 devstack sudo[102818]: pam_unix(sudo:session): session closed for user root Aug 05 06:23:50 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-380027ac-219a-4fd5-8c3d-39f1a4768622 tempest-TestInstancesWithCinderVolumes-74752822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9aae2421-130c-4aca-af18-98a124cc2b7e" returned: 0 in 0.293s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:23:50 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-380027ac-219a-4fd5-8c3d-39f1a4768622 tempest-TestInstancesWithCinderVolumes-74752822 None] Lock "cinder-quobyte-9aae2421-130c-4aca-af18-98a124cc2b7e" released by "delete_volume" :: held 0.787s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:23:50 devstack cinder-volume[88695]: WARNING cinder.quota [None req-380027ac-219a-4fd5-8c3d-39f1a4768622 tempest-TestInstancesWithCinderVolumes-74752822 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-458950654-1514676787 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-458950654-1514676787, it is now deprecated. Please use the default quota class for default quota. Aug 05 06:23:50 devstack cinder-volume[88695]: WARNING cinder.quota [None req-380027ac-219a-4fd5-8c3d-39f1a4768622 tempest-TestInstancesWithCinderVolumes-74752822 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-458950654-1514676787 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-458950654-1514676787, it is now deprecated. Please use the default quota class for default quota. Aug 05 06:23:50 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-380027ac-219a-4fd5-8c3d-39f1a4768622 tempest-TestInstancesWithCinderVolumes-74752822 None] Created reservations ['a16905a1-aa33-48dd-8611-01b24a30757d', '3a754832-0a79-41bf-a8b5-a18cc0f23ddd', '23af33a9-1bd9-48c7-9e9c-a67b87897cbd', '3e87f9be-7090-45d4-92ef-6ce0db7f100a'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:23:50 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-380027ac-219a-4fd5-8c3d-39f1a4768622 tempest-TestInstancesWithCinderVolumes-74752822 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:23:50 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-380027ac-219a-4fd5-8c3d-39f1a4768622 tempest-TestInstancesWithCinderVolumes-74752822 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:23:50 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-380027ac-219a-4fd5-8c3d-39f1a4768622 tempest-TestInstancesWithCinderVolumes-74752822 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:23:50 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-380027ac-219a-4fd5-8c3d-39f1a4768622 tempest-TestInstancesWithCinderVolumes-74752822 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:23:50 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-380027ac-219a-4fd5-8c3d-39f1a4768622 tempest-TestInstancesWithCinderVolumes-74752822 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:23:50 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-380027ac-219a-4fd5-8c3d-39f1a4768622 tempest-TestInstancesWithCinderVolumes-74752822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:23:51 devstack sudo[102829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce Aug 05 06:23:51 devstack sudo[102829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:23:51 devstack sudo[102829]: pam_unix(sudo:session): session closed for user root Aug 05 06:23:51 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-380027ac-219a-4fd5-8c3d-39f1a4768622 tempest-TestInstancesWithCinderVolumes-74752822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce" returned: 0 in 0.281s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:23:51 devstack cinder-volume[88695]: DEBUG cinder.manager [None req-380027ac-219a-4fd5-8c3d-39f1a4768622 tempest-TestInstancesWithCinderVolumes-74752822 None] Notifying Schedulers of capabilities ... {{(pid=88695) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 06:23:51 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-380027ac-219a-4fd5-8c3d-39f1a4768622 tempest-TestInstancesWithCinderVolumes-74752822 None] Deleted volume successfully. Aug 05 06:23:51 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-380027ac-219a-4fd5-8c3d-39f1a4768622 tempest-TestInstancesWithCinderVolumes-74752822 None] Lock "cinder-9aae2421-130c-4aca-af18-98a124cc2b7e-delete_volume" released by "delete_volume" :: held 1.316s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:23:51 devstack cinder-volume[88695]: DEBUG cinder.volume.flows.manager.create_volume [None req-a32639e9-42bb-460a-b8bb-fc5e440966f8 tempest-AttachVolumeNegativeTest-1368352343 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88695) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 06:23:51 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-a32639e9-42bb-460a-b8bb-fc5e440966f8 tempest-AttachVolumeNegativeTest-1368352343 None] Flow 'volume_create_manager' (b54b7253-c879-40c8-bf78-0ee986102408) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:23:51 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-a32639e9-42bb-460a-b8bb-fc5e440966f8 tempest-AttachVolumeNegativeTest-1368352343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0683de5-bd8c-4ea2-b4b4-6aa28d8ed8eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:23:51 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-a32639e9-42bb-460a-b8bb-fc5e440966f8 tempest-AttachVolumeNegativeTest-1368352343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0683de5-bd8c-4ea2-b4b4-6aa28d8ed8eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:23:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1528583052',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8ada0cd-4728-44f0-b6d3-218943332a92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f582f538cec4452a5f67cec7936e431',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:23:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:23:52Z,use_quota=True,user_id='7af00ab35f0247e98b9718283cbcd42c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:23:51 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-a32639e9-42bb-460a-b8bb-fc5e440966f8 tempest-AttachVolumeNegativeTest-1368352343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1920e0e9-4801-4db6-8ecc-d961e33df05b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:23:51 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-a32639e9-42bb-460a-b8bb-fc5e440966f8 tempest-AttachVolumeNegativeTest-1368352343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1920e0e9-4801-4db6-8ecc-d961e33df05b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:23:51 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-a32639e9-42bb-460a-b8bb-fc5e440966f8 tempest-AttachVolumeNegativeTest-1368352343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cf14094-06a7-4b84-a6b2-d22207ef5c50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:23:51 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-a32639e9-42bb-460a-b8bb-fc5e440966f8 tempest-AttachVolumeNegativeTest-1368352343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cf14094-06a7-4b84-a6b2-d22207ef5c50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f8ada0cd-4728-44f0-b6d3-218943332a92', 'volume_name': 'volume-f8ada0cd-4728-44f0-b6d3-218943332a92', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:23:51 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-a32639e9-42bb-460a-b8bb-fc5e440966f8 tempest-AttachVolumeNegativeTest-1368352343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b097155-5ace-4aa6-9650-0dd044a1e504) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:23:51 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-a32639e9-42bb-460a-b8bb-fc5e440966f8 tempest-AttachVolumeNegativeTest-1368352343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b097155-5ace-4aa6-9650-0dd044a1e504) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:23:51 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-a32639e9-42bb-460a-b8bb-fc5e440966f8 tempest-AttachVolumeNegativeTest-1368352343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d85ea72-5aed-4d32-ae6f-f9f3285b27bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:23:51 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-a32639e9-42bb-460a-b8bb-fc5e440966f8 tempest-AttachVolumeNegativeTest-1368352343 None] Volume f8ada0cd-4728-44f0-b6d3-218943332a92: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f8ada0cd-4728-44f0-b6d3-218943332a92', 'volume_size': 1} Aug 05 06:23:51 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-a32639e9-42bb-460a-b8bb-fc5e440966f8 tempest-AttachVolumeNegativeTest-1368352343 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:23:51 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-a32639e9-42bb-460a-b8bb-fc5e440966f8 tempest-AttachVolumeNegativeTest-1368352343 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:23:51 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-a32639e9-42bb-460a-b8bb-fc5e440966f8 tempest-AttachVolumeNegativeTest-1368352343 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:23:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1528583052',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8ada0cd-4728-44f0-b6d3-218943332a92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f582f538cec4452a5f67cec7936e431',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:23:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:23:52Z,use_quota=True,user_id='7af00ab35f0247e98b9718283cbcd42c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)}" {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 06:23:51 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-a32639e9-42bb-460a-b8bb-fc5e440966f8 tempest-AttachVolumeNegativeTest-1368352343 None] Creating volume f8ada0cd-4728-44f0-b6d3-218943332a92 {{(pid=88695) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 06:23:51 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-a32639e9-42bb-460a-b8bb-fc5e440966f8 tempest-AttachVolumeNegativeTest-1368352343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:23:51 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-a32639e9-42bb-460a-b8bb-fc5e440966f8 tempest-AttachVolumeNegativeTest-1368352343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:23:51 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-a32639e9-42bb-460a-b8bb-fc5e440966f8 tempest-AttachVolumeNegativeTest-1368352343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:23:51 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-a32639e9-42bb-460a-b8bb-fc5e440966f8 tempest-AttachVolumeNegativeTest-1368352343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:23:51 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-a32639e9-42bb-460a-b8bb-fc5e440966f8 tempest-AttachVolumeNegativeTest-1368352343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:23:51 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-a32639e9-42bb-460a-b8bb-fc5e440966f8 tempest-AttachVolumeNegativeTest-1368352343 None] Selected osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 as target Quobyte volume. {{(pid=88695) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 06:23:51 devstack cinder-volume[88695]: INFO cinder.volume.drivers.remotefs [None req-a32639e9-42bb-460a-b8bb-fc5e440966f8 tempest-AttachVolumeNegativeTest-1368352343 None] casted to osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 Aug 05 06:23:51 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-a32639e9-42bb-460a-b8bb-fc5e440966f8 tempest-AttachVolumeNegativeTest-1368352343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-f8ada0cd-4728-44f0-b6d3-218943332a92 1073741824 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:23:51 devstack sudo[102832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-f8ada0cd-4728-44f0-b6d3-218943332a92 1073741824 Aug 05 06:23:51 devstack sudo[102832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:23:52 devstack sudo[102832]: pam_unix(sudo:session): session closed for user root Aug 05 06:23:52 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-a32639e9-42bb-460a-b8bb-fc5e440966f8 tempest-AttachVolumeNegativeTest-1368352343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-f8ada0cd-4728-44f0-b6d3-218943332a92 1073741824" returned: 0 in 0.467s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:23:52 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-a32639e9-42bb-460a-b8bb-fc5e440966f8 tempest-AttachVolumeNegativeTest-1368352343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-f8ada0cd-4728-44f0-b6d3-218943332a92 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:23:52 devstack sudo[102844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-f8ada0cd-4728-44f0-b6d3-218943332a92 Aug 05 06:23:52 devstack sudo[102844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:23:52 devstack sudo[102844]: pam_unix(sudo:session): session closed for user root Aug 05 06:23:52 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-a32639e9-42bb-460a-b8bb-fc5e440966f8 tempest-AttachVolumeNegativeTest-1368352343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-f8ada0cd-4728-44f0-b6d3-218943332a92" returned: 0 in 0.264s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:23:52 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-a32639e9-42bb-460a-b8bb-fc5e440966f8 tempest-AttachVolumeNegativeTest-1368352343 None] <== create_volume: return (770ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'} {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 06:23:52 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-a32639e9-42bb-460a-b8bb-fc5e440966f8 tempest-AttachVolumeNegativeTest-1368352343 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.773s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:23:52 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-a32639e9-42bb-460a-b8bb-fc5e440966f8 tempest-AttachVolumeNegativeTest-1368352343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d85ea72-5aed-4d32-ae6f-f9f3285b27bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f8ada0cd-4728-44f0-b6d3-218943332a92', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:23:52 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-a32639e9-42bb-460a-b8bb-fc5e440966f8 tempest-AttachVolumeNegativeTest-1368352343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03057507-a6a8-4c76-ba4e-c53674cebb65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:23:52 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-a32639e9-42bb-460a-b8bb-fc5e440966f8 tempest-AttachVolumeNegativeTest-1368352343 None] Volume volume-f8ada0cd-4728-44f0-b6d3-218943332a92 (f8ada0cd-4728-44f0-b6d3-218943332a92): created successfully Aug 05 06:23:52 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-a32639e9-42bb-460a-b8bb-fc5e440966f8 tempest-AttachVolumeNegativeTest-1368352343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03057507-a6a8-4c76-ba4e-c53674cebb65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:23:52 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-a32639e9-42bb-460a-b8bb-fc5e440966f8 tempest-AttachVolumeNegativeTest-1368352343 None] Flow 'volume_create_manager' (b54b7253-c879-40c8-bf78-0ee986102408) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:23:52 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-a32639e9-42bb-460a-b8bb-fc5e440966f8 tempest-AttachVolumeNegativeTest-1368352343 None] Created volume successfully. Aug 05 06:23:53 devstack cinder-volume[88695]: INFO cinder.volume.manager [req-c71bce32-2654-4210-aead-5338ed8bff29 req-6754e138-0b6f-47b6-9b6b-68ab41a7cbc2 tempest-TestInstancesWithCinderVolumes-74752822 None] Terminate volume connection completed successfully. Aug 05 06:23:53 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [req-c71bce32-2654-4210-aead-5338ed8bff29 req-6754e138-0b6f-47b6-9b6b-68ab41a7cbc2 tempest-TestInstancesWithCinderVolumes-74752822 None] Deleting attachment 114ee378-b55b-4f3c-8944-67f170523095. {{(pid=88695) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 05 06:23:54 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [req-1b392ad7-abf3-42b1-be21-db941ec3f61b req-6a75cf60-8495-462f-a329-cf10fd0bf2f4 tempest-AttachVolumeNegativeTest-1368352343 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:23:54 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [req-1b392ad7-abf3-42b1-be21-db941ec3f61b req-6a75cf60-8495-462f-a329-cf10fd0bf2f4 tempest-AttachVolumeNegativeTest-1368352343 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:23:54 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [req-1b392ad7-abf3-42b1-be21-db941ec3f61b req-6a75cf60-8495-462f-a329-cf10fd0bf2f4 tempest-AttachVolumeNegativeTest-1368352343 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:23:54 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [req-1b392ad7-abf3-42b1-be21-db941ec3f61b req-6a75cf60-8495-462f-a329-cf10fd0bf2f4 tempest-AttachVolumeNegativeTest-1368352343 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087', 'name': 'volume-f8ada0cd-4728-44f0-b6d3-218943332a92', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c7235f53-ae08-4969-873c-5ac4168915b9', 'enforce_multipath': True} {{(pid=88695) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 05 06:23:54 devstack cinder-volume[88695]: INFO cinder.volume.manager [req-1b392ad7-abf3-42b1-be21-db941ec3f61b req-6a75cf60-8495-462f-a329-cf10fd0bf2f4 tempest-AttachVolumeNegativeTest-1368352343 None] attachment_update completed successfully. Aug 05 06:23:54 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-5cba015c-5662-4268-8cdd-ba1b5a29b4aa tempest-TestInstancesWithCinderVolumes-74752822 None] Acquiring lock "cinder-e294a7ba-44ca-4a90-8641-f713a9548ef4-delete_volume" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:23:54 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-5cba015c-5662-4268-8cdd-ba1b5a29b4aa tempest-TestInstancesWithCinderVolumes-74752822 None] Lock "cinder-e294a7ba-44ca-4a90-8641-f713a9548ef4-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:23:54 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-5cba015c-5662-4268-8cdd-ba1b5a29b4aa tempest-TestInstancesWithCinderVolumes-74752822 None] Acquiring lock "cinder-quobyte-e294a7ba-44ca-4a90-8641-f713a9548ef4" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:23:54 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-5cba015c-5662-4268-8cdd-ba1b5a29b4aa tempest-TestInstancesWithCinderVolumes-74752822 None] Lock "cinder-quobyte-e294a7ba-44ca-4a90-8641-f713a9548ef4" acquired by "delete_volume" :: waited 0.021s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:23:54 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e772002-14f4-4e98-b0b1-039d6dd14dd5]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:23:54 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-5cba015c-5662-4268-8cdd-ba1b5a29b4aa tempest-TestInstancesWithCinderVolumes-74752822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-e294a7ba-44ca-4a90-8641-f713a9548ef4 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:23:54 devstack sudo[102885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-e294a7ba-44ca-4a90-8641-f713a9548ef4 Aug 05 06:23:54 devstack sudo[102885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:23:54 devstack sudo[102885]: pam_unix(sudo:session): session closed for user root Aug 05 06:23:54 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-5cba015c-5662-4268-8cdd-ba1b5a29b4aa tempest-TestInstancesWithCinderVolumes-74752822 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-e294a7ba-44ca-4a90-8641-f713a9548ef4" returned: 0 in 0.412s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:23:54 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-5cba015c-5662-4268-8cdd-ba1b5a29b4aa tempest-TestInstancesWithCinderVolumes-74752822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-e294a7ba-44ca-4a90-8641-f713a9548ef4 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:23:55 devstack sudo[102891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-e294a7ba-44ca-4a90-8641-f713a9548ef4 Aug 05 06:23:55 devstack sudo[102891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:23:55 devstack sudo[102891]: pam_unix(sudo:session): session closed for user root Aug 05 06:23:55 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-5cba015c-5662-4268-8cdd-ba1b5a29b4aa tempest-TestInstancesWithCinderVolumes-74752822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-e294a7ba-44ca-4a90-8641-f713a9548ef4" returned: 0 in 0.301s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:23:55 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-5cba015c-5662-4268-8cdd-ba1b5a29b4aa tempest-TestInstancesWithCinderVolumes-74752822 None] Lock "cinder-quobyte-e294a7ba-44ca-4a90-8641-f713a9548ef4" released by "delete_volume" :: held 0.762s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:23:55 devstack cinder-volume[88695]: WARNING cinder.quota [None req-5cba015c-5662-4268-8cdd-ba1b5a29b4aa tempest-TestInstancesWithCinderVolumes-74752822 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-704333185-701728132 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-704333185-701728132, it is now deprecated. Please use the default quota class for default quota. Aug 05 06:23:55 devstack cinder-volume[88695]: WARNING cinder.quota [None req-5cba015c-5662-4268-8cdd-ba1b5a29b4aa tempest-TestInstancesWithCinderVolumes-74752822 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-704333185-701728132 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-704333185-701728132, it is now deprecated. Please use the default quota class for default quota. Aug 05 06:23:55 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-5cba015c-5662-4268-8cdd-ba1b5a29b4aa tempest-TestInstancesWithCinderVolumes-74752822 None] Created reservations ['5b94f7ad-23b1-4d54-a5bc-86687db36787', '11d390a5-2ad0-4177-b576-dd51846327c9', 'e9071f9a-0ba1-4dc1-a77b-2d5850e69ca4', '0e96acb6-bf17-480a-9bc3-03155d1547bd'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:23:55 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-5cba015c-5662-4268-8cdd-ba1b5a29b4aa tempest-TestInstancesWithCinderVolumes-74752822 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:23:55 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-5cba015c-5662-4268-8cdd-ba1b5a29b4aa tempest-TestInstancesWithCinderVolumes-74752822 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:23:55 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-5cba015c-5662-4268-8cdd-ba1b5a29b4aa tempest-TestInstancesWithCinderVolumes-74752822 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:23:55 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-5cba015c-5662-4268-8cdd-ba1b5a29b4aa tempest-TestInstancesWithCinderVolumes-74752822 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:23:55 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-5cba015c-5662-4268-8cdd-ba1b5a29b4aa tempest-TestInstancesWithCinderVolumes-74752822 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:23:55 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-5cba015c-5662-4268-8cdd-ba1b5a29b4aa tempest-TestInstancesWithCinderVolumes-74752822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:23:55 devstack sudo[102894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce Aug 05 06:23:55 devstack sudo[102894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:23:55 devstack sudo[102894]: pam_unix(sudo:session): session closed for user root Aug 05 06:23:55 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-5cba015c-5662-4268-8cdd-ba1b5a29b4aa tempest-TestInstancesWithCinderVolumes-74752822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce" returned: 0 in 0.283s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:23:55 devstack cinder-volume[88695]: DEBUG cinder.manager [None req-5cba015c-5662-4268-8cdd-ba1b5a29b4aa tempest-TestInstancesWithCinderVolumes-74752822 None] Notifying Schedulers of capabilities ... {{(pid=88695) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 06:23:55 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-5cba015c-5662-4268-8cdd-ba1b5a29b4aa tempest-TestInstancesWithCinderVolumes-74752822 None] Deleted volume successfully. Aug 05 06:23:55 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-5cba015c-5662-4268-8cdd-ba1b5a29b4aa tempest-TestInstancesWithCinderVolumes-74752822 None] Lock "cinder-e294a7ba-44ca-4a90-8641-f713a9548ef4-delete_volume" released by "delete_volume" :: held 1.272s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:23:57 devstack cinder-volume[88695]: INFO cinder.volume.manager [req-766fafdb-5d9f-430c-9c93-8711287c9097 req-d778c19d-7b92-450e-bc74-628f28c61c58 tempest-AttachVolumeNegativeTest-1368352343 None] Terminate volume connection completed successfully. Aug 05 06:23:57 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [req-766fafdb-5d9f-430c-9c93-8711287c9097 req-d778c19d-7b92-450e-bc74-628f28c61c58 tempest-AttachVolumeNegativeTest-1368352343 None] Deleting attachment c7235f53-ae08-4969-873c-5ac4168915b9. {{(pid=88695) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 05 06:23:58 devstack cinder-volume[88695]: INFO cinder.volume.manager [req-c3a5eb7d-b9ff-4296-9c78-f73cbeafd0ae req-eaa2593b-3d49-42ab-8ab1-3b94f50ed1af tempest-TestInstancesWithCinderVolumes-74752822 None] Terminate volume connection completed successfully. Aug 05 06:23:58 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [req-c3a5eb7d-b9ff-4296-9c78-f73cbeafd0ae req-eaa2593b-3d49-42ab-8ab1-3b94f50ed1af tempest-TestInstancesWithCinderVolumes-74752822 None] Deleting attachment f5e70ef7-5b68-4612-9ad0-a4893a21c43e. {{(pid=88695) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 05 06:23:59 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-b0450601-c515-48a7-834f-cf47e087f344 tempest-TestInstancesWithCinderVolumes-74752822 None] Acquiring lock "cinder-f3e73e77-1d10-4f48-a416-2c9a8555c137-delete_volume" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:23:59 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-b0450601-c515-48a7-834f-cf47e087f344 tempest-TestInstancesWithCinderVolumes-74752822 None] Lock "cinder-f3e73e77-1d10-4f48-a416-2c9a8555c137-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:23:59 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-b0450601-c515-48a7-834f-cf47e087f344 tempest-TestInstancesWithCinderVolumes-74752822 None] Acquiring lock "cinder-quobyte-f3e73e77-1d10-4f48-a416-2c9a8555c137" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:23:59 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-b0450601-c515-48a7-834f-cf47e087f344 tempest-TestInstancesWithCinderVolumes-74752822 None] Lock "cinder-quobyte-f3e73e77-1d10-4f48-a416-2c9a8555c137" acquired by "delete_volume" :: waited 0.015s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:23:59 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb7a31e6-f1c6-4ba7-99e6-342623354454]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:23:59 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-b0450601-c515-48a7-834f-cf47e087f344 tempest-TestInstancesWithCinderVolumes-74752822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-f3e73e77-1d10-4f48-a416-2c9a8555c137 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:24:00 devstack sudo[102955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-f3e73e77-1d10-4f48-a416-2c9a8555c137 Aug 05 06:24:00 devstack sudo[102955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:24:00 devstack sudo[102955]: pam_unix(sudo:session): session closed for user root Aug 05 06:24:00 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-b0450601-c515-48a7-834f-cf47e087f344 tempest-TestInstancesWithCinderVolumes-74752822 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-f3e73e77-1d10-4f48-a416-2c9a8555c137" returned: 0 in 0.406s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:24:00 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-b0450601-c515-48a7-834f-cf47e087f344 tempest-TestInstancesWithCinderVolumes-74752822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-f3e73e77-1d10-4f48-a416-2c9a8555c137 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:24:00 devstack sudo[102961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-f3e73e77-1d10-4f48-a416-2c9a8555c137 Aug 05 06:24:00 devstack sudo[102961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:24:00 devstack cinder-volume[88695]: DEBUG oslo_service.periodic_task [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88695) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 06:24:00 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:24:00 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:24:00 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:24:00 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:24:00 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:24:00 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:24:00 devstack sudo[102963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce Aug 05 06:24:00 devstack sudo[102963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:24:00 devstack sudo[102961]: pam_unix(sudo:session): session closed for user root Aug 05 06:24:00 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-b0450601-c515-48a7-834f-cf47e087f344 tempest-TestInstancesWithCinderVolumes-74752822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-f3e73e77-1d10-4f48-a416-2c9a8555c137" returned: 0 in 0.263s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:24:00 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-b0450601-c515-48a7-834f-cf47e087f344 tempest-TestInstancesWithCinderVolumes-74752822 None] Lock "cinder-quobyte-f3e73e77-1d10-4f48-a416-2c9a8555c137" released by "delete_volume" :: held 0.719s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:24:00 devstack cinder-volume[88695]: WARNING cinder.quota [None req-b0450601-c515-48a7-834f-cf47e087f344 tempest-TestInstancesWithCinderVolumes-74752822 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1898218490-1289611890 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1898218490-1289611890, it is now deprecated. Please use the default quota class for default quota. Aug 05 06:24:00 devstack cinder-volume[88695]: WARNING cinder.quota [None req-b0450601-c515-48a7-834f-cf47e087f344 tempest-TestInstancesWithCinderVolumes-74752822 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1898218490-1289611890 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1898218490-1289611890, it is now deprecated. Please use the default quota class for default quota. Aug 05 06:24:00 devstack sudo[102963]: pam_unix(sudo:session): session closed for user root Aug 05 06:24:00 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-b0450601-c515-48a7-834f-cf47e087f344 tempest-TestInstancesWithCinderVolumes-74752822 None] Created reservations ['0e3a1165-3f31-4797-a2cb-64ba4f16729a', '6f527cbe-daa7-4598-a49c-9c635a041a75', '6e43d940-bcc5-4e3c-9246-357e93f8043a', '2b71bc33-6029-454a-a348-1bca3b0b37e6'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:24:00 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce" returned: 0 in 0.279s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:24:00 devstack cinder-volume[88695]: DEBUG cinder.manager [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] Notifying Schedulers of capabilities ... {{(pid=88695) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 06:24:00 devstack cinder-volume[88695]: DEBUG oslo_service.periodic_task [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] Running periodic task VolumeManager._thread_info {{(pid=88695) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 06:24:00 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] thread count: 28 {{(pid=88695) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 05 06:24:00 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] thread info: [<_MainThread(MainThread, started 134469211893888)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88695) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 05 06:24:00 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-b0450601-c515-48a7-834f-cf47e087f344 tempest-TestInstancesWithCinderVolumes-74752822 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:24:00 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-b0450601-c515-48a7-834f-cf47e087f344 tempest-TestInstancesWithCinderVolumes-74752822 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:24:00 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-b0450601-c515-48a7-834f-cf47e087f344 tempest-TestInstancesWithCinderVolumes-74752822 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:24:00 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-b0450601-c515-48a7-834f-cf47e087f344 tempest-TestInstancesWithCinderVolumes-74752822 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:24:00 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-b0450601-c515-48a7-834f-cf47e087f344 tempest-TestInstancesWithCinderVolumes-74752822 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:24:00 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-b0450601-c515-48a7-834f-cf47e087f344 tempest-TestInstancesWithCinderVolumes-74752822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:24:00 devstack sudo[102967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce Aug 05 06:24:00 devstack sudo[102967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:24:01 devstack sudo[102967]: pam_unix(sudo:session): session closed for user root Aug 05 06:24:01 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-b0450601-c515-48a7-834f-cf47e087f344 tempest-TestInstancesWithCinderVolumes-74752822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce" returned: 0 in 0.269s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:24:01 devstack cinder-volume[88695]: DEBUG cinder.manager [None req-b0450601-c515-48a7-834f-cf47e087f344 tempest-TestInstancesWithCinderVolumes-74752822 None] Notifying Schedulers of capabilities ... {{(pid=88695) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 06:24:01 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-b0450601-c515-48a7-834f-cf47e087f344 tempest-TestInstancesWithCinderVolumes-74752822 None] Deleted volume successfully. Aug 05 06:24:01 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-b0450601-c515-48a7-834f-cf47e087f344 tempest-TestInstancesWithCinderVolumes-74752822 None] Lock "cinder-f3e73e77-1d10-4f48-a416-2c9a8555c137-delete_volume" released by "delete_volume" :: held 1.278s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:24:01 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-a65091a5-6869-48b4-bca3-3030c8ef4cad tempest-AttachVolumeNegativeTest-1368352343 None] Acquiring lock "cinder-f8ada0cd-4728-44f0-b6d3-218943332a92-delete_volume" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:24:01 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-a65091a5-6869-48b4-bca3-3030c8ef4cad tempest-AttachVolumeNegativeTest-1368352343 None] Lock "cinder-f8ada0cd-4728-44f0-b6d3-218943332a92-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:24:01 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-a65091a5-6869-48b4-bca3-3030c8ef4cad tempest-AttachVolumeNegativeTest-1368352343 None] Acquiring lock "cinder-quobyte-f8ada0cd-4728-44f0-b6d3-218943332a92" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:24:01 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-a65091a5-6869-48b4-bca3-3030c8ef4cad tempest-AttachVolumeNegativeTest-1368352343 None] Lock "cinder-quobyte-f8ada0cd-4728-44f0-b6d3-218943332a92" acquired by "delete_volume" :: waited 0.015s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:24:01 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[13d14d98-ba6e-4433-a2c0-cc9411c18870]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:24:01 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-a65091a5-6869-48b4-bca3-3030c8ef4cad tempest-AttachVolumeNegativeTest-1368352343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-f8ada0cd-4728-44f0-b6d3-218943332a92 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:24:01 devstack sudo[102970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-f8ada0cd-4728-44f0-b6d3-218943332a92 Aug 05 06:24:01 devstack sudo[102970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:24:02 devstack sudo[102970]: pam_unix(sudo:session): session closed for user root Aug 05 06:24:02 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-a65091a5-6869-48b4-bca3-3030c8ef4cad tempest-AttachVolumeNegativeTest-1368352343 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-f8ada0cd-4728-44f0-b6d3-218943332a92" returned: 0 in 0.378s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:24:02 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-a65091a5-6869-48b4-bca3-3030c8ef4cad tempest-AttachVolumeNegativeTest-1368352343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-f8ada0cd-4728-44f0-b6d3-218943332a92 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:24:02 devstack sudo[102975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-f8ada0cd-4728-44f0-b6d3-218943332a92 Aug 05 06:24:02 devstack sudo[102975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:24:02 devstack sudo[102975]: pam_unix(sudo:session): session closed for user root Aug 05 06:24:02 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-a65091a5-6869-48b4-bca3-3030c8ef4cad tempest-AttachVolumeNegativeTest-1368352343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-f8ada0cd-4728-44f0-b6d3-218943332a92" returned: 0 in 0.260s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:24:02 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-a65091a5-6869-48b4-bca3-3030c8ef4cad tempest-AttachVolumeNegativeTest-1368352343 None] Lock "cinder-quobyte-f8ada0cd-4728-44f0-b6d3-218943332a92" released by "delete_volume" :: held 0.685s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:24:02 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-a65091a5-6869-48b4-bca3-3030c8ef4cad tempest-AttachVolumeNegativeTest-1368352343 None] Created reservations ['b0cc15ab-9177-49ae-aede-16c2f393f150', '7972f7be-4a6b-44aa-a1d8-9081aafb8de1', '9b4facb7-4b5c-4384-815c-babbd3060013', '2304fc1a-63e8-4e6b-a793-54c2ef1fb546'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:24:02 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-a65091a5-6869-48b4-bca3-3030c8ef4cad tempest-AttachVolumeNegativeTest-1368352343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:24:02 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-a65091a5-6869-48b4-bca3-3030c8ef4cad tempest-AttachVolumeNegativeTest-1368352343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:24:02 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-a65091a5-6869-48b4-bca3-3030c8ef4cad tempest-AttachVolumeNegativeTest-1368352343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:24:02 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-a65091a5-6869-48b4-bca3-3030c8ef4cad tempest-AttachVolumeNegativeTest-1368352343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:24:02 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-a65091a5-6869-48b4-bca3-3030c8ef4cad tempest-AttachVolumeNegativeTest-1368352343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:24:02 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-a65091a5-6869-48b4-bca3-3030c8ef4cad tempest-AttachVolumeNegativeTest-1368352343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:24:02 devstack sudo[102978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce Aug 05 06:24:02 devstack sudo[102978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:24:02 devstack sudo[102978]: pam_unix(sudo:session): session closed for user root Aug 05 06:24:02 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-a65091a5-6869-48b4-bca3-3030c8ef4cad tempest-AttachVolumeNegativeTest-1368352343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce" returned: 0 in 0.251s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:24:02 devstack cinder-volume[88695]: DEBUG cinder.manager [None req-a65091a5-6869-48b4-bca3-3030c8ef4cad tempest-AttachVolumeNegativeTest-1368352343 None] Notifying Schedulers of capabilities ... {{(pid=88695) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 06:24:02 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-a65091a5-6869-48b4-bca3-3030c8ef4cad tempest-AttachVolumeNegativeTest-1368352343 None] Deleted volume successfully. Aug 05 06:24:02 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-a65091a5-6869-48b4-bca3-3030c8ef4cad tempest-AttachVolumeNegativeTest-1368352343 None] Lock "cinder-f8ada0cd-4728-44f0-b6d3-218943332a92-delete_volume" released by "delete_volume" :: held 1.183s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:24:02 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-fb4b83ce-54db-4909-a622-7da52e2e827f tempest-AttachVolumeNegativeTest-1368352343 None] Acquiring lock "cinder-deee4520-52f8-4770-9505-74a052710fe5-delete_volume" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:24:02 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-fb4b83ce-54db-4909-a622-7da52e2e827f tempest-AttachVolumeNegativeTest-1368352343 None] Lock "cinder-deee4520-52f8-4770-9505-74a052710fe5-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:24:03 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-fb4b83ce-54db-4909-a622-7da52e2e827f tempest-AttachVolumeNegativeTest-1368352343 None] Acquiring lock "cinder-quobyte-deee4520-52f8-4770-9505-74a052710fe5" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:24:03 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-fb4b83ce-54db-4909-a622-7da52e2e827f tempest-AttachVolumeNegativeTest-1368352343 None] Lock "cinder-quobyte-deee4520-52f8-4770-9505-74a052710fe5" acquired by "delete_volume" :: waited 0.017s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:24:03 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[832c009e-5d48-429b-9812-db0ea075d194]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:24:03 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-fb4b83ce-54db-4909-a622-7da52e2e827f tempest-AttachVolumeNegativeTest-1368352343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-deee4520-52f8-4770-9505-74a052710fe5 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:24:03 devstack sudo[102981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-deee4520-52f8-4770-9505-74a052710fe5 Aug 05 06:24:03 devstack sudo[102981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:24:03 devstack sudo[102981]: pam_unix(sudo:session): session closed for user root Aug 05 06:24:03 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-fb4b83ce-54db-4909-a622-7da52e2e827f tempest-AttachVolumeNegativeTest-1368352343 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-deee4520-52f8-4770-9505-74a052710fe5" returned: 0 in 0.412s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:24:03 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-fb4b83ce-54db-4909-a622-7da52e2e827f tempest-AttachVolumeNegativeTest-1368352343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-deee4520-52f8-4770-9505-74a052710fe5 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:24:03 devstack sudo[102988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-deee4520-52f8-4770-9505-74a052710fe5 Aug 05 06:24:03 devstack sudo[102988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:24:03 devstack sudo[102988]: pam_unix(sudo:session): session closed for user root Aug 05 06:24:03 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-fb4b83ce-54db-4909-a622-7da52e2e827f tempest-AttachVolumeNegativeTest-1368352343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-deee4520-52f8-4770-9505-74a052710fe5" returned: 0 in 0.300s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:24:03 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-fb4b83ce-54db-4909-a622-7da52e2e827f tempest-AttachVolumeNegativeTest-1368352343 None] Lock "cinder-quobyte-deee4520-52f8-4770-9505-74a052710fe5" released by "delete_volume" :: held 0.759s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:24:03 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-fb4b83ce-54db-4909-a622-7da52e2e827f tempest-AttachVolumeNegativeTest-1368352343 None] Created reservations ['d3e26b83-7090-4efa-a13c-5ce45f88e496', 'c5fb7de1-09c7-4137-b9a9-8544460921a3', '49830bd2-c078-44bb-9252-28ded155f850', 'ee4112e8-34ed-4e5e-959e-e538a0805041'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:24:03 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-fb4b83ce-54db-4909-a622-7da52e2e827f tempest-AttachVolumeNegativeTest-1368352343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:24:03 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-fb4b83ce-54db-4909-a622-7da52e2e827f tempest-AttachVolumeNegativeTest-1368352343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:24:03 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-fb4b83ce-54db-4909-a622-7da52e2e827f tempest-AttachVolumeNegativeTest-1368352343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:24:03 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-fb4b83ce-54db-4909-a622-7da52e2e827f tempest-AttachVolumeNegativeTest-1368352343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:24:03 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-fb4b83ce-54db-4909-a622-7da52e2e827f tempest-AttachVolumeNegativeTest-1368352343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:24:03 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-fb4b83ce-54db-4909-a622-7da52e2e827f tempest-AttachVolumeNegativeTest-1368352343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:24:03 devstack sudo[102993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce Aug 05 06:24:03 devstack sudo[102993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:24:04 devstack sudo[102993]: pam_unix(sudo:session): session closed for user root Aug 05 06:24:04 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-fb4b83ce-54db-4909-a622-7da52e2e827f tempest-AttachVolumeNegativeTest-1368352343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce" returned: 0 in 0.322s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:24:04 devstack cinder-volume[88695]: DEBUG cinder.manager [None req-fb4b83ce-54db-4909-a622-7da52e2e827f tempest-AttachVolumeNegativeTest-1368352343 None] Notifying Schedulers of capabilities ... {{(pid=88695) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 06:24:04 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-fb4b83ce-54db-4909-a622-7da52e2e827f tempest-AttachVolumeNegativeTest-1368352343 None] Deleted volume successfully. Aug 05 06:24:04 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-fb4b83ce-54db-4909-a622-7da52e2e827f tempest-AttachVolumeNegativeTest-1368352343 None] Lock "cinder-deee4520-52f8-4770-9505-74a052710fe5-delete_volume" released by "delete_volume" :: held 1.349s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:24:04 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-fe885526-9b3a-4053-8c56-e965cc692249 tempest-AttachVolumeNegativeTest-1368352343 None] Acquiring lock "cinder-141c8479-fd92-499e-b9c4-6a4b989bbe2d-delete_volume" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:24:04 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-fe885526-9b3a-4053-8c56-e965cc692249 tempest-AttachVolumeNegativeTest-1368352343 None] Lock "cinder-141c8479-fd92-499e-b9c4-6a4b989bbe2d-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:24:04 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-fe885526-9b3a-4053-8c56-e965cc692249 tempest-AttachVolumeNegativeTest-1368352343 None] Acquiring lock "cinder-quobyte-141c8479-fd92-499e-b9c4-6a4b989bbe2d" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:24:04 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-fe885526-9b3a-4053-8c56-e965cc692249 tempest-AttachVolumeNegativeTest-1368352343 None] Lock "cinder-quobyte-141c8479-fd92-499e-b9c4-6a4b989bbe2d" acquired by "delete_volume" :: waited 0.013s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:24:04 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[41681f6e-8d9e-4645-b2b4-5ed3659c3fce]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:24:04 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-fe885526-9b3a-4053-8c56-e965cc692249 tempest-AttachVolumeNegativeTest-1368352343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-141c8479-fd92-499e-b9c4-6a4b989bbe2d {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:24:04 devstack sudo[102996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-141c8479-fd92-499e-b9c4-6a4b989bbe2d Aug 05 06:24:04 devstack sudo[102996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:24:04 devstack sudo[102996]: pam_unix(sudo:session): session closed for user root Aug 05 06:24:04 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-fe885526-9b3a-4053-8c56-e965cc692249 tempest-AttachVolumeNegativeTest-1368352343 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-141c8479-fd92-499e-b9c4-6a4b989bbe2d" returned: 0 in 0.421s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:24:04 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-fe885526-9b3a-4053-8c56-e965cc692249 tempest-AttachVolumeNegativeTest-1368352343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-141c8479-fd92-499e-b9c4-6a4b989bbe2d {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:24:04 devstack sudo[103001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-141c8479-fd92-499e-b9c4-6a4b989bbe2d Aug 05 06:24:04 devstack sudo[103001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:24:05 devstack sudo[103001]: pam_unix(sudo:session): session closed for user root Aug 05 06:24:05 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-fe885526-9b3a-4053-8c56-e965cc692249 tempest-AttachVolumeNegativeTest-1368352343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-141c8479-fd92-499e-b9c4-6a4b989bbe2d" returned: 0 in 0.262s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:24:05 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-fe885526-9b3a-4053-8c56-e965cc692249 tempest-AttachVolumeNegativeTest-1368352343 None] Lock "cinder-quobyte-141c8479-fd92-499e-b9c4-6a4b989bbe2d" released by "delete_volume" :: held 0.723s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:24:05 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-fe885526-9b3a-4053-8c56-e965cc692249 tempest-AttachVolumeNegativeTest-1368352343 None] Created reservations ['aa54461f-f4f1-4b7d-a989-ac050d2cbd27', '0969db07-da16-4b0a-9ddf-c6efd99114c5', '2d8b5c6e-b005-4c65-8784-da10d4daebf8', '2979379f-214d-4262-81fc-65daa401158c'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:24:05 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-fe885526-9b3a-4053-8c56-e965cc692249 tempest-AttachVolumeNegativeTest-1368352343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:24:05 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-fe885526-9b3a-4053-8c56-e965cc692249 tempest-AttachVolumeNegativeTest-1368352343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:24:05 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-fe885526-9b3a-4053-8c56-e965cc692249 tempest-AttachVolumeNegativeTest-1368352343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:24:05 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-fe885526-9b3a-4053-8c56-e965cc692249 tempest-AttachVolumeNegativeTest-1368352343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:24:05 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-fe885526-9b3a-4053-8c56-e965cc692249 tempest-AttachVolumeNegativeTest-1368352343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:24:05 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-fe885526-9b3a-4053-8c56-e965cc692249 tempest-AttachVolumeNegativeTest-1368352343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:24:05 devstack sudo[103004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce Aug 05 06:24:05 devstack sudo[103004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:24:05 devstack sudo[103004]: pam_unix(sudo:session): session closed for user root Aug 05 06:24:05 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-fe885526-9b3a-4053-8c56-e965cc692249 tempest-AttachVolumeNegativeTest-1368352343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce" returned: 0 in 0.324s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:24:05 devstack cinder-volume[88695]: DEBUG cinder.manager [None req-fe885526-9b3a-4053-8c56-e965cc692249 tempest-AttachVolumeNegativeTest-1368352343 None] Notifying Schedulers of capabilities ... {{(pid=88695) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 06:24:05 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-fe885526-9b3a-4053-8c56-e965cc692249 tempest-AttachVolumeNegativeTest-1368352343 None] Deleted volume successfully. Aug 05 06:24:05 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-fe885526-9b3a-4053-8c56-e965cc692249 tempest-AttachVolumeNegativeTest-1368352343 None] Lock "cinder-141c8479-fd92-499e-b9c4-6a4b989bbe2d-delete_volume" released by "delete_volume" :: held 1.266s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:24:12 devstack cinder-volume[88695]: DEBUG cinder.volume.flows.manager.create_volume [req-5586bd1c-3ea2-46ff-a0e7-e96ecc85efb3 req-ab411de2-f17d-4fb1-bdf1-b696c10191de tempest-VolumesSnapshotsTestJSON-1065277507 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88695) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 06:24:12 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [req-5586bd1c-3ea2-46ff-a0e7-e96ecc85efb3 req-ab411de2-f17d-4fb1-bdf1-b696c10191de tempest-VolumesSnapshotsTestJSON-1065277507 None] Flow 'volume_create_manager' (863251b9-dd03-4423-893f-f20c3cc04453) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:24:12 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [req-5586bd1c-3ea2-46ff-a0e7-e96ecc85efb3 req-ab411de2-f17d-4fb1-bdf1-b696c10191de tempest-VolumesSnapshotsTestJSON-1065277507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c71b966-5627-45b4-8fe5-08a5ecd692c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:24:13 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [req-5586bd1c-3ea2-46ff-a0e7-e96ecc85efb3 req-ab411de2-f17d-4fb1-bdf1-b696c10191de tempest-VolumesSnapshotsTestJSON-1065277507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c71b966-5627-45b4-8fe5-08a5ecd692c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:24:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1382052563',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f139ace5-0c35-45ce-b9d0-3e4935b37e89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99b8ee1c452d48a49ade7721085fd477',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:24:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:24:13Z,use_quota=True,user_id='e0d13cab0b28472f8e0af6227d38c955',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:24:13 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [req-5586bd1c-3ea2-46ff-a0e7-e96ecc85efb3 req-ab411de2-f17d-4fb1-bdf1-b696c10191de tempest-VolumesSnapshotsTestJSON-1065277507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c394c735-0d07-4eed-b535-8b5977406e2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:24:13 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [req-5586bd1c-3ea2-46ff-a0e7-e96ecc85efb3 req-ab411de2-f17d-4fb1-bdf1-b696c10191de tempest-VolumesSnapshotsTestJSON-1065277507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c394c735-0d07-4eed-b535-8b5977406e2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:24:13 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [req-5586bd1c-3ea2-46ff-a0e7-e96ecc85efb3 req-ab411de2-f17d-4fb1-bdf1-b696c10191de tempest-VolumesSnapshotsTestJSON-1065277507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c7b4d82-ace8-42da-93e4-a00854f50a92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:24:13 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [req-5586bd1c-3ea2-46ff-a0e7-e96ecc85efb3 req-ab411de2-f17d-4fb1-bdf1-b696c10191de tempest-VolumesSnapshotsTestJSON-1065277507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c7b4d82-ace8-42da-93e4-a00854f50a92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f139ace5-0c35-45ce-b9d0-3e4935b37e89', 'volume_name': 'volume-f139ace5-0c35-45ce-b9d0-3e4935b37e89', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:24:13 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [req-5586bd1c-3ea2-46ff-a0e7-e96ecc85efb3 req-ab411de2-f17d-4fb1-bdf1-b696c10191de tempest-VolumesSnapshotsTestJSON-1065277507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b5e8ed0-3b02-45fc-819a-9f762050f1fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:24:13 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [req-5586bd1c-3ea2-46ff-a0e7-e96ecc85efb3 req-ab411de2-f17d-4fb1-bdf1-b696c10191de tempest-VolumesSnapshotsTestJSON-1065277507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b5e8ed0-3b02-45fc-819a-9f762050f1fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:24:13 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [req-5586bd1c-3ea2-46ff-a0e7-e96ecc85efb3 req-ab411de2-f17d-4fb1-bdf1-b696c10191de tempest-VolumesSnapshotsTestJSON-1065277507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34b0f1d5-8925-436f-8f3c-5e541404ec28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:24:13 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [req-5586bd1c-3ea2-46ff-a0e7-e96ecc85efb3 req-ab411de2-f17d-4fb1-bdf1-b696c10191de tempest-VolumesSnapshotsTestJSON-1065277507 None] Volume f139ace5-0c35-45ce-b9d0-3e4935b37e89: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f139ace5-0c35-45ce-b9d0-3e4935b37e89', 'volume_size': 1} Aug 05 06:24:13 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [req-5586bd1c-3ea2-46ff-a0e7-e96ecc85efb3 req-ab411de2-f17d-4fb1-bdf1-b696c10191de tempest-VolumesSnapshotsTestJSON-1065277507 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:24:13 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [req-5586bd1c-3ea2-46ff-a0e7-e96ecc85efb3 req-ab411de2-f17d-4fb1-bdf1-b696c10191de tempest-VolumesSnapshotsTestJSON-1065277507 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:24:13 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [req-5586bd1c-3ea2-46ff-a0e7-e96ecc85efb3 req-ab411de2-f17d-4fb1-bdf1-b696c10191de tempest-VolumesSnapshotsTestJSON-1065277507 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:24:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1382052563',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f139ace5-0c35-45ce-b9d0-3e4935b37e89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99b8ee1c452d48a49ade7721085fd477',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:24:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:24:13Z,use_quota=True,user_id='e0d13cab0b28472f8e0af6227d38c955',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)}" {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 06:24:13 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [req-5586bd1c-3ea2-46ff-a0e7-e96ecc85efb3 req-ab411de2-f17d-4fb1-bdf1-b696c10191de tempest-VolumesSnapshotsTestJSON-1065277507 None] Creating volume f139ace5-0c35-45ce-b9d0-3e4935b37e89 {{(pid=88695) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 06:24:13 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [req-5586bd1c-3ea2-46ff-a0e7-e96ecc85efb3 req-ab411de2-f17d-4fb1-bdf1-b696c10191de tempest-VolumesSnapshotsTestJSON-1065277507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:24:13 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [req-5586bd1c-3ea2-46ff-a0e7-e96ecc85efb3 req-ab411de2-f17d-4fb1-bdf1-b696c10191de tempest-VolumesSnapshotsTestJSON-1065277507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:24:13 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [req-5586bd1c-3ea2-46ff-a0e7-e96ecc85efb3 req-ab411de2-f17d-4fb1-bdf1-b696c10191de tempest-VolumesSnapshotsTestJSON-1065277507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:24:13 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [req-5586bd1c-3ea2-46ff-a0e7-e96ecc85efb3 req-ab411de2-f17d-4fb1-bdf1-b696c10191de tempest-VolumesSnapshotsTestJSON-1065277507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:24:13 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [req-5586bd1c-3ea2-46ff-a0e7-e96ecc85efb3 req-ab411de2-f17d-4fb1-bdf1-b696c10191de tempest-VolumesSnapshotsTestJSON-1065277507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:24:13 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [req-5586bd1c-3ea2-46ff-a0e7-e96ecc85efb3 req-ab411de2-f17d-4fb1-bdf1-b696c10191de tempest-VolumesSnapshotsTestJSON-1065277507 None] Selected osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 as target Quobyte volume. {{(pid=88695) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 06:24:13 devstack cinder-volume[88695]: INFO cinder.volume.drivers.remotefs [req-5586bd1c-3ea2-46ff-a0e7-e96ecc85efb3 req-ab411de2-f17d-4fb1-bdf1-b696c10191de tempest-VolumesSnapshotsTestJSON-1065277507 None] casted to osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 Aug 05 06:24:13 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [req-5586bd1c-3ea2-46ff-a0e7-e96ecc85efb3 req-ab411de2-f17d-4fb1-bdf1-b696c10191de tempest-VolumesSnapshotsTestJSON-1065277507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-f139ace5-0c35-45ce-b9d0-3e4935b37e89 1073741824 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:24:13 devstack sudo[103014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-f139ace5-0c35-45ce-b9d0-3e4935b37e89 1073741824 Aug 05 06:24:13 devstack sudo[103014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:24:13 devstack sudo[103014]: pam_unix(sudo:session): session closed for user root Aug 05 06:24:13 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [req-5586bd1c-3ea2-46ff-a0e7-e96ecc85efb3 req-ab411de2-f17d-4fb1-bdf1-b696c10191de tempest-VolumesSnapshotsTestJSON-1065277507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-f139ace5-0c35-45ce-b9d0-3e4935b37e89 1073741824" returned: 0 in 0.521s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:24:13 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [req-5586bd1c-3ea2-46ff-a0e7-e96ecc85efb3 req-ab411de2-f17d-4fb1-bdf1-b696c10191de tempest-VolumesSnapshotsTestJSON-1065277507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-f139ace5-0c35-45ce-b9d0-3e4935b37e89 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:24:13 devstack sudo[103020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-f139ace5-0c35-45ce-b9d0-3e4935b37e89 Aug 05 06:24:13 devstack sudo[103020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:24:13 devstack sudo[103020]: pam_unix(sudo:session): session closed for user root Aug 05 06:24:13 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [req-5586bd1c-3ea2-46ff-a0e7-e96ecc85efb3 req-ab411de2-f17d-4fb1-bdf1-b696c10191de tempest-VolumesSnapshotsTestJSON-1065277507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-f139ace5-0c35-45ce-b9d0-3e4935b37e89" returned: 0 in 0.270s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:24:13 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [req-5586bd1c-3ea2-46ff-a0e7-e96ecc85efb3 req-ab411de2-f17d-4fb1-bdf1-b696c10191de tempest-VolumesSnapshotsTestJSON-1065277507 None] <== create_volume: return (854ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'} {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 06:24:13 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [req-5586bd1c-3ea2-46ff-a0e7-e96ecc85efb3 req-ab411de2-f17d-4fb1-bdf1-b696c10191de tempest-VolumesSnapshotsTestJSON-1065277507 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.858s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:24:13 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [req-5586bd1c-3ea2-46ff-a0e7-e96ecc85efb3 req-ab411de2-f17d-4fb1-bdf1-b696c10191de tempest-VolumesSnapshotsTestJSON-1065277507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34b0f1d5-8925-436f-8f3c-5e541404ec28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f139ace5-0c35-45ce-b9d0-3e4935b37e89', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:24:13 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [req-5586bd1c-3ea2-46ff-a0e7-e96ecc85efb3 req-ab411de2-f17d-4fb1-bdf1-b696c10191de tempest-VolumesSnapshotsTestJSON-1065277507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (643f1798-ad84-4493-a66d-fcfa5f7765b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:24:13 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [req-5586bd1c-3ea2-46ff-a0e7-e96ecc85efb3 req-ab411de2-f17d-4fb1-bdf1-b696c10191de tempest-VolumesSnapshotsTestJSON-1065277507 None] Volume volume-f139ace5-0c35-45ce-b9d0-3e4935b37e89 (f139ace5-0c35-45ce-b9d0-3e4935b37e89): created successfully Aug 05 06:24:13 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [req-5586bd1c-3ea2-46ff-a0e7-e96ecc85efb3 req-ab411de2-f17d-4fb1-bdf1-b696c10191de tempest-VolumesSnapshotsTestJSON-1065277507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (643f1798-ad84-4493-a66d-fcfa5f7765b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:24:13 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [req-5586bd1c-3ea2-46ff-a0e7-e96ecc85efb3 req-ab411de2-f17d-4fb1-bdf1-b696c10191de tempest-VolumesSnapshotsTestJSON-1065277507 None] Flow 'volume_create_manager' (863251b9-dd03-4423-893f-f20c3cc04453) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:24:13 devstack cinder-volume[88695]: INFO cinder.volume.manager [req-5586bd1c-3ea2-46ff-a0e7-e96ecc85efb3 req-ab411de2-f17d-4fb1-bdf1-b696c10191de tempest-VolumesSnapshotsTestJSON-1065277507 None] Created volume successfully. Aug 05 06:24:14 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [req-ebc96a14-20be-4837-996e-cc9637f7f11b req-fc691810-b97d-4a02-97d3-9adc3c83ec9f tempest-VolumesSnapshotsTestJSON-1065277507 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:24:14 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [req-ebc96a14-20be-4837-996e-cc9637f7f11b req-fc691810-b97d-4a02-97d3-9adc3c83ec9f tempest-VolumesSnapshotsTestJSON-1065277507 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:24:14 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [req-ebc96a14-20be-4837-996e-cc9637f7f11b req-fc691810-b97d-4a02-97d3-9adc3c83ec9f tempest-VolumesSnapshotsTestJSON-1065277507 None] Creating offline snapshot 79464fd6-9ace-48dc-a669-9adcb6d7eb79 of volume f139ace5-0c35-45ce-b9d0-3e4935b37e89 {{(pid=88695) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 06:24:14 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d65bb7f-d6e9-4ff0-921b-eebd1f6af695]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:24:14 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [req-ebc96a14-20be-4837-996e-cc9637f7f11b req-fc691810-b97d-4a02-97d3-9adc3c83ec9f tempest-VolumesSnapshotsTestJSON-1065277507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-f139ace5-0c35-45ce-b9d0-3e4935b37e89 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:24:14 devstack sudo[103023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-f139ace5-0c35-45ce-b9d0-3e4935b37e89 Aug 05 06:24:14 devstack sudo[103023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:24:14 devstack sudo[103023]: pam_unix(sudo:session): session closed for user root Aug 05 06:24:14 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [req-ebc96a14-20be-4837-996e-cc9637f7f11b req-fc691810-b97d-4a02-97d3-9adc3c83ec9f tempest-VolumesSnapshotsTestJSON-1065277507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-f139ace5-0c35-45ce-b9d0-3e4935b37e89" returned: 0 in 0.409s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:24:14 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [req-ebc96a14-20be-4837-996e-cc9637f7f11b req-fc691810-b97d-4a02-97d3-9adc3c83ec9f tempest-VolumesSnapshotsTestJSON-1065277507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-f139ace5-0c35-45ce-b9d0-3e4935b37e89,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-f139ace5-0c35-45ce-b9d0-3e4935b37e89.79464fd6-9ace-48dc-a669-9adcb6d7eb79 1G {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:24:14 devstack sudo[103028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-f139ace5-0c35-45ce-b9d0-3e4935b37e89,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-f139ace5-0c35-45ce-b9d0-3e4935b37e89.79464fd6-9ace-48dc-a669-9adcb6d7eb79 1G Aug 05 06:24:14 devstack sudo[103028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:24:15 devstack sudo[103028]: pam_unix(sudo:session): session closed for user root Aug 05 06:24:15 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [req-ebc96a14-20be-4837-996e-cc9637f7f11b req-fc691810-b97d-4a02-97d3-9adc3c83ec9f tempest-VolumesSnapshotsTestJSON-1065277507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-f139ace5-0c35-45ce-b9d0-3e4935b37e89,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-f139ace5-0c35-45ce-b9d0-3e4935b37e89.79464fd6-9ace-48dc-a669-9adcb6d7eb79 1G" returned: 0 in 0.411s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:24:15 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [req-ebc96a14-20be-4837-996e-cc9637f7f11b req-fc691810-b97d-4a02-97d3-9adc3c83ec9f tempest-VolumesSnapshotsTestJSON-1065277507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f139ace5-0c35-45ce-b9d0-3e4935b37e89 -F qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-f139ace5-0c35-45ce-b9d0-3e4935b37e89.79464fd6-9ace-48dc-a669-9adcb6d7eb79 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:24:15 devstack sudo[103033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f139ace5-0c35-45ce-b9d0-3e4935b37e89 -F qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-f139ace5-0c35-45ce-b9d0-3e4935b37e89.79464fd6-9ace-48dc-a669-9adcb6d7eb79 Aug 05 06:24:15 devstack sudo[103033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:24:15 devstack sudo[103033]: pam_unix(sudo:session): session closed for user root Aug 05 06:24:15 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [req-ebc96a14-20be-4837-996e-cc9637f7f11b req-fc691810-b97d-4a02-97d3-9adc3c83ec9f tempest-VolumesSnapshotsTestJSON-1065277507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f139ace5-0c35-45ce-b9d0-3e4935b37e89 -F qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-f139ace5-0c35-45ce-b9d0-3e4935b37e89.79464fd6-9ace-48dc-a669-9adcb6d7eb79" returned: 0 in 0.297s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:24:15 devstack cinder-volume[88695]: WARNING cinder.volume.drivers.remotefs [req-ebc96a14-20be-4837-996e-cc9637f7f11b req-fc691810-b97d-4a02-97d3-9adc3c83ec9f tempest-VolumesSnapshotsTestJSON-1065277507 None] /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-f139ace5-0c35-45ce-b9d0-3e4935b37e89.79464fd6-9ace-48dc-a669-9adcb6d7eb79 is being set with open permissions: ugo+rw Aug 05 06:24:15 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [req-ebc96a14-20be-4837-996e-cc9637f7f11b req-fc691810-b97d-4a02-97d3-9adc3c83ec9f tempest-VolumesSnapshotsTestJSON-1065277507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-f139ace5-0c35-45ce-b9d0-3e4935b37e89.79464fd6-9ace-48dc-a669-9adcb6d7eb79 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:24:15 devstack sudo[103038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-f139ace5-0c35-45ce-b9d0-3e4935b37e89.79464fd6-9ace-48dc-a669-9adcb6d7eb79 Aug 05 06:24:15 devstack sudo[103038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:24:15 devstack sudo[103038]: pam_unix(sudo:session): session closed for user root Aug 05 06:24:15 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [req-ebc96a14-20be-4837-996e-cc9637f7f11b req-fc691810-b97d-4a02-97d3-9adc3c83ec9f tempest-VolumesSnapshotsTestJSON-1065277507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-f139ace5-0c35-45ce-b9d0-3e4935b37e89.79464fd6-9ace-48dc-a669-9adcb6d7eb79" returned: 0 in 0.296s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:24:15 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [req-ebc96a14-20be-4837-996e-cc9637f7f11b req-fc691810-b97d-4a02-97d3-9adc3c83ec9f tempest-VolumesSnapshotsTestJSON-1065277507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-f139ace5-0c35-45ce-b9d0-3e4935b37e89.info {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:24:15 devstack sudo[103041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-f139ace5-0c35-45ce-b9d0-3e4935b37e89.info Aug 05 06:24:15 devstack sudo[103041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:24:16 devstack sudo[103041]: pam_unix(sudo:session): session closed for user root Aug 05 06:24:16 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [req-ebc96a14-20be-4837-996e-cc9637f7f11b req-fc691810-b97d-4a02-97d3-9adc3c83ec9f tempest-VolumesSnapshotsTestJSON-1065277507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-f139ace5-0c35-45ce-b9d0-3e4935b37e89.info" returned: 0 in 0.277s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:24:16 devstack cinder-volume[88695]: WARNING cinder.volume.drivers.remotefs [req-ebc96a14-20be-4837-996e-cc9637f7f11b req-fc691810-b97d-4a02-97d3-9adc3c83ec9f tempest-VolumesSnapshotsTestJSON-1065277507 None] /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-f139ace5-0c35-45ce-b9d0-3e4935b37e89.info is being set with open permissions: ugo+rw Aug 05 06:24:16 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [req-ebc96a14-20be-4837-996e-cc9637f7f11b req-fc691810-b97d-4a02-97d3-9adc3c83ec9f tempest-VolumesSnapshotsTestJSON-1065277507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-f139ace5-0c35-45ce-b9d0-3e4935b37e89.info {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:24:16 devstack sudo[103044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-f139ace5-0c35-45ce-b9d0-3e4935b37e89.info Aug 05 06:24:16 devstack sudo[103044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:24:16 devstack sudo[103044]: pam_unix(sudo:session): session closed for user root Aug 05 06:24:16 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [req-ebc96a14-20be-4837-996e-cc9637f7f11b req-fc691810-b97d-4a02-97d3-9adc3c83ec9f tempest-VolumesSnapshotsTestJSON-1065277507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-f139ace5-0c35-45ce-b9d0-3e4935b37e89.info" returned: 0 in 0.244s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:24:16 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [req-ebc96a14-20be-4837-996e-cc9637f7f11b req-fc691810-b97d-4a02-97d3-9adc3c83ec9f tempest-VolumesSnapshotsTestJSON-1065277507 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.037s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:24:16 devstack cinder-volume[88695]: INFO cinder.volume.manager [req-ebc96a14-20be-4837-996e-cc9637f7f11b req-fc691810-b97d-4a02-97d3-9adc3c83ec9f tempest-VolumesSnapshotsTestJSON-1065277507 None] Create snapshot completed successfully Aug 05 06:24:16 devstack cinder-volume[88695]: DEBUG cinder.coordination [req-ea3db1a3-d46c-4d3d-840e-1bb46f46b1e6 req-5e8f751e-ae70-4973-b604-b7d3cc487e9e tempest-VolumesSnapshotsTestJSON-1065277507 None] Acquiring lock "cinder-79464fd6-9ace-48dc-a669-9adcb6d7eb79-delete_snapshot" by "delete_snapshot" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:24:16 devstack cinder-volume[88695]: DEBUG cinder.coordination [req-ea3db1a3-d46c-4d3d-840e-1bb46f46b1e6 req-5e8f751e-ae70-4973-b604-b7d3cc487e9e tempest-VolumesSnapshotsTestJSON-1065277507 None] Lock "cinder-79464fd6-9ace-48dc-a669-9adcb6d7eb79-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:24:16 devstack cinder-volume[88695]: DEBUG cinder.coordination [req-ea3db1a3-d46c-4d3d-840e-1bb46f46b1e6 req-5e8f751e-ae70-4973-b604-b7d3cc487e9e tempest-VolumesSnapshotsTestJSON-1065277507 None] Acquiring lock "cinder-quobyte-f139ace5-0c35-45ce-b9d0-3e4935b37e89" by "delete_snapshot" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:24:16 devstack cinder-volume[88695]: DEBUG cinder.coordination [req-ea3db1a3-d46c-4d3d-840e-1bb46f46b1e6 req-5e8f751e-ae70-4973-b604-b7d3cc487e9e tempest-VolumesSnapshotsTestJSON-1065277507 None] Lock "cinder-quobyte-f139ace5-0c35-45ce-b9d0-3e4935b37e89" acquired by "delete_snapshot" :: waited 0.026s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:24:16 devstack cinder-volume[88695]: DEBUG cinder.coordination [req-ea3db1a3-d46c-4d3d-840e-1bb46f46b1e6 req-5e8f751e-ae70-4973-b604-b7d3cc487e9e tempest-VolumesSnapshotsTestJSON-1065277507 None] Acquiring lock "cinder-quobyte-79464fd6-9ace-48dc-a669-9adcb6d7eb79" by "_delete_snapshot" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:24:16 devstack cinder-volume[88695]: DEBUG cinder.coordination [req-ea3db1a3-d46c-4d3d-840e-1bb46f46b1e6 req-5e8f751e-ae70-4973-b604-b7d3cc487e9e tempest-VolumesSnapshotsTestJSON-1065277507 None] Lock "cinder-quobyte-79464fd6-9ace-48dc-a669-9adcb6d7eb79" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:24:16 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [req-ea3db1a3-d46c-4d3d-840e-1bb46f46b1e6 req-5e8f751e-ae70-4973-b604-b7d3cc487e9e tempest-VolumesSnapshotsTestJSON-1065277507 None] Deleting offline snapshot 79464fd6-9ace-48dc-a669-9adcb6d7eb79 of volume f139ace5-0c35-45ce-b9d0-3e4935b37e89 {{(pid=88695) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 06:24:16 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [req-ea3db1a3-d46c-4d3d-840e-1bb46f46b1e6 req-5e8f751e-ae70-4973-b604-b7d3cc487e9e tempest-VolumesSnapshotsTestJSON-1065277507 None] snapshot_file for this snap is: volume-f139ace5-0c35-45ce-b9d0-3e4935b37e89.79464fd6-9ace-48dc-a669-9adcb6d7eb79 {{(pid=88695) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 06:24:16 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[61cda255-62f6-4de0-8516-2b456c78eb4d]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:24:16 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [req-ea3db1a3-d46c-4d3d-840e-1bb46f46b1e6 req-5e8f751e-ae70-4973-b604-b7d3cc487e9e tempest-VolumesSnapshotsTestJSON-1065277507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-f139ace5-0c35-45ce-b9d0-3e4935b37e89.79464fd6-9ace-48dc-a669-9adcb6d7eb79 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:24:17 devstack sudo[103047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-f139ace5-0c35-45ce-b9d0-3e4935b37e89.79464fd6-9ace-48dc-a669-9adcb6d7eb79 Aug 05 06:24:17 devstack sudo[103047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:24:17 devstack sudo[103047]: pam_unix(sudo:session): session closed for user root Aug 05 06:24:17 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [req-ea3db1a3-d46c-4d3d-840e-1bb46f46b1e6 req-5e8f751e-ae70-4973-b604-b7d3cc487e9e tempest-VolumesSnapshotsTestJSON-1065277507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-f139ace5-0c35-45ce-b9d0-3e4935b37e89.79464fd6-9ace-48dc-a669-9adcb6d7eb79" returned: 0 in 0.408s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:24:17 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [req-ea3db1a3-d46c-4d3d-840e-1bb46f46b1e6 req-5e8f751e-ae70-4973-b604-b7d3cc487e9e tempest-VolumesSnapshotsTestJSON-1065277507 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f139ace5-0c35-45ce-b9d0-3e4935b37e89(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88695) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 06:24:17 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[feb52e37-3d5f-4ef0-8045-815d83ec2e5e]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:24:17 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [req-ea3db1a3-d46c-4d3d-840e-1bb46f46b1e6 req-5e8f751e-ae70-4973-b604-b7d3cc487e9e tempest-VolumesSnapshotsTestJSON-1065277507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-f139ace5-0c35-45ce-b9d0-3e4935b37e89 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:24:17 devstack sudo[103052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-f139ace5-0c35-45ce-b9d0-3e4935b37e89 Aug 05 06:24:17 devstack sudo[103052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:24:17 devstack sudo[103052]: pam_unix(sudo:session): session closed for user root Aug 05 06:24:17 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [req-ea3db1a3-d46c-4d3d-840e-1bb46f46b1e6 req-5e8f751e-ae70-4973-b604-b7d3cc487e9e tempest-VolumesSnapshotsTestJSON-1065277507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-f139ace5-0c35-45ce-b9d0-3e4935b37e89" returned: 0 in 0.389s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:24:17 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [req-ea3db1a3-d46c-4d3d-840e-1bb46f46b1e6 req-5e8f751e-ae70-4973-b604-b7d3cc487e9e tempest-VolumesSnapshotsTestJSON-1065277507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-f139ace5-0c35-45ce-b9d0-3e4935b37e89.79464fd6-9ace-48dc-a669-9adcb6d7eb79 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:24:17 devstack sudo[103057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-f139ace5-0c35-45ce-b9d0-3e4935b37e89.79464fd6-9ace-48dc-a669-9adcb6d7eb79 Aug 05 06:24:17 devstack sudo[103057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:24:18 devstack sudo[103057]: pam_unix(sudo:session): session closed for user root Aug 05 06:24:18 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [req-ea3db1a3-d46c-4d3d-840e-1bb46f46b1e6 req-5e8f751e-ae70-4973-b604-b7d3cc487e9e tempest-VolumesSnapshotsTestJSON-1065277507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-f139ace5-0c35-45ce-b9d0-3e4935b37e89.79464fd6-9ace-48dc-a669-9adcb6d7eb79" returned: 0 in 0.369s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:24:18 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [req-ea3db1a3-d46c-4d3d-840e-1bb46f46b1e6 req-5e8f751e-ae70-4973-b604-b7d3cc487e9e tempest-VolumesSnapshotsTestJSON-1065277507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-f139ace5-0c35-45ce-b9d0-3e4935b37e89.79464fd6-9ace-48dc-a669-9adcb6d7eb79 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:24:18 devstack sudo[103063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-f139ace5-0c35-45ce-b9d0-3e4935b37e89.79464fd6-9ace-48dc-a669-9adcb6d7eb79 Aug 05 06:24:18 devstack sudo[103063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:24:18 devstack sudo[103063]: pam_unix(sudo:session): session closed for user root Aug 05 06:24:18 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [req-ea3db1a3-d46c-4d3d-840e-1bb46f46b1e6 req-5e8f751e-ae70-4973-b604-b7d3cc487e9e tempest-VolumesSnapshotsTestJSON-1065277507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-f139ace5-0c35-45ce-b9d0-3e4935b37e89.79464fd6-9ace-48dc-a669-9adcb6d7eb79" returned: 0 in 0.264s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:24:18 devstack cinder-volume[88695]: DEBUG cinder.coordination [req-ea3db1a3-d46c-4d3d-840e-1bb46f46b1e6 req-5e8f751e-ae70-4973-b604-b7d3cc487e9e tempest-VolumesSnapshotsTestJSON-1065277507 None] Lock "cinder-quobyte-79464fd6-9ace-48dc-a669-9adcb6d7eb79" released by "_delete_snapshot" :: held 1.558s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:24:18 devstack cinder-volume[88695]: DEBUG cinder.coordination [req-ea3db1a3-d46c-4d3d-840e-1bb46f46b1e6 req-5e8f751e-ae70-4973-b604-b7d3cc487e9e tempest-VolumesSnapshotsTestJSON-1065277507 None] Lock "cinder-quobyte-f139ace5-0c35-45ce-b9d0-3e4935b37e89" released by "delete_snapshot" :: held 1.588s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:24:18 devstack cinder-volume[88695]: DEBUG cinder.quota [req-ea3db1a3-d46c-4d3d-840e-1bb46f46b1e6 req-5e8f751e-ae70-4973-b604-b7d3cc487e9e tempest-VolumesSnapshotsTestJSON-1065277507 None] Created reservations ['9e270a37-bdb8-4f7b-add0-7476892f430e', 'ce9d675b-1cf1-4613-a317-9c5a33b46b09', '4f173bdf-b514-439f-9850-793d658e4a44', 'b75dc8f1-fa3d-4f66-9d42-f503f565eb6e'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:24:18 devstack cinder-volume[88695]: INFO cinder.volume.manager [req-ea3db1a3-d46c-4d3d-840e-1bb46f46b1e6 req-5e8f751e-ae70-4973-b604-b7d3cc487e9e tempest-VolumesSnapshotsTestJSON-1065277507 None] Delete snapshot completed successfully. Aug 05 06:24:18 devstack cinder-volume[88695]: DEBUG cinder.coordination [req-ea3db1a3-d46c-4d3d-840e-1bb46f46b1e6 req-5e8f751e-ae70-4973-b604-b7d3cc487e9e tempest-VolumesSnapshotsTestJSON-1065277507 None] Lock "cinder-79464fd6-9ace-48dc-a669-9adcb6d7eb79-delete_snapshot" released by "delete_snapshot" :: held 1.760s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:24:19 devstack cinder-volume[88695]: DEBUG cinder.coordination [req-8a30b1c7-ce76-49d0-8d90-a1e8a41d62de req-c6c399ff-d8f7-40a7-8704-88562cfb697a tempest-VolumesSnapshotsTestJSON-1065277507 None] Acquiring lock "cinder-f139ace5-0c35-45ce-b9d0-3e4935b37e89-delete_volume" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:24:19 devstack cinder-volume[88695]: DEBUG cinder.coordination [req-8a30b1c7-ce76-49d0-8d90-a1e8a41d62de req-c6c399ff-d8f7-40a7-8704-88562cfb697a tempest-VolumesSnapshotsTestJSON-1065277507 None] Lock "cinder-f139ace5-0c35-45ce-b9d0-3e4935b37e89-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:24:19 devstack cinder-volume[88695]: DEBUG cinder.coordination [req-8a30b1c7-ce76-49d0-8d90-a1e8a41d62de req-c6c399ff-d8f7-40a7-8704-88562cfb697a tempest-VolumesSnapshotsTestJSON-1065277507 None] Acquiring lock "cinder-quobyte-f139ace5-0c35-45ce-b9d0-3e4935b37e89" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:24:19 devstack cinder-volume[88695]: DEBUG cinder.coordination [req-8a30b1c7-ce76-49d0-8d90-a1e8a41d62de req-c6c399ff-d8f7-40a7-8704-88562cfb697a tempest-VolumesSnapshotsTestJSON-1065277507 None] Lock "cinder-quobyte-f139ace5-0c35-45ce-b9d0-3e4935b37e89" acquired by "delete_volume" :: waited 0.017s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:24:19 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f405884-ee5a-45ca-bcbf-df67ce4213db]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:24:19 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [req-8a30b1c7-ce76-49d0-8d90-a1e8a41d62de req-c6c399ff-d8f7-40a7-8704-88562cfb697a tempest-VolumesSnapshotsTestJSON-1065277507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-f139ace5-0c35-45ce-b9d0-3e4935b37e89 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:24:19 devstack sudo[103066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-f139ace5-0c35-45ce-b9d0-3e4935b37e89 Aug 05 06:24:19 devstack sudo[103066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:24:19 devstack sudo[103066]: pam_unix(sudo:session): session closed for user root Aug 05 06:24:19 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [req-8a30b1c7-ce76-49d0-8d90-a1e8a41d62de req-c6c399ff-d8f7-40a7-8704-88562cfb697a tempest-VolumesSnapshotsTestJSON-1065277507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-f139ace5-0c35-45ce-b9d0-3e4935b37e89" returned: 0 in 0.425s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:24:19 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [req-8a30b1c7-ce76-49d0-8d90-a1e8a41d62de req-c6c399ff-d8f7-40a7-8704-88562cfb697a tempest-VolumesSnapshotsTestJSON-1065277507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-f139ace5-0c35-45ce-b9d0-3e4935b37e89 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:24:19 devstack sudo[103071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-f139ace5-0c35-45ce-b9d0-3e4935b37e89 Aug 05 06:24:19 devstack sudo[103071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:24:19 devstack sudo[103071]: pam_unix(sudo:session): session closed for user root Aug 05 06:24:19 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [req-8a30b1c7-ce76-49d0-8d90-a1e8a41d62de req-c6c399ff-d8f7-40a7-8704-88562cfb697a tempest-VolumesSnapshotsTestJSON-1065277507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-f139ace5-0c35-45ce-b9d0-3e4935b37e89" returned: 0 in 0.263s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:24:19 devstack cinder-volume[88695]: DEBUG cinder.coordination [req-8a30b1c7-ce76-49d0-8d90-a1e8a41d62de req-c6c399ff-d8f7-40a7-8704-88562cfb697a tempest-VolumesSnapshotsTestJSON-1065277507 None] Lock "cinder-quobyte-f139ace5-0c35-45ce-b9d0-3e4935b37e89" released by "delete_volume" :: held 0.767s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:24:19 devstack cinder-volume[88695]: DEBUG cinder.quota [req-8a30b1c7-ce76-49d0-8d90-a1e8a41d62de req-c6c399ff-d8f7-40a7-8704-88562cfb697a tempest-VolumesSnapshotsTestJSON-1065277507 None] Created reservations ['a50d0407-e864-4cd3-b627-82753671093e', '2011be7b-a0c4-44d4-a804-c6cbd14f23dc', '0a8eedb2-2800-4558-b034-34f1d2a385b3', '9da14707-d5d4-4469-8269-23b8b19ce9cc'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:24:20 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [req-8a30b1c7-ce76-49d0-8d90-a1e8a41d62de req-c6c399ff-d8f7-40a7-8704-88562cfb697a tempest-VolumesSnapshotsTestJSON-1065277507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:24:20 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [req-8a30b1c7-ce76-49d0-8d90-a1e8a41d62de req-c6c399ff-d8f7-40a7-8704-88562cfb697a tempest-VolumesSnapshotsTestJSON-1065277507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:24:20 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [req-8a30b1c7-ce76-49d0-8d90-a1e8a41d62de req-c6c399ff-d8f7-40a7-8704-88562cfb697a tempest-VolumesSnapshotsTestJSON-1065277507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:24:20 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [req-8a30b1c7-ce76-49d0-8d90-a1e8a41d62de req-c6c399ff-d8f7-40a7-8704-88562cfb697a tempest-VolumesSnapshotsTestJSON-1065277507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:24:20 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [req-8a30b1c7-ce76-49d0-8d90-a1e8a41d62de req-c6c399ff-d8f7-40a7-8704-88562cfb697a tempest-VolumesSnapshotsTestJSON-1065277507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:24:20 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [req-8a30b1c7-ce76-49d0-8d90-a1e8a41d62de req-c6c399ff-d8f7-40a7-8704-88562cfb697a tempest-VolumesSnapshotsTestJSON-1065277507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:24:20 devstack sudo[103074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce Aug 05 06:24:20 devstack sudo[103074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:24:20 devstack sudo[103074]: pam_unix(sudo:session): session closed for user root Aug 05 06:24:20 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [req-8a30b1c7-ce76-49d0-8d90-a1e8a41d62de req-c6c399ff-d8f7-40a7-8704-88562cfb697a tempest-VolumesSnapshotsTestJSON-1065277507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce" returned: 0 in 0.267s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:24:20 devstack cinder-volume[88695]: DEBUG cinder.manager [req-8a30b1c7-ce76-49d0-8d90-a1e8a41d62de req-c6c399ff-d8f7-40a7-8704-88562cfb697a tempest-VolumesSnapshotsTestJSON-1065277507 None] Notifying Schedulers of capabilities ... {{(pid=88695) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 06:24:20 devstack cinder-volume[88695]: INFO cinder.volume.manager [req-8a30b1c7-ce76-49d0-8d90-a1e8a41d62de req-c6c399ff-d8f7-40a7-8704-88562cfb697a tempest-VolumesSnapshotsTestJSON-1065277507 None] Deleted volume successfully. Aug 05 06:24:20 devstack cinder-volume[88695]: DEBUG cinder.coordination [req-8a30b1c7-ce76-49d0-8d90-a1e8a41d62de req-c6c399ff-d8f7-40a7-8704-88562cfb697a tempest-VolumesSnapshotsTestJSON-1065277507 None] Lock "cinder-f139ace5-0c35-45ce-b9d0-3e4935b37e89-delete_volume" released by "delete_volume" :: held 1.269s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:24:28 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-f7c085b9-4cb3-4e82-a15a-c2a1bf748b42 tempest-GroupsTest-1133874654 None] Group tempest-Group1-1728775676: creating Aug 05 06:24:28 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-f7c085b9-4cb3-4e82-a15a-c2a1bf748b42 tempest-GroupsTest-1133874654 None] Group tempest-Group1-1728775676: created successfully Aug 05 06:24:28 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-f7c085b9-4cb3-4e82-a15a-c2a1bf748b42 tempest-GroupsTest-1133874654 None] Create group completed successfully. Aug 05 06:24:29 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-e403a487-49b1-4a29-a7a4-19f14339e620 tempest-GroupsTest-1133874654 None] Group tempest-Group2-1377171574: creating Aug 05 06:24:29 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-e403a487-49b1-4a29-a7a4-19f14339e620 tempest-GroupsTest-1133874654 None] Group tempest-Group2-1377171574: created successfully Aug 05 06:24:29 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-e403a487-49b1-4a29-a7a4-19f14339e620 tempest-GroupsTest-1133874654 None] Create group completed successfully. Aug 05 06:24:31 devstack cinder-volume[88695]: DEBUG cinder.volume.flows.manager.create_volume [None req-dad697fc-fcc0-4a63-a3a2-9bc57a08aaf6 tempest-GroupsTest-1133874654 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88695) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 06:24:31 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-dad697fc-fcc0-4a63-a3a2-9bc57a08aaf6 tempest-GroupsTest-1133874654 None] Flow 'volume_create_manager' (cfd983bd-c99d-42c1-b6b6-0937d852204d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:24:31 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-dad697fc-fcc0-4a63-a3a2-9bc57a08aaf6 tempest-GroupsTest-1133874654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (081002d7-8f5e-437b-9c79-b6d2a5e5f981) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:24:31 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-dad697fc-fcc0-4a63-a3a2-9bc57a08aaf6 tempest-GroupsTest-1133874654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (081002d7-8f5e-437b-9c79-b6d2a5e5f981) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:24:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-519148722',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ff4c51f0-9dd3-41e2-a304-06955a61edc8,host='devstack@QuobyteHD#QuobyteHD',id=af6055cc-5579-41b8-805c-34b615d81433,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2016b4b8930498987ebfa2654efa4fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:24:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:24:31Z,use_quota=True,user_id='3c6f4a735b4a44cb8a152078a2203930',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0bc84194-cda6-4eca-ae55-7a9663e58097),volume_type_id=0bc84194-cda6-4eca-ae55-7a9663e58097)' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:24:31 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-dad697fc-fcc0-4a63-a3a2-9bc57a08aaf6 tempest-GroupsTest-1133874654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bda78f6b-e4aa-45a1-9846-db292a3bb442) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:24:31 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-dad697fc-fcc0-4a63-a3a2-9bc57a08aaf6 tempest-GroupsTest-1133874654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bda78f6b-e4aa-45a1-9846-db292a3bb442) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:24:31 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-dad697fc-fcc0-4a63-a3a2-9bc57a08aaf6 tempest-GroupsTest-1133874654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1bdde92-1db9-46f8-a723-c6eebacef70d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:24:31 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-dad697fc-fcc0-4a63-a3a2-9bc57a08aaf6 tempest-GroupsTest-1133874654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1bdde92-1db9-46f8-a723-c6eebacef70d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af6055cc-5579-41b8-805c-34b615d81433', 'volume_name': 'volume-af6055cc-5579-41b8-805c-34b615d81433', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:24:31 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-dad697fc-fcc0-4a63-a3a2-9bc57a08aaf6 tempest-GroupsTest-1133874654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (289ec307-4663-4486-aa2f-b68ed2645d02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:24:31 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-dad697fc-fcc0-4a63-a3a2-9bc57a08aaf6 tempest-GroupsTest-1133874654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (289ec307-4663-4486-aa2f-b68ed2645d02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:24:31 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-dad697fc-fcc0-4a63-a3a2-9bc57a08aaf6 tempest-GroupsTest-1133874654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b6a5f90-f841-479c-8642-cdeb71df8809) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:24:31 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-dad697fc-fcc0-4a63-a3a2-9bc57a08aaf6 tempest-GroupsTest-1133874654 None] Volume af6055cc-5579-41b8-805c-34b615d81433: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af6055cc-5579-41b8-805c-34b615d81433', 'volume_size': 1} Aug 05 06:24:31 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-dad697fc-fcc0-4a63-a3a2-9bc57a08aaf6 tempest-GroupsTest-1133874654 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:24:31 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-dad697fc-fcc0-4a63-a3a2-9bc57a08aaf6 tempest-GroupsTest-1133874654 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:24:31 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-dad697fc-fcc0-4a63-a3a2-9bc57a08aaf6 tempest-GroupsTest-1133874654 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=ff4c51f0-9dd3-41e2-a304-06955a61edc8,created_at=2026-08-05T04:24:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-519148722',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ff4c51f0-9dd3-41e2-a304-06955a61edc8,host='devstack@QuobyteHD#QuobyteHD',id=af6055cc-5579-41b8-805c-34b615d81433,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2016b4b8930498987ebfa2654efa4fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:24:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:24:31Z,use_quota=True,user_id='3c6f4a735b4a44cb8a152078a2203930',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0bc84194-cda6-4eca-ae55-7a9663e58097),volume_type_id=0bc84194-cda6-4eca-ae55-7a9663e58097)}" {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 06:24:31 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-dad697fc-fcc0-4a63-a3a2-9bc57a08aaf6 tempest-GroupsTest-1133874654 None] Creating volume af6055cc-5579-41b8-805c-34b615d81433 {{(pid=88695) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 06:24:31 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-dad697fc-fcc0-4a63-a3a2-9bc57a08aaf6 tempest-GroupsTest-1133874654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:24:31 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-dad697fc-fcc0-4a63-a3a2-9bc57a08aaf6 tempest-GroupsTest-1133874654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:24:31 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-dad697fc-fcc0-4a63-a3a2-9bc57a08aaf6 tempest-GroupsTest-1133874654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:24:31 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-dad697fc-fcc0-4a63-a3a2-9bc57a08aaf6 tempest-GroupsTest-1133874654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:24:31 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-dad697fc-fcc0-4a63-a3a2-9bc57a08aaf6 tempest-GroupsTest-1133874654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:24:31 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-dad697fc-fcc0-4a63-a3a2-9bc57a08aaf6 tempest-GroupsTest-1133874654 None] Selected osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 as target Quobyte volume. {{(pid=88695) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 06:24:31 devstack cinder-volume[88695]: INFO cinder.volume.drivers.remotefs [None req-dad697fc-fcc0-4a63-a3a2-9bc57a08aaf6 tempest-GroupsTest-1133874654 None] casted to osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 Aug 05 06:24:31 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-dad697fc-fcc0-4a63-a3a2-9bc57a08aaf6 tempest-GroupsTest-1133874654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-af6055cc-5579-41b8-805c-34b615d81433 1073741824 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:24:31 devstack sudo[103079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-af6055cc-5579-41b8-805c-34b615d81433 1073741824 Aug 05 06:24:31 devstack sudo[103079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:24:31 devstack sudo[103079]: pam_unix(sudo:session): session closed for user root Aug 05 06:24:31 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-dad697fc-fcc0-4a63-a3a2-9bc57a08aaf6 tempest-GroupsTest-1133874654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-af6055cc-5579-41b8-805c-34b615d81433 1073741824" returned: 0 in 0.497s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:24:31 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-dad697fc-fcc0-4a63-a3a2-9bc57a08aaf6 tempest-GroupsTest-1133874654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-af6055cc-5579-41b8-805c-34b615d81433 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:24:31 devstack sudo[103085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-af6055cc-5579-41b8-805c-34b615d81433 Aug 05 06:24:31 devstack sudo[103085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:24:32 devstack sudo[103085]: pam_unix(sudo:session): session closed for user root Aug 05 06:24:32 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-dad697fc-fcc0-4a63-a3a2-9bc57a08aaf6 tempest-GroupsTest-1133874654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-af6055cc-5579-41b8-805c-34b615d81433" returned: 0 in 0.286s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:24:32 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-dad697fc-fcc0-4a63-a3a2-9bc57a08aaf6 tempest-GroupsTest-1133874654 None] <== create_volume: return (832ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'} {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 06:24:32 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-dad697fc-fcc0-4a63-a3a2-9bc57a08aaf6 tempest-GroupsTest-1133874654 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.834s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:24:32 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-dad697fc-fcc0-4a63-a3a2-9bc57a08aaf6 tempest-GroupsTest-1133874654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b6a5f90-f841-479c-8642-cdeb71df8809) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af6055cc-5579-41b8-805c-34b615d81433', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:24:32 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-dad697fc-fcc0-4a63-a3a2-9bc57a08aaf6 tempest-GroupsTest-1133874654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1f82f67-5f92-439a-8672-ae5acd04bf6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:24:32 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-dad697fc-fcc0-4a63-a3a2-9bc57a08aaf6 tempest-GroupsTest-1133874654 None] Volume volume-af6055cc-5579-41b8-805c-34b615d81433 (af6055cc-5579-41b8-805c-34b615d81433): created successfully Aug 05 06:24:32 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-dad697fc-fcc0-4a63-a3a2-9bc57a08aaf6 tempest-GroupsTest-1133874654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1f82f67-5f92-439a-8672-ae5acd04bf6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:24:32 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-dad697fc-fcc0-4a63-a3a2-9bc57a08aaf6 tempest-GroupsTest-1133874654 None] Flow 'volume_create_manager' (cfd983bd-c99d-42c1-b6b6-0937d852204d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:24:32 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-dad697fc-fcc0-4a63-a3a2-9bc57a08aaf6 tempest-GroupsTest-1133874654 None] Created volume successfully. Aug 05 06:24:33 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-538b6760-74a0-4500-a0cc-3a5bb4bbaf63 tempest-GroupsTest-1133874654 None] Acquiring lock "cinder-quobyte-af6055cc-5579-41b8-805c-34b615d81433" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:24:33 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-538b6760-74a0-4500-a0cc-3a5bb4bbaf63 tempest-GroupsTest-1133874654 None] Lock "cinder-quobyte-af6055cc-5579-41b8-805c-34b615d81433" acquired by "delete_volume" :: waited 0.018s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:24:33 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7c2e1fd-cc80-482f-8f15-db9b0189eb16]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:24:33 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-538b6760-74a0-4500-a0cc-3a5bb4bbaf63 tempest-GroupsTest-1133874654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-af6055cc-5579-41b8-805c-34b615d81433 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:24:33 devstack sudo[103088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-af6055cc-5579-41b8-805c-34b615d81433 Aug 05 06:24:33 devstack sudo[103088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:24:33 devstack sudo[103088]: pam_unix(sudo:session): session closed for user root Aug 05 06:24:33 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-538b6760-74a0-4500-a0cc-3a5bb4bbaf63 tempest-GroupsTest-1133874654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-af6055cc-5579-41b8-805c-34b615d81433" returned: 0 in 0.411s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:24:33 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-538b6760-74a0-4500-a0cc-3a5bb4bbaf63 tempest-GroupsTest-1133874654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-af6055cc-5579-41b8-805c-34b615d81433 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:24:33 devstack sudo[103093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-af6055cc-5579-41b8-805c-34b615d81433 Aug 05 06:24:33 devstack sudo[103093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:24:33 devstack sudo[103093]: pam_unix(sudo:session): session closed for user root Aug 05 06:24:33 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-538b6760-74a0-4500-a0cc-3a5bb4bbaf63 tempest-GroupsTest-1133874654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-af6055cc-5579-41b8-805c-34b615d81433" returned: 0 in 0.275s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:24:33 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-538b6760-74a0-4500-a0cc-3a5bb4bbaf63 tempest-GroupsTest-1133874654 None] Lock "cinder-quobyte-af6055cc-5579-41b8-805c-34b615d81433" released by "delete_volume" :: held 0.745s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:24:33 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-538b6760-74a0-4500-a0cc-3a5bb4bbaf63 tempest-GroupsTest-1133874654 None] Created reservations ['8310259a-1ec8-42eb-ac18-d575ab89d6b0'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:24:33 devstack cinder-volume[88695]: WARNING cinder.quota [None req-538b6760-74a0-4500-a0cc-3a5bb4bbaf63 tempest-GroupsTest-1133874654 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-2080767732 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-2080767732, it is now deprecated. Please use the default quota class for default quota. Aug 05 06:24:33 devstack cinder-volume[88695]: WARNING cinder.quota [None req-538b6760-74a0-4500-a0cc-3a5bb4bbaf63 tempest-GroupsTest-1133874654 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-2080767732 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-2080767732, it is now deprecated. Please use the default quota class for default quota. Aug 05 06:24:33 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-538b6760-74a0-4500-a0cc-3a5bb4bbaf63 tempest-GroupsTest-1133874654 None] Created reservations ['67d62e18-7bef-4760-ba07-10802f0966e8', 'b30b6f2e-302a-46bf-b7b2-8b7cd8aeaaf1', '5f84e9a4-4fdc-4237-8f5b-64cb0e0588e6', '019f399d-43fa-4c33-9e20-e13f40de36f1'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:24:34 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-538b6760-74a0-4500-a0cc-3a5bb4bbaf63 tempest-GroupsTest-1133874654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:24:34 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-538b6760-74a0-4500-a0cc-3a5bb4bbaf63 tempest-GroupsTest-1133874654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:24:34 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-538b6760-74a0-4500-a0cc-3a5bb4bbaf63 tempest-GroupsTest-1133874654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:24:34 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-538b6760-74a0-4500-a0cc-3a5bb4bbaf63 tempest-GroupsTest-1133874654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:24:34 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-538b6760-74a0-4500-a0cc-3a5bb4bbaf63 tempest-GroupsTest-1133874654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:24:34 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-538b6760-74a0-4500-a0cc-3a5bb4bbaf63 tempest-GroupsTest-1133874654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:24:34 devstack sudo[103096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce Aug 05 06:24:34 devstack sudo[103096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:24:34 devstack sudo[103096]: pam_unix(sudo:session): session closed for user root Aug 05 06:24:34 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-538b6760-74a0-4500-a0cc-3a5bb4bbaf63 tempest-GroupsTest-1133874654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce" returned: 0 in 0.260s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:24:34 devstack cinder-volume[88695]: DEBUG cinder.manager [None req-538b6760-74a0-4500-a0cc-3a5bb4bbaf63 tempest-GroupsTest-1133874654 None] Notifying Schedulers of capabilities ... {{(pid=88695) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 06:24:34 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-538b6760-74a0-4500-a0cc-3a5bb4bbaf63 tempest-GroupsTest-1133874654 None] Delete group completed successfully. Aug 05 06:24:34 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-d377cad5-a52b-4390-9ad2-31529b313c4a tempest-GroupsTest-1133874654 None] Created reservations ['a047ff5b-b1ac-42aa-a270-f777857d5235'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:24:34 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-d377cad5-a52b-4390-9ad2-31529b313c4a tempest-GroupsTest-1133874654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:24:34 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-d377cad5-a52b-4390-9ad2-31529b313c4a tempest-GroupsTest-1133874654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:24:34 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-d377cad5-a52b-4390-9ad2-31529b313c4a tempest-GroupsTest-1133874654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:24:34 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-d377cad5-a52b-4390-9ad2-31529b313c4a tempest-GroupsTest-1133874654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:24:34 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-d377cad5-a52b-4390-9ad2-31529b313c4a tempest-GroupsTest-1133874654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:24:34 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-d377cad5-a52b-4390-9ad2-31529b313c4a tempest-GroupsTest-1133874654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:24:34 devstack sudo[103099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce Aug 05 06:24:34 devstack sudo[103099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:24:34 devstack sudo[103099]: pam_unix(sudo:session): session closed for user root Aug 05 06:24:34 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-d377cad5-a52b-4390-9ad2-31529b313c4a tempest-GroupsTest-1133874654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce" returned: 0 in 0.264s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:24:34 devstack cinder-volume[88695]: DEBUG cinder.manager [None req-d377cad5-a52b-4390-9ad2-31529b313c4a tempest-GroupsTest-1133874654 None] Notifying Schedulers of capabilities ... {{(pid=88695) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 06:24:34 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-d377cad5-a52b-4390-9ad2-31529b313c4a tempest-GroupsTest-1133874654 None] Delete group completed successfully. Aug 05 06:24:35 devstack cinder-volume[88695]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb9c8d2e-9f60-48ed-b47e-29eca5f4dccd tempest-TestShelveInstance-802603102 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88695) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 06:24:35 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-bb9c8d2e-9f60-48ed-b47e-29eca5f4dccd tempest-TestShelveInstance-802603102 None] Flow 'volume_create_manager' (269d2eb0-83f6-4686-9c97-0aafa78d0b01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:24:35 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-bb9c8d2e-9f60-48ed-b47e-29eca5f4dccd tempest-TestShelveInstance-802603102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e8c99c0-4631-4c73-b2d4-613309f695d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:24:35 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-bb9c8d2e-9f60-48ed-b47e-29eca5f4dccd tempest-TestShelveInstance-802603102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e8c99c0-4631-4c73-b2d4-613309f695d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:24:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1094315769',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50048e3d-a5d7-4b7f-8f6a-cc0bf11aa6c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87b03a0bc6e747e9b8a4a206457cc8ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:24:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:24:35Z,use_quota=True,user_id='bd9ccb2954b040369b44c9c59ed8e9f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:24:35 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-bb9c8d2e-9f60-48ed-b47e-29eca5f4dccd tempest-TestShelveInstance-802603102 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b85975d-5553-4175-ad1c-42321ddb0702) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:24:35 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-bb9c8d2e-9f60-48ed-b47e-29eca5f4dccd tempest-TestShelveInstance-802603102 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b85975d-5553-4175-ad1c-42321ddb0702) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:24:35 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-bb9c8d2e-9f60-48ed-b47e-29eca5f4dccd tempest-TestShelveInstance-802603102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68a27162-68e0-4ebb-924f-befc04c7c496) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:24:35 devstack cinder-volume[88695]: DEBUG cinder.image.glance [None req-bb9c8d2e-9f60-48ed-b47e-29eca5f4dccd tempest-TestShelveInstance-802603102 None] Creating Keystone auth plugin from conf {{(pid=88695) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 05 06:24:35 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-bb9c8d2e-9f60-48ed-b47e-29eca5f4dccd tempest-TestShelveInstance-802603102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68a27162-68e0-4ebb-924f-befc04c7c496) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '50048e3d-a5d7-4b7f-8f6a-cc0bf11aa6c9', 'volume_name': 'volume-50048e3d-a5d7-4b7f-8f6a-cc0bf11aa6c9', 'volume_size': 1, 'image_id': '02d74946-ca9b-46cd-a590-fddaad1baed9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/02d74946-ca9b-46cd-a590-fddaad1baed9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '45a6d5bbcac24d598455fe1cd77a6beb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '02d74946-ca9b-46cd-a590-fddaad1baed9', 'created_at': datetime.datetime(2026, 8, 5, 4, 5, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 5, 4, 5, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/02d74946-ca9b-46cd-a590-fddaad1baed9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:24:35 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-bb9c8d2e-9f60-48ed-b47e-29eca5f4dccd tempest-TestShelveInstance-802603102 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcee678c-49f6-41ee-8b4c-7c90cd7675d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:24:35 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-bb9c8d2e-9f60-48ed-b47e-29eca5f4dccd tempest-TestShelveInstance-802603102 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcee678c-49f6-41ee-8b4c-7c90cd7675d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:24:35 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-bb9c8d2e-9f60-48ed-b47e-29eca5f4dccd tempest-TestShelveInstance-802603102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73ebb60d-e68d-425c-833e-db59b3199c28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:24:35 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-bb9c8d2e-9f60-48ed-b47e-29eca5f4dccd tempest-TestShelveInstance-802603102 None] Volume 50048e3d-a5d7-4b7f-8f6a-cc0bf11aa6c9: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-50048e3d-a5d7-4b7f-8f6a-cc0bf11aa6c9', 'volume_size': 1, 'image_id': '02d74946-ca9b-46cd-a590-fddaad1baed9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/02d74946-ca9b-46cd-a590-fddaad1baed9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '45a6d5bbcac24d598455fe1cd77a6beb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '02d74946-ca9b-46cd-a590-fddaad1baed9', 'created_at': datetime.datetime(2026, 8, 5, 4, 5, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 5, 4, 5, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/02d74946-ca9b-46cd-a590-fddaad1baed9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Aug 05 06:24:35 devstack cinder-volume[88695]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb9c8d2e-9f60-48ed-b47e-29eca5f4dccd tempest-TestShelveInstance-802603102 None] Trying to clone 50048e3d-a5d7-4b7f-8f6a-cc0bf11aa6c9 from image 02d74946-ca9b-46cd-a590-fddaad1baed9 at location (None, [{'url': 'file:///opt/stack/data/glance/images/02d74946-ca9b-46cd-a590-fddaad1baed9', 'metadata': {}}]). {{(pid=88695) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 05 06:24:36 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-054cdc4e-fdab-4c68-8cde-d70b5146eca1 tempest-GroupsTest-1133874654 None] Group tempest-GroupsTest-Group-537974079: creating Aug 05 06:24:36 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-054cdc4e-fdab-4c68-8cde-d70b5146eca1 tempest-GroupsTest-1133874654 None] Group tempest-GroupsTest-Group-537974079: created successfully Aug 05 06:24:36 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-054cdc4e-fdab-4c68-8cde-d70b5146eca1 tempest-GroupsTest-1133874654 None] Create group completed successfully. Aug 05 06:24:36 devstack cinder-volume[88695]: DEBUG cinder.image.image_utils [None req-bb9c8d2e-9f60-48ed-b47e-29eca5f4dccd tempest-TestShelveInstance-802603102 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_02d74946-ca9b-46cd-a590-fddaad1baed9_6ecs7jaodevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=88695) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 05 06:24:36 devstack cinder-volume[88695]: INFO cinder.image.image_utils [None req-bb9c8d2e-9f60-48ed-b47e-29eca5f4dccd tempest-TestShelveInstance-802603102 None] Image download 20.69 MB at 20.69 MB/s Aug 05 06:24:36 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[25bcd90d-60f4-40d3-84c3-f8eab871635c]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:24:36 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-bb9c8d2e-9f60-48ed-b47e-29eca5f4dccd tempest-TestShelveInstance-802603102 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_02d74946-ca9b-46cd-a590-fddaad1baed9_6ecs7jaodevstack@QuobyteHD {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:24:36 devstack sudo[103103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_02d74946-ca9b-46cd-a590-fddaad1baed9_6ecs7jaodevstack@QuobyteHD Aug 05 06:24:36 devstack sudo[103103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:24:36 devstack sudo[103103]: pam_unix(sudo:session): session closed for user root Aug 05 06:24:36 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-bb9c8d2e-9f60-48ed-b47e-29eca5f4dccd tempest-TestShelveInstance-802603102 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_02d74946-ca9b-46cd-a590-fddaad1baed9_6ecs7jaodevstack@QuobyteHD" returned: 0 in 0.345s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:24:36 devstack cinder-volume[88695]: DEBUG cinder.image.image_utils [None req-bb9c8d2e-9f60-48ed-b47e-29eca5f4dccd tempest-TestShelveInstance-802603102 None] Temporary image 02d74946-ca9b-46cd-a590-fddaad1baed9 is fetched for user bd9ccb2954b040369b44c9c59ed8e9f1. {{(pid=88695) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 05 06:24:36 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c893a2e-c205-40bc-a974-270a6e3035b7]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:24:36 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-bb9c8d2e-9f60-48ed-b47e-29eca5f4dccd tempest-TestShelveInstance-802603102 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_02d74946-ca9b-46cd-a590-fddaad1baed9_6ecs7jaodevstack@QuobyteHD {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:24:36 devstack sudo[103108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_02d74946-ca9b-46cd-a590-fddaad1baed9_6ecs7jaodevstack@QuobyteHD Aug 05 06:24:36 devstack sudo[103108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:24:36 devstack sudo[103108]: pam_unix(sudo:session): session closed for user root Aug 05 06:24:36 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-bb9c8d2e-9f60-48ed-b47e-29eca5f4dccd tempest-TestShelveInstance-802603102 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_02d74946-ca9b-46cd-a590-fddaad1baed9_6ecs7jaodevstack@QuobyteHD" returned: 0 in 0.318s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:24:36 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-bb9c8d2e-9f60-48ed-b47e-29eca5f4dccd tempest-TestShelveInstance-802603102 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:24:36 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-bb9c8d2e-9f60-48ed-b47e-29eca5f4dccd tempest-TestShelveInstance-802603102 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:24:36 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-bb9c8d2e-9f60-48ed-b47e-29eca5f4dccd tempest-TestShelveInstance-802603102 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:24:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1094315769',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50048e3d-a5d7-4b7f-8f6a-cc0bf11aa6c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87b03a0bc6e747e9b8a4a206457cc8ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:24:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:24:35Z,use_quota=True,user_id='bd9ccb2954b040369b44c9c59ed8e9f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)}" {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 06:24:36 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-bb9c8d2e-9f60-48ed-b47e-29eca5f4dccd tempest-TestShelveInstance-802603102 None] Creating volume 50048e3d-a5d7-4b7f-8f6a-cc0bf11aa6c9 {{(pid=88695) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 06:24:36 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-bb9c8d2e-9f60-48ed-b47e-29eca5f4dccd tempest-TestShelveInstance-802603102 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:24:36 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-bb9c8d2e-9f60-48ed-b47e-29eca5f4dccd tempest-TestShelveInstance-802603102 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:24:36 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-bb9c8d2e-9f60-48ed-b47e-29eca5f4dccd tempest-TestShelveInstance-802603102 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:24:36 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-bb9c8d2e-9f60-48ed-b47e-29eca5f4dccd tempest-TestShelveInstance-802603102 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:24:36 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-bb9c8d2e-9f60-48ed-b47e-29eca5f4dccd tempest-TestShelveInstance-802603102 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:24:36 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-bb9c8d2e-9f60-48ed-b47e-29eca5f4dccd tempest-TestShelveInstance-802603102 None] Selected osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 as target Quobyte volume. {{(pid=88695) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 06:24:36 devstack cinder-volume[88695]: INFO cinder.volume.drivers.remotefs [None req-bb9c8d2e-9f60-48ed-b47e-29eca5f4dccd tempest-TestShelveInstance-802603102 None] casted to osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 Aug 05 06:24:36 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-bb9c8d2e-9f60-48ed-b47e-29eca5f4dccd tempest-TestShelveInstance-802603102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-50048e3d-a5d7-4b7f-8f6a-cc0bf11aa6c9 1073741824 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:24:36 devstack sudo[103113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-50048e3d-a5d7-4b7f-8f6a-cc0bf11aa6c9 1073741824 Aug 05 06:24:36 devstack sudo[103113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:24:37 devstack sudo[103113]: pam_unix(sudo:session): session closed for user root Aug 05 06:24:37 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-bb9c8d2e-9f60-48ed-b47e-29eca5f4dccd tempest-TestShelveInstance-802603102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-50048e3d-a5d7-4b7f-8f6a-cc0bf11aa6c9 1073741824" returned: 0 in 0.417s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:24:37 devstack cinder-volume[88695]: DEBUG dbcounter [-] [88695] Writing DB stats cinder:SELECT=99,cinder:UPDATE=99,cinder:INSERT=17,cinder:DELETE=6 {{(pid=88695) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 06:24:37 devstack cinder-volume[88695]: DEBUG dbcounter [-] [88695] Writing DB stats cinder:SELECT=90,cinder:UPDATE=89,cinder:INSERT=26,cinder:DELETE=5 {{(pid=88695) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 06:24:37 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-bb9c8d2e-9f60-48ed-b47e-29eca5f4dccd tempest-TestShelveInstance-802603102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-50048e3d-a5d7-4b7f-8f6a-cc0bf11aa6c9 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:24:37 devstack sudo[103119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-50048e3d-a5d7-4b7f-8f6a-cc0bf11aa6c9 Aug 05 06:24:37 devstack sudo[103119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:24:37 devstack sudo[103119]: pam_unix(sudo:session): session closed for user root Aug 05 06:24:37 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-bb9c8d2e-9f60-48ed-b47e-29eca5f4dccd tempest-TestShelveInstance-802603102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-50048e3d-a5d7-4b7f-8f6a-cc0bf11aa6c9" returned: 0 in 0.287s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:24:37 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-bb9c8d2e-9f60-48ed-b47e-29eca5f4dccd tempest-TestShelveInstance-802603102 None] <== create_volume: return (773ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'} {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 06:24:37 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-bb9c8d2e-9f60-48ed-b47e-29eca5f4dccd tempest-TestShelveInstance-802603102 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.776s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:24:37 devstack cinder-volume[88695]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3a52ee3-ff0e-430c-85c1-a8e7dd289261 tempest-GroupsTest-1133874654 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88695) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 06:24:37 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-d3a52ee3-ff0e-430c-85c1-a8e7dd289261 tempest-GroupsTest-1133874654 None] Flow 'volume_create_manager' (515da82f-e45f-4ad8-a033-69eb4710317a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:24:37 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-d3a52ee3-ff0e-430c-85c1-a8e7dd289261 tempest-GroupsTest-1133874654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26113018-ce67-42de-bca0-b2f56addb817) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:24:37 devstack cinder-volume[88695]: DEBUG cinder.volume.volume_utils [None req-bb9c8d2e-9f60-48ed-b47e-29eca5f4dccd tempest-TestShelveInstance-802603102 None] Attempting download of 02d74946-ca9b-46cd-a590-fddaad1baed9 ((None, [{'url': 'file:///opt/stack/data/glance/images/02d74946-ca9b-46cd-a590-fddaad1baed9', 'metadata': {}}])) to volume 50048e3d-a5d7-4b7f-8f6a-cc0bf11aa6c9. {{(pid=88695) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 05 06:24:37 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-d3a52ee3-ff0e-430c-85c1-a8e7dd289261 tempest-GroupsTest-1133874654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26113018-ce67-42de-bca0-b2f56addb817) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:24:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-507971330',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f3ebdac1-585d-456f-bef4-c16026890b9e,host='devstack@QuobyteHD#QuobyteHD',id=02d62eba-c2b6-4cf3-9372-f20b267c23cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2016b4b8930498987ebfa2654efa4fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:24:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:24:38Z,use_quota=True,user_id='3c6f4a735b4a44cb8a152078a2203930',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13bcc30b-9ecd-4b4a-a06a-098c7a27ab78),volume_type_id=13bcc30b-9ecd-4b4a-a06a-098c7a27ab78)' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:24:37 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-d3a52ee3-ff0e-430c-85c1-a8e7dd289261 tempest-GroupsTest-1133874654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85342241-2e39-495b-9bd0-4f73b115c2d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:24:37 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-d3a52ee3-ff0e-430c-85c1-a8e7dd289261 tempest-GroupsTest-1133874654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85342241-2e39-495b-9bd0-4f73b115c2d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:24:37 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-d3a52ee3-ff0e-430c-85c1-a8e7dd289261 tempest-GroupsTest-1133874654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0a64b8d-9dea-4866-831e-e788c6865937) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:24:37 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-d3a52ee3-ff0e-430c-85c1-a8e7dd289261 tempest-GroupsTest-1133874654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0a64b8d-9dea-4866-831e-e788c6865937) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '02d62eba-c2b6-4cf3-9372-f20b267c23cc', 'volume_name': 'volume-02d62eba-c2b6-4cf3-9372-f20b267c23cc', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:24:37 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-d3a52ee3-ff0e-430c-85c1-a8e7dd289261 tempest-GroupsTest-1133874654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88b25772-3962-467a-a415-d920dd1ca892) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:24:37 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-d3a52ee3-ff0e-430c-85c1-a8e7dd289261 tempest-GroupsTest-1133874654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88b25772-3962-467a-a415-d920dd1ca892) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:24:37 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-d3a52ee3-ff0e-430c-85c1-a8e7dd289261 tempest-GroupsTest-1133874654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a527d215-4b11-4118-8866-0675a78b07a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:24:37 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-d3a52ee3-ff0e-430c-85c1-a8e7dd289261 tempest-GroupsTest-1133874654 None] Volume 02d62eba-c2b6-4cf3-9372-f20b267c23cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-02d62eba-c2b6-4cf3-9372-f20b267c23cc', 'volume_size': 1} Aug 05 06:24:37 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-d3a52ee3-ff0e-430c-85c1-a8e7dd289261 tempest-GroupsTest-1133874654 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:24:37 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-d3a52ee3-ff0e-430c-85c1-a8e7dd289261 tempest-GroupsTest-1133874654 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:24:37 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-d3a52ee3-ff0e-430c-85c1-a8e7dd289261 tempest-GroupsTest-1133874654 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=f3ebdac1-585d-456f-bef4-c16026890b9e,created_at=2026-08-05T04:24:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-507971330',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f3ebdac1-585d-456f-bef4-c16026890b9e,host='devstack@QuobyteHD#QuobyteHD',id=02d62eba-c2b6-4cf3-9372-f20b267c23cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2016b4b8930498987ebfa2654efa4fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:24:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:24:38Z,use_quota=True,user_id='3c6f4a735b4a44cb8a152078a2203930',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13bcc30b-9ecd-4b4a-a06a-098c7a27ab78),volume_type_id=13bcc30b-9ecd-4b4a-a06a-098c7a27ab78)}" {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 06:24:37 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-d3a52ee3-ff0e-430c-85c1-a8e7dd289261 tempest-GroupsTest-1133874654 None] Creating volume 02d62eba-c2b6-4cf3-9372-f20b267c23cc {{(pid=88695) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 06:24:37 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-d3a52ee3-ff0e-430c-85c1-a8e7dd289261 tempest-GroupsTest-1133874654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:24:37 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-d3a52ee3-ff0e-430c-85c1-a8e7dd289261 tempest-GroupsTest-1133874654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:24:37 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-d3a52ee3-ff0e-430c-85c1-a8e7dd289261 tempest-GroupsTest-1133874654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:24:37 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-d3a52ee3-ff0e-430c-85c1-a8e7dd289261 tempest-GroupsTest-1133874654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:24:37 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-d3a52ee3-ff0e-430c-85c1-a8e7dd289261 tempest-GroupsTest-1133874654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:24:37 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-d3a52ee3-ff0e-430c-85c1-a8e7dd289261 tempest-GroupsTest-1133874654 None] Selected osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 as target Quobyte volume. {{(pid=88695) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 06:24:37 devstack cinder-volume[88695]: INFO cinder.volume.drivers.remotefs [None req-d3a52ee3-ff0e-430c-85c1-a8e7dd289261 tempest-GroupsTest-1133874654 None] casted to osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 Aug 05 06:24:37 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-d3a52ee3-ff0e-430c-85c1-a8e7dd289261 tempest-GroupsTest-1133874654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-02d62eba-c2b6-4cf3-9372-f20b267c23cc 1073741824 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:24:37 devstack sudo[103123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-02d62eba-c2b6-4cf3-9372-f20b267c23cc 1073741824 Aug 05 06:24:37 devstack sudo[103123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:24:37 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[57346041-fdec-454c-bb9d-e921d8af23bb]: (4, 'raw') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:24:37 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-bb9c8d2e-9f60-48ed-b47e-29eca5f4dccd tempest-TestShelveInstance-802603102 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_02d74946-ca9b-46cd-a590-fddaad1baed9_ejflpc7b {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:24:37 devstack sudo[103125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_02d74946-ca9b-46cd-a590-fddaad1baed9_ejflpc7b Aug 05 06:24:37 devstack sudo[103125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:24:38 devstack sudo[103125]: pam_unix(sudo:session): session closed for user root Aug 05 06:24:38 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-bb9c8d2e-9f60-48ed-b47e-29eca5f4dccd tempest-TestShelveInstance-802603102 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_02d74946-ca9b-46cd-a590-fddaad1baed9_ejflpc7b" returned: 0 in 0.371s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:24:38 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-bb9c8d2e-9f60-48ed-b47e-29eca5f4dccd tempest-TestShelveInstance-802603102 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_02d74946-ca9b-46cd-a590-fddaad1baed9_ejflpc7b {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:24:38 devstack sudo[103123]: pam_unix(sudo:session): session closed for user root Aug 05 06:24:38 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-d3a52ee3-ff0e-430c-85c1-a8e7dd289261 tempest-GroupsTest-1133874654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-02d62eba-c2b6-4cf3-9372-f20b267c23cc 1073741824" returned: 0 in 0.434s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:24:38 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-d3a52ee3-ff0e-430c-85c1-a8e7dd289261 tempest-GroupsTest-1133874654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-02d62eba-c2b6-4cf3-9372-f20b267c23cc {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:24:38 devstack sudo[103171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-02d62eba-c2b6-4cf3-9372-f20b267c23cc Aug 05 06:24:38 devstack sudo[103171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:24:38 devstack sudo[103170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_02d74946-ca9b-46cd-a590-fddaad1baed9_ejflpc7b Aug 05 06:24:38 devstack sudo[103170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:24:38 devstack sudo[103170]: pam_unix(sudo:session): session closed for user root Aug 05 06:24:38 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-bb9c8d2e-9f60-48ed-b47e-29eca5f4dccd tempest-TestShelveInstance-802603102 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_02d74946-ca9b-46cd-a590-fddaad1baed9_ejflpc7b" returned: 1 in 0.336s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:24:38 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-bb9c8d2e-9f60-48ed-b47e-29eca5f4dccd tempest-TestShelveInstance-802603102 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_02d74946-ca9b-46cd-a590-fddaad1baed9_ejflpc7b' failed. Not Retrying. {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 05 06:24:38 devstack sudo[103171]: pam_unix(sudo:session): session closed for user root Aug 05 06:24:38 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e4583e9-13ce-44b4-ae1d-42c1b5b61720]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:24:38 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-bb9c8d2e-9f60-48ed-b47e-29eca5f4dccd tempest-TestShelveInstance-802603102 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_02d74946-ca9b-46cd-a590-fddaad1baed9_6ecs7jaodevstack@QuobyteHD {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:24:38 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-d3a52ee3-ff0e-430c-85c1-a8e7dd289261 tempest-GroupsTest-1133874654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-02d62eba-c2b6-4cf3-9372-f20b267c23cc" returned: 0 in 0.287s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:24:38 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-d3a52ee3-ff0e-430c-85c1-a8e7dd289261 tempest-GroupsTest-1133874654 None] <== create_volume: return (767ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'} {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 06:24:38 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-d3a52ee3-ff0e-430c-85c1-a8e7dd289261 tempest-GroupsTest-1133874654 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.770s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:24:38 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-d3a52ee3-ff0e-430c-85c1-a8e7dd289261 tempest-GroupsTest-1133874654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a527d215-4b11-4118-8866-0675a78b07a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-02d62eba-c2b6-4cf3-9372-f20b267c23cc', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:24:38 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-d3a52ee3-ff0e-430c-85c1-a8e7dd289261 tempest-GroupsTest-1133874654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb3ba523-2c17-4ff0-9ab8-c22c0c7ff71f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:24:38 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-d3a52ee3-ff0e-430c-85c1-a8e7dd289261 tempest-GroupsTest-1133874654 None] Volume volume-02d62eba-c2b6-4cf3-9372-f20b267c23cc (02d62eba-c2b6-4cf3-9372-f20b267c23cc): created successfully Aug 05 06:24:38 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-d3a52ee3-ff0e-430c-85c1-a8e7dd289261 tempest-GroupsTest-1133874654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb3ba523-2c17-4ff0-9ab8-c22c0c7ff71f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:24:38 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-d3a52ee3-ff0e-430c-85c1-a8e7dd289261 tempest-GroupsTest-1133874654 None] Flow 'volume_create_manager' (515da82f-e45f-4ad8-a033-69eb4710317a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:24:38 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-d3a52ee3-ff0e-430c-85c1-a8e7dd289261 tempest-GroupsTest-1133874654 None] Created volume successfully. Aug 05 06:24:38 devstack sudo[103177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_02d74946-ca9b-46cd-a590-fddaad1baed9_6ecs7jaodevstack@QuobyteHD Aug 05 06:24:38 devstack sudo[103177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:24:38 devstack sudo[103177]: pam_unix(sudo:session): session closed for user root Aug 05 06:24:38 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-bb9c8d2e-9f60-48ed-b47e-29eca5f4dccd tempest-TestShelveInstance-802603102 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_02d74946-ca9b-46cd-a590-fddaad1baed9_6ecs7jaodevstack@QuobyteHD" returned: 0 in 0.337s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:24:38 devstack cinder-volume[88695]: DEBUG cinder.image.image_utils [None req-bb9c8d2e-9f60-48ed-b47e-29eca5f4dccd tempest-TestShelveInstance-802603102 None] 02d74946-ca9b-46cd-a590-fddaad1baed9 was qcow2, converting to qcow2 {{(pid=88695) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 05 06:24:38 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-bb9c8d2e-9f60-48ed-b47e-29eca5f4dccd tempest-TestShelveInstance-802603102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_02d74946-ca9b-46cd-a590-fddaad1baed9_6ecs7jaodevstack@QuobyteHD /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-50048e3d-a5d7-4b7f-8f6a-cc0bf11aa6c9 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:24:38 devstack sudo[103182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_02d74946-ca9b-46cd-a590-fddaad1baed9_6ecs7jaodevstack@QuobyteHD /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-50048e3d-a5d7-4b7f-8f6a-cc0bf11aa6c9 Aug 05 06:24:38 devstack sudo[103182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:24:39 devstack cinder-volume[88695]: DEBUG cinder.volume.flows.manager.create_volume [None req-7bb68e02-a612-454f-a40e-fdb138536bdd tempest-GroupsTest-1133874654 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88695) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 06:24:39 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-7bb68e02-a612-454f-a40e-fdb138536bdd tempest-GroupsTest-1133874654 None] Flow 'volume_create_manager' (ac46f8a6-6370-42c3-9e75-8cae0c19b080) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:24:39 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-7bb68e02-a612-454f-a40e-fdb138536bdd tempest-GroupsTest-1133874654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac5605a9-3864-4d6d-b7a9-f53e6cc86b17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:24:39 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-7bb68e02-a612-454f-a40e-fdb138536bdd tempest-GroupsTest-1133874654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac5605a9-3864-4d6d-b7a9-f53e6cc86b17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:24:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1742985858',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f3ebdac1-585d-456f-bef4-c16026890b9e,host='devstack@QuobyteHD#QuobyteHD',id=a3d6d483-c03d-403b-b81c-c031219b1e47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2016b4b8930498987ebfa2654efa4fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:24:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:24:39Z,use_quota=True,user_id='3c6f4a735b4a44cb8a152078a2203930',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13bcc30b-9ecd-4b4a-a06a-098c7a27ab78),volume_type_id=13bcc30b-9ecd-4b4a-a06a-098c7a27ab78)' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:24:39 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-7bb68e02-a612-454f-a40e-fdb138536bdd tempest-GroupsTest-1133874654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bec2d13a-8489-4610-aa95-8490ae6a4302) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:24:39 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-7bb68e02-a612-454f-a40e-fdb138536bdd tempest-GroupsTest-1133874654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bec2d13a-8489-4610-aa95-8490ae6a4302) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:24:39 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-7bb68e02-a612-454f-a40e-fdb138536bdd tempest-GroupsTest-1133874654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43e5b727-b05c-49a4-8ea6-1dc59fd9ae18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:24:39 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-7bb68e02-a612-454f-a40e-fdb138536bdd tempest-GroupsTest-1133874654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43e5b727-b05c-49a4-8ea6-1dc59fd9ae18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a3d6d483-c03d-403b-b81c-c031219b1e47', 'volume_name': 'volume-a3d6d483-c03d-403b-b81c-c031219b1e47', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:24:39 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-7bb68e02-a612-454f-a40e-fdb138536bdd tempest-GroupsTest-1133874654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bc2eea2-31a4-46dd-afeb-13db05b470e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:24:39 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-7bb68e02-a612-454f-a40e-fdb138536bdd tempest-GroupsTest-1133874654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bc2eea2-31a4-46dd-afeb-13db05b470e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:24:39 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-7bb68e02-a612-454f-a40e-fdb138536bdd tempest-GroupsTest-1133874654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a44f325c-14e8-48f2-bf8f-f573f33a5a98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:24:39 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-7bb68e02-a612-454f-a40e-fdb138536bdd tempest-GroupsTest-1133874654 None] Volume a3d6d483-c03d-403b-b81c-c031219b1e47: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a3d6d483-c03d-403b-b81c-c031219b1e47', 'volume_size': 1} Aug 05 06:24:39 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-7bb68e02-a612-454f-a40e-fdb138536bdd tempest-GroupsTest-1133874654 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:24:39 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-7bb68e02-a612-454f-a40e-fdb138536bdd tempest-GroupsTest-1133874654 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:24:39 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-7bb68e02-a612-454f-a40e-fdb138536bdd tempest-GroupsTest-1133874654 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=f3ebdac1-585d-456f-bef4-c16026890b9e,created_at=2026-08-05T04:24:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1742985858',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f3ebdac1-585d-456f-bef4-c16026890b9e,host='devstack@QuobyteHD#QuobyteHD',id=a3d6d483-c03d-403b-b81c-c031219b1e47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2016b4b8930498987ebfa2654efa4fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:24:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:24:39Z,use_quota=True,user_id='3c6f4a735b4a44cb8a152078a2203930',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13bcc30b-9ecd-4b4a-a06a-098c7a27ab78),volume_type_id=13bcc30b-9ecd-4b4a-a06a-098c7a27ab78)}" {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 06:24:39 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-7bb68e02-a612-454f-a40e-fdb138536bdd tempest-GroupsTest-1133874654 None] Creating volume a3d6d483-c03d-403b-b81c-c031219b1e47 {{(pid=88695) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 06:24:39 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-7bb68e02-a612-454f-a40e-fdb138536bdd tempest-GroupsTest-1133874654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:24:39 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-7bb68e02-a612-454f-a40e-fdb138536bdd tempest-GroupsTest-1133874654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:24:39 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-7bb68e02-a612-454f-a40e-fdb138536bdd tempest-GroupsTest-1133874654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:24:39 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-7bb68e02-a612-454f-a40e-fdb138536bdd tempest-GroupsTest-1133874654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:24:39 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-7bb68e02-a612-454f-a40e-fdb138536bdd tempest-GroupsTest-1133874654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:24:39 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-7bb68e02-a612-454f-a40e-fdb138536bdd tempest-GroupsTest-1133874654 None] Selected osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 as target Quobyte volume. {{(pid=88695) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 06:24:39 devstack cinder-volume[88695]: INFO cinder.volume.drivers.remotefs [None req-7bb68e02-a612-454f-a40e-fdb138536bdd tempest-GroupsTest-1133874654 None] casted to osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 Aug 05 06:24:39 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-7bb68e02-a612-454f-a40e-fdb138536bdd tempest-GroupsTest-1133874654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a3d6d483-c03d-403b-b81c-c031219b1e47 1073741824 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:24:39 devstack sudo[103195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a3d6d483-c03d-403b-b81c-c031219b1e47 1073741824 Aug 05 06:24:39 devstack sudo[103195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:24:40 devstack sudo[103195]: pam_unix(sudo:session): session closed for user root Aug 05 06:24:40 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-7bb68e02-a612-454f-a40e-fdb138536bdd tempest-GroupsTest-1133874654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a3d6d483-c03d-403b-b81c-c031219b1e47 1073741824" returned: 0 in 0.494s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:24:40 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-7bb68e02-a612-454f-a40e-fdb138536bdd tempest-GroupsTest-1133874654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a3d6d483-c03d-403b-b81c-c031219b1e47 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:24:40 devstack sudo[103201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a3d6d483-c03d-403b-b81c-c031219b1e47 Aug 05 06:24:40 devstack sudo[103201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:24:40 devstack sudo[103201]: pam_unix(sudo:session): session closed for user root Aug 05 06:24:40 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-7bb68e02-a612-454f-a40e-fdb138536bdd tempest-GroupsTest-1133874654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a3d6d483-c03d-403b-b81c-c031219b1e47" returned: 0 in 0.307s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:24:40 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-7bb68e02-a612-454f-a40e-fdb138536bdd tempest-GroupsTest-1133874654 None] <== create_volume: return (855ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'} {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 06:24:40 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-7bb68e02-a612-454f-a40e-fdb138536bdd tempest-GroupsTest-1133874654 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.858s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:24:40 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-7bb68e02-a612-454f-a40e-fdb138536bdd tempest-GroupsTest-1133874654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a44f325c-14e8-48f2-bf8f-f573f33a5a98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3d6d483-c03d-403b-b81c-c031219b1e47', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:24:40 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-7bb68e02-a612-454f-a40e-fdb138536bdd tempest-GroupsTest-1133874654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f43c7559-0d5e-4661-b354-37d9f4c81345) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:24:40 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-7bb68e02-a612-454f-a40e-fdb138536bdd tempest-GroupsTest-1133874654 None] Volume volume-a3d6d483-c03d-403b-b81c-c031219b1e47 (a3d6d483-c03d-403b-b81c-c031219b1e47): created successfully Aug 05 06:24:40 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-7bb68e02-a612-454f-a40e-fdb138536bdd tempest-GroupsTest-1133874654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f43c7559-0d5e-4661-b354-37d9f4c81345) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:24:40 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-7bb68e02-a612-454f-a40e-fdb138536bdd tempest-GroupsTest-1133874654 None] Flow 'volume_create_manager' (ac46f8a6-6370-42c3-9e75-8cae0c19b080) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:24:40 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-7bb68e02-a612-454f-a40e-fdb138536bdd tempest-GroupsTest-1133874654 None] Created volume successfully. Aug 05 06:24:40 devstack sudo[103182]: pam_unix(sudo:session): session closed for user root Aug 05 06:24:40 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-bb9c8d2e-9f60-48ed-b47e-29eca5f4dccd tempest-TestShelveInstance-802603102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_02d74946-ca9b-46cd-a590-fddaad1baed9_6ecs7jaodevstack@QuobyteHD /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-50048e3d-a5d7-4b7f-8f6a-cc0bf11aa6c9" returned: 0 in 1.846s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:24:40 devstack cinder-volume[88695]: DEBUG cinder.image.image_utils [None req-bb9c8d2e-9f60-48ed-b47e-29eca5f4dccd tempest-TestShelveInstance-802603102 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_02d74946-ca9b-46cd-a590-fddaad1baed9_6ecs7jaodevstack@QuobyteHD, size 112.00 MB, duration 1.85 sec, destination /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-50048e3d-a5d7-4b7f-8f6a-cc0bf11aa6c9 {{(pid=88695) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 05 06:24:40 devstack cinder-volume[88695]: INFO cinder.image.image_utils [None req-bb9c8d2e-9f60-48ed-b47e-29eca5f4dccd tempest-TestShelveInstance-802603102 None] Converted 112.00 MB image at 60.64 MB/s Aug 05 06:24:40 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-bb9c8d2e-9f60-48ed-b47e-29eca5f4dccd tempest-TestShelveInstance-802603102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-50048e3d-a5d7-4b7f-8f6a-cc0bf11aa6c9 1G {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:24:40 devstack sudo[103206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-50048e3d-a5d7-4b7f-8f6a-cc0bf11aa6c9 1G Aug 05 06:24:40 devstack sudo[103206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:24:40 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-fe000b65-423e-4193-a3e5-087192bddb4c tempest-GroupsTest-1133874654 None] Update group completed successfully. Aug 05 06:24:41 devstack sudo[103206]: pam_unix(sudo:session): session closed for user root Aug 05 06:24:41 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-bb9c8d2e-9f60-48ed-b47e-29eca5f4dccd tempest-TestShelveInstance-802603102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-50048e3d-a5d7-4b7f-8f6a-cc0bf11aa6c9 1G" returned: 0 in 0.323s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:24:41 devstack cinder-volume[88695]: DEBUG cinder.volume.volume_utils [None req-bb9c8d2e-9f60-48ed-b47e-29eca5f4dccd tempest-TestShelveInstance-802603102 None] Downloaded image 02d74946-ca9b-46cd-a590-fddaad1baed9 ((None, [{'url': 'file:///opt/stack/data/glance/images/02d74946-ca9b-46cd-a590-fddaad1baed9', 'metadata': {}}])) to volume 50048e3d-a5d7-4b7f-8f6a-cc0bf11aa6c9 successfully. {{(pid=88695) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 05 06:24:41 devstack cinder-volume[88695]: DEBUG cinder.image.image_utils [None req-bb9c8d2e-9f60-48ed-b47e-29eca5f4dccd tempest-TestShelveInstance-802603102 None] Temporary image 02d74946-ca9b-46cd-a590-fddaad1baed9 for user bd9ccb2954b040369b44c9c59ed8e9f1 is deleted. {{(pid=88695) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 05 06:24:41 devstack cinder-volume[88695]: DEBUG cinder.volume.volume_utils [None req-bb9c8d2e-9f60-48ed-b47e-29eca5f4dccd tempest-TestShelveInstance-802603102 None] Marking volume 50048e3d-a5d7-4b7f-8f6a-cc0bf11aa6c9 as bootable. {{(pid=88695) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 05 06:24:41 devstack cinder-volume[88695]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb9c8d2e-9f60-48ed-b47e-29eca5f4dccd tempest-TestShelveInstance-802603102 None] Copying metadata from image 02d74946-ca9b-46cd-a590-fddaad1baed9 to 50048e3d-a5d7-4b7f-8f6a-cc0bf11aa6c9. {{(pid=88695) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 05 06:24:41 devstack cinder-volume[88695]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb9c8d2e-9f60-48ed-b47e-29eca5f4dccd tempest-TestShelveInstance-802603102 None] Creating volume glance metadata for volume 50048e3d-a5d7-4b7f-8f6a-cc0bf11aa6c9 backed by image 02d74946-ca9b-46cd-a590-fddaad1baed9 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '02d74946-ca9b-46cd-a590-fddaad1baed9', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88695) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 05 06:24:41 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-bb9c8d2e-9f60-48ed-b47e-29eca5f4dccd tempest-TestShelveInstance-802603102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73ebb60d-e68d-425c-833e-db59b3199c28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50048e3d-a5d7-4b7f-8f6a-cc0bf11aa6c9', 'volume_size': 1, 'image_id': '02d74946-ca9b-46cd-a590-fddaad1baed9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/02d74946-ca9b-46cd-a590-fddaad1baed9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '45a6d5bbcac24d598455fe1cd77a6beb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '02d74946-ca9b-46cd-a590-fddaad1baed9', 'created_at': datetime.datetime(2026, 8, 5, 4, 5, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 5, 4, 5, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/02d74946-ca9b-46cd-a590-fddaad1baed9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:24:41 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-bb9c8d2e-9f60-48ed-b47e-29eca5f4dccd tempest-TestShelveInstance-802603102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c05ae24c-2eff-462e-80c8-e59bbdb59d0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:24:41 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-bb9c8d2e-9f60-48ed-b47e-29eca5f4dccd tempest-TestShelveInstance-802603102 None] Volume volume-50048e3d-a5d7-4b7f-8f6a-cc0bf11aa6c9 (50048e3d-a5d7-4b7f-8f6a-cc0bf11aa6c9): created successfully Aug 05 06:24:41 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-bb9c8d2e-9f60-48ed-b47e-29eca5f4dccd tempest-TestShelveInstance-802603102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c05ae24c-2eff-462e-80c8-e59bbdb59d0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:24:41 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-bb9c8d2e-9f60-48ed-b47e-29eca5f4dccd tempest-TestShelveInstance-802603102 None] Flow 'volume_create_manager' (269d2eb0-83f6-4686-9c97-0aafa78d0b01) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:24:41 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-bb9c8d2e-9f60-48ed-b47e-29eca5f4dccd tempest-TestShelveInstance-802603102 None] Created volume successfully. Aug 05 06:24:42 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-e74ed02a-c1f2-4bba-9cd9-1a2accd239a0 tempest-GroupsTest-1133874654 None] Update group completed successfully. Aug 05 06:24:43 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-0479c4bc-f334-47dc-acc0-65682a6a50fb tempest-GroupsTest-1133874654 None] Acquiring lock "cinder-quobyte-02d62eba-c2b6-4cf3-9372-f20b267c23cc" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:24:43 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-0479c4bc-f334-47dc-acc0-65682a6a50fb tempest-GroupsTest-1133874654 None] Lock "cinder-quobyte-02d62eba-c2b6-4cf3-9372-f20b267c23cc" acquired by "delete_volume" :: waited 0.020s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:24:43 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[19843490-2e2e-4f02-8ec7-93cfd27da461]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:24:43 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-0479c4bc-f334-47dc-acc0-65682a6a50fb tempest-GroupsTest-1133874654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-02d62eba-c2b6-4cf3-9372-f20b267c23cc {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:24:44 devstack sudo[103215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-02d62eba-c2b6-4cf3-9372-f20b267c23cc Aug 05 06:24:44 devstack sudo[103215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:24:44 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [req-d861330e-0072-4d24-b3f9-beeacc9fcb73 req-9983548c-d620-4ce9-b32a-42be1e33eee5 tempest-TestShelveInstance-802603102 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:24:44 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [req-d861330e-0072-4d24-b3f9-beeacc9fcb73 req-9983548c-d620-4ce9-b32a-42be1e33eee5 tempest-TestShelveInstance-802603102 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:24:44 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [req-d861330e-0072-4d24-b3f9-beeacc9fcb73 req-9983548c-d620-4ce9-b32a-42be1e33eee5 tempest-TestShelveInstance-802603102 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:24:44 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [req-d861330e-0072-4d24-b3f9-beeacc9fcb73 req-9983548c-d620-4ce9-b32a-42be1e33eee5 tempest-TestShelveInstance-802603102 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087', 'name': 'volume-50048e3d-a5d7-4b7f-8f6a-cc0bf11aa6c9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b16d3057-164d-4426-90f3-8ab55480ea15', 'enforce_multipath': True} {{(pid=88695) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 05 06:24:44 devstack cinder-volume[88695]: INFO cinder.volume.manager [req-d861330e-0072-4d24-b3f9-beeacc9fcb73 req-9983548c-d620-4ce9-b32a-42be1e33eee5 tempest-TestShelveInstance-802603102 None] attachment_update completed successfully. Aug 05 06:24:44 devstack sudo[103215]: pam_unix(sudo:session): session closed for user root Aug 05 06:24:44 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-0479c4bc-f334-47dc-acc0-65682a6a50fb tempest-GroupsTest-1133874654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-02d62eba-c2b6-4cf3-9372-f20b267c23cc" returned: 0 in 0.445s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:24:44 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-0479c4bc-f334-47dc-acc0-65682a6a50fb tempest-GroupsTest-1133874654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-02d62eba-c2b6-4cf3-9372-f20b267c23cc {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:24:44 devstack sudo[103228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-02d62eba-c2b6-4cf3-9372-f20b267c23cc Aug 05 06:24:44 devstack sudo[103228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:24:44 devstack sudo[103228]: pam_unix(sudo:session): session closed for user root Aug 05 06:24:44 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-0479c4bc-f334-47dc-acc0-65682a6a50fb tempest-GroupsTest-1133874654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-02d62eba-c2b6-4cf3-9372-f20b267c23cc" returned: 0 in 0.322s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:24:44 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-0479c4bc-f334-47dc-acc0-65682a6a50fb tempest-GroupsTest-1133874654 None] Lock "cinder-quobyte-02d62eba-c2b6-4cf3-9372-f20b267c23cc" released by "delete_volume" :: held 0.833s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:24:44 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-0479c4bc-f334-47dc-acc0-65682a6a50fb tempest-GroupsTest-1133874654 None] Acquiring lock "cinder-quobyte-a3d6d483-c03d-403b-b81c-c031219b1e47" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:24:44 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-0479c4bc-f334-47dc-acc0-65682a6a50fb tempest-GroupsTest-1133874654 None] Lock "cinder-quobyte-a3d6d483-c03d-403b-b81c-c031219b1e47" acquired by "delete_volume" :: waited 0.017s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:24:44 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[4417ed71-c914-4193-a0a2-c8bb3606ec98]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:24:44 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-0479c4bc-f334-47dc-acc0-65682a6a50fb tempest-GroupsTest-1133874654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a3d6d483-c03d-403b-b81c-c031219b1e47 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:24:44 devstack sudo[103231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a3d6d483-c03d-403b-b81c-c031219b1e47 Aug 05 06:24:44 devstack sudo[103231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:24:45 devstack sudo[103231]: pam_unix(sudo:session): session closed for user root Aug 05 06:24:45 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-0479c4bc-f334-47dc-acc0-65682a6a50fb tempest-GroupsTest-1133874654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a3d6d483-c03d-403b-b81c-c031219b1e47" returned: 0 in 0.414s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:24:45 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-0479c4bc-f334-47dc-acc0-65682a6a50fb tempest-GroupsTest-1133874654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a3d6d483-c03d-403b-b81c-c031219b1e47 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:24:45 devstack sudo[103237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a3d6d483-c03d-403b-b81c-c031219b1e47 Aug 05 06:24:45 devstack sudo[103237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:24:45 devstack sudo[103237]: pam_unix(sudo:session): session closed for user root Aug 05 06:24:45 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-0479c4bc-f334-47dc-acc0-65682a6a50fb tempest-GroupsTest-1133874654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a3d6d483-c03d-403b-b81c-c031219b1e47" returned: 0 in 0.278s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:24:45 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-0479c4bc-f334-47dc-acc0-65682a6a50fb tempest-GroupsTest-1133874654 None] Lock "cinder-quobyte-a3d6d483-c03d-403b-b81c-c031219b1e47" released by "delete_volume" :: held 0.739s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:24:45 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-0479c4bc-f334-47dc-acc0-65682a6a50fb tempest-GroupsTest-1133874654 None] Created reservations ['7cd5869a-58e7-4a75-8900-28fb201c7e1d'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:24:45 devstack cinder-volume[88695]: WARNING cinder.quota [None req-0479c4bc-f334-47dc-acc0-65682a6a50fb tempest-GroupsTest-1133874654 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1311213325 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1311213325, it is now deprecated. Please use the default quota class for default quota. Aug 05 06:24:45 devstack cinder-volume[88695]: WARNING cinder.quota [None req-0479c4bc-f334-47dc-acc0-65682a6a50fb tempest-GroupsTest-1133874654 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1311213325 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1311213325, it is now deprecated. Please use the default quota class for default quota. Aug 05 06:24:45 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-0479c4bc-f334-47dc-acc0-65682a6a50fb tempest-GroupsTest-1133874654 None] Created reservations ['541c8587-494c-44e2-a20c-54f6fa790fbd', '7dceb31e-8821-494b-bd05-3a3bb1f47623', '3e9ca299-7791-45c7-bc93-ed70e45bdd0f', '199590ce-6762-4ed5-8b93-c03fa757e4c4'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:24:45 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-0479c4bc-f334-47dc-acc0-65682a6a50fb tempest-GroupsTest-1133874654 None] Created reservations ['551c74f9-e10f-495c-bc43-8ce81dfc8524', 'f64e3197-6e4b-4e6f-96d9-1196e5ec4047', '71244011-1738-4b1b-afbf-726c42ea13df', 'e8d865fe-df03-478b-87b3-915001e5f5ef'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:24:45 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-0479c4bc-f334-47dc-acc0-65682a6a50fb tempest-GroupsTest-1133874654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:24:45 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-0479c4bc-f334-47dc-acc0-65682a6a50fb tempest-GroupsTest-1133874654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:24:45 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-0479c4bc-f334-47dc-acc0-65682a6a50fb tempest-GroupsTest-1133874654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:24:45 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-0479c4bc-f334-47dc-acc0-65682a6a50fb tempest-GroupsTest-1133874654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:24:45 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-0479c4bc-f334-47dc-acc0-65682a6a50fb tempest-GroupsTest-1133874654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:24:45 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-0479c4bc-f334-47dc-acc0-65682a6a50fb tempest-GroupsTest-1133874654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:24:45 devstack sudo[103240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce Aug 05 06:24:45 devstack sudo[103240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:24:46 devstack sudo[103240]: pam_unix(sudo:session): session closed for user root Aug 05 06:24:46 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-0479c4bc-f334-47dc-acc0-65682a6a50fb tempest-GroupsTest-1133874654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce" returned: 0 in 0.271s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:24:46 devstack cinder-volume[88695]: DEBUG cinder.manager [None req-0479c4bc-f334-47dc-acc0-65682a6a50fb tempest-GroupsTest-1133874654 None] Notifying Schedulers of capabilities ... {{(pid=88695) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 06:24:46 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-0479c4bc-f334-47dc-acc0-65682a6a50fb tempest-GroupsTest-1133874654 None] Delete group completed successfully. Aug 05 06:24:52 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-ad8e1073-b3eb-428c-9c69-3b84e223f041 tempest-GroupsV314Test-994534806 None] Group tempest-GroupsV314Test-Group-1516718392: creating Aug 05 06:24:52 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-ad8e1073-b3eb-428c-9c69-3b84e223f041 tempest-GroupsV314Test-994534806 None] Group tempest-GroupsV314Test-Group-1516718392: created successfully Aug 05 06:24:52 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-ad8e1073-b3eb-428c-9c69-3b84e223f041 tempest-GroupsV314Test-994534806 None] Create group completed successfully. Aug 05 06:24:54 devstack cinder-volume[88695]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa81b20e-d8a8-4de9-b881-c754a6914957 tempest-GroupsV314Test-994534806 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88695) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 06:24:54 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-aa81b20e-d8a8-4de9-b881-c754a6914957 tempest-GroupsV314Test-994534806 None] Flow 'volume_create_manager' (0f7e6921-cad9-4ea2-a751-1954f51d9e9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:24:54 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-aa81b20e-d8a8-4de9-b881-c754a6914957 tempest-GroupsV314Test-994534806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0df9d3c-06f8-4a6a-8b1d-fa2298718961) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:24:54 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-aa81b20e-d8a8-4de9-b881-c754a6914957 tempest-GroupsV314Test-994534806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0df9d3c-06f8-4a6a-8b1d-fa2298718961) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:24:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-65820920',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=43d703ae-d951-4a3f-a063-45dbcf152577,host='devstack@QuobyteHD#QuobyteHD',id=a8ef64ce-738c-4b4f-8769-49896cfc05dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34e26cd3a0aa4c8b835395ea385c4f4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:24:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:24:54Z,use_quota=True,user_id='1aed6668770a49fbbf3c5b445e607a7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b14acbd-e5e2-49f8-a6df-a36af99ba80c),volume_type_id=2b14acbd-e5e2-49f8-a6df-a36af99ba80c)' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:24:54 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-aa81b20e-d8a8-4de9-b881-c754a6914957 tempest-GroupsV314Test-994534806 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42f691de-a696-49b1-a954-d33b9c0538ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:24:54 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-aa81b20e-d8a8-4de9-b881-c754a6914957 tempest-GroupsV314Test-994534806 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42f691de-a696-49b1-a954-d33b9c0538ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:24:54 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-aa81b20e-d8a8-4de9-b881-c754a6914957 tempest-GroupsV314Test-994534806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3b7f3cb-bf78-4171-b2ce-04ece9f10c19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:24:54 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-aa81b20e-d8a8-4de9-b881-c754a6914957 tempest-GroupsV314Test-994534806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3b7f3cb-bf78-4171-b2ce-04ece9f10c19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a8ef64ce-738c-4b4f-8769-49896cfc05dc', 'volume_name': 'volume-a8ef64ce-738c-4b4f-8769-49896cfc05dc', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:24:54 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-aa81b20e-d8a8-4de9-b881-c754a6914957 tempest-GroupsV314Test-994534806 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59b04a5d-2a2d-4420-b036-e69dcfd67360) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:24:54 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-aa81b20e-d8a8-4de9-b881-c754a6914957 tempest-GroupsV314Test-994534806 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59b04a5d-2a2d-4420-b036-e69dcfd67360) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:24:54 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-aa81b20e-d8a8-4de9-b881-c754a6914957 tempest-GroupsV314Test-994534806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea21a7c5-3d1c-4722-9306-bc6aa601aca4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:24:54 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-aa81b20e-d8a8-4de9-b881-c754a6914957 tempest-GroupsV314Test-994534806 None] Volume a8ef64ce-738c-4b4f-8769-49896cfc05dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a8ef64ce-738c-4b4f-8769-49896cfc05dc', 'volume_size': 1} Aug 05 06:24:54 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-aa81b20e-d8a8-4de9-b881-c754a6914957 tempest-GroupsV314Test-994534806 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:24:54 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-aa81b20e-d8a8-4de9-b881-c754a6914957 tempest-GroupsV314Test-994534806 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:24:54 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-aa81b20e-d8a8-4de9-b881-c754a6914957 tempest-GroupsV314Test-994534806 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=43d703ae-d951-4a3f-a063-45dbcf152577,created_at=2026-08-05T04:24:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-65820920',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=43d703ae-d951-4a3f-a063-45dbcf152577,host='devstack@QuobyteHD#QuobyteHD',id=a8ef64ce-738c-4b4f-8769-49896cfc05dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34e26cd3a0aa4c8b835395ea385c4f4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:24:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:24:54Z,use_quota=True,user_id='1aed6668770a49fbbf3c5b445e607a7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b14acbd-e5e2-49f8-a6df-a36af99ba80c),volume_type_id=2b14acbd-e5e2-49f8-a6df-a36af99ba80c)}" {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 06:24:54 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-aa81b20e-d8a8-4de9-b881-c754a6914957 tempest-GroupsV314Test-994534806 None] Creating volume a8ef64ce-738c-4b4f-8769-49896cfc05dc {{(pid=88695) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 06:24:54 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-aa81b20e-d8a8-4de9-b881-c754a6914957 tempest-GroupsV314Test-994534806 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:24:54 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-aa81b20e-d8a8-4de9-b881-c754a6914957 tempest-GroupsV314Test-994534806 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:24:54 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-aa81b20e-d8a8-4de9-b881-c754a6914957 tempest-GroupsV314Test-994534806 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:24:54 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-aa81b20e-d8a8-4de9-b881-c754a6914957 tempest-GroupsV314Test-994534806 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:24:54 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-aa81b20e-d8a8-4de9-b881-c754a6914957 tempest-GroupsV314Test-994534806 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:24:54 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-aa81b20e-d8a8-4de9-b881-c754a6914957 tempest-GroupsV314Test-994534806 None] Selected osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 as target Quobyte volume. {{(pid=88695) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 06:24:54 devstack cinder-volume[88695]: INFO cinder.volume.drivers.remotefs [None req-aa81b20e-d8a8-4de9-b881-c754a6914957 tempest-GroupsV314Test-994534806 None] casted to osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 Aug 05 06:24:54 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-aa81b20e-d8a8-4de9-b881-c754a6914957 tempest-GroupsV314Test-994534806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a8ef64ce-738c-4b4f-8769-49896cfc05dc 1073741824 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:24:54 devstack sudo[103713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a8ef64ce-738c-4b4f-8769-49896cfc05dc 1073741824 Aug 05 06:24:54 devstack sudo[103713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:24:54 devstack sudo[103713]: pam_unix(sudo:session): session closed for user root Aug 05 06:24:54 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-aa81b20e-d8a8-4de9-b881-c754a6914957 tempest-GroupsV314Test-994534806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a8ef64ce-738c-4b4f-8769-49896cfc05dc 1073741824" returned: 0 in 0.498s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:24:54 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-aa81b20e-d8a8-4de9-b881-c754a6914957 tempest-GroupsV314Test-994534806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a8ef64ce-738c-4b4f-8769-49896cfc05dc {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:24:54 devstack sudo[103718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a8ef64ce-738c-4b4f-8769-49896cfc05dc Aug 05 06:24:54 devstack sudo[103718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:24:55 devstack sudo[103718]: pam_unix(sudo:session): session closed for user root Aug 05 06:24:55 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-aa81b20e-d8a8-4de9-b881-c754a6914957 tempest-GroupsV314Test-994534806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a8ef64ce-738c-4b4f-8769-49896cfc05dc" returned: 0 in 0.262s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:24:55 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-aa81b20e-d8a8-4de9-b881-c754a6914957 tempest-GroupsV314Test-994534806 None] <== create_volume: return (800ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'} {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 06:24:55 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-aa81b20e-d8a8-4de9-b881-c754a6914957 tempest-GroupsV314Test-994534806 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.803s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:24:55 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-aa81b20e-d8a8-4de9-b881-c754a6914957 tempest-GroupsV314Test-994534806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea21a7c5-3d1c-4722-9306-bc6aa601aca4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8ef64ce-738c-4b4f-8769-49896cfc05dc', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:24:55 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-aa81b20e-d8a8-4de9-b881-c754a6914957 tempest-GroupsV314Test-994534806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f83c9c46-e35f-4507-8589-499952d2d991) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:24:55 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-aa81b20e-d8a8-4de9-b881-c754a6914957 tempest-GroupsV314Test-994534806 None] Volume volume-a8ef64ce-738c-4b4f-8769-49896cfc05dc (a8ef64ce-738c-4b4f-8769-49896cfc05dc): created successfully Aug 05 06:24:55 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-aa81b20e-d8a8-4de9-b881-c754a6914957 tempest-GroupsV314Test-994534806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f83c9c46-e35f-4507-8589-499952d2d991) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:24:55 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-aa81b20e-d8a8-4de9-b881-c754a6914957 tempest-GroupsV314Test-994534806 None] Flow 'volume_create_manager' (0f7e6921-cad9-4ea2-a751-1954f51d9e9c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:24:55 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-aa81b20e-d8a8-4de9-b881-c754a6914957 tempest-GroupsV314Test-994534806 None] Created volume successfully. Aug 05 06:24:55 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-1742c8f8-65a8-4c94-b294-ba590f81c470 tempest-GroupsV314Test-994534806 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:24:55 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-1742c8f8-65a8-4c94-b294-ba590f81c470 tempest-GroupsV314Test-994534806 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:24:55 devstack cinder-volume[88695]: INFO cinder.volume.drivers.remotefs [None req-1742c8f8-65a8-4c94-b294-ba590f81c470 tempest-GroupsV314Test-994534806 None] Cloning volume a8ef64ce-738c-4b4f-8769-49896cfc05dc to volume 33fdbf3a-2a72-479f-8978-4531403d11cf Aug 05 06:24:55 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-1742c8f8-65a8-4c94-b294-ba590f81c470 tempest-GroupsV314Test-994534806 None] Creating offline snapshot c790be1e-33ae-415f-b84d-9a3b2696bee0 of volume a8ef64ce-738c-4b4f-8769-49896cfc05dc {{(pid=88695) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 06:24:55 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bdc37ef-2f14-41d7-9846-a7b1ca5c00df]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:24:55 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-1742c8f8-65a8-4c94-b294-ba590f81c470 tempest-GroupsV314Test-994534806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a8ef64ce-738c-4b4f-8769-49896cfc05dc {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:24:56 devstack sudo[103721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a8ef64ce-738c-4b4f-8769-49896cfc05dc Aug 05 06:24:56 devstack sudo[103721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:24:56 devstack sudo[103721]: pam_unix(sudo:session): session closed for user root Aug 05 06:24:56 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-1742c8f8-65a8-4c94-b294-ba590f81c470 tempest-GroupsV314Test-994534806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a8ef64ce-738c-4b4f-8769-49896cfc05dc" returned: 0 in 0.378s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:24:56 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-1742c8f8-65a8-4c94-b294-ba590f81c470 tempest-GroupsV314Test-994534806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a8ef64ce-738c-4b4f-8769-49896cfc05dc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a8ef64ce-738c-4b4f-8769-49896cfc05dc.c790be1e-33ae-415f-b84d-9a3b2696bee0 1G {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:24:56 devstack sudo[103726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a8ef64ce-738c-4b4f-8769-49896cfc05dc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a8ef64ce-738c-4b4f-8769-49896cfc05dc.c790be1e-33ae-415f-b84d-9a3b2696bee0 1G Aug 05 06:24:56 devstack sudo[103726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:24:56 devstack sudo[103726]: pam_unix(sudo:session): session closed for user root Aug 05 06:24:56 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-1742c8f8-65a8-4c94-b294-ba590f81c470 tempest-GroupsV314Test-994534806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a8ef64ce-738c-4b4f-8769-49896cfc05dc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a8ef64ce-738c-4b4f-8769-49896cfc05dc.c790be1e-33ae-415f-b84d-9a3b2696bee0 1G" returned: 0 in 0.430s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:24:56 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-1742c8f8-65a8-4c94-b294-ba590f81c470 tempest-GroupsV314Test-994534806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a8ef64ce-738c-4b4f-8769-49896cfc05dc -F qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a8ef64ce-738c-4b4f-8769-49896cfc05dc.c790be1e-33ae-415f-b84d-9a3b2696bee0 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:24:56 devstack sudo[103731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a8ef64ce-738c-4b4f-8769-49896cfc05dc -F qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a8ef64ce-738c-4b4f-8769-49896cfc05dc.c790be1e-33ae-415f-b84d-9a3b2696bee0 Aug 05 06:24:56 devstack sudo[103731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:24:57 devstack sudo[103731]: pam_unix(sudo:session): session closed for user root Aug 05 06:24:57 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-1742c8f8-65a8-4c94-b294-ba590f81c470 tempest-GroupsV314Test-994534806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a8ef64ce-738c-4b4f-8769-49896cfc05dc -F qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a8ef64ce-738c-4b4f-8769-49896cfc05dc.c790be1e-33ae-415f-b84d-9a3b2696bee0" returned: 0 in 0.290s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:24:57 devstack cinder-volume[88695]: WARNING cinder.volume.drivers.remotefs [None req-1742c8f8-65a8-4c94-b294-ba590f81c470 tempest-GroupsV314Test-994534806 None] /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a8ef64ce-738c-4b4f-8769-49896cfc05dc.c790be1e-33ae-415f-b84d-9a3b2696bee0 is being set with open permissions: ugo+rw: NotImplementedError Aug 05 06:24:57 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-1742c8f8-65a8-4c94-b294-ba590f81c470 tempest-GroupsV314Test-994534806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a8ef64ce-738c-4b4f-8769-49896cfc05dc.c790be1e-33ae-415f-b84d-9a3b2696bee0 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:24:57 devstack sudo[103737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a8ef64ce-738c-4b4f-8769-49896cfc05dc.c790be1e-33ae-415f-b84d-9a3b2696bee0 Aug 05 06:24:57 devstack sudo[103737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:24:57 devstack sudo[103737]: pam_unix(sudo:session): session closed for user root Aug 05 06:24:57 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-1742c8f8-65a8-4c94-b294-ba590f81c470 tempest-GroupsV314Test-994534806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a8ef64ce-738c-4b4f-8769-49896cfc05dc.c790be1e-33ae-415f-b84d-9a3b2696bee0" returned: 0 in 0.265s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:24:57 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-1742c8f8-65a8-4c94-b294-ba590f81c470 tempest-GroupsV314Test-994534806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a8ef64ce-738c-4b4f-8769-49896cfc05dc.info {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:24:57 devstack sudo[103740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a8ef64ce-738c-4b4f-8769-49896cfc05dc.info Aug 05 06:24:57 devstack sudo[103740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:24:57 devstack sudo[103740]: pam_unix(sudo:session): session closed for user root Aug 05 06:24:57 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-1742c8f8-65a8-4c94-b294-ba590f81c470 tempest-GroupsV314Test-994534806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a8ef64ce-738c-4b4f-8769-49896cfc05dc.info" returned: 0 in 0.256s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:24:57 devstack cinder-volume[88695]: WARNING cinder.volume.drivers.remotefs [None req-1742c8f8-65a8-4c94-b294-ba590f81c470 tempest-GroupsV314Test-994534806 None] /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a8ef64ce-738c-4b4f-8769-49896cfc05dc.info is being set with open permissions: ugo+rw: NotImplementedError Aug 05 06:24:57 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-1742c8f8-65a8-4c94-b294-ba590f81c470 tempest-GroupsV314Test-994534806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a8ef64ce-738c-4b4f-8769-49896cfc05dc.info {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:24:57 devstack sudo[103743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a8ef64ce-738c-4b4f-8769-49896cfc05dc.info Aug 05 06:24:57 devstack sudo[103743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:24:57 devstack sudo[103743]: pam_unix(sudo:session): session closed for user root Aug 05 06:24:57 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-1742c8f8-65a8-4c94-b294-ba590f81c470 tempest-GroupsV314Test-994534806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a8ef64ce-738c-4b4f-8769-49896cfc05dc.info" returned: 0 in 0.257s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:24:57 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-1742c8f8-65a8-4c94-b294-ba590f81c470 tempest-GroupsV314Test-994534806 None] Acquiring lock "cinder-quobyte-33fdbf3a-2a72-479f-8978-4531403d11cf" by "_copy_volume_from_snapshot" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:24:57 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-1742c8f8-65a8-4c94-b294-ba590f81c470 tempest-GroupsV314Test-994534806 None] Lock "cinder-quobyte-33fdbf3a-2a72-479f-8978-4531403d11cf" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:24:57 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-1742c8f8-65a8-4c94-b294-ba590f81c470 tempest-GroupsV314Test-994534806 None] snapshot: c790be1e-33ae-415f-b84d-9a3b2696bee0, volume: 33fdbf3a-2a72-479f-8978-4531403d11cf, {{(pid=88695) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 05 06:24:57 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-1742c8f8-65a8-4c94-b294-ba590f81c470 tempest-GroupsV314Test-994534806 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:24:57 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-1742c8f8-65a8-4c94-b294-ba590f81c470 tempest-GroupsV314Test-994534806 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:24:57 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-1742c8f8-65a8-4c94-b294-ba590f81c470 tempest-GroupsV314Test-994534806 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:24:57 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-1742c8f8-65a8-4c94-b294-ba590f81c470 tempest-GroupsV314Test-994534806 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:24:57 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-1742c8f8-65a8-4c94-b294-ba590f81c470 tempest-GroupsV314Test-994534806 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:24:58 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac2bb976-8035-42ba-8e8b-dc97f6eef18e]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:24:58 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-1742c8f8-65a8-4c94-b294-ba590f81c470 tempest-GroupsV314Test-994534806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a8ef64ce-738c-4b4f-8769-49896cfc05dc.c790be1e-33ae-415f-b84d-9a3b2696bee0 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:24:58 devstack sudo[103748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a8ef64ce-738c-4b4f-8769-49896cfc05dc.c790be1e-33ae-415f-b84d-9a3b2696bee0 Aug 05 06:24:58 devstack sudo[103748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:24:58 devstack sudo[103748]: pam_unix(sudo:session): session closed for user root Aug 05 06:24:58 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-1742c8f8-65a8-4c94-b294-ba590f81c470 tempest-GroupsV314Test-994534806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a8ef64ce-738c-4b4f-8769-49896cfc05dc.c790be1e-33ae-415f-b84d-9a3b2696bee0" returned: 0 in 0.367s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:24:58 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-1742c8f8-65a8-4c94-b294-ba590f81c470 tempest-GroupsV314Test-994534806 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a8ef64ce-738c-4b4f-8769-49896cfc05dc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88695) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 06:24:58 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[1534acda-6f71-463d-8e7f-e13421076cbb]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:24:58 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-1742c8f8-65a8-4c94-b294-ba590f81c470 tempest-GroupsV314Test-994534806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a8ef64ce-738c-4b4f-8769-49896cfc05dc {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:24:58 devstack sudo[103754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a8ef64ce-738c-4b4f-8769-49896cfc05dc Aug 05 06:24:58 devstack sudo[103754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:24:58 devstack sudo[103754]: pam_unix(sudo:session): session closed for user root Aug 05 06:24:58 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-1742c8f8-65a8-4c94-b294-ba590f81c470 tempest-GroupsV314Test-994534806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a8ef64ce-738c-4b4f-8769-49896cfc05dc" returned: 0 in 0.367s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:24:58 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-1742c8f8-65a8-4c94-b294-ba590f81c470 tempest-GroupsV314Test-994534806 None] will copy from snapshot at /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a8ef64ce-738c-4b4f-8769-49896cfc05dc {{(pid=88695) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 05 06:24:58 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-1742c8f8-65a8-4c94-b294-ba590f81c470 tempest-GroupsV314Test-994534806 None] Creating direct copy from snapshot {{(pid=88695) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 05 06:24:58 devstack cinder-volume[88695]: DEBUG cinder.utils [None req-1742c8f8-65a8-4c94-b294-ba590f81c470 tempest-GroupsV314Test-994534806 None] Path /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-33fdbf3a-2a72-479f-8978-4531403d11cf not found in is_blk_device check {{(pid=88695) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 05 06:24:58 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-1742c8f8-65a8-4c94-b294-ba590f81c470 tempest-GroupsV314Test-994534806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a8ef64ce-738c-4b4f-8769-49896cfc05dc /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-33fdbf3a-2a72-479f-8978-4531403d11cf {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:24:58 devstack sudo[103759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a8ef64ce-738c-4b4f-8769-49896cfc05dc /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-33fdbf3a-2a72-479f-8978-4531403d11cf Aug 05 06:24:58 devstack sudo[103759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:25:00 devstack cinder-volume[88695]: DEBUG oslo_service.periodic_task [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88695) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 06:25:00 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:25:00 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:25:00 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:25:00 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:25:00 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:25:00 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:25:00 devstack sudo[103774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce Aug 05 06:25:00 devstack sudo[103774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:25:01 devstack sudo[103774]: pam_unix(sudo:session): session closed for user root Aug 05 06:25:01 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce" returned: 0 in 1.138s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:25:01 devstack cinder-volume[88695]: DEBUG cinder.manager [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] Notifying Schedulers of capabilities ... {{(pid=88695) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 06:25:01 devstack cinder-volume[88695]: DEBUG oslo_service.periodic_task [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] Running periodic task VolumeManager._thread_info {{(pid=88695) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 06:25:01 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] thread count: 28 {{(pid=88695) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 05 06:25:01 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] thread info: [<_MainThread(MainThread, started 134469211893888)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88695) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 05 06:25:04 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-1742c8f8-65a8-4c94-b294-ba590f81c470 tempest-GroupsV314Test-994534806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a8ef64ce-738c-4b4f-8769-49896cfc05dc /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-33fdbf3a-2a72-479f-8978-4531403d11cf" returned: 0 in 5.443s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:25:04 devstack cinder-volume[88695]: DEBUG cinder.image.image_utils [None req-1742c8f8-65a8-4c94-b294-ba590f81c470 tempest-GroupsV314Test-994534806 None] Image conversion details: src /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a8ef64ce-738c-4b4f-8769-49896cfc05dc, size 1024.00 MB, duration 5.44 sec, destination /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-33fdbf3a-2a72-479f-8978-4531403d11cf {{(pid=88695) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 05 06:25:04 devstack cinder-volume[88695]: INFO cinder.image.image_utils [None req-1742c8f8-65a8-4c94-b294-ba590f81c470 tempest-GroupsV314Test-994534806 None] Converted 1024.00 MB image at 188.10 MB/s Aug 05 06:25:04 devstack cinder-volume[88695]: WARNING cinder.volume.drivers.remotefs [None req-1742c8f8-65a8-4c94-b294-ba590f81c470 tempest-GroupsV314Test-994534806 None] /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-33fdbf3a-2a72-479f-8978-4531403d11cf is being set with open permissions: ugo+rw: NotImplementedError Aug 05 06:25:04 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-1742c8f8-65a8-4c94-b294-ba590f81c470 tempest-GroupsV314Test-994534806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-33fdbf3a-2a72-479f-8978-4531403d11cf {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:25:04 devstack sudo[104123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-33fdbf3a-2a72-479f-8978-4531403d11cf Aug 05 06:25:04 devstack sudo[104123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:25:04 devstack sudo[104123]: pam_unix(sudo:session): session closed for user root Aug 05 06:25:04 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-1742c8f8-65a8-4c94-b294-ba590f81c470 tempest-GroupsV314Test-994534806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-33fdbf3a-2a72-479f-8978-4531403d11cf" returned: 0 in 0.261s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:25:04 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-1742c8f8-65a8-4c94-b294-ba590f81c470 tempest-GroupsV314Test-994534806 None] Lock "cinder-quobyte-33fdbf3a-2a72-479f-8978-4531403d11cf" released by "_copy_volume_from_snapshot" :: held 6.508s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:25:04 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-1742c8f8-65a8-4c94-b294-ba590f81c470 tempest-GroupsV314Test-994534806 None] Acquiring lock "cinder-quobyte-c790be1e-33ae-415f-b84d-9a3b2696bee0" by "_delete_snapshot" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:25:04 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-1742c8f8-65a8-4c94-b294-ba590f81c470 tempest-GroupsV314Test-994534806 None] Lock "cinder-quobyte-c790be1e-33ae-415f-b84d-9a3b2696bee0" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:25:04 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-1742c8f8-65a8-4c94-b294-ba590f81c470 tempest-GroupsV314Test-994534806 None] Deleting offline snapshot c790be1e-33ae-415f-b84d-9a3b2696bee0 of volume a8ef64ce-738c-4b4f-8769-49896cfc05dc {{(pid=88695) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 06:25:04 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-1742c8f8-65a8-4c94-b294-ba590f81c470 tempest-GroupsV314Test-994534806 None] snapshot_file for this snap is: volume-a8ef64ce-738c-4b4f-8769-49896cfc05dc.c790be1e-33ae-415f-b84d-9a3b2696bee0 {{(pid=88695) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 06:25:04 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c104aa5-967a-4e9e-9387-d76b9289a3da]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:25:04 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-1742c8f8-65a8-4c94-b294-ba590f81c470 tempest-GroupsV314Test-994534806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a8ef64ce-738c-4b4f-8769-49896cfc05dc.c790be1e-33ae-415f-b84d-9a3b2696bee0 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:25:04 devstack sudo[104126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a8ef64ce-738c-4b4f-8769-49896cfc05dc.c790be1e-33ae-415f-b84d-9a3b2696bee0 Aug 05 06:25:04 devstack sudo[104126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:25:05 devstack sudo[104126]: pam_unix(sudo:session): session closed for user root Aug 05 06:25:05 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-1742c8f8-65a8-4c94-b294-ba590f81c470 tempest-GroupsV314Test-994534806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a8ef64ce-738c-4b4f-8769-49896cfc05dc.c790be1e-33ae-415f-b84d-9a3b2696bee0" returned: 0 in 0.431s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:25:05 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-1742c8f8-65a8-4c94-b294-ba590f81c470 tempest-GroupsV314Test-994534806 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a8ef64ce-738c-4b4f-8769-49896cfc05dc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88695) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 06:25:05 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc68bed8-9077-41de-b5a3-71b140101983]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:25:05 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-1742c8f8-65a8-4c94-b294-ba590f81c470 tempest-GroupsV314Test-994534806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a8ef64ce-738c-4b4f-8769-49896cfc05dc {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:25:05 devstack sudo[104135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a8ef64ce-738c-4b4f-8769-49896cfc05dc Aug 05 06:25:05 devstack sudo[104135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:25:05 devstack sudo[104135]: pam_unix(sudo:session): session closed for user root Aug 05 06:25:05 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-1742c8f8-65a8-4c94-b294-ba590f81c470 tempest-GroupsV314Test-994534806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a8ef64ce-738c-4b4f-8769-49896cfc05dc" returned: 0 in 0.637s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:25:05 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-1742c8f8-65a8-4c94-b294-ba590f81c470 tempest-GroupsV314Test-994534806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a8ef64ce-738c-4b4f-8769-49896cfc05dc.c790be1e-33ae-415f-b84d-9a3b2696bee0 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:25:05 devstack sudo[104142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a8ef64ce-738c-4b4f-8769-49896cfc05dc.c790be1e-33ae-415f-b84d-9a3b2696bee0 Aug 05 06:25:05 devstack sudo[104142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:25:06 devstack sudo[104142]: pam_unix(sudo:session): session closed for user root Aug 05 06:25:06 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-1742c8f8-65a8-4c94-b294-ba590f81c470 tempest-GroupsV314Test-994534806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a8ef64ce-738c-4b4f-8769-49896cfc05dc.c790be1e-33ae-415f-b84d-9a3b2696bee0" returned: 0 in 0.380s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:25:06 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-1742c8f8-65a8-4c94-b294-ba590f81c470 tempest-GroupsV314Test-994534806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a8ef64ce-738c-4b4f-8769-49896cfc05dc.c790be1e-33ae-415f-b84d-9a3b2696bee0 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:25:06 devstack sudo[104155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a8ef64ce-738c-4b4f-8769-49896cfc05dc.c790be1e-33ae-415f-b84d-9a3b2696bee0 Aug 05 06:25:06 devstack sudo[104155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:25:06 devstack sudo[104155]: pam_unix(sudo:session): session closed for user root Aug 05 06:25:06 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-1742c8f8-65a8-4c94-b294-ba590f81c470 tempest-GroupsV314Test-994534806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a8ef64ce-738c-4b4f-8769-49896cfc05dc.c790be1e-33ae-415f-b84d-9a3b2696bee0" returned: 0 in 0.249s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:25:06 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-1742c8f8-65a8-4c94-b294-ba590f81c470 tempest-GroupsV314Test-994534806 None] Lock "cinder-quobyte-c790be1e-33ae-415f-b84d-9a3b2696bee0" released by "_delete_snapshot" :: held 1.812s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:25:06 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-1742c8f8-65a8-4c94-b294-ba590f81c470 tempest-GroupsV314Test-994534806 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 10.409s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:25:06 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-1742c8f8-65a8-4c94-b294-ba590f81c470 tempest-GroupsV314Test-994534806 None] Create group from source-group-43d703ae-d951-4a3f-a063-45dbcf152577 completed successfully. Aug 05 06:25:07 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-33df9b9b-93e1-44f9-b52d-df9ecf6de5ea tempest-GroupsV314Test-994534806 None] Acquiring lock "cinder-quobyte-33fdbf3a-2a72-479f-8978-4531403d11cf" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:25:07 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-33df9b9b-93e1-44f9-b52d-df9ecf6de5ea tempest-GroupsV314Test-994534806 None] Lock "cinder-quobyte-33fdbf3a-2a72-479f-8978-4531403d11cf" acquired by "delete_volume" :: waited 0.017s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:25:07 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[4caf4ce7-5171-4e35-a1ed-5a2b2350cb89]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:25:07 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-33df9b9b-93e1-44f9-b52d-df9ecf6de5ea tempest-GroupsV314Test-994534806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-33fdbf3a-2a72-479f-8978-4531403d11cf {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:25:07 devstack sudo[104182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-33fdbf3a-2a72-479f-8978-4531403d11cf Aug 05 06:25:07 devstack sudo[104182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:25:07 devstack sudo[104182]: pam_unix(sudo:session): session closed for user root Aug 05 06:25:07 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-33df9b9b-93e1-44f9-b52d-df9ecf6de5ea tempest-GroupsV314Test-994534806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-33fdbf3a-2a72-479f-8978-4531403d11cf" returned: 0 in 0.370s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:25:07 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-33df9b9b-93e1-44f9-b52d-df9ecf6de5ea tempest-GroupsV314Test-994534806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-33fdbf3a-2a72-479f-8978-4531403d11cf {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:25:07 devstack sudo[104187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-33fdbf3a-2a72-479f-8978-4531403d11cf Aug 05 06:25:07 devstack sudo[104187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:25:08 devstack sudo[104187]: pam_unix(sudo:session): session closed for user root Aug 05 06:25:08 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-33df9b9b-93e1-44f9-b52d-df9ecf6de5ea tempest-GroupsV314Test-994534806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-33fdbf3a-2a72-479f-8978-4531403d11cf" returned: 0 in 0.239s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:25:08 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-33df9b9b-93e1-44f9-b52d-df9ecf6de5ea tempest-GroupsV314Test-994534806 None] Lock "cinder-quobyte-33fdbf3a-2a72-479f-8978-4531403d11cf" released by "delete_volume" :: held 0.656s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:25:08 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-33df9b9b-93e1-44f9-b52d-df9ecf6de5ea tempest-GroupsV314Test-994534806 None] Created reservations ['ee53a63c-2efc-4d60-9797-35aaca210995'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:25:08 devstack cinder-volume[88695]: WARNING cinder.quota [None req-33df9b9b-93e1-44f9-b52d-df9ecf6de5ea tempest-GroupsV314Test-994534806 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1990378042 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1990378042, it is now deprecated. Please use the default quota class for default quota. Aug 05 06:25:08 devstack cinder-volume[88695]: WARNING cinder.quota [None req-33df9b9b-93e1-44f9-b52d-df9ecf6de5ea tempest-GroupsV314Test-994534806 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1990378042 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1990378042, it is now deprecated. Please use the default quota class for default quota. Aug 05 06:25:08 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-33df9b9b-93e1-44f9-b52d-df9ecf6de5ea tempest-GroupsV314Test-994534806 None] Created reservations ['e24d1853-5604-4d99-9445-300738f1194f', 'da73c8c1-21ba-4cc9-85b9-06f35400e3ec', '0e4fb238-efe9-47d4-9a73-6107d9f3c383', '35996aa0-ecf9-4457-896a-c2b3dd1f4e33'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:25:08 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-33df9b9b-93e1-44f9-b52d-df9ecf6de5ea tempest-GroupsV314Test-994534806 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:25:08 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-33df9b9b-93e1-44f9-b52d-df9ecf6de5ea tempest-GroupsV314Test-994534806 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:25:08 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-33df9b9b-93e1-44f9-b52d-df9ecf6de5ea tempest-GroupsV314Test-994534806 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:25:08 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-33df9b9b-93e1-44f9-b52d-df9ecf6de5ea tempest-GroupsV314Test-994534806 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:25:08 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-33df9b9b-93e1-44f9-b52d-df9ecf6de5ea tempest-GroupsV314Test-994534806 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:25:08 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-33df9b9b-93e1-44f9-b52d-df9ecf6de5ea tempest-GroupsV314Test-994534806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:25:08 devstack sudo[104191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce Aug 05 06:25:08 devstack sudo[104191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:25:08 devstack sudo[104191]: pam_unix(sudo:session): session closed for user root Aug 05 06:25:08 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-33df9b9b-93e1-44f9-b52d-df9ecf6de5ea tempest-GroupsV314Test-994534806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce" returned: 0 in 0.279s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:25:08 devstack cinder-volume[88695]: DEBUG cinder.manager [None req-33df9b9b-93e1-44f9-b52d-df9ecf6de5ea tempest-GroupsV314Test-994534806 None] Notifying Schedulers of capabilities ... {{(pid=88695) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 06:25:08 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-33df9b9b-93e1-44f9-b52d-df9ecf6de5ea tempest-GroupsV314Test-994534806 None] Delete group completed successfully. Aug 05 06:25:08 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-2e9f8bbb-ed44-42c6-9581-d4f9b55fd83a tempest-GroupsV314Test-994534806 None] Acquiring lock "cinder-quobyte-a8ef64ce-738c-4b4f-8769-49896cfc05dc" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:25:08 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-2e9f8bbb-ed44-42c6-9581-d4f9b55fd83a tempest-GroupsV314Test-994534806 None] Lock "cinder-quobyte-a8ef64ce-738c-4b4f-8769-49896cfc05dc" acquired by "delete_volume" :: waited 0.021s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:25:08 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[646b400c-2eb4-4be7-be4d-f4bc03d803ab]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:25:08 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-2e9f8bbb-ed44-42c6-9581-d4f9b55fd83a tempest-GroupsV314Test-994534806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a8ef64ce-738c-4b4f-8769-49896cfc05dc {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:25:09 devstack sudo[104194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a8ef64ce-738c-4b4f-8769-49896cfc05dc Aug 05 06:25:09 devstack sudo[104194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:25:09 devstack sudo[104194]: pam_unix(sudo:session): session closed for user root Aug 05 06:25:09 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-2e9f8bbb-ed44-42c6-9581-d4f9b55fd83a tempest-GroupsV314Test-994534806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a8ef64ce-738c-4b4f-8769-49896cfc05dc" returned: 0 in 0.400s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:25:09 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-2e9f8bbb-ed44-42c6-9581-d4f9b55fd83a tempest-GroupsV314Test-994534806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a8ef64ce-738c-4b4f-8769-49896cfc05dc {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:25:09 devstack sudo[104199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a8ef64ce-738c-4b4f-8769-49896cfc05dc Aug 05 06:25:09 devstack sudo[104199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:25:09 devstack sudo[104199]: pam_unix(sudo:session): session closed for user root Aug 05 06:25:09 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-2e9f8bbb-ed44-42c6-9581-d4f9b55fd83a tempest-GroupsV314Test-994534806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a8ef64ce-738c-4b4f-8769-49896cfc05dc" returned: 0 in 0.268s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:25:09 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-2e9f8bbb-ed44-42c6-9581-d4f9b55fd83a tempest-GroupsV314Test-994534806 None] Lock "cinder-quobyte-a8ef64ce-738c-4b4f-8769-49896cfc05dc" released by "delete_volume" :: held 0.732s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:25:09 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-2e9f8bbb-ed44-42c6-9581-d4f9b55fd83a tempest-GroupsV314Test-994534806 None] Created reservations ['cc983ef3-bb04-4949-b6ea-46762dacc1f9'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:25:09 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-2e9f8bbb-ed44-42c6-9581-d4f9b55fd83a tempest-GroupsV314Test-994534806 None] Created reservations ['66764dad-a46a-45a1-afa4-f37422ff25a8', 'd7d79b0d-86a7-4f2e-be37-4f8feadc7f5a', 'db14c6e1-adf9-4f5e-bf4d-e461979bb022', '56909b8c-d43f-48f9-9384-dbf10debfdc7'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:25:09 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-2e9f8bbb-ed44-42c6-9581-d4f9b55fd83a tempest-GroupsV314Test-994534806 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:25:09 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-2e9f8bbb-ed44-42c6-9581-d4f9b55fd83a tempest-GroupsV314Test-994534806 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:25:09 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-2e9f8bbb-ed44-42c6-9581-d4f9b55fd83a tempest-GroupsV314Test-994534806 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:25:09 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-2e9f8bbb-ed44-42c6-9581-d4f9b55fd83a tempest-GroupsV314Test-994534806 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:25:09 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-2e9f8bbb-ed44-42c6-9581-d4f9b55fd83a tempest-GroupsV314Test-994534806 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:25:09 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-2e9f8bbb-ed44-42c6-9581-d4f9b55fd83a tempest-GroupsV314Test-994534806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:25:09 devstack sudo[104202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce Aug 05 06:25:09 devstack sudo[104202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:25:10 devstack sudo[104202]: pam_unix(sudo:session): session closed for user root Aug 05 06:25:10 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-2e9f8bbb-ed44-42c6-9581-d4f9b55fd83a tempest-GroupsV314Test-994534806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce" returned: 0 in 0.291s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:25:10 devstack cinder-volume[88695]: DEBUG cinder.manager [None req-2e9f8bbb-ed44-42c6-9581-d4f9b55fd83a tempest-GroupsV314Test-994534806 None] Notifying Schedulers of capabilities ... {{(pid=88695) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 06:25:10 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-2e9f8bbb-ed44-42c6-9581-d4f9b55fd83a tempest-GroupsV314Test-994534806 None] Delete group completed successfully. Aug 05 06:25:18 devstack cinder-volume[88695]: INFO cinder.volume.manager [req-406b170c-63d2-423c-b663-5fcb10c99a27 req-60d7e41e-7c51-473a-96bc-1b537f19811f tempest-TestShelveInstance-802603102 None] Terminate volume connection completed successfully. Aug 05 06:25:18 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [req-406b170c-63d2-423c-b663-5fcb10c99a27 req-60d7e41e-7c51-473a-96bc-1b537f19811f tempest-TestShelveInstance-802603102 None] Deleting attachment b16d3057-164d-4426-90f3-8ab55480ea15. {{(pid=88695) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 05 06:25:21 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [req-ebe5ec2b-27fc-438a-985f-ed34204ae5be req-e675e85c-6aaf-415b-ad08-bfcc373d6de3 tempest-TestShelveInstance-802603102 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:25:21 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [req-ebe5ec2b-27fc-438a-985f-ed34204ae5be req-e675e85c-6aaf-415b-ad08-bfcc373d6de3 tempest-TestShelveInstance-802603102 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:25:21 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [req-ebe5ec2b-27fc-438a-985f-ed34204ae5be req-e675e85c-6aaf-415b-ad08-bfcc373d6de3 tempest-TestShelveInstance-802603102 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:25:21 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [req-ebe5ec2b-27fc-438a-985f-ed34204ae5be req-e675e85c-6aaf-415b-ad08-bfcc373d6de3 tempest-TestShelveInstance-802603102 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087', 'name': 'volume-50048e3d-a5d7-4b7f-8f6a-cc0bf11aa6c9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd5132fa1-53d0-4a21-87af-9ff5125fdaf4', 'enforce_multipath': True} {{(pid=88695) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 05 06:25:21 devstack cinder-volume[88695]: INFO cinder.volume.manager [req-ebe5ec2b-27fc-438a-985f-ed34204ae5be req-e675e85c-6aaf-415b-ad08-bfcc373d6de3 tempest-TestShelveInstance-802603102 None] attachment_update completed successfully. Aug 05 06:25:21 devstack cinder-volume[88695]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7316d6f-ae36-4564-a346-4e41e4f9a1ee tempest-SnapshotsActionsTest-1399985861 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88695) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 06:25:21 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-d7316d6f-ae36-4564-a346-4e41e4f9a1ee tempest-SnapshotsActionsTest-1399985861 None] Flow 'volume_create_manager' (d33238ea-bfa5-46da-963c-c333d4fb3cc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:25:21 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-d7316d6f-ae36-4564-a346-4e41e4f9a1ee tempest-SnapshotsActionsTest-1399985861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6aa30625-caa5-4bb2-af64-1e951fb9b883) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:25:21 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-d7316d6f-ae36-4564-a346-4e41e4f9a1ee tempest-SnapshotsActionsTest-1399985861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6aa30625-caa5-4bb2-af64-1e951fb9b883) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:25:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1151932398',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ff653aa-e37e-49aa-957b-2e0eb854595b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3438f7033564d33ae2458e4a075da8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:25:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:25:22Z,use_quota=True,user_id='2766d00511004167b827cfef7be2e7c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:25:21 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-d7316d6f-ae36-4564-a346-4e41e4f9a1ee tempest-SnapshotsActionsTest-1399985861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b1d09e6-9aa6-45ff-afa7-2f8a19b7d3c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:25:21 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-d7316d6f-ae36-4564-a346-4e41e4f9a1ee tempest-SnapshotsActionsTest-1399985861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b1d09e6-9aa6-45ff-afa7-2f8a19b7d3c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:25:21 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-d7316d6f-ae36-4564-a346-4e41e4f9a1ee tempest-SnapshotsActionsTest-1399985861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50b0c6f9-10c2-4c88-83bc-bbfef92d1220) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:25:21 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-d7316d6f-ae36-4564-a346-4e41e4f9a1ee tempest-SnapshotsActionsTest-1399985861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50b0c6f9-10c2-4c88-83bc-bbfef92d1220) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ff653aa-e37e-49aa-957b-2e0eb854595b', 'volume_name': 'volume-9ff653aa-e37e-49aa-957b-2e0eb854595b', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:25:21 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-d7316d6f-ae36-4564-a346-4e41e4f9a1ee tempest-SnapshotsActionsTest-1399985861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c739769-cd61-4378-a91f-686939ddfc83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:25:21 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-d7316d6f-ae36-4564-a346-4e41e4f9a1ee tempest-SnapshotsActionsTest-1399985861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c739769-cd61-4378-a91f-686939ddfc83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:25:21 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-d7316d6f-ae36-4564-a346-4e41e4f9a1ee tempest-SnapshotsActionsTest-1399985861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da65ef89-e262-48bf-a0d8-e3b9e4c197cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:25:21 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-d7316d6f-ae36-4564-a346-4e41e4f9a1ee tempest-SnapshotsActionsTest-1399985861 None] Volume 9ff653aa-e37e-49aa-957b-2e0eb854595b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ff653aa-e37e-49aa-957b-2e0eb854595b', 'volume_size': 1} Aug 05 06:25:21 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-d7316d6f-ae36-4564-a346-4e41e4f9a1ee tempest-SnapshotsActionsTest-1399985861 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:25:21 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-d7316d6f-ae36-4564-a346-4e41e4f9a1ee tempest-SnapshotsActionsTest-1399985861 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:25:21 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-d7316d6f-ae36-4564-a346-4e41e4f9a1ee tempest-SnapshotsActionsTest-1399985861 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:25:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1151932398',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ff653aa-e37e-49aa-957b-2e0eb854595b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3438f7033564d33ae2458e4a075da8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:25:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:25:22Z,use_quota=True,user_id='2766d00511004167b827cfef7be2e7c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)}" {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 06:25:21 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-d7316d6f-ae36-4564-a346-4e41e4f9a1ee tempest-SnapshotsActionsTest-1399985861 None] Creating volume 9ff653aa-e37e-49aa-957b-2e0eb854595b {{(pid=88695) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 06:25:21 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-d7316d6f-ae36-4564-a346-4e41e4f9a1ee tempest-SnapshotsActionsTest-1399985861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:25:21 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-d7316d6f-ae36-4564-a346-4e41e4f9a1ee tempest-SnapshotsActionsTest-1399985861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:25:21 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-d7316d6f-ae36-4564-a346-4e41e4f9a1ee tempest-SnapshotsActionsTest-1399985861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:25:21 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-d7316d6f-ae36-4564-a346-4e41e4f9a1ee tempest-SnapshotsActionsTest-1399985861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:25:21 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-d7316d6f-ae36-4564-a346-4e41e4f9a1ee tempest-SnapshotsActionsTest-1399985861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:25:21 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-d7316d6f-ae36-4564-a346-4e41e4f9a1ee tempest-SnapshotsActionsTest-1399985861 None] Selected osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 as target Quobyte volume. {{(pid=88695) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 06:25:21 devstack cinder-volume[88695]: INFO cinder.volume.drivers.remotefs [None req-d7316d6f-ae36-4564-a346-4e41e4f9a1ee tempest-SnapshotsActionsTest-1399985861 None] casted to osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 Aug 05 06:25:21 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-d7316d6f-ae36-4564-a346-4e41e4f9a1ee tempest-SnapshotsActionsTest-1399985861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9ff653aa-e37e-49aa-957b-2e0eb854595b 1073741824 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:25:22 devstack sudo[104346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9ff653aa-e37e-49aa-957b-2e0eb854595b 1073741824 Aug 05 06:25:22 devstack sudo[104346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:25:22 devstack sudo[104346]: pam_unix(sudo:session): session closed for user root Aug 05 06:25:22 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-d7316d6f-ae36-4564-a346-4e41e4f9a1ee tempest-SnapshotsActionsTest-1399985861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9ff653aa-e37e-49aa-957b-2e0eb854595b 1073741824" returned: 0 in 0.491s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:25:22 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-d7316d6f-ae36-4564-a346-4e41e4f9a1ee tempest-SnapshotsActionsTest-1399985861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9ff653aa-e37e-49aa-957b-2e0eb854595b {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:25:22 devstack sudo[104351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9ff653aa-e37e-49aa-957b-2e0eb854595b Aug 05 06:25:22 devstack sudo[104351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:25:22 devstack sudo[104351]: pam_unix(sudo:session): session closed for user root Aug 05 06:25:22 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-d7316d6f-ae36-4564-a346-4e41e4f9a1ee tempest-SnapshotsActionsTest-1399985861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9ff653aa-e37e-49aa-957b-2e0eb854595b" returned: 0 in 0.279s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:25:22 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-d7316d6f-ae36-4564-a346-4e41e4f9a1ee tempest-SnapshotsActionsTest-1399985861 None] <== create_volume: return (829ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'} {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 06:25:22 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-d7316d6f-ae36-4564-a346-4e41e4f9a1ee tempest-SnapshotsActionsTest-1399985861 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.834s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:25:22 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-d7316d6f-ae36-4564-a346-4e41e4f9a1ee tempest-SnapshotsActionsTest-1399985861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da65ef89-e262-48bf-a0d8-e3b9e4c197cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ff653aa-e37e-49aa-957b-2e0eb854595b', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:25:22 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-d7316d6f-ae36-4564-a346-4e41e4f9a1ee tempest-SnapshotsActionsTest-1399985861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f53f6c36-fcc9-47a5-8fed-c7cef3e1cd85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:25:22 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-d7316d6f-ae36-4564-a346-4e41e4f9a1ee tempest-SnapshotsActionsTest-1399985861 None] Volume volume-9ff653aa-e37e-49aa-957b-2e0eb854595b (9ff653aa-e37e-49aa-957b-2e0eb854595b): created successfully Aug 05 06:25:22 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-d7316d6f-ae36-4564-a346-4e41e4f9a1ee tempest-SnapshotsActionsTest-1399985861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f53f6c36-fcc9-47a5-8fed-c7cef3e1cd85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:25:22 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-d7316d6f-ae36-4564-a346-4e41e4f9a1ee tempest-SnapshotsActionsTest-1399985861 None] Flow 'volume_create_manager' (d33238ea-bfa5-46da-963c-c333d4fb3cc0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:25:22 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-d7316d6f-ae36-4564-a346-4e41e4f9a1ee tempest-SnapshotsActionsTest-1399985861 None] Created volume successfully. Aug 05 06:25:24 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-9f189026-b2a3-46e5-a0e7-52bc1c7335d1 tempest-SnapshotsActionsTest-1399985861 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:25:24 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-9f189026-b2a3-46e5-a0e7-52bc1c7335d1 tempest-SnapshotsActionsTest-1399985861 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:25:24 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-9f189026-b2a3-46e5-a0e7-52bc1c7335d1 tempest-SnapshotsActionsTest-1399985861 None] Creating offline snapshot 4daa71f1-9505-471d-afc1-c7977e9a6d1b of volume 9ff653aa-e37e-49aa-957b-2e0eb854595b {{(pid=88695) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 06:25:24 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[530e01e2-84a3-4ae8-85a3-2237d7b28cb9]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:25:24 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-9f189026-b2a3-46e5-a0e7-52bc1c7335d1 tempest-SnapshotsActionsTest-1399985861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9ff653aa-e37e-49aa-957b-2e0eb854595b {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:25:24 devstack sudo[104487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9ff653aa-e37e-49aa-957b-2e0eb854595b Aug 05 06:25:24 devstack sudo[104487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:25:24 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-9f189026-b2a3-46e5-a0e7-52bc1c7335d1 tempest-SnapshotsActionsTest-1399985861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9ff653aa-e37e-49aa-957b-2e0eb854595b" returned: 0 in 0.522s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:25:24 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-9f189026-b2a3-46e5-a0e7-52bc1c7335d1 tempest-SnapshotsActionsTest-1399985861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9ff653aa-e37e-49aa-957b-2e0eb854595b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9ff653aa-e37e-49aa-957b-2e0eb854595b.4daa71f1-9505-471d-afc1-c7977e9a6d1b 1G {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:25:24 devstack sudo[104487]: pam_unix(sudo:session): session closed for user root Aug 05 06:25:24 devstack sudo[104793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9ff653aa-e37e-49aa-957b-2e0eb854595b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9ff653aa-e37e-49aa-957b-2e0eb854595b.4daa71f1-9505-471d-afc1-c7977e9a6d1b 1G Aug 05 06:25:24 devstack sudo[104793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:25:25 devstack sudo[104793]: pam_unix(sudo:session): session closed for user root Aug 05 06:25:25 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-9f189026-b2a3-46e5-a0e7-52bc1c7335d1 tempest-SnapshotsActionsTest-1399985861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9ff653aa-e37e-49aa-957b-2e0eb854595b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9ff653aa-e37e-49aa-957b-2e0eb854595b.4daa71f1-9505-471d-afc1-c7977e9a6d1b 1G" returned: 0 in 0.477s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:25:25 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-9f189026-b2a3-46e5-a0e7-52bc1c7335d1 tempest-SnapshotsActionsTest-1399985861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ff653aa-e37e-49aa-957b-2e0eb854595b -F qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9ff653aa-e37e-49aa-957b-2e0eb854595b.4daa71f1-9505-471d-afc1-c7977e9a6d1b {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:25:25 devstack sudo[104811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ff653aa-e37e-49aa-957b-2e0eb854595b -F qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9ff653aa-e37e-49aa-957b-2e0eb854595b.4daa71f1-9505-471d-afc1-c7977e9a6d1b Aug 05 06:25:25 devstack sudo[104811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:25:25 devstack sudo[104811]: pam_unix(sudo:session): session closed for user root Aug 05 06:25:25 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-9f189026-b2a3-46e5-a0e7-52bc1c7335d1 tempest-SnapshotsActionsTest-1399985861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ff653aa-e37e-49aa-957b-2e0eb854595b -F qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9ff653aa-e37e-49aa-957b-2e0eb854595b.4daa71f1-9505-471d-afc1-c7977e9a6d1b" returned: 0 in 0.295s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:25:25 devstack cinder-volume[88695]: WARNING cinder.volume.drivers.remotefs [None req-9f189026-b2a3-46e5-a0e7-52bc1c7335d1 tempest-SnapshotsActionsTest-1399985861 None] /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9ff653aa-e37e-49aa-957b-2e0eb854595b.4daa71f1-9505-471d-afc1-c7977e9a6d1b is being set with open permissions: ugo+rw Aug 05 06:25:25 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-9f189026-b2a3-46e5-a0e7-52bc1c7335d1 tempest-SnapshotsActionsTest-1399985861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9ff653aa-e37e-49aa-957b-2e0eb854595b.4daa71f1-9505-471d-afc1-c7977e9a6d1b {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:25:25 devstack sudo[104830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9ff653aa-e37e-49aa-957b-2e0eb854595b.4daa71f1-9505-471d-afc1-c7977e9a6d1b Aug 05 06:25:25 devstack sudo[104830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:25:25 devstack sudo[104830]: pam_unix(sudo:session): session closed for user root Aug 05 06:25:25 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-9f189026-b2a3-46e5-a0e7-52bc1c7335d1 tempest-SnapshotsActionsTest-1399985861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9ff653aa-e37e-49aa-957b-2e0eb854595b.4daa71f1-9505-471d-afc1-c7977e9a6d1b" returned: 0 in 0.264s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:25:25 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-9f189026-b2a3-46e5-a0e7-52bc1c7335d1 tempest-SnapshotsActionsTest-1399985861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9ff653aa-e37e-49aa-957b-2e0eb854595b.info {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:25:25 devstack sudo[104833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9ff653aa-e37e-49aa-957b-2e0eb854595b.info Aug 05 06:25:25 devstack sudo[104833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:25:26 devstack sudo[104833]: pam_unix(sudo:session): session closed for user root Aug 05 06:25:26 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-9f189026-b2a3-46e5-a0e7-52bc1c7335d1 tempest-SnapshotsActionsTest-1399985861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9ff653aa-e37e-49aa-957b-2e0eb854595b.info" returned: 0 in 0.257s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:25:26 devstack cinder-volume[88695]: WARNING cinder.volume.drivers.remotefs [None req-9f189026-b2a3-46e5-a0e7-52bc1c7335d1 tempest-SnapshotsActionsTest-1399985861 None] /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9ff653aa-e37e-49aa-957b-2e0eb854595b.info is being set with open permissions: ugo+rw Aug 05 06:25:26 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-9f189026-b2a3-46e5-a0e7-52bc1c7335d1 tempest-SnapshotsActionsTest-1399985861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9ff653aa-e37e-49aa-957b-2e0eb854595b.info {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:25:26 devstack sudo[104836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9ff653aa-e37e-49aa-957b-2e0eb854595b.info Aug 05 06:25:26 devstack sudo[104836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:25:26 devstack sudo[104836]: pam_unix(sudo:session): session closed for user root Aug 05 06:25:26 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-9f189026-b2a3-46e5-a0e7-52bc1c7335d1 tempest-SnapshotsActionsTest-1399985861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9ff653aa-e37e-49aa-957b-2e0eb854595b.info" returned: 0 in 0.271s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:25:26 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-9f189026-b2a3-46e5-a0e7-52bc1c7335d1 tempest-SnapshotsActionsTest-1399985861 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.222s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:25:26 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-9f189026-b2a3-46e5-a0e7-52bc1c7335d1 tempest-SnapshotsActionsTest-1399985861 None] Create snapshot completed successfully Aug 05 06:25:27 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-7b029a21-8719-4804-95de-19ab4119d70a tempest-SnapshotsActionsTest-1399985861 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:25:27 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-7b029a21-8719-4804-95de-19ab4119d70a tempest-SnapshotsActionsTest-1399985861 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:25:27 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-7b029a21-8719-4804-95de-19ab4119d70a tempest-SnapshotsActionsTest-1399985861 None] Creating offline snapshot 23781c8c-ac98-4363-b322-f768efefabaf of volume 9ff653aa-e37e-49aa-957b-2e0eb854595b {{(pid=88695) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 06:25:27 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e554e7c-8270-455e-852b-2c37471e26b0]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:25:27 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-7b029a21-8719-4804-95de-19ab4119d70a tempest-SnapshotsActionsTest-1399985861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9ff653aa-e37e-49aa-957b-2e0eb854595b.4daa71f1-9505-471d-afc1-c7977e9a6d1b {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:25:28 devstack sudo[104841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9ff653aa-e37e-49aa-957b-2e0eb854595b.4daa71f1-9505-471d-afc1-c7977e9a6d1b Aug 05 06:25:28 devstack sudo[104841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:25:28 devstack sudo[104841]: pam_unix(sudo:session): session closed for user root Aug 05 06:25:28 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-7b029a21-8719-4804-95de-19ab4119d70a tempest-SnapshotsActionsTest-1399985861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9ff653aa-e37e-49aa-957b-2e0eb854595b.4daa71f1-9505-471d-afc1-c7977e9a6d1b" returned: 0 in 0.387s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:25:28 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-7b029a21-8719-4804-95de-19ab4119d70a tempest-SnapshotsActionsTest-1399985861 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9ff653aa-e37e-49aa-957b-2e0eb854595b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88695) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 06:25:28 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-7b029a21-8719-4804-95de-19ab4119d70a tempest-SnapshotsActionsTest-1399985861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9ff653aa-e37e-49aa-957b-2e0eb854595b.4daa71f1-9505-471d-afc1-c7977e9a6d1b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9ff653aa-e37e-49aa-957b-2e0eb854595b.23781c8c-ac98-4363-b322-f768efefabaf 1G {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:25:28 devstack sudo[104847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9ff653aa-e37e-49aa-957b-2e0eb854595b.4daa71f1-9505-471d-afc1-c7977e9a6d1b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9ff653aa-e37e-49aa-957b-2e0eb854595b.23781c8c-ac98-4363-b322-f768efefabaf 1G Aug 05 06:25:28 devstack sudo[104847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:25:28 devstack sudo[104847]: pam_unix(sudo:session): session closed for user root Aug 05 06:25:28 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-7b029a21-8719-4804-95de-19ab4119d70a tempest-SnapshotsActionsTest-1399985861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9ff653aa-e37e-49aa-957b-2e0eb854595b.4daa71f1-9505-471d-afc1-c7977e9a6d1b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9ff653aa-e37e-49aa-957b-2e0eb854595b.23781c8c-ac98-4363-b322-f768efefabaf 1G" returned: 0 in 0.454s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:25:28 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-7b029a21-8719-4804-95de-19ab4119d70a tempest-SnapshotsActionsTest-1399985861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ff653aa-e37e-49aa-957b-2e0eb854595b.4daa71f1-9505-471d-afc1-c7977e9a6d1b -F qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9ff653aa-e37e-49aa-957b-2e0eb854595b.23781c8c-ac98-4363-b322-f768efefabaf {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:25:28 devstack sudo[104853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ff653aa-e37e-49aa-957b-2e0eb854595b.4daa71f1-9505-471d-afc1-c7977e9a6d1b -F qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9ff653aa-e37e-49aa-957b-2e0eb854595b.23781c8c-ac98-4363-b322-f768efefabaf Aug 05 06:25:28 devstack sudo[104853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:25:29 devstack sudo[104853]: pam_unix(sudo:session): session closed for user root Aug 05 06:25:29 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-7b029a21-8719-4804-95de-19ab4119d70a tempest-SnapshotsActionsTest-1399985861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ff653aa-e37e-49aa-957b-2e0eb854595b.4daa71f1-9505-471d-afc1-c7977e9a6d1b -F qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9ff653aa-e37e-49aa-957b-2e0eb854595b.23781c8c-ac98-4363-b322-f768efefabaf" returned: 0 in 0.301s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:25:29 devstack cinder-volume[88695]: WARNING cinder.volume.drivers.remotefs [None req-7b029a21-8719-4804-95de-19ab4119d70a tempest-SnapshotsActionsTest-1399985861 None] /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9ff653aa-e37e-49aa-957b-2e0eb854595b.23781c8c-ac98-4363-b322-f768efefabaf is being set with open permissions: ugo+rw Aug 05 06:25:29 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-7b029a21-8719-4804-95de-19ab4119d70a tempest-SnapshotsActionsTest-1399985861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9ff653aa-e37e-49aa-957b-2e0eb854595b.23781c8c-ac98-4363-b322-f768efefabaf {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:25:29 devstack sudo[104858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9ff653aa-e37e-49aa-957b-2e0eb854595b.23781c8c-ac98-4363-b322-f768efefabaf Aug 05 06:25:29 devstack sudo[104858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:25:29 devstack sudo[104858]: pam_unix(sudo:session): session closed for user root Aug 05 06:25:29 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-7b029a21-8719-4804-95de-19ab4119d70a tempest-SnapshotsActionsTest-1399985861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9ff653aa-e37e-49aa-957b-2e0eb854595b.23781c8c-ac98-4363-b322-f768efefabaf" returned: 0 in 0.277s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:25:29 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-7b029a21-8719-4804-95de-19ab4119d70a tempest-SnapshotsActionsTest-1399985861 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.511s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:25:29 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-7b029a21-8719-4804-95de-19ab4119d70a tempest-SnapshotsActionsTest-1399985861 None] Create snapshot completed successfully Aug 05 06:25:30 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-115c8ff6-9883-49d6-9cdd-b8851f4d2f7b tempest-SnapshotsActionsTest-349922654 None] Acquiring lock "cinder-23781c8c-ac98-4363-b322-f768efefabaf-delete_snapshot" by "delete_snapshot" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:25:30 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-115c8ff6-9883-49d6-9cdd-b8851f4d2f7b tempest-SnapshotsActionsTest-349922654 None] Lock "cinder-23781c8c-ac98-4363-b322-f768efefabaf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:25:30 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-115c8ff6-9883-49d6-9cdd-b8851f4d2f7b tempest-SnapshotsActionsTest-349922654 None] Acquiring lock "cinder-quobyte-9ff653aa-e37e-49aa-957b-2e0eb854595b" by "delete_snapshot" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:25:30 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-115c8ff6-9883-49d6-9cdd-b8851f4d2f7b tempest-SnapshotsActionsTest-349922654 None] Lock "cinder-quobyte-9ff653aa-e37e-49aa-957b-2e0eb854595b" acquired by "delete_snapshot" :: waited 0.025s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:25:30 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-115c8ff6-9883-49d6-9cdd-b8851f4d2f7b tempest-SnapshotsActionsTest-349922654 None] Acquiring lock "cinder-quobyte-23781c8c-ac98-4363-b322-f768efefabaf" by "_delete_snapshot" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:25:30 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-115c8ff6-9883-49d6-9cdd-b8851f4d2f7b tempest-SnapshotsActionsTest-349922654 None] Lock "cinder-quobyte-23781c8c-ac98-4363-b322-f768efefabaf" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:25:30 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-115c8ff6-9883-49d6-9cdd-b8851f4d2f7b tempest-SnapshotsActionsTest-349922654 None] Deleting offline snapshot 23781c8c-ac98-4363-b322-f768efefabaf of volume 9ff653aa-e37e-49aa-957b-2e0eb854595b {{(pid=88695) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 06:25:30 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-115c8ff6-9883-49d6-9cdd-b8851f4d2f7b tempest-SnapshotsActionsTest-349922654 None] snapshot_file for this snap is: volume-9ff653aa-e37e-49aa-957b-2e0eb854595b.23781c8c-ac98-4363-b322-f768efefabaf {{(pid=88695) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 06:25:30 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2d34724-b733-4cb7-a649-8b5423569da2]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:25:30 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-115c8ff6-9883-49d6-9cdd-b8851f4d2f7b tempest-SnapshotsActionsTest-349922654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9ff653aa-e37e-49aa-957b-2e0eb854595b.23781c8c-ac98-4363-b322-f768efefabaf {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:25:30 devstack sudo[104861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9ff653aa-e37e-49aa-957b-2e0eb854595b.23781c8c-ac98-4363-b322-f768efefabaf Aug 05 06:25:30 devstack sudo[104861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:25:30 devstack sudo[104861]: pam_unix(sudo:session): session closed for user root Aug 05 06:25:30 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-115c8ff6-9883-49d6-9cdd-b8851f4d2f7b tempest-SnapshotsActionsTest-349922654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9ff653aa-e37e-49aa-957b-2e0eb854595b.23781c8c-ac98-4363-b322-f768efefabaf" returned: 0 in 0.397s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:25:30 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-115c8ff6-9883-49d6-9cdd-b8851f4d2f7b tempest-SnapshotsActionsTest-349922654 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9ff653aa-e37e-49aa-957b-2e0eb854595b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88695) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 06:25:30 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6ac2eb4-ddbe-42ea-9a60-41d7cf51a4ca]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:25:30 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-115c8ff6-9883-49d6-9cdd-b8851f4d2f7b tempest-SnapshotsActionsTest-349922654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9ff653aa-e37e-49aa-957b-2e0eb854595b.4daa71f1-9505-471d-afc1-c7977e9a6d1b {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:25:30 devstack sudo[104866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9ff653aa-e37e-49aa-957b-2e0eb854595b.4daa71f1-9505-471d-afc1-c7977e9a6d1b Aug 05 06:25:30 devstack sudo[104866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:25:31 devstack sudo[104866]: pam_unix(sudo:session): session closed for user root Aug 05 06:25:31 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-115c8ff6-9883-49d6-9cdd-b8851f4d2f7b tempest-SnapshotsActionsTest-349922654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9ff653aa-e37e-49aa-957b-2e0eb854595b.4daa71f1-9505-471d-afc1-c7977e9a6d1b" returned: 0 in 0.376s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:25:31 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-115c8ff6-9883-49d6-9cdd-b8851f4d2f7b tempest-SnapshotsActionsTest-349922654 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9ff653aa-e37e-49aa-957b-2e0eb854595b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88695) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 06:25:31 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-115c8ff6-9883-49d6-9cdd-b8851f4d2f7b tempest-SnapshotsActionsTest-349922654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9ff653aa-e37e-49aa-957b-2e0eb854595b.23781c8c-ac98-4363-b322-f768efefabaf {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:25:31 devstack sudo[104871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9ff653aa-e37e-49aa-957b-2e0eb854595b.23781c8c-ac98-4363-b322-f768efefabaf Aug 05 06:25:31 devstack sudo[104871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:25:31 devstack sudo[104871]: pam_unix(sudo:session): session closed for user root Aug 05 06:25:31 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-115c8ff6-9883-49d6-9cdd-b8851f4d2f7b tempest-SnapshotsActionsTest-349922654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9ff653aa-e37e-49aa-957b-2e0eb854595b.23781c8c-ac98-4363-b322-f768efefabaf" returned: 0 in 0.349s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:25:31 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-115c8ff6-9883-49d6-9cdd-b8851f4d2f7b tempest-SnapshotsActionsTest-349922654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9ff653aa-e37e-49aa-957b-2e0eb854595b.23781c8c-ac98-4363-b322-f768efefabaf {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:25:31 devstack sudo[104876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9ff653aa-e37e-49aa-957b-2e0eb854595b.23781c8c-ac98-4363-b322-f768efefabaf Aug 05 06:25:31 devstack sudo[104876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:25:31 devstack sudo[104876]: pam_unix(sudo:session): session closed for user root Aug 05 06:25:31 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-115c8ff6-9883-49d6-9cdd-b8851f4d2f7b tempest-SnapshotsActionsTest-349922654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9ff653aa-e37e-49aa-957b-2e0eb854595b.23781c8c-ac98-4363-b322-f768efefabaf" returned: 0 in 0.256s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:25:31 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-115c8ff6-9883-49d6-9cdd-b8851f4d2f7b tempest-SnapshotsActionsTest-349922654 None] Lock "cinder-quobyte-23781c8c-ac98-4363-b322-f768efefabaf" released by "_delete_snapshot" :: held 1.473s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:25:31 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-115c8ff6-9883-49d6-9cdd-b8851f4d2f7b tempest-SnapshotsActionsTest-349922654 None] Lock "cinder-quobyte-9ff653aa-e37e-49aa-957b-2e0eb854595b" released by "delete_snapshot" :: held 1.495s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:25:31 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-115c8ff6-9883-49d6-9cdd-b8851f4d2f7b tempest-SnapshotsActionsTest-349922654 None] Created reservations ['2b475df5-25f1-4480-a115-f501bb4fa57c', '74e7ad2e-120a-4e59-9e79-4f70e517604e', 'f95ef31f-d2a9-4748-98a5-43fb59603680', 'ca965254-cccb-4f51-bf0a-6cedbb5443fc'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:25:31 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-115c8ff6-9883-49d6-9cdd-b8851f4d2f7b tempest-SnapshotsActionsTest-349922654 None] Delete snapshot completed successfully. Aug 05 06:25:31 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-115c8ff6-9883-49d6-9cdd-b8851f4d2f7b tempest-SnapshotsActionsTest-349922654 None] Lock "cinder-23781c8c-ac98-4363-b322-f768efefabaf-delete_snapshot" released by "delete_snapshot" :: held 1.637s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:25:32 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-c15304c4-52f9-4263-b59e-5dc6ce69c20b tempest-SnapshotsActionsTest-1399985861 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:25:32 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-c15304c4-52f9-4263-b59e-5dc6ce69c20b tempest-SnapshotsActionsTest-1399985861 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:25:32 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-c15304c4-52f9-4263-b59e-5dc6ce69c20b tempest-SnapshotsActionsTest-1399985861 None] Creating offline snapshot 5b9b877e-5b43-4eca-a3a5-05c22653aae1 of volume 9ff653aa-e37e-49aa-957b-2e0eb854595b {{(pid=88695) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 06:25:32 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbaa7783-ed18-4f91-b62c-ae0cd84b2557]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:25:32 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-c15304c4-52f9-4263-b59e-5dc6ce69c20b tempest-SnapshotsActionsTest-1399985861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9ff653aa-e37e-49aa-957b-2e0eb854595b.4daa71f1-9505-471d-afc1-c7977e9a6d1b {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:25:32 devstack sudo[104879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9ff653aa-e37e-49aa-957b-2e0eb854595b.4daa71f1-9505-471d-afc1-c7977e9a6d1b Aug 05 06:25:32 devstack sudo[104879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:25:33 devstack sudo[104879]: pam_unix(sudo:session): session closed for user root Aug 05 06:25:33 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-c15304c4-52f9-4263-b59e-5dc6ce69c20b tempest-SnapshotsActionsTest-1399985861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9ff653aa-e37e-49aa-957b-2e0eb854595b.4daa71f1-9505-471d-afc1-c7977e9a6d1b" returned: 0 in 0.368s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:25:33 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-c15304c4-52f9-4263-b59e-5dc6ce69c20b tempest-SnapshotsActionsTest-1399985861 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9ff653aa-e37e-49aa-957b-2e0eb854595b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88695) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 06:25:33 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-c15304c4-52f9-4263-b59e-5dc6ce69c20b tempest-SnapshotsActionsTest-1399985861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9ff653aa-e37e-49aa-957b-2e0eb854595b.4daa71f1-9505-471d-afc1-c7977e9a6d1b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9ff653aa-e37e-49aa-957b-2e0eb854595b.5b9b877e-5b43-4eca-a3a5-05c22653aae1 1G {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:25:33 devstack sudo[104884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9ff653aa-e37e-49aa-957b-2e0eb854595b.4daa71f1-9505-471d-afc1-c7977e9a6d1b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9ff653aa-e37e-49aa-957b-2e0eb854595b.5b9b877e-5b43-4eca-a3a5-05c22653aae1 1G Aug 05 06:25:33 devstack sudo[104884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:25:33 devstack sudo[104884]: pam_unix(sudo:session): session closed for user root Aug 05 06:25:33 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-c15304c4-52f9-4263-b59e-5dc6ce69c20b tempest-SnapshotsActionsTest-1399985861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9ff653aa-e37e-49aa-957b-2e0eb854595b.4daa71f1-9505-471d-afc1-c7977e9a6d1b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9ff653aa-e37e-49aa-957b-2e0eb854595b.5b9b877e-5b43-4eca-a3a5-05c22653aae1 1G" returned: 0 in 0.420s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:25:33 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-c15304c4-52f9-4263-b59e-5dc6ce69c20b tempest-SnapshotsActionsTest-1399985861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ff653aa-e37e-49aa-957b-2e0eb854595b.4daa71f1-9505-471d-afc1-c7977e9a6d1b -F qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9ff653aa-e37e-49aa-957b-2e0eb854595b.5b9b877e-5b43-4eca-a3a5-05c22653aae1 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:25:33 devstack sudo[104889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ff653aa-e37e-49aa-957b-2e0eb854595b.4daa71f1-9505-471d-afc1-c7977e9a6d1b -F qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9ff653aa-e37e-49aa-957b-2e0eb854595b.5b9b877e-5b43-4eca-a3a5-05c22653aae1 Aug 05 06:25:33 devstack sudo[104889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:25:33 devstack sudo[104889]: pam_unix(sudo:session): session closed for user root Aug 05 06:25:33 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-c15304c4-52f9-4263-b59e-5dc6ce69c20b tempest-SnapshotsActionsTest-1399985861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ff653aa-e37e-49aa-957b-2e0eb854595b.4daa71f1-9505-471d-afc1-c7977e9a6d1b -F qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9ff653aa-e37e-49aa-957b-2e0eb854595b.5b9b877e-5b43-4eca-a3a5-05c22653aae1" returned: 0 in 0.300s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:25:33 devstack cinder-volume[88695]: WARNING cinder.volume.drivers.remotefs [None req-c15304c4-52f9-4263-b59e-5dc6ce69c20b tempest-SnapshotsActionsTest-1399985861 None] /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9ff653aa-e37e-49aa-957b-2e0eb854595b.5b9b877e-5b43-4eca-a3a5-05c22653aae1 is being set with open permissions: ugo+rw Aug 05 06:25:33 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-c15304c4-52f9-4263-b59e-5dc6ce69c20b tempest-SnapshotsActionsTest-1399985861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9ff653aa-e37e-49aa-957b-2e0eb854595b.5b9b877e-5b43-4eca-a3a5-05c22653aae1 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:25:33 devstack sudo[104894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9ff653aa-e37e-49aa-957b-2e0eb854595b.5b9b877e-5b43-4eca-a3a5-05c22653aae1 Aug 05 06:25:33 devstack sudo[104894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:25:34 devstack sudo[104894]: pam_unix(sudo:session): session closed for user root Aug 05 06:25:34 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-c15304c4-52f9-4263-b59e-5dc6ce69c20b tempest-SnapshotsActionsTest-1399985861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9ff653aa-e37e-49aa-957b-2e0eb854595b.5b9b877e-5b43-4eca-a3a5-05c22653aae1" returned: 0 in 0.261s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:25:34 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-c15304c4-52f9-4263-b59e-5dc6ce69c20b tempest-SnapshotsActionsTest-1399985861 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.457s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:25:34 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-c15304c4-52f9-4263-b59e-5dc6ce69c20b tempest-SnapshotsActionsTest-1399985861 None] Create snapshot completed successfully Aug 05 06:25:34 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-e17d5296-2bdd-4ed6-98ff-5b6b927f1b6f tempest-SnapshotsActionsTest-349922654 None] Acquiring lock "cinder-5b9b877e-5b43-4eca-a3a5-05c22653aae1-delete_snapshot" by "delete_snapshot" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:25:34 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-e17d5296-2bdd-4ed6-98ff-5b6b927f1b6f tempest-SnapshotsActionsTest-349922654 None] Lock "cinder-5b9b877e-5b43-4eca-a3a5-05c22653aae1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:25:34 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-e17d5296-2bdd-4ed6-98ff-5b6b927f1b6f tempest-SnapshotsActionsTest-349922654 None] Acquiring lock "cinder-quobyte-9ff653aa-e37e-49aa-957b-2e0eb854595b" by "delete_snapshot" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:25:34 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-e17d5296-2bdd-4ed6-98ff-5b6b927f1b6f tempest-SnapshotsActionsTest-349922654 None] Lock "cinder-quobyte-9ff653aa-e37e-49aa-957b-2e0eb854595b" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:25:34 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-e17d5296-2bdd-4ed6-98ff-5b6b927f1b6f tempest-SnapshotsActionsTest-349922654 None] Acquiring lock "cinder-quobyte-5b9b877e-5b43-4eca-a3a5-05c22653aae1" by "_delete_snapshot" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:25:34 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-e17d5296-2bdd-4ed6-98ff-5b6b927f1b6f tempest-SnapshotsActionsTest-349922654 None] Lock "cinder-quobyte-5b9b877e-5b43-4eca-a3a5-05c22653aae1" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:25:34 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-e17d5296-2bdd-4ed6-98ff-5b6b927f1b6f tempest-SnapshotsActionsTest-349922654 None] Deleting offline snapshot 5b9b877e-5b43-4eca-a3a5-05c22653aae1 of volume 9ff653aa-e37e-49aa-957b-2e0eb854595b {{(pid=88695) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 06:25:34 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-e17d5296-2bdd-4ed6-98ff-5b6b927f1b6f tempest-SnapshotsActionsTest-349922654 None] snapshot_file for this snap is: volume-9ff653aa-e37e-49aa-957b-2e0eb854595b.5b9b877e-5b43-4eca-a3a5-05c22653aae1 {{(pid=88695) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 06:25:34 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0dd4bc0-c43d-4a5b-ba11-0c8354111f21]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:25:34 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-e17d5296-2bdd-4ed6-98ff-5b6b927f1b6f tempest-SnapshotsActionsTest-349922654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9ff653aa-e37e-49aa-957b-2e0eb854595b.5b9b877e-5b43-4eca-a3a5-05c22653aae1 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:25:35 devstack sudo[104897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9ff653aa-e37e-49aa-957b-2e0eb854595b.5b9b877e-5b43-4eca-a3a5-05c22653aae1 Aug 05 06:25:35 devstack sudo[104897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:25:35 devstack sudo[104897]: pam_unix(sudo:session): session closed for user root Aug 05 06:25:35 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-e17d5296-2bdd-4ed6-98ff-5b6b927f1b6f tempest-SnapshotsActionsTest-349922654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9ff653aa-e37e-49aa-957b-2e0eb854595b.5b9b877e-5b43-4eca-a3a5-05c22653aae1" returned: 0 in 0.361s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:25:35 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-e17d5296-2bdd-4ed6-98ff-5b6b927f1b6f tempest-SnapshotsActionsTest-349922654 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9ff653aa-e37e-49aa-957b-2e0eb854595b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88695) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 06:25:35 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecfc5fc7-5144-472f-8400-04bae801ea12]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:25:35 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-e17d5296-2bdd-4ed6-98ff-5b6b927f1b6f tempest-SnapshotsActionsTest-349922654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9ff653aa-e37e-49aa-957b-2e0eb854595b.4daa71f1-9505-471d-afc1-c7977e9a6d1b {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:25:35 devstack sudo[104902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9ff653aa-e37e-49aa-957b-2e0eb854595b.4daa71f1-9505-471d-afc1-c7977e9a6d1b Aug 05 06:25:35 devstack sudo[104902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:25:35 devstack sudo[104902]: pam_unix(sudo:session): session closed for user root Aug 05 06:25:35 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-e17d5296-2bdd-4ed6-98ff-5b6b927f1b6f tempest-SnapshotsActionsTest-349922654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9ff653aa-e37e-49aa-957b-2e0eb854595b.4daa71f1-9505-471d-afc1-c7977e9a6d1b" returned: 0 in 0.367s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:25:35 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-e17d5296-2bdd-4ed6-98ff-5b6b927f1b6f tempest-SnapshotsActionsTest-349922654 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9ff653aa-e37e-49aa-957b-2e0eb854595b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88695) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 06:25:35 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-e17d5296-2bdd-4ed6-98ff-5b6b927f1b6f tempest-SnapshotsActionsTest-349922654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9ff653aa-e37e-49aa-957b-2e0eb854595b.5b9b877e-5b43-4eca-a3a5-05c22653aae1 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:25:35 devstack sudo[104907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9ff653aa-e37e-49aa-957b-2e0eb854595b.5b9b877e-5b43-4eca-a3a5-05c22653aae1 Aug 05 06:25:35 devstack sudo[104907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:25:36 devstack sudo[104907]: pam_unix(sudo:session): session closed for user root Aug 05 06:25:36 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-e17d5296-2bdd-4ed6-98ff-5b6b927f1b6f tempest-SnapshotsActionsTest-349922654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9ff653aa-e37e-49aa-957b-2e0eb854595b.5b9b877e-5b43-4eca-a3a5-05c22653aae1" returned: 0 in 0.357s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:25:36 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-e17d5296-2bdd-4ed6-98ff-5b6b927f1b6f tempest-SnapshotsActionsTest-349922654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9ff653aa-e37e-49aa-957b-2e0eb854595b.5b9b877e-5b43-4eca-a3a5-05c22653aae1 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:25:36 devstack sudo[104912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9ff653aa-e37e-49aa-957b-2e0eb854595b.5b9b877e-5b43-4eca-a3a5-05c22653aae1 Aug 05 06:25:36 devstack sudo[104912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:25:36 devstack sudo[104912]: pam_unix(sudo:session): session closed for user root Aug 05 06:25:36 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-e17d5296-2bdd-4ed6-98ff-5b6b927f1b6f tempest-SnapshotsActionsTest-349922654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9ff653aa-e37e-49aa-957b-2e0eb854595b.5b9b877e-5b43-4eca-a3a5-05c22653aae1" returned: 0 in 0.255s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:25:36 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-e17d5296-2bdd-4ed6-98ff-5b6b927f1b6f tempest-SnapshotsActionsTest-349922654 None] Lock "cinder-quobyte-5b9b877e-5b43-4eca-a3a5-05c22653aae1" released by "_delete_snapshot" :: held 1.429s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:25:36 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-e17d5296-2bdd-4ed6-98ff-5b6b927f1b6f tempest-SnapshotsActionsTest-349922654 None] Lock "cinder-quobyte-9ff653aa-e37e-49aa-957b-2e0eb854595b" released by "delete_snapshot" :: held 1.453s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:25:36 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-e17d5296-2bdd-4ed6-98ff-5b6b927f1b6f tempest-SnapshotsActionsTest-349922654 None] Created reservations ['59f7ee85-853e-4273-a129-36105a232a76', '09ac9bff-295d-4818-b26a-e5ab2dcafd7b', '90d29461-587b-40ba-ac10-21a4c8508b03', '92c43af7-3c8f-4538-a606-fc02f53427b7'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:25:36 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-e17d5296-2bdd-4ed6-98ff-5b6b927f1b6f tempest-SnapshotsActionsTest-349922654 None] Delete snapshot completed successfully. Aug 05 06:25:36 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-e17d5296-2bdd-4ed6-98ff-5b6b927f1b6f tempest-SnapshotsActionsTest-349922654 None] Lock "cinder-5b9b877e-5b43-4eca-a3a5-05c22653aae1-delete_snapshot" released by "delete_snapshot" :: held 1.607s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:25:37 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-5083fc81-2cd9-4fb4-bd00-3eec656fa3d5 tempest-SnapshotsActionsTest-1399985861 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:25:37 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-5083fc81-2cd9-4fb4-bd00-3eec656fa3d5 tempest-SnapshotsActionsTest-1399985861 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:25:37 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-5083fc81-2cd9-4fb4-bd00-3eec656fa3d5 tempest-SnapshotsActionsTest-1399985861 None] Creating offline snapshot beacdeb1-8465-46fc-927c-d9b766c52508 of volume 9ff653aa-e37e-49aa-957b-2e0eb854595b {{(pid=88695) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 06:25:37 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[e760bea5-0c4c-4783-9293-ed150633a7fa]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:25:37 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-5083fc81-2cd9-4fb4-bd00-3eec656fa3d5 tempest-SnapshotsActionsTest-1399985861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9ff653aa-e37e-49aa-957b-2e0eb854595b.4daa71f1-9505-471d-afc1-c7977e9a6d1b {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:25:37 devstack sudo[104915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9ff653aa-e37e-49aa-957b-2e0eb854595b.4daa71f1-9505-471d-afc1-c7977e9a6d1b Aug 05 06:25:37 devstack sudo[104915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:25:37 devstack sudo[104915]: pam_unix(sudo:session): session closed for user root Aug 05 06:25:37 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-5083fc81-2cd9-4fb4-bd00-3eec656fa3d5 tempest-SnapshotsActionsTest-1399985861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9ff653aa-e37e-49aa-957b-2e0eb854595b.4daa71f1-9505-471d-afc1-c7977e9a6d1b" returned: 0 in 0.373s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:25:37 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-5083fc81-2cd9-4fb4-bd00-3eec656fa3d5 tempest-SnapshotsActionsTest-1399985861 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9ff653aa-e37e-49aa-957b-2e0eb854595b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88695) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 06:25:37 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-5083fc81-2cd9-4fb4-bd00-3eec656fa3d5 tempest-SnapshotsActionsTest-1399985861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9ff653aa-e37e-49aa-957b-2e0eb854595b.4daa71f1-9505-471d-afc1-c7977e9a6d1b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9ff653aa-e37e-49aa-957b-2e0eb854595b.beacdeb1-8465-46fc-927c-d9b766c52508 1G {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:25:37 devstack sudo[104921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9ff653aa-e37e-49aa-957b-2e0eb854595b.4daa71f1-9505-471d-afc1-c7977e9a6d1b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9ff653aa-e37e-49aa-957b-2e0eb854595b.beacdeb1-8465-46fc-927c-d9b766c52508 1G Aug 05 06:25:37 devstack sudo[104921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:25:38 devstack sudo[104921]: pam_unix(sudo:session): session closed for user root Aug 05 06:25:38 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-5083fc81-2cd9-4fb4-bd00-3eec656fa3d5 tempest-SnapshotsActionsTest-1399985861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9ff653aa-e37e-49aa-957b-2e0eb854595b.4daa71f1-9505-471d-afc1-c7977e9a6d1b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9ff653aa-e37e-49aa-957b-2e0eb854595b.beacdeb1-8465-46fc-927c-d9b766c52508 1G" returned: 0 in 0.428s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:25:38 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-5083fc81-2cd9-4fb4-bd00-3eec656fa3d5 tempest-SnapshotsActionsTest-1399985861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ff653aa-e37e-49aa-957b-2e0eb854595b.4daa71f1-9505-471d-afc1-c7977e9a6d1b -F qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9ff653aa-e37e-49aa-957b-2e0eb854595b.beacdeb1-8465-46fc-927c-d9b766c52508 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:25:38 devstack sudo[104927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ff653aa-e37e-49aa-957b-2e0eb854595b.4daa71f1-9505-471d-afc1-c7977e9a6d1b -F qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9ff653aa-e37e-49aa-957b-2e0eb854595b.beacdeb1-8465-46fc-927c-d9b766c52508 Aug 05 06:25:38 devstack sudo[104927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:25:38 devstack sudo[104927]: pam_unix(sudo:session): session closed for user root Aug 05 06:25:38 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-5083fc81-2cd9-4fb4-bd00-3eec656fa3d5 tempest-SnapshotsActionsTest-1399985861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ff653aa-e37e-49aa-957b-2e0eb854595b.4daa71f1-9505-471d-afc1-c7977e9a6d1b -F qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9ff653aa-e37e-49aa-957b-2e0eb854595b.beacdeb1-8465-46fc-927c-d9b766c52508" returned: 0 in 0.320s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:25:38 devstack cinder-volume[88695]: WARNING cinder.volume.drivers.remotefs [None req-5083fc81-2cd9-4fb4-bd00-3eec656fa3d5 tempest-SnapshotsActionsTest-1399985861 None] /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9ff653aa-e37e-49aa-957b-2e0eb854595b.beacdeb1-8465-46fc-927c-d9b766c52508 is being set with open permissions: ugo+rw Aug 05 06:25:38 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-5083fc81-2cd9-4fb4-bd00-3eec656fa3d5 tempest-SnapshotsActionsTest-1399985861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9ff653aa-e37e-49aa-957b-2e0eb854595b.beacdeb1-8465-46fc-927c-d9b766c52508 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:25:38 devstack sudo[104966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9ff653aa-e37e-49aa-957b-2e0eb854595b.beacdeb1-8465-46fc-927c-d9b766c52508 Aug 05 06:25:38 devstack sudo[104966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:25:38 devstack sudo[104966]: pam_unix(sudo:session): session closed for user root Aug 05 06:25:38 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-5083fc81-2cd9-4fb4-bd00-3eec656fa3d5 tempest-SnapshotsActionsTest-1399985861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9ff653aa-e37e-49aa-957b-2e0eb854595b.beacdeb1-8465-46fc-927c-d9b766c52508" returned: 0 in 0.272s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:25:38 devstack cinder-volume[88695]: DEBUG dbcounter [-] [88695] Writing DB stats cinder:SELECT=85,cinder:INSERT=22,cinder:UPDATE=86,cinder:DELETE=4 {{(pid=88695) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 06:25:38 devstack cinder-volume[88695]: DEBUG dbcounter [-] [88695] Writing DB stats cinder:SELECT=96,cinder:INSERT=25,cinder:UPDATE=74,cinder:DELETE=4 {{(pid=88695) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 06:25:38 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-5083fc81-2cd9-4fb4-bd00-3eec656fa3d5 tempest-SnapshotsActionsTest-1399985861 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.486s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:25:38 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-5083fc81-2cd9-4fb4-bd00-3eec656fa3d5 tempest-SnapshotsActionsTest-1399985861 None] Create snapshot completed successfully Aug 05 06:25:39 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-5dd96013-2ff8-46f6-8058-905065623ed2 tempest-SnapshotsActionsTest-349922654 None] Acquiring lock "cinder-beacdeb1-8465-46fc-927c-d9b766c52508-delete_snapshot" by "delete_snapshot" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:25:39 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-5dd96013-2ff8-46f6-8058-905065623ed2 tempest-SnapshotsActionsTest-349922654 None] Lock "cinder-beacdeb1-8465-46fc-927c-d9b766c52508-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:25:39 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-5dd96013-2ff8-46f6-8058-905065623ed2 tempest-SnapshotsActionsTest-349922654 None] Acquiring lock "cinder-quobyte-9ff653aa-e37e-49aa-957b-2e0eb854595b" by "delete_snapshot" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:25:39 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-5dd96013-2ff8-46f6-8058-905065623ed2 tempest-SnapshotsActionsTest-349922654 None] Lock "cinder-quobyte-9ff653aa-e37e-49aa-957b-2e0eb854595b" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:25:39 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-5dd96013-2ff8-46f6-8058-905065623ed2 tempest-SnapshotsActionsTest-349922654 None] Acquiring lock "cinder-quobyte-beacdeb1-8465-46fc-927c-d9b766c52508" by "_delete_snapshot" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:25:39 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-5dd96013-2ff8-46f6-8058-905065623ed2 tempest-SnapshotsActionsTest-349922654 None] Lock "cinder-quobyte-beacdeb1-8465-46fc-927c-d9b766c52508" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:25:39 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-5dd96013-2ff8-46f6-8058-905065623ed2 tempest-SnapshotsActionsTest-349922654 None] Deleting offline snapshot beacdeb1-8465-46fc-927c-d9b766c52508 of volume 9ff653aa-e37e-49aa-957b-2e0eb854595b {{(pid=88695) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 06:25:39 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-5dd96013-2ff8-46f6-8058-905065623ed2 tempest-SnapshotsActionsTest-349922654 None] snapshot_file for this snap is: volume-9ff653aa-e37e-49aa-957b-2e0eb854595b.beacdeb1-8465-46fc-927c-d9b766c52508 {{(pid=88695) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 06:25:39 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[99683e0b-97ff-4a62-9f1a-a9c85934c099]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:25:39 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-5dd96013-2ff8-46f6-8058-905065623ed2 tempest-SnapshotsActionsTest-349922654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9ff653aa-e37e-49aa-957b-2e0eb854595b.beacdeb1-8465-46fc-927c-d9b766c52508 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:25:39 devstack sudo[104971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9ff653aa-e37e-49aa-957b-2e0eb854595b.beacdeb1-8465-46fc-927c-d9b766c52508 Aug 05 06:25:39 devstack sudo[104971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:25:40 devstack sudo[104971]: pam_unix(sudo:session): session closed for user root Aug 05 06:25:40 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-5dd96013-2ff8-46f6-8058-905065623ed2 tempest-SnapshotsActionsTest-349922654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9ff653aa-e37e-49aa-957b-2e0eb854595b.beacdeb1-8465-46fc-927c-d9b766c52508" returned: 0 in 0.384s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:25:40 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-5dd96013-2ff8-46f6-8058-905065623ed2 tempest-SnapshotsActionsTest-349922654 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9ff653aa-e37e-49aa-957b-2e0eb854595b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88695) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 06:25:40 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[553a68a6-9b80-44f4-8116-90f83b2c0c97]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:25:40 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-5dd96013-2ff8-46f6-8058-905065623ed2 tempest-SnapshotsActionsTest-349922654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9ff653aa-e37e-49aa-957b-2e0eb854595b.4daa71f1-9505-471d-afc1-c7977e9a6d1b {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:25:40 devstack sudo[104989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9ff653aa-e37e-49aa-957b-2e0eb854595b.4daa71f1-9505-471d-afc1-c7977e9a6d1b Aug 05 06:25:40 devstack sudo[104989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:25:40 devstack sudo[104989]: pam_unix(sudo:session): session closed for user root Aug 05 06:25:40 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-5dd96013-2ff8-46f6-8058-905065623ed2 tempest-SnapshotsActionsTest-349922654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9ff653aa-e37e-49aa-957b-2e0eb854595b.4daa71f1-9505-471d-afc1-c7977e9a6d1b" returned: 0 in 0.388s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:25:40 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-5dd96013-2ff8-46f6-8058-905065623ed2 tempest-SnapshotsActionsTest-349922654 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9ff653aa-e37e-49aa-957b-2e0eb854595b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88695) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 06:25:40 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-5dd96013-2ff8-46f6-8058-905065623ed2 tempest-SnapshotsActionsTest-349922654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9ff653aa-e37e-49aa-957b-2e0eb854595b.beacdeb1-8465-46fc-927c-d9b766c52508 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:25:40 devstack sudo[104994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9ff653aa-e37e-49aa-957b-2e0eb854595b.beacdeb1-8465-46fc-927c-d9b766c52508 Aug 05 06:25:40 devstack sudo[104994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:25:40 devstack sudo[104994]: pam_unix(sudo:session): session closed for user root Aug 05 06:25:40 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-5dd96013-2ff8-46f6-8058-905065623ed2 tempest-SnapshotsActionsTest-349922654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9ff653aa-e37e-49aa-957b-2e0eb854595b.beacdeb1-8465-46fc-927c-d9b766c52508" returned: 0 in 0.390s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:25:40 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-5dd96013-2ff8-46f6-8058-905065623ed2 tempest-SnapshotsActionsTest-349922654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9ff653aa-e37e-49aa-957b-2e0eb854595b.beacdeb1-8465-46fc-927c-d9b766c52508 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:25:40 devstack sudo[105001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9ff653aa-e37e-49aa-957b-2e0eb854595b.beacdeb1-8465-46fc-927c-d9b766c52508 Aug 05 06:25:40 devstack sudo[105001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:25:41 devstack sudo[105001]: pam_unix(sudo:session): session closed for user root Aug 05 06:25:41 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-5dd96013-2ff8-46f6-8058-905065623ed2 tempest-SnapshotsActionsTest-349922654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9ff653aa-e37e-49aa-957b-2e0eb854595b.beacdeb1-8465-46fc-927c-d9b766c52508" returned: 0 in 0.252s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:25:41 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-5dd96013-2ff8-46f6-8058-905065623ed2 tempest-SnapshotsActionsTest-349922654 None] Lock "cinder-quobyte-beacdeb1-8465-46fc-927c-d9b766c52508" released by "_delete_snapshot" :: held 1.500s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:25:41 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-5dd96013-2ff8-46f6-8058-905065623ed2 tempest-SnapshotsActionsTest-349922654 None] Lock "cinder-quobyte-9ff653aa-e37e-49aa-957b-2e0eb854595b" released by "delete_snapshot" :: held 1.527s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:25:41 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-5dd96013-2ff8-46f6-8058-905065623ed2 tempest-SnapshotsActionsTest-349922654 None] Created reservations ['debf4ef0-6574-4acb-81ff-a9dbf74a2b50', '3c243294-f9a8-4b2c-ac89-1d6a745abc27', '6ec016a4-022b-49a7-a964-7349d5434f61', 'b4ea8d0b-933a-4cbc-a981-eeadf952e3b0'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:25:41 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-5dd96013-2ff8-46f6-8058-905065623ed2 tempest-SnapshotsActionsTest-349922654 None] Delete snapshot completed successfully. Aug 05 06:25:41 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-5dd96013-2ff8-46f6-8058-905065623ed2 tempest-SnapshotsActionsTest-349922654 None] Lock "cinder-beacdeb1-8465-46fc-927c-d9b766c52508-delete_snapshot" released by "delete_snapshot" :: held 1.962s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:25:42 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-2ca0d305-2cb4-4334-a41d-e57ab70e5c91 tempest-SnapshotsActionsTest-1399985861 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:25:42 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-2ca0d305-2cb4-4334-a41d-e57ab70e5c91 tempest-SnapshotsActionsTest-1399985861 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:25:42 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-2ca0d305-2cb4-4334-a41d-e57ab70e5c91 tempest-SnapshotsActionsTest-1399985861 None] Creating offline snapshot 972b2d24-45c3-4c1f-9bbe-02526260f5cb of volume 9ff653aa-e37e-49aa-957b-2e0eb854595b {{(pid=88695) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 06:25:42 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[042a424a-fd5c-4acd-b496-0cdc1afcb9f1]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:25:42 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-2ca0d305-2cb4-4334-a41d-e57ab70e5c91 tempest-SnapshotsActionsTest-1399985861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9ff653aa-e37e-49aa-957b-2e0eb854595b.4daa71f1-9505-471d-afc1-c7977e9a6d1b {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:25:42 devstack sudo[105004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9ff653aa-e37e-49aa-957b-2e0eb854595b.4daa71f1-9505-471d-afc1-c7977e9a6d1b Aug 05 06:25:42 devstack sudo[105004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:25:42 devstack sudo[105004]: pam_unix(sudo:session): session closed for user root Aug 05 06:25:42 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-2ca0d305-2cb4-4334-a41d-e57ab70e5c91 tempest-SnapshotsActionsTest-1399985861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9ff653aa-e37e-49aa-957b-2e0eb854595b.4daa71f1-9505-471d-afc1-c7977e9a6d1b" returned: 0 in 0.360s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:25:42 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-2ca0d305-2cb4-4334-a41d-e57ab70e5c91 tempest-SnapshotsActionsTest-1399985861 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9ff653aa-e37e-49aa-957b-2e0eb854595b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88695) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 06:25:42 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-2ca0d305-2cb4-4334-a41d-e57ab70e5c91 tempest-SnapshotsActionsTest-1399985861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9ff653aa-e37e-49aa-957b-2e0eb854595b.4daa71f1-9505-471d-afc1-c7977e9a6d1b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9ff653aa-e37e-49aa-957b-2e0eb854595b.972b2d24-45c3-4c1f-9bbe-02526260f5cb 1G {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:25:42 devstack sudo[105009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9ff653aa-e37e-49aa-957b-2e0eb854595b.4daa71f1-9505-471d-afc1-c7977e9a6d1b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9ff653aa-e37e-49aa-957b-2e0eb854595b.972b2d24-45c3-4c1f-9bbe-02526260f5cb 1G Aug 05 06:25:42 devstack sudo[105009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:25:43 devstack sudo[105009]: pam_unix(sudo:session): session closed for user root Aug 05 06:25:43 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-2ca0d305-2cb4-4334-a41d-e57ab70e5c91 tempest-SnapshotsActionsTest-1399985861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9ff653aa-e37e-49aa-957b-2e0eb854595b.4daa71f1-9505-471d-afc1-c7977e9a6d1b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9ff653aa-e37e-49aa-957b-2e0eb854595b.972b2d24-45c3-4c1f-9bbe-02526260f5cb 1G" returned: 0 in 0.456s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:25:43 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-2ca0d305-2cb4-4334-a41d-e57ab70e5c91 tempest-SnapshotsActionsTest-1399985861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ff653aa-e37e-49aa-957b-2e0eb854595b.4daa71f1-9505-471d-afc1-c7977e9a6d1b -F qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9ff653aa-e37e-49aa-957b-2e0eb854595b.972b2d24-45c3-4c1f-9bbe-02526260f5cb {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:25:43 devstack sudo[105014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ff653aa-e37e-49aa-957b-2e0eb854595b.4daa71f1-9505-471d-afc1-c7977e9a6d1b -F qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9ff653aa-e37e-49aa-957b-2e0eb854595b.972b2d24-45c3-4c1f-9bbe-02526260f5cb Aug 05 06:25:43 devstack sudo[105014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:25:43 devstack sudo[105014]: pam_unix(sudo:session): session closed for user root Aug 05 06:25:43 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-2ca0d305-2cb4-4334-a41d-e57ab70e5c91 tempest-SnapshotsActionsTest-1399985861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ff653aa-e37e-49aa-957b-2e0eb854595b.4daa71f1-9505-471d-afc1-c7977e9a6d1b -F qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9ff653aa-e37e-49aa-957b-2e0eb854595b.972b2d24-45c3-4c1f-9bbe-02526260f5cb" returned: 0 in 0.285s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:25:43 devstack cinder-volume[88695]: WARNING cinder.volume.drivers.remotefs [None req-2ca0d305-2cb4-4334-a41d-e57ab70e5c91 tempest-SnapshotsActionsTest-1399985861 None] /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9ff653aa-e37e-49aa-957b-2e0eb854595b.972b2d24-45c3-4c1f-9bbe-02526260f5cb is being set with open permissions: ugo+rw Aug 05 06:25:43 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-2ca0d305-2cb4-4334-a41d-e57ab70e5c91 tempest-SnapshotsActionsTest-1399985861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9ff653aa-e37e-49aa-957b-2e0eb854595b.972b2d24-45c3-4c1f-9bbe-02526260f5cb {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:25:43 devstack sudo[105019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9ff653aa-e37e-49aa-957b-2e0eb854595b.972b2d24-45c3-4c1f-9bbe-02526260f5cb Aug 05 06:25:43 devstack sudo[105019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:25:43 devstack sudo[105019]: pam_unix(sudo:session): session closed for user root Aug 05 06:25:43 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-2ca0d305-2cb4-4334-a41d-e57ab70e5c91 tempest-SnapshotsActionsTest-1399985861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9ff653aa-e37e-49aa-957b-2e0eb854595b.972b2d24-45c3-4c1f-9bbe-02526260f5cb" returned: 0 in 0.256s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:25:43 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-2ca0d305-2cb4-4334-a41d-e57ab70e5c91 tempest-SnapshotsActionsTest-1399985861 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.448s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:25:43 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-2ca0d305-2cb4-4334-a41d-e57ab70e5c91 tempest-SnapshotsActionsTest-1399985861 None] Create snapshot completed successfully Aug 05 06:25:44 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-8fb3a753-45a9-42cd-9ba4-cafacefe61a3 tempest-SnapshotsActionsTest-349922654 None] Acquiring lock "cinder-972b2d24-45c3-4c1f-9bbe-02526260f5cb-delete_snapshot" by "delete_snapshot" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:25:44 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-8fb3a753-45a9-42cd-9ba4-cafacefe61a3 tempest-SnapshotsActionsTest-349922654 None] Lock "cinder-972b2d24-45c3-4c1f-9bbe-02526260f5cb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:25:44 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-8fb3a753-45a9-42cd-9ba4-cafacefe61a3 tempest-SnapshotsActionsTest-349922654 None] Acquiring lock "cinder-quobyte-9ff653aa-e37e-49aa-957b-2e0eb854595b" by "delete_snapshot" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:25:44 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-8fb3a753-45a9-42cd-9ba4-cafacefe61a3 tempest-SnapshotsActionsTest-349922654 None] Lock "cinder-quobyte-9ff653aa-e37e-49aa-957b-2e0eb854595b" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:25:44 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-8fb3a753-45a9-42cd-9ba4-cafacefe61a3 tempest-SnapshotsActionsTest-349922654 None] Acquiring lock "cinder-quobyte-972b2d24-45c3-4c1f-9bbe-02526260f5cb" by "_delete_snapshot" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:25:44 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-8fb3a753-45a9-42cd-9ba4-cafacefe61a3 tempest-SnapshotsActionsTest-349922654 None] Lock "cinder-quobyte-972b2d24-45c3-4c1f-9bbe-02526260f5cb" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:25:44 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-8fb3a753-45a9-42cd-9ba4-cafacefe61a3 tempest-SnapshotsActionsTest-349922654 None] Deleting offline snapshot 972b2d24-45c3-4c1f-9bbe-02526260f5cb of volume 9ff653aa-e37e-49aa-957b-2e0eb854595b {{(pid=88695) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 06:25:44 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-8fb3a753-45a9-42cd-9ba4-cafacefe61a3 tempest-SnapshotsActionsTest-349922654 None] snapshot_file for this snap is: volume-9ff653aa-e37e-49aa-957b-2e0eb854595b.972b2d24-45c3-4c1f-9bbe-02526260f5cb {{(pid=88695) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 06:25:44 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[805829ee-16e2-4d90-b50c-ab305a8a34b3]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:25:44 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-8fb3a753-45a9-42cd-9ba4-cafacefe61a3 tempest-SnapshotsActionsTest-349922654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9ff653aa-e37e-49aa-957b-2e0eb854595b.972b2d24-45c3-4c1f-9bbe-02526260f5cb {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:25:45 devstack sudo[105046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9ff653aa-e37e-49aa-957b-2e0eb854595b.972b2d24-45c3-4c1f-9bbe-02526260f5cb Aug 05 06:25:45 devstack sudo[105046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:25:45 devstack sudo[105046]: pam_unix(sudo:session): session closed for user root Aug 05 06:25:45 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-8fb3a753-45a9-42cd-9ba4-cafacefe61a3 tempest-SnapshotsActionsTest-349922654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9ff653aa-e37e-49aa-957b-2e0eb854595b.972b2d24-45c3-4c1f-9bbe-02526260f5cb" returned: 0 in 0.400s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:25:45 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-8fb3a753-45a9-42cd-9ba4-cafacefe61a3 tempest-SnapshotsActionsTest-349922654 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9ff653aa-e37e-49aa-957b-2e0eb854595b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88695) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 06:25:45 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[42006420-24eb-42c3-945e-53bb4d82dc9f]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:25:45 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-8fb3a753-45a9-42cd-9ba4-cafacefe61a3 tempest-SnapshotsActionsTest-349922654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9ff653aa-e37e-49aa-957b-2e0eb854595b.4daa71f1-9505-471d-afc1-c7977e9a6d1b {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:25:45 devstack sudo[105051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9ff653aa-e37e-49aa-957b-2e0eb854595b.4daa71f1-9505-471d-afc1-c7977e9a6d1b Aug 05 06:25:45 devstack sudo[105051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:25:45 devstack sudo[105051]: pam_unix(sudo:session): session closed for user root Aug 05 06:25:45 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-8fb3a753-45a9-42cd-9ba4-cafacefe61a3 tempest-SnapshotsActionsTest-349922654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9ff653aa-e37e-49aa-957b-2e0eb854595b.4daa71f1-9505-471d-afc1-c7977e9a6d1b" returned: 0 in 0.392s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:25:45 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-8fb3a753-45a9-42cd-9ba4-cafacefe61a3 tempest-SnapshotsActionsTest-349922654 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9ff653aa-e37e-49aa-957b-2e0eb854595b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88695) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 06:25:45 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-8fb3a753-45a9-42cd-9ba4-cafacefe61a3 tempest-SnapshotsActionsTest-349922654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9ff653aa-e37e-49aa-957b-2e0eb854595b.972b2d24-45c3-4c1f-9bbe-02526260f5cb {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:25:45 devstack sudo[105056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9ff653aa-e37e-49aa-957b-2e0eb854595b.972b2d24-45c3-4c1f-9bbe-02526260f5cb Aug 05 06:25:45 devstack sudo[105056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:25:46 devstack sudo[105056]: pam_unix(sudo:session): session closed for user root Aug 05 06:25:46 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-8fb3a753-45a9-42cd-9ba4-cafacefe61a3 tempest-SnapshotsActionsTest-349922654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9ff653aa-e37e-49aa-957b-2e0eb854595b.972b2d24-45c3-4c1f-9bbe-02526260f5cb" returned: 0 in 0.397s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:25:46 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-8fb3a753-45a9-42cd-9ba4-cafacefe61a3 tempest-SnapshotsActionsTest-349922654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9ff653aa-e37e-49aa-957b-2e0eb854595b.972b2d24-45c3-4c1f-9bbe-02526260f5cb {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:25:46 devstack sudo[105062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9ff653aa-e37e-49aa-957b-2e0eb854595b.972b2d24-45c3-4c1f-9bbe-02526260f5cb Aug 05 06:25:46 devstack sudo[105062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:25:46 devstack sudo[105062]: pam_unix(sudo:session): session closed for user root Aug 05 06:25:46 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-8fb3a753-45a9-42cd-9ba4-cafacefe61a3 tempest-SnapshotsActionsTest-349922654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9ff653aa-e37e-49aa-957b-2e0eb854595b.972b2d24-45c3-4c1f-9bbe-02526260f5cb" returned: 0 in 0.259s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:25:46 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-8fb3a753-45a9-42cd-9ba4-cafacefe61a3 tempest-SnapshotsActionsTest-349922654 None] Lock "cinder-quobyte-972b2d24-45c3-4c1f-9bbe-02526260f5cb" released by "_delete_snapshot" :: held 1.542s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:25:46 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-8fb3a753-45a9-42cd-9ba4-cafacefe61a3 tempest-SnapshotsActionsTest-349922654 None] Lock "cinder-quobyte-9ff653aa-e37e-49aa-957b-2e0eb854595b" released by "delete_snapshot" :: held 1.567s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:25:46 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-8fb3a753-45a9-42cd-9ba4-cafacefe61a3 tempest-SnapshotsActionsTest-349922654 None] Created reservations ['b62b3f39-8418-46b6-8d30-338a5c815353', 'c0317413-b5ec-430e-8cbb-cb66091bed76', 'eb6f6147-ed9a-41c5-b5ab-347f91458434', '3295814b-ada5-42d1-b122-a9057a6076f6'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:25:46 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-8fb3a753-45a9-42cd-9ba4-cafacefe61a3 tempest-SnapshotsActionsTest-349922654 None] Delete snapshot completed successfully. Aug 05 06:25:46 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-8fb3a753-45a9-42cd-9ba4-cafacefe61a3 tempest-SnapshotsActionsTest-349922654 None] Lock "cinder-972b2d24-45c3-4c1f-9bbe-02526260f5cb-delete_snapshot" released by "delete_snapshot" :: held 2.096s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:25:47 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-a6c36f20-dbf5-42e6-8ed0-670f6d84eeca tempest-SnapshotsActionsTest-1399985861 None] Acquiring lock "cinder-4daa71f1-9505-471d-afc1-c7977e9a6d1b-delete_snapshot" by "delete_snapshot" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:25:47 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-a6c36f20-dbf5-42e6-8ed0-670f6d84eeca tempest-SnapshotsActionsTest-1399985861 None] Lock "cinder-4daa71f1-9505-471d-afc1-c7977e9a6d1b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:25:47 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-a6c36f20-dbf5-42e6-8ed0-670f6d84eeca tempest-SnapshotsActionsTest-1399985861 None] Acquiring lock "cinder-quobyte-9ff653aa-e37e-49aa-957b-2e0eb854595b" by "delete_snapshot" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:25:47 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-a6c36f20-dbf5-42e6-8ed0-670f6d84eeca tempest-SnapshotsActionsTest-1399985861 None] Lock "cinder-quobyte-9ff653aa-e37e-49aa-957b-2e0eb854595b" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:25:47 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-a6c36f20-dbf5-42e6-8ed0-670f6d84eeca tempest-SnapshotsActionsTest-1399985861 None] Acquiring lock "cinder-quobyte-4daa71f1-9505-471d-afc1-c7977e9a6d1b" by "_delete_snapshot" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:25:47 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-a6c36f20-dbf5-42e6-8ed0-670f6d84eeca tempest-SnapshotsActionsTest-1399985861 None] Lock "cinder-quobyte-4daa71f1-9505-471d-afc1-c7977e9a6d1b" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:25:47 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-a6c36f20-dbf5-42e6-8ed0-670f6d84eeca tempest-SnapshotsActionsTest-1399985861 None] Deleting offline snapshot 4daa71f1-9505-471d-afc1-c7977e9a6d1b of volume 9ff653aa-e37e-49aa-957b-2e0eb854595b {{(pid=88695) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 06:25:47 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-a6c36f20-dbf5-42e6-8ed0-670f6d84eeca tempest-SnapshotsActionsTest-1399985861 None] snapshot_file for this snap is: volume-9ff653aa-e37e-49aa-957b-2e0eb854595b.4daa71f1-9505-471d-afc1-c7977e9a6d1b {{(pid=88695) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 06:25:47 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc4e584d-fb14-4159-8507-e48dec35afaa]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:25:47 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-a6c36f20-dbf5-42e6-8ed0-670f6d84eeca tempest-SnapshotsActionsTest-1399985861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9ff653aa-e37e-49aa-957b-2e0eb854595b.4daa71f1-9505-471d-afc1-c7977e9a6d1b {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:25:47 devstack sudo[105065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9ff653aa-e37e-49aa-957b-2e0eb854595b.4daa71f1-9505-471d-afc1-c7977e9a6d1b Aug 05 06:25:47 devstack sudo[105065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:25:47 devstack sudo[105065]: pam_unix(sudo:session): session closed for user root Aug 05 06:25:47 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-a6c36f20-dbf5-42e6-8ed0-670f6d84eeca tempest-SnapshotsActionsTest-1399985861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9ff653aa-e37e-49aa-957b-2e0eb854595b.4daa71f1-9505-471d-afc1-c7977e9a6d1b" returned: 0 in 0.362s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:25:47 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-a6c36f20-dbf5-42e6-8ed0-670f6d84eeca tempest-SnapshotsActionsTest-1399985861 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9ff653aa-e37e-49aa-957b-2e0eb854595b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88695) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 06:25:47 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb8a9edd-b8b3-4b4b-b599-da41ba013307]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:25:47 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-a6c36f20-dbf5-42e6-8ed0-670f6d84eeca tempest-SnapshotsActionsTest-1399985861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9ff653aa-e37e-49aa-957b-2e0eb854595b {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:25:47 devstack sudo[105070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9ff653aa-e37e-49aa-957b-2e0eb854595b Aug 05 06:25:47 devstack sudo[105070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:25:48 devstack sudo[105070]: pam_unix(sudo:session): session closed for user root Aug 05 06:25:48 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-a6c36f20-dbf5-42e6-8ed0-670f6d84eeca tempest-SnapshotsActionsTest-1399985861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9ff653aa-e37e-49aa-957b-2e0eb854595b" returned: 0 in 0.403s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:25:48 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-a6c36f20-dbf5-42e6-8ed0-670f6d84eeca tempest-SnapshotsActionsTest-1399985861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9ff653aa-e37e-49aa-957b-2e0eb854595b.4daa71f1-9505-471d-afc1-c7977e9a6d1b {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:25:48 devstack sudo[105076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9ff653aa-e37e-49aa-957b-2e0eb854595b.4daa71f1-9505-471d-afc1-c7977e9a6d1b Aug 05 06:25:48 devstack sudo[105076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:25:48 devstack sudo[105076]: pam_unix(sudo:session): session closed for user root Aug 05 06:25:48 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-a6c36f20-dbf5-42e6-8ed0-670f6d84eeca tempest-SnapshotsActionsTest-1399985861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9ff653aa-e37e-49aa-957b-2e0eb854595b.4daa71f1-9505-471d-afc1-c7977e9a6d1b" returned: 0 in 0.383s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:25:48 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-a6c36f20-dbf5-42e6-8ed0-670f6d84eeca tempest-SnapshotsActionsTest-1399985861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9ff653aa-e37e-49aa-957b-2e0eb854595b.4daa71f1-9505-471d-afc1-c7977e9a6d1b {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:25:48 devstack sudo[105081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9ff653aa-e37e-49aa-957b-2e0eb854595b.4daa71f1-9505-471d-afc1-c7977e9a6d1b Aug 05 06:25:48 devstack sudo[105081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:25:48 devstack sudo[105081]: pam_unix(sudo:session): session closed for user root Aug 05 06:25:48 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-a6c36f20-dbf5-42e6-8ed0-670f6d84eeca tempest-SnapshotsActionsTest-1399985861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9ff653aa-e37e-49aa-957b-2e0eb854595b.4daa71f1-9505-471d-afc1-c7977e9a6d1b" returned: 0 in 0.278s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:25:48 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-a6c36f20-dbf5-42e6-8ed0-670f6d84eeca tempest-SnapshotsActionsTest-1399985861 None] Lock "cinder-quobyte-4daa71f1-9505-471d-afc1-c7977e9a6d1b" released by "_delete_snapshot" :: held 1.543s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:25:48 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-a6c36f20-dbf5-42e6-8ed0-670f6d84eeca tempest-SnapshotsActionsTest-1399985861 None] Lock "cinder-quobyte-9ff653aa-e37e-49aa-957b-2e0eb854595b" released by "delete_snapshot" :: held 1.565s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:25:49 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-a6c36f20-dbf5-42e6-8ed0-670f6d84eeca tempest-SnapshotsActionsTest-1399985861 None] Created reservations ['97ba6752-8ce5-42e3-acf4-66a423f13f96', '6e232ef8-84d0-4912-94d8-a03c6169b883', '7fe212d7-7a97-4ecb-ba37-ed668f1ac29e', 'a54459d7-43fc-4274-b4e7-5627b0893d56'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:25:49 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-a6c36f20-dbf5-42e6-8ed0-670f6d84eeca tempest-SnapshotsActionsTest-1399985861 None] Delete snapshot completed successfully. Aug 05 06:25:49 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-a6c36f20-dbf5-42e6-8ed0-670f6d84eeca tempest-SnapshotsActionsTest-1399985861 None] Lock "cinder-4daa71f1-9505-471d-afc1-c7977e9a6d1b-delete_snapshot" released by "delete_snapshot" :: held 1.719s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:25:49 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-b49afc49-c8ab-426f-9173-0f17758a8141 tempest-SnapshotsActionsTest-1399985861 None] Acquiring lock "cinder-9ff653aa-e37e-49aa-957b-2e0eb854595b-delete_volume" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:25:49 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-b49afc49-c8ab-426f-9173-0f17758a8141 tempest-SnapshotsActionsTest-1399985861 None] Lock "cinder-9ff653aa-e37e-49aa-957b-2e0eb854595b-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:25:49 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-b49afc49-c8ab-426f-9173-0f17758a8141 tempest-SnapshotsActionsTest-1399985861 None] Acquiring lock "cinder-quobyte-9ff653aa-e37e-49aa-957b-2e0eb854595b" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:25:49 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-b49afc49-c8ab-426f-9173-0f17758a8141 tempest-SnapshotsActionsTest-1399985861 None] Lock "cinder-quobyte-9ff653aa-e37e-49aa-957b-2e0eb854595b" acquired by "delete_volume" :: waited 0.015s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:25:49 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ad95996-fccc-44fa-a946-83d944f8a27c]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:25:49 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-b49afc49-c8ab-426f-9173-0f17758a8141 tempest-SnapshotsActionsTest-1399985861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9ff653aa-e37e-49aa-957b-2e0eb854595b {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:25:49 devstack sudo[105084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9ff653aa-e37e-49aa-957b-2e0eb854595b Aug 05 06:25:49 devstack sudo[105084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:25:50 devstack sudo[105084]: pam_unix(sudo:session): session closed for user root Aug 05 06:25:50 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-b49afc49-c8ab-426f-9173-0f17758a8141 tempest-SnapshotsActionsTest-1399985861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9ff653aa-e37e-49aa-957b-2e0eb854595b" returned: 0 in 0.360s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:25:50 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-b49afc49-c8ab-426f-9173-0f17758a8141 tempest-SnapshotsActionsTest-1399985861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9ff653aa-e37e-49aa-957b-2e0eb854595b {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:25:50 devstack sudo[105089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9ff653aa-e37e-49aa-957b-2e0eb854595b Aug 05 06:25:50 devstack sudo[105089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:25:50 devstack sudo[105089]: pam_unix(sudo:session): session closed for user root Aug 05 06:25:50 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-b49afc49-c8ab-426f-9173-0f17758a8141 tempest-SnapshotsActionsTest-1399985861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9ff653aa-e37e-49aa-957b-2e0eb854595b" returned: 0 in 0.258s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:25:50 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-b49afc49-c8ab-426f-9173-0f17758a8141 tempest-SnapshotsActionsTest-1399985861 None] Lock "cinder-quobyte-9ff653aa-e37e-49aa-957b-2e0eb854595b" released by "delete_volume" :: held 0.679s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:25:50 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-b49afc49-c8ab-426f-9173-0f17758a8141 tempest-SnapshotsActionsTest-1399985861 None] Created reservations ['7076997b-5e69-4ae9-a4d6-8ddc8d82dd3e', 'c1498351-e928-49c6-a853-e765bfdd5b3c', '69ac39f7-648c-4e2e-afc6-dd02de9d0843', '8491f331-b859-46a5-b1b0-2ef77f89f74f'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:25:50 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-b49afc49-c8ab-426f-9173-0f17758a8141 tempest-SnapshotsActionsTest-1399985861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:25:50 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-b49afc49-c8ab-426f-9173-0f17758a8141 tempest-SnapshotsActionsTest-1399985861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:25:50 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-b49afc49-c8ab-426f-9173-0f17758a8141 tempest-SnapshotsActionsTest-1399985861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:25:50 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-b49afc49-c8ab-426f-9173-0f17758a8141 tempest-SnapshotsActionsTest-1399985861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:25:50 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-b49afc49-c8ab-426f-9173-0f17758a8141 tempest-SnapshotsActionsTest-1399985861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:25:50 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-b49afc49-c8ab-426f-9173-0f17758a8141 tempest-SnapshotsActionsTest-1399985861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:25:50 devstack sudo[105092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce Aug 05 06:25:50 devstack sudo[105092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:25:50 devstack sudo[105092]: pam_unix(sudo:session): session closed for user root Aug 05 06:25:50 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-b49afc49-c8ab-426f-9173-0f17758a8141 tempest-SnapshotsActionsTest-1399985861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce" returned: 0 in 0.254s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:25:50 devstack cinder-volume[88695]: DEBUG cinder.manager [None req-b49afc49-c8ab-426f-9173-0f17758a8141 tempest-SnapshotsActionsTest-1399985861 None] Notifying Schedulers of capabilities ... {{(pid=88695) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 06:25:50 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-b49afc49-c8ab-426f-9173-0f17758a8141 tempest-SnapshotsActionsTest-1399985861 None] Deleted volume successfully. Aug 05 06:25:50 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-b49afc49-c8ab-426f-9173-0f17758a8141 tempest-SnapshotsActionsTest-1399985861 None] Lock "cinder-9ff653aa-e37e-49aa-957b-2e0eb854595b-delete_volume" released by "delete_volume" :: held 1.137s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:26:00 devstack cinder-volume[88695]: DEBUG oslo_service.periodic_task [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88695) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 06:26:00 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:26:00 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:26:00 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:26:00 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:26:00 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:26:00 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:26:00 devstack cinder-volume[88695]: DEBUG dbcounter [-] [88695] Writing DB stats cinder:SELECT=23,cinder:INSERT=9,cinder:UPDATE=27,cinder:DELETE=1 {{(pid=88695) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 06:26:00 devstack sudo[105103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce Aug 05 06:26:00 devstack sudo[105103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:26:00 devstack sudo[105103]: pam_unix(sudo:session): session closed for user root Aug 05 06:26:00 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce" returned: 0 in 0.269s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:26:00 devstack cinder-volume[88695]: DEBUG cinder.manager [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] Notifying Schedulers of capabilities ... {{(pid=88695) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 06:26:00 devstack cinder-volume[88695]: DEBUG oslo_service.periodic_task [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] Running periodic task VolumeManager._thread_info {{(pid=88695) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 06:26:00 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] thread count: 28 {{(pid=88695) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 05 06:26:00 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] thread info: [<_MainThread(MainThread, started 134469211893888)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88695) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 05 06:26:00 devstack cinder-volume[88695]: DEBUG dbcounter [-] [88695] Writing DB stats cinder:SELECT=23,cinder:UPDATE=26,cinder:DELETE=2,cinder:INSERT=7 {{(pid=88695) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 06:26:07 devstack cinder-volume[88695]: INFO cinder.volume.manager [req-256acdf2-bdad-4a57-a923-93b6f1eb4f41 req-a510c3e4-4094-4fc2-a0ae-05f2f6b7d61c tempest-TestShelveInstance-802603102 None] Terminate volume connection completed successfully. Aug 05 06:26:07 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [req-256acdf2-bdad-4a57-a923-93b6f1eb4f41 req-a510c3e4-4094-4fc2-a0ae-05f2f6b7d61c tempest-TestShelveInstance-802603102 None] Deleting attachment d5132fa1-53d0-4a21-87af-9ff5125fdaf4. {{(pid=88695) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 05 06:26:07 devstack cinder-volume[88695]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0b19480-8294-4a53-9c0b-06f74e12f5a8 tempest-VolumeQuotasAdminTestJSON-1757405422 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88695) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 06:26:07 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-a0b19480-8294-4a53-9c0b-06f74e12f5a8 tempest-VolumeQuotasAdminTestJSON-1757405422 None] Flow 'volume_create_manager' (4c187b88-d225-4e04-903d-26df89f03a19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:26:07 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-a0b19480-8294-4a53-9c0b-06f74e12f5a8 tempest-VolumeQuotasAdminTestJSON-1757405422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c491535-e41e-4f4a-8f55-accc9ef2de01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:26:07 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-a0b19480-8294-4a53-9c0b-06f74e12f5a8 tempest-VolumeQuotasAdminTestJSON-1757405422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c491535-e41e-4f4a-8f55-accc9ef2de01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:26:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1725500288',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b18d58c3-4130-40ef-bbdf-9b0609230347,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccdcdfb1040546e5a9c0954bbfd982fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:26:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:26:07Z,use_quota=True,user_id='5bf64a2a1676424e92af853e88e7960e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:26:07 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-a0b19480-8294-4a53-9c0b-06f74e12f5a8 tempest-VolumeQuotasAdminTestJSON-1757405422 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40c2d343-d111-49f6-9a82-2f301b4e2813) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:26:07 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-a0b19480-8294-4a53-9c0b-06f74e12f5a8 tempest-VolumeQuotasAdminTestJSON-1757405422 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40c2d343-d111-49f6-9a82-2f301b4e2813) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:26:07 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-a0b19480-8294-4a53-9c0b-06f74e12f5a8 tempest-VolumeQuotasAdminTestJSON-1757405422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa0db555-32e1-40ad-b85d-93e476b6ae1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:26:07 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-a0b19480-8294-4a53-9c0b-06f74e12f5a8 tempest-VolumeQuotasAdminTestJSON-1757405422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa0db555-32e1-40ad-b85d-93e476b6ae1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b18d58c3-4130-40ef-bbdf-9b0609230347', 'volume_name': 'volume-b18d58c3-4130-40ef-bbdf-9b0609230347', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:26:07 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-a0b19480-8294-4a53-9c0b-06f74e12f5a8 tempest-VolumeQuotasAdminTestJSON-1757405422 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1fde3a5-7f9d-453d-a688-1686ffa2a300) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:26:07 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-a0b19480-8294-4a53-9c0b-06f74e12f5a8 tempest-VolumeQuotasAdminTestJSON-1757405422 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1fde3a5-7f9d-453d-a688-1686ffa2a300) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:26:07 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-a0b19480-8294-4a53-9c0b-06f74e12f5a8 tempest-VolumeQuotasAdminTestJSON-1757405422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4720407e-49bb-4b27-a1db-44f0129d6647) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:26:07 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-a0b19480-8294-4a53-9c0b-06f74e12f5a8 tempest-VolumeQuotasAdminTestJSON-1757405422 None] Volume b18d58c3-4130-40ef-bbdf-9b0609230347: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b18d58c3-4130-40ef-bbdf-9b0609230347', 'volume_size': 1} Aug 05 06:26:07 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-a0b19480-8294-4a53-9c0b-06f74e12f5a8 tempest-VolumeQuotasAdminTestJSON-1757405422 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:26:07 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-a0b19480-8294-4a53-9c0b-06f74e12f5a8 tempest-VolumeQuotasAdminTestJSON-1757405422 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:26:07 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-a0b19480-8294-4a53-9c0b-06f74e12f5a8 tempest-VolumeQuotasAdminTestJSON-1757405422 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:26:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1725500288',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b18d58c3-4130-40ef-bbdf-9b0609230347,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccdcdfb1040546e5a9c0954bbfd982fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:26:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:26:07Z,use_quota=True,user_id='5bf64a2a1676424e92af853e88e7960e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)}" {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 06:26:07 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-a0b19480-8294-4a53-9c0b-06f74e12f5a8 tempest-VolumeQuotasAdminTestJSON-1757405422 None] Creating volume b18d58c3-4130-40ef-bbdf-9b0609230347 {{(pid=88695) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 06:26:07 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-a0b19480-8294-4a53-9c0b-06f74e12f5a8 tempest-VolumeQuotasAdminTestJSON-1757405422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:26:07 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-a0b19480-8294-4a53-9c0b-06f74e12f5a8 tempest-VolumeQuotasAdminTestJSON-1757405422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:26:07 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-a0b19480-8294-4a53-9c0b-06f74e12f5a8 tempest-VolumeQuotasAdminTestJSON-1757405422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:26:07 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-a0b19480-8294-4a53-9c0b-06f74e12f5a8 tempest-VolumeQuotasAdminTestJSON-1757405422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:26:07 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-a0b19480-8294-4a53-9c0b-06f74e12f5a8 tempest-VolumeQuotasAdminTestJSON-1757405422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:26:07 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-a0b19480-8294-4a53-9c0b-06f74e12f5a8 tempest-VolumeQuotasAdminTestJSON-1757405422 None] Selected osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 as target Quobyte volume. {{(pid=88695) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 06:26:07 devstack cinder-volume[88695]: INFO cinder.volume.drivers.remotefs [None req-a0b19480-8294-4a53-9c0b-06f74e12f5a8 tempest-VolumeQuotasAdminTestJSON-1757405422 None] casted to osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 Aug 05 06:26:07 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-a0b19480-8294-4a53-9c0b-06f74e12f5a8 tempest-VolumeQuotasAdminTestJSON-1757405422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-b18d58c3-4130-40ef-bbdf-9b0609230347 1073741824 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:26:07 devstack cinder-volume[88695]: DEBUG cinder.coordination [req-256acdf2-bdad-4a57-a923-93b6f1eb4f41 req-bf9d06bc-34e8-4fa9-b8e0-b6e423db133c tempest-TestShelveInstance-802603102 None] Acquiring lock "cinder-50048e3d-a5d7-4b7f-8f6a-cc0bf11aa6c9-delete_volume" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:26:07 devstack sudo[105141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-b18d58c3-4130-40ef-bbdf-9b0609230347 1073741824 Aug 05 06:26:07 devstack sudo[105141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:26:07 devstack cinder-volume[88695]: DEBUG cinder.coordination [req-256acdf2-bdad-4a57-a923-93b6f1eb4f41 req-bf9d06bc-34e8-4fa9-b8e0-b6e423db133c tempest-TestShelveInstance-802603102 None] Lock "cinder-50048e3d-a5d7-4b7f-8f6a-cc0bf11aa6c9-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:26:07 devstack cinder-volume[88695]: DEBUG cinder.coordination [req-256acdf2-bdad-4a57-a923-93b6f1eb4f41 req-bf9d06bc-34e8-4fa9-b8e0-b6e423db133c tempest-TestShelveInstance-802603102 None] Acquiring lock "cinder-quobyte-50048e3d-a5d7-4b7f-8f6a-cc0bf11aa6c9" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:26:07 devstack cinder-volume[88695]: DEBUG cinder.coordination [req-256acdf2-bdad-4a57-a923-93b6f1eb4f41 req-bf9d06bc-34e8-4fa9-b8e0-b6e423db133c tempest-TestShelveInstance-802603102 None] Lock "cinder-quobyte-50048e3d-a5d7-4b7f-8f6a-cc0bf11aa6c9" acquired by "delete_volume" :: waited 0.021s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:26:07 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[82d81e4a-fbc9-40f6-a0bd-3710a141e519]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:26:07 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [req-256acdf2-bdad-4a57-a923-93b6f1eb4f41 req-bf9d06bc-34e8-4fa9-b8e0-b6e423db133c tempest-TestShelveInstance-802603102 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-50048e3d-a5d7-4b7f-8f6a-cc0bf11aa6c9 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:26:07 devstack sudo[105143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-50048e3d-a5d7-4b7f-8f6a-cc0bf11aa6c9 Aug 05 06:26:07 devstack sudo[105143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:26:07 devstack sudo[105141]: pam_unix(sudo:session): session closed for user root Aug 05 06:26:07 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-a0b19480-8294-4a53-9c0b-06f74e12f5a8 tempest-VolumeQuotasAdminTestJSON-1757405422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-b18d58c3-4130-40ef-bbdf-9b0609230347 1073741824" returned: 0 in 0.536s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:26:07 devstack sudo[105143]: pam_unix(sudo:session): session closed for user root Aug 05 06:26:07 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [req-256acdf2-bdad-4a57-a923-93b6f1eb4f41 req-bf9d06bc-34e8-4fa9-b8e0-b6e423db133c tempest-TestShelveInstance-802603102 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-50048e3d-a5d7-4b7f-8f6a-cc0bf11aa6c9" returned: 0 in 0.417s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:26:07 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [req-256acdf2-bdad-4a57-a923-93b6f1eb4f41 req-bf9d06bc-34e8-4fa9-b8e0-b6e423db133c tempest-TestShelveInstance-802603102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-50048e3d-a5d7-4b7f-8f6a-cc0bf11aa6c9 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:26:07 devstack sudo[105152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-50048e3d-a5d7-4b7f-8f6a-cc0bf11aa6c9 Aug 05 06:26:07 devstack sudo[105152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:26:07 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-a0b19480-8294-4a53-9c0b-06f74e12f5a8 tempest-VolumeQuotasAdminTestJSON-1757405422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-b18d58c3-4130-40ef-bbdf-9b0609230347 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:26:07 devstack sudo[105154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-b18d58c3-4130-40ef-bbdf-9b0609230347 Aug 05 06:26:07 devstack sudo[105154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:26:08 devstack sudo[105152]: pam_unix(sudo:session): session closed for user root Aug 05 06:26:08 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [req-256acdf2-bdad-4a57-a923-93b6f1eb4f41 req-bf9d06bc-34e8-4fa9-b8e0-b6e423db133c tempest-TestShelveInstance-802603102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-50048e3d-a5d7-4b7f-8f6a-cc0bf11aa6c9" returned: 0 in 0.280s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:26:08 devstack cinder-volume[88695]: DEBUG cinder.coordination [req-256acdf2-bdad-4a57-a923-93b6f1eb4f41 req-bf9d06bc-34e8-4fa9-b8e0-b6e423db133c tempest-TestShelveInstance-802603102 None] Lock "cinder-quobyte-50048e3d-a5d7-4b7f-8f6a-cc0bf11aa6c9" released by "delete_volume" :: held 0.755s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:26:08 devstack sudo[105154]: pam_unix(sudo:session): session closed for user root Aug 05 06:26:08 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-a0b19480-8294-4a53-9c0b-06f74e12f5a8 tempest-VolumeQuotasAdminTestJSON-1757405422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-b18d58c3-4130-40ef-bbdf-9b0609230347" returned: 0 in 0.274s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:26:08 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-a0b19480-8294-4a53-9c0b-06f74e12f5a8 tempest-VolumeQuotasAdminTestJSON-1757405422 None] <== create_volume: return (867ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'} {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 06:26:08 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-a0b19480-8294-4a53-9c0b-06f74e12f5a8 tempest-VolumeQuotasAdminTestJSON-1757405422 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.871s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:26:08 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-a0b19480-8294-4a53-9c0b-06f74e12f5a8 tempest-VolumeQuotasAdminTestJSON-1757405422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4720407e-49bb-4b27-a1db-44f0129d6647) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b18d58c3-4130-40ef-bbdf-9b0609230347', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:26:08 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-a0b19480-8294-4a53-9c0b-06f74e12f5a8 tempest-VolumeQuotasAdminTestJSON-1757405422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33add571-fc9e-491a-961a-b618a9329f44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:26:08 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-a0b19480-8294-4a53-9c0b-06f74e12f5a8 tempest-VolumeQuotasAdminTestJSON-1757405422 None] Volume volume-b18d58c3-4130-40ef-bbdf-9b0609230347 (b18d58c3-4130-40ef-bbdf-9b0609230347): created successfully Aug 05 06:26:08 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-a0b19480-8294-4a53-9c0b-06f74e12f5a8 tempest-VolumeQuotasAdminTestJSON-1757405422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33add571-fc9e-491a-961a-b618a9329f44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:26:08 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-a0b19480-8294-4a53-9c0b-06f74e12f5a8 tempest-VolumeQuotasAdminTestJSON-1757405422 None] Flow 'volume_create_manager' (4c187b88-d225-4e04-903d-26df89f03a19) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:26:08 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-a0b19480-8294-4a53-9c0b-06f74e12f5a8 tempest-VolumeQuotasAdminTestJSON-1757405422 None] Created volume successfully. Aug 05 06:26:08 devstack cinder-volume[88695]: DEBUG cinder.quota [req-256acdf2-bdad-4a57-a923-93b6f1eb4f41 req-bf9d06bc-34e8-4fa9-b8e0-b6e423db133c tempest-TestShelveInstance-802603102 None] Created reservations ['2e250c0a-b15d-42ea-affe-3be10fd9e8f0', '32a7ef15-4d6a-4de1-936a-6ee77ea75f9d', 'f23f4318-0f42-4ec4-90e2-158d9b899feb', 'a3cfed7d-746d-43b0-984e-4833adeeb2c6'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:26:08 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [req-256acdf2-bdad-4a57-a923-93b6f1eb4f41 req-bf9d06bc-34e8-4fa9-b8e0-b6e423db133c tempest-TestShelveInstance-802603102 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:26:08 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [req-256acdf2-bdad-4a57-a923-93b6f1eb4f41 req-bf9d06bc-34e8-4fa9-b8e0-b6e423db133c tempest-TestShelveInstance-802603102 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:26:08 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [req-256acdf2-bdad-4a57-a923-93b6f1eb4f41 req-bf9d06bc-34e8-4fa9-b8e0-b6e423db133c tempest-TestShelveInstance-802603102 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:26:08 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [req-256acdf2-bdad-4a57-a923-93b6f1eb4f41 req-bf9d06bc-34e8-4fa9-b8e0-b6e423db133c tempest-TestShelveInstance-802603102 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:26:08 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [req-256acdf2-bdad-4a57-a923-93b6f1eb4f41 req-bf9d06bc-34e8-4fa9-b8e0-b6e423db133c tempest-TestShelveInstance-802603102 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:26:08 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [req-256acdf2-bdad-4a57-a923-93b6f1eb4f41 req-bf9d06bc-34e8-4fa9-b8e0-b6e423db133c tempest-TestShelveInstance-802603102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:26:08 devstack sudo[105159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce Aug 05 06:26:08 devstack sudo[105159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:26:08 devstack sudo[105159]: pam_unix(sudo:session): session closed for user root Aug 05 06:26:08 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [req-256acdf2-bdad-4a57-a923-93b6f1eb4f41 req-bf9d06bc-34e8-4fa9-b8e0-b6e423db133c tempest-TestShelveInstance-802603102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce" returned: 0 in 0.285s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:26:08 devstack cinder-volume[88695]: DEBUG cinder.manager [req-256acdf2-bdad-4a57-a923-93b6f1eb4f41 req-bf9d06bc-34e8-4fa9-b8e0-b6e423db133c tempest-TestShelveInstance-802603102 None] Notifying Schedulers of capabilities ... {{(pid=88695) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 06:26:08 devstack cinder-volume[88695]: INFO cinder.volume.manager [req-256acdf2-bdad-4a57-a923-93b6f1eb4f41 req-bf9d06bc-34e8-4fa9-b8e0-b6e423db133c tempest-TestShelveInstance-802603102 None] Deleted volume successfully. Aug 05 06:26:08 devstack cinder-volume[88695]: DEBUG cinder.coordination [req-256acdf2-bdad-4a57-a923-93b6f1eb4f41 req-bf9d06bc-34e8-4fa9-b8e0-b6e423db133c tempest-TestShelveInstance-802603102 None] Lock "cinder-50048e3d-a5d7-4b7f-8f6a-cc0bf11aa6c9-delete_volume" released by "delete_volume" :: held 1.348s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:26:09 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-ae00aa0c-66e9-45ae-9bb6-5ed5511e013c tempest-VolumeQuotasAdminTestJSON-1757405422 None] Acquiring lock "cinder-b18d58c3-4130-40ef-bbdf-9b0609230347-delete_volume" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:26:09 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-ae00aa0c-66e9-45ae-9bb6-5ed5511e013c tempest-VolumeQuotasAdminTestJSON-1757405422 None] Lock "cinder-b18d58c3-4130-40ef-bbdf-9b0609230347-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:26:09 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-ae00aa0c-66e9-45ae-9bb6-5ed5511e013c tempest-VolumeQuotasAdminTestJSON-1757405422 None] Acquiring lock "cinder-quobyte-b18d58c3-4130-40ef-bbdf-9b0609230347" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:26:09 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-ae00aa0c-66e9-45ae-9bb6-5ed5511e013c tempest-VolumeQuotasAdminTestJSON-1757405422 None] Lock "cinder-quobyte-b18d58c3-4130-40ef-bbdf-9b0609230347" acquired by "delete_volume" :: waited 0.014s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:26:09 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d1b778b-9ff8-4486-8a53-16cadeea3bc5]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:26:09 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-ae00aa0c-66e9-45ae-9bb6-5ed5511e013c tempest-VolumeQuotasAdminTestJSON-1757405422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-b18d58c3-4130-40ef-bbdf-9b0609230347 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:26:09 devstack sudo[105162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-b18d58c3-4130-40ef-bbdf-9b0609230347 Aug 05 06:26:09 devstack sudo[105162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:26:09 devstack sudo[105162]: pam_unix(sudo:session): session closed for user root Aug 05 06:26:09 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-ae00aa0c-66e9-45ae-9bb6-5ed5511e013c tempest-VolumeQuotasAdminTestJSON-1757405422 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-b18d58c3-4130-40ef-bbdf-9b0609230347" returned: 0 in 0.368s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:26:09 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-ae00aa0c-66e9-45ae-9bb6-5ed5511e013c tempest-VolumeQuotasAdminTestJSON-1757405422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-b18d58c3-4130-40ef-bbdf-9b0609230347 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:26:09 devstack sudo[105168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-b18d58c3-4130-40ef-bbdf-9b0609230347 Aug 05 06:26:09 devstack sudo[105168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:26:10 devstack sudo[105168]: pam_unix(sudo:session): session closed for user root Aug 05 06:26:10 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-ae00aa0c-66e9-45ae-9bb6-5ed5511e013c tempest-VolumeQuotasAdminTestJSON-1757405422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-b18d58c3-4130-40ef-bbdf-9b0609230347" returned: 0 in 0.271s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:26:10 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-ae00aa0c-66e9-45ae-9bb6-5ed5511e013c tempest-VolumeQuotasAdminTestJSON-1757405422 None] Lock "cinder-quobyte-b18d58c3-4130-40ef-bbdf-9b0609230347" released by "delete_volume" :: held 0.683s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:26:10 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-ae00aa0c-66e9-45ae-9bb6-5ed5511e013c tempest-VolumeQuotasAdminTestJSON-1757405422 None] Created reservations ['3f6bec72-f18e-45bb-828e-4a43d7a01bcf', '85f9b37e-7681-430e-aeaa-82231199766f', 'ee488bb3-b4ba-4995-bbc2-4ecce2f16a48', 'aed0ea20-3ec3-4434-998e-9695e658acd1'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:26:10 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-ae00aa0c-66e9-45ae-9bb6-5ed5511e013c tempest-VolumeQuotasAdminTestJSON-1757405422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:26:10 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-ae00aa0c-66e9-45ae-9bb6-5ed5511e013c tempest-VolumeQuotasAdminTestJSON-1757405422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:26:10 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-ae00aa0c-66e9-45ae-9bb6-5ed5511e013c tempest-VolumeQuotasAdminTestJSON-1757405422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:26:10 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-ae00aa0c-66e9-45ae-9bb6-5ed5511e013c tempest-VolumeQuotasAdminTestJSON-1757405422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:26:10 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-ae00aa0c-66e9-45ae-9bb6-5ed5511e013c tempest-VolumeQuotasAdminTestJSON-1757405422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:26:10 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-ae00aa0c-66e9-45ae-9bb6-5ed5511e013c tempest-VolumeQuotasAdminTestJSON-1757405422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:26:10 devstack sudo[105171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce Aug 05 06:26:10 devstack sudo[105171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:26:10 devstack sudo[105171]: pam_unix(sudo:session): session closed for user root Aug 05 06:26:10 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-ae00aa0c-66e9-45ae-9bb6-5ed5511e013c tempest-VolumeQuotasAdminTestJSON-1757405422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce" returned: 0 in 0.254s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:26:10 devstack cinder-volume[88695]: DEBUG cinder.manager [None req-ae00aa0c-66e9-45ae-9bb6-5ed5511e013c tempest-VolumeQuotasAdminTestJSON-1757405422 None] Notifying Schedulers of capabilities ... {{(pid=88695) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 06:26:10 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-ae00aa0c-66e9-45ae-9bb6-5ed5511e013c tempest-VolumeQuotasAdminTestJSON-1757405422 None] Deleted volume successfully. Aug 05 06:26:10 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-ae00aa0c-66e9-45ae-9bb6-5ed5511e013c tempest-VolumeQuotasAdminTestJSON-1757405422 None] Lock "cinder-b18d58c3-4130-40ef-bbdf-9b0609230347-delete_volume" released by "delete_volume" :: held 1.147s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:26:11 devstack cinder-volume[88695]: DEBUG cinder.volume.flows.manager.create_volume [None req-b783355a-f542-4144-afb0-6bc8a44cfee4 tempest-VolumeQuotasAdminTestJSON-1757405422 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88695) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 06:26:11 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-b783355a-f542-4144-afb0-6bc8a44cfee4 tempest-VolumeQuotasAdminTestJSON-1757405422 None] Flow 'volume_create_manager' (a7e80d7c-5b1e-4476-927b-156291a8e097) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:26:11 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-b783355a-f542-4144-afb0-6bc8a44cfee4 tempest-VolumeQuotasAdminTestJSON-1757405422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1f66e62-3ed7-4102-9c19-60ce71d7fe9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:26:11 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-b783355a-f542-4144-afb0-6bc8a44cfee4 tempest-VolumeQuotasAdminTestJSON-1757405422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1f66e62-3ed7-4102-9c19-60ce71d7fe9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:26:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-899364998',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0e2a748-315f-464a-85c4-fd84ab4b5085,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccdcdfb1040546e5a9c0954bbfd982fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:26:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:26:11Z,use_quota=True,user_id='5bf64a2a1676424e92af853e88e7960e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:26:11 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-b783355a-f542-4144-afb0-6bc8a44cfee4 tempest-VolumeQuotasAdminTestJSON-1757405422 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bb36ef4-e6ab-47a8-af5e-d70b31e9626d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:26:11 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-b783355a-f542-4144-afb0-6bc8a44cfee4 tempest-VolumeQuotasAdminTestJSON-1757405422 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bb36ef4-e6ab-47a8-af5e-d70b31e9626d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:26:11 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-b783355a-f542-4144-afb0-6bc8a44cfee4 tempest-VolumeQuotasAdminTestJSON-1757405422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24204b71-06a7-40b4-9d7f-460e5dd72388) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:26:11 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-b783355a-f542-4144-afb0-6bc8a44cfee4 tempest-VolumeQuotasAdminTestJSON-1757405422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24204b71-06a7-40b4-9d7f-460e5dd72388) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b0e2a748-315f-464a-85c4-fd84ab4b5085', 'volume_name': 'volume-b0e2a748-315f-464a-85c4-fd84ab4b5085', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:26:11 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-b783355a-f542-4144-afb0-6bc8a44cfee4 tempest-VolumeQuotasAdminTestJSON-1757405422 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83396b5e-fa70-4140-9d1c-beb39d536757) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:26:11 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-b783355a-f542-4144-afb0-6bc8a44cfee4 tempest-VolumeQuotasAdminTestJSON-1757405422 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83396b5e-fa70-4140-9d1c-beb39d536757) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:26:11 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-b783355a-f542-4144-afb0-6bc8a44cfee4 tempest-VolumeQuotasAdminTestJSON-1757405422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6beac55-9685-4675-9d7a-9e36f52b27ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:26:11 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-b783355a-f542-4144-afb0-6bc8a44cfee4 tempest-VolumeQuotasAdminTestJSON-1757405422 None] Volume b0e2a748-315f-464a-85c4-fd84ab4b5085: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b0e2a748-315f-464a-85c4-fd84ab4b5085', 'volume_size': 1} Aug 05 06:26:11 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-b783355a-f542-4144-afb0-6bc8a44cfee4 tempest-VolumeQuotasAdminTestJSON-1757405422 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:26:11 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-b783355a-f542-4144-afb0-6bc8a44cfee4 tempest-VolumeQuotasAdminTestJSON-1757405422 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:26:11 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-b783355a-f542-4144-afb0-6bc8a44cfee4 tempest-VolumeQuotasAdminTestJSON-1757405422 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:26:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-899364998',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0e2a748-315f-464a-85c4-fd84ab4b5085,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccdcdfb1040546e5a9c0954bbfd982fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:26:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:26:11Z,use_quota=True,user_id='5bf64a2a1676424e92af853e88e7960e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)}" {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 06:26:11 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-b783355a-f542-4144-afb0-6bc8a44cfee4 tempest-VolumeQuotasAdminTestJSON-1757405422 None] Creating volume b0e2a748-315f-464a-85c4-fd84ab4b5085 {{(pid=88695) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 06:26:11 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-b783355a-f542-4144-afb0-6bc8a44cfee4 tempest-VolumeQuotasAdminTestJSON-1757405422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:26:11 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-b783355a-f542-4144-afb0-6bc8a44cfee4 tempest-VolumeQuotasAdminTestJSON-1757405422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:26:11 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-b783355a-f542-4144-afb0-6bc8a44cfee4 tempest-VolumeQuotasAdminTestJSON-1757405422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:26:11 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-b783355a-f542-4144-afb0-6bc8a44cfee4 tempest-VolumeQuotasAdminTestJSON-1757405422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:26:11 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-b783355a-f542-4144-afb0-6bc8a44cfee4 tempest-VolumeQuotasAdminTestJSON-1757405422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:26:11 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-b783355a-f542-4144-afb0-6bc8a44cfee4 tempest-VolumeQuotasAdminTestJSON-1757405422 None] Selected osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 as target Quobyte volume. {{(pid=88695) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 06:26:11 devstack cinder-volume[88695]: INFO cinder.volume.drivers.remotefs [None req-b783355a-f542-4144-afb0-6bc8a44cfee4 tempest-VolumeQuotasAdminTestJSON-1757405422 None] casted to osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 Aug 05 06:26:11 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-b783355a-f542-4144-afb0-6bc8a44cfee4 tempest-VolumeQuotasAdminTestJSON-1757405422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-b0e2a748-315f-464a-85c4-fd84ab4b5085 1073741824 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:26:11 devstack sudo[105175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-b0e2a748-315f-464a-85c4-fd84ab4b5085 1073741824 Aug 05 06:26:11 devstack sudo[105175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:26:11 devstack sudo[105175]: pam_unix(sudo:session): session closed for user root Aug 05 06:26:11 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-b783355a-f542-4144-afb0-6bc8a44cfee4 tempest-VolumeQuotasAdminTestJSON-1757405422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-b0e2a748-315f-464a-85c4-fd84ab4b5085 1073741824" returned: 0 in 0.448s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:26:11 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-b783355a-f542-4144-afb0-6bc8a44cfee4 tempest-VolumeQuotasAdminTestJSON-1757405422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-b0e2a748-315f-464a-85c4-fd84ab4b5085 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:26:11 devstack sudo[105181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-b0e2a748-315f-464a-85c4-fd84ab4b5085 Aug 05 06:26:11 devstack sudo[105181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:26:11 devstack sudo[105181]: pam_unix(sudo:session): session closed for user root Aug 05 06:26:11 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-b783355a-f542-4144-afb0-6bc8a44cfee4 tempest-VolumeQuotasAdminTestJSON-1757405422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-b0e2a748-315f-464a-85c4-fd84ab4b5085" returned: 0 in 0.261s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:26:11 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-b783355a-f542-4144-afb0-6bc8a44cfee4 tempest-VolumeQuotasAdminTestJSON-1757405422 None] <== create_volume: return (754ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'} {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 06:26:11 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-b783355a-f542-4144-afb0-6bc8a44cfee4 tempest-VolumeQuotasAdminTestJSON-1757405422 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.757s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:26:11 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-b783355a-f542-4144-afb0-6bc8a44cfee4 tempest-VolumeQuotasAdminTestJSON-1757405422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6beac55-9685-4675-9d7a-9e36f52b27ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b0e2a748-315f-464a-85c4-fd84ab4b5085', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:26:11 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-b783355a-f542-4144-afb0-6bc8a44cfee4 tempest-VolumeQuotasAdminTestJSON-1757405422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9287dd1c-805e-449d-9e9d-3305c249314d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:26:11 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-b783355a-f542-4144-afb0-6bc8a44cfee4 tempest-VolumeQuotasAdminTestJSON-1757405422 None] Volume volume-b0e2a748-315f-464a-85c4-fd84ab4b5085 (b0e2a748-315f-464a-85c4-fd84ab4b5085): created successfully Aug 05 06:26:11 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-b783355a-f542-4144-afb0-6bc8a44cfee4 tempest-VolumeQuotasAdminTestJSON-1757405422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9287dd1c-805e-449d-9e9d-3305c249314d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:26:11 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-b783355a-f542-4144-afb0-6bc8a44cfee4 tempest-VolumeQuotasAdminTestJSON-1757405422 None] Flow 'volume_create_manager' (a7e80d7c-5b1e-4476-927b-156291a8e097) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:26:11 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-b783355a-f542-4144-afb0-6bc8a44cfee4 tempest-VolumeQuotasAdminTestJSON-1757405422 None] Created volume successfully. Aug 05 06:26:12 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-9107b951-a86d-47e0-8860-7810ca3a0897 tempest-VolumeQuotasAdminTestJSON-464807626 None] Transfer volume completed successfully. Aug 05 06:26:13 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-1c58be2b-820b-4916-a4b8-0b723ecc391e tempest-VolumeQuotasAdminTestJSON-1720405889 None] Acquiring lock "cinder-b0e2a748-315f-464a-85c4-fd84ab4b5085-delete_volume" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:26:13 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-1c58be2b-820b-4916-a4b8-0b723ecc391e tempest-VolumeQuotasAdminTestJSON-1720405889 None] Lock "cinder-b0e2a748-315f-464a-85c4-fd84ab4b5085-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:26:13 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-1c58be2b-820b-4916-a4b8-0b723ecc391e tempest-VolumeQuotasAdminTestJSON-1720405889 None] Acquiring lock "cinder-quobyte-b0e2a748-315f-464a-85c4-fd84ab4b5085" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:26:13 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-1c58be2b-820b-4916-a4b8-0b723ecc391e tempest-VolumeQuotasAdminTestJSON-1720405889 None] Lock "cinder-quobyte-b0e2a748-315f-464a-85c4-fd84ab4b5085" acquired by "delete_volume" :: waited 0.017s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:26:13 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f838eb2-9d25-40ed-bcb7-0d2d9162fad6]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:26:13 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-1c58be2b-820b-4916-a4b8-0b723ecc391e tempest-VolumeQuotasAdminTestJSON-1720405889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-b0e2a748-315f-464a-85c4-fd84ab4b5085 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:26:13 devstack sudo[105185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-b0e2a748-315f-464a-85c4-fd84ab4b5085 Aug 05 06:26:13 devstack sudo[105185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:26:13 devstack sudo[105185]: pam_unix(sudo:session): session closed for user root Aug 05 06:26:13 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-1c58be2b-820b-4916-a4b8-0b723ecc391e tempest-VolumeQuotasAdminTestJSON-1720405889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-b0e2a748-315f-464a-85c4-fd84ab4b5085" returned: 0 in 0.409s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:26:13 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-1c58be2b-820b-4916-a4b8-0b723ecc391e tempest-VolumeQuotasAdminTestJSON-1720405889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-b0e2a748-315f-464a-85c4-fd84ab4b5085 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:26:13 devstack sudo[105191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-b0e2a748-315f-464a-85c4-fd84ab4b5085 Aug 05 06:26:13 devstack sudo[105191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:26:13 devstack sudo[105191]: pam_unix(sudo:session): session closed for user root Aug 05 06:26:13 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-1c58be2b-820b-4916-a4b8-0b723ecc391e tempest-VolumeQuotasAdminTestJSON-1720405889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-b0e2a748-315f-464a-85c4-fd84ab4b5085" returned: 0 in 0.247s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:26:13 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-1c58be2b-820b-4916-a4b8-0b723ecc391e tempest-VolumeQuotasAdminTestJSON-1720405889 None] Lock "cinder-quobyte-b0e2a748-315f-464a-85c4-fd84ab4b5085" released by "delete_volume" :: held 0.709s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:26:13 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-1c58be2b-820b-4916-a4b8-0b723ecc391e tempest-VolumeQuotasAdminTestJSON-1720405889 None] Created reservations ['e2c59cc8-749e-4dbc-927d-fd411d22f2c1', '81864292-defd-44d4-8783-20ccdfc7ee07', '217e4455-59ee-4703-a39c-3076051c6947', '01e2997f-e2f8-4a12-9eba-431b8e1e56ed'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:26:14 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-1c58be2b-820b-4916-a4b8-0b723ecc391e tempest-VolumeQuotasAdminTestJSON-1720405889 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:26:14 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-1c58be2b-820b-4916-a4b8-0b723ecc391e tempest-VolumeQuotasAdminTestJSON-1720405889 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:26:14 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-1c58be2b-820b-4916-a4b8-0b723ecc391e tempest-VolumeQuotasAdminTestJSON-1720405889 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:26:14 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-1c58be2b-820b-4916-a4b8-0b723ecc391e tempest-VolumeQuotasAdminTestJSON-1720405889 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:26:14 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-1c58be2b-820b-4916-a4b8-0b723ecc391e tempest-VolumeQuotasAdminTestJSON-1720405889 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:26:14 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-1c58be2b-820b-4916-a4b8-0b723ecc391e tempest-VolumeQuotasAdminTestJSON-1720405889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:26:14 devstack sudo[105194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce Aug 05 06:26:14 devstack sudo[105194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:26:14 devstack sudo[105194]: pam_unix(sudo:session): session closed for user root Aug 05 06:26:14 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-1c58be2b-820b-4916-a4b8-0b723ecc391e tempest-VolumeQuotasAdminTestJSON-1720405889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce" returned: 0 in 0.257s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:26:14 devstack cinder-volume[88695]: DEBUG cinder.manager [None req-1c58be2b-820b-4916-a4b8-0b723ecc391e tempest-VolumeQuotasAdminTestJSON-1720405889 None] Notifying Schedulers of capabilities ... {{(pid=88695) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 06:26:14 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-1c58be2b-820b-4916-a4b8-0b723ecc391e tempest-VolumeQuotasAdminTestJSON-1720405889 None] Deleted volume successfully. Aug 05 06:26:14 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-1c58be2b-820b-4916-a4b8-0b723ecc391e tempest-VolumeQuotasAdminTestJSON-1720405889 None] Lock "cinder-b0e2a748-315f-464a-85c4-fd84ab4b5085-delete_volume" released by "delete_volume" :: held 1.169s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:26:24 devstack cinder-volume[88695]: DEBUG dbcounter [-] [88695] Writing DB stats cinder:SELECT=22,cinder:UPDATE=31,cinder:INSERT=6,cinder:DELETE=3 {{(pid=88695) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 06:26:24 devstack cinder-volume[88695]: DEBUG dbcounter [-] [88695] Writing DB stats cinder:SELECT=19,cinder:UPDATE=29,cinder:INSERT=8,cinder:DELETE=2 {{(pid=88695) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 06:26:43 devstack cinder-volume[88695]: DEBUG cinder.volume.flows.manager.create_volume [None req-51f05925-5f48-4e62-b006-295ce542a792 tempest-TestStampPattern-1026635927 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88695) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 06:26:43 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-51f05925-5f48-4e62-b006-295ce542a792 tempest-TestStampPattern-1026635927 None] Flow 'volume_create_manager' (3e00ef49-acb8-4abb-8c28-f7c1b9a86963) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:26:43 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-51f05925-5f48-4e62-b006-295ce542a792 tempest-TestStampPattern-1026635927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a98f43dd-b9c2-4878-bcf3-e54f4bdc4ded) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:26:43 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-51f05925-5f48-4e62-b006-295ce542a792 tempest-TestStampPattern-1026635927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a98f43dd-b9c2-4878-bcf3-e54f4bdc4ded) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:26:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-2018719970',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7b0e17f-ef27-406c-84a7-e9e2c18ece55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='137a4e738e5042628029f043090aaff9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:26:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:26:43Z,use_quota=True,user_id='b9e849ea4cc74851bb64674e46270744',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:26:43 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-51f05925-5f48-4e62-b006-295ce542a792 tempest-TestStampPattern-1026635927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37c74195-a28d-49eb-b88b-e6b834436b5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:26:43 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-51f05925-5f48-4e62-b006-295ce542a792 tempest-TestStampPattern-1026635927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37c74195-a28d-49eb-b88b-e6b834436b5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:26:43 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-51f05925-5f48-4e62-b006-295ce542a792 tempest-TestStampPattern-1026635927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b873e03-d6fa-4049-ac80-78e6b3c59470) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:26:43 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-51f05925-5f48-4e62-b006-295ce542a792 tempest-TestStampPattern-1026635927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b873e03-d6fa-4049-ac80-78e6b3c59470) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c7b0e17f-ef27-406c-84a7-e9e2c18ece55', 'volume_name': 'volume-c7b0e17f-ef27-406c-84a7-e9e2c18ece55', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:26:43 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-51f05925-5f48-4e62-b006-295ce542a792 tempest-TestStampPattern-1026635927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6c96dac-48d0-4f97-9256-688eede07f3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:26:43 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-51f05925-5f48-4e62-b006-295ce542a792 tempest-TestStampPattern-1026635927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6c96dac-48d0-4f97-9256-688eede07f3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:26:43 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-51f05925-5f48-4e62-b006-295ce542a792 tempest-TestStampPattern-1026635927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3174f310-70ca-4376-829e-60ce35496517) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:26:43 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-51f05925-5f48-4e62-b006-295ce542a792 tempest-TestStampPattern-1026635927 None] Volume c7b0e17f-ef27-406c-84a7-e9e2c18ece55: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c7b0e17f-ef27-406c-84a7-e9e2c18ece55', 'volume_size': 1} Aug 05 06:26:43 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-51f05925-5f48-4e62-b006-295ce542a792 tempest-TestStampPattern-1026635927 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:26:43 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-51f05925-5f48-4e62-b006-295ce542a792 tempest-TestStampPattern-1026635927 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:26:43 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-51f05925-5f48-4e62-b006-295ce542a792 tempest-TestStampPattern-1026635927 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:26:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-2018719970',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7b0e17f-ef27-406c-84a7-e9e2c18ece55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='137a4e738e5042628029f043090aaff9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:26:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:26:43Z,use_quota=True,user_id='b9e849ea4cc74851bb64674e46270744',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)}" {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 06:26:43 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-51f05925-5f48-4e62-b006-295ce542a792 tempest-TestStampPattern-1026635927 None] Creating volume c7b0e17f-ef27-406c-84a7-e9e2c18ece55 {{(pid=88695) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 06:26:43 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-51f05925-5f48-4e62-b006-295ce542a792 tempest-TestStampPattern-1026635927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:26:43 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-51f05925-5f48-4e62-b006-295ce542a792 tempest-TestStampPattern-1026635927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:26:43 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-51f05925-5f48-4e62-b006-295ce542a792 tempest-TestStampPattern-1026635927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:26:43 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-51f05925-5f48-4e62-b006-295ce542a792 tempest-TestStampPattern-1026635927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:26:43 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-51f05925-5f48-4e62-b006-295ce542a792 tempest-TestStampPattern-1026635927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:26:43 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-51f05925-5f48-4e62-b006-295ce542a792 tempest-TestStampPattern-1026635927 None] Selected osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 as target Quobyte volume. {{(pid=88695) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 06:26:43 devstack cinder-volume[88695]: INFO cinder.volume.drivers.remotefs [None req-51f05925-5f48-4e62-b006-295ce542a792 tempest-TestStampPattern-1026635927 None] casted to osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 Aug 05 06:26:43 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-51f05925-5f48-4e62-b006-295ce542a792 tempest-TestStampPattern-1026635927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-c7b0e17f-ef27-406c-84a7-e9e2c18ece55 1073741824 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:26:43 devstack sudo[105240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-c7b0e17f-ef27-406c-84a7-e9e2c18ece55 1073741824 Aug 05 06:26:43 devstack sudo[105240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:26:44 devstack sudo[105240]: pam_unix(sudo:session): session closed for user root Aug 05 06:26:44 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-51f05925-5f48-4e62-b006-295ce542a792 tempest-TestStampPattern-1026635927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-c7b0e17f-ef27-406c-84a7-e9e2c18ece55 1073741824" returned: 0 in 0.563s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:26:44 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-51f05925-5f48-4e62-b006-295ce542a792 tempest-TestStampPattern-1026635927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-c7b0e17f-ef27-406c-84a7-e9e2c18ece55 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:26:44 devstack sudo[105246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-c7b0e17f-ef27-406c-84a7-e9e2c18ece55 Aug 05 06:26:44 devstack sudo[105246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:26:44 devstack sudo[105246]: pam_unix(sudo:session): session closed for user root Aug 05 06:26:44 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-51f05925-5f48-4e62-b006-295ce542a792 tempest-TestStampPattern-1026635927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-c7b0e17f-ef27-406c-84a7-e9e2c18ece55" returned: 0 in 0.383s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:26:44 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-51f05925-5f48-4e62-b006-295ce542a792 tempest-TestStampPattern-1026635927 None] <== create_volume: return (1001ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'} {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 06:26:44 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-51f05925-5f48-4e62-b006-295ce542a792 tempest-TestStampPattern-1026635927 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.004s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:26:44 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-51f05925-5f48-4e62-b006-295ce542a792 tempest-TestStampPattern-1026635927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3174f310-70ca-4376-829e-60ce35496517) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7b0e17f-ef27-406c-84a7-e9e2c18ece55', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:26:44 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-51f05925-5f48-4e62-b006-295ce542a792 tempest-TestStampPattern-1026635927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8cb5faf-6822-4355-9526-e121448996e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:26:44 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-51f05925-5f48-4e62-b006-295ce542a792 tempest-TestStampPattern-1026635927 None] Volume volume-c7b0e17f-ef27-406c-84a7-e9e2c18ece55 (c7b0e17f-ef27-406c-84a7-e9e2c18ece55): created successfully Aug 05 06:26:44 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-51f05925-5f48-4e62-b006-295ce542a792 tempest-TestStampPattern-1026635927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8cb5faf-6822-4355-9526-e121448996e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:26:44 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-51f05925-5f48-4e62-b006-295ce542a792 tempest-TestStampPattern-1026635927 None] Flow 'volume_create_manager' (3e00ef49-acb8-4abb-8c28-f7c1b9a86963) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:26:44 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-51f05925-5f48-4e62-b006-295ce542a792 tempest-TestStampPattern-1026635927 None] Created volume successfully. Aug 05 06:26:54 devstack cinder-volume[88695]: DEBUG dbcounter [-] [88695] Writing DB stats cinder:SELECT=4,cinder:UPDATE=2 {{(pid=88695) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 06:26:54 devstack cinder-volume[88695]: DEBUG dbcounter [-] [88695] Writing DB stats cinder:UPDATE=4,cinder:INSERT=1,cinder:DELETE=1 {{(pid=88695) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 06:27:00 devstack cinder-volume[88695]: DEBUG oslo_service.periodic_task [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88695) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 06:27:00 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:27:00 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:27:00 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:27:00 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:27:00 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:27:00 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:27:00 devstack sudo[105364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce Aug 05 06:27:00 devstack sudo[105364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:27:00 devstack sudo[105364]: pam_unix(sudo:session): session closed for user root Aug 05 06:27:00 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce" returned: 0 in 0.488s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:27:00 devstack cinder-volume[88695]: DEBUG cinder.manager [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] Notifying Schedulers of capabilities ... {{(pid=88695) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 06:27:00 devstack cinder-volume[88695]: DEBUG oslo_service.periodic_task [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] Running periodic task VolumeManager._thread_info {{(pid=88695) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 06:27:00 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] thread count: 28 {{(pid=88695) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 05 06:27:00 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] thread info: [<_MainThread(MainThread, started 134469211893888)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88695) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 05 06:27:08 devstack cinder-volume[88695]: DEBUG cinder.volume.flows.manager.create_volume [None req-b65b956b-f103-4d08-8483-ef9251907ad0 tempest-VolumesActionsTest-199631217 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88695) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 06:27:08 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-b65b956b-f103-4d08-8483-ef9251907ad0 tempest-VolumesActionsTest-199631217 None] Flow 'volume_create_manager' (004e6f05-dd80-4bbc-a88b-3b2d4eb43b50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:27:08 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-b65b956b-f103-4d08-8483-ef9251907ad0 tempest-VolumesActionsTest-199631217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (092a7775-b04d-4dc3-9765-82d06a83b53d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:27:08 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-b65b956b-f103-4d08-8483-ef9251907ad0 tempest-VolumesActionsTest-199631217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (092a7775-b04d-4dc3-9765-82d06a83b53d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:27:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-170039482',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=788f53d7-24fa-4a60-a5db-601d43121e6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c06f18fd2cba47dba692e7c512010699',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:27:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:27:08Z,use_quota=True,user_id='488418aa4de54217a05d643e862f1b4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:27:08 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-b65b956b-f103-4d08-8483-ef9251907ad0 tempest-VolumesActionsTest-199631217 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d44be84a-ee83-40b8-a1c8-ce57618febde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:27:08 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-b65b956b-f103-4d08-8483-ef9251907ad0 tempest-VolumesActionsTest-199631217 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d44be84a-ee83-40b8-a1c8-ce57618febde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:27:08 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-b65b956b-f103-4d08-8483-ef9251907ad0 tempest-VolumesActionsTest-199631217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb078caf-09fd-41e4-9c58-aa24b31ec503) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:27:08 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-b65b956b-f103-4d08-8483-ef9251907ad0 tempest-VolumesActionsTest-199631217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb078caf-09fd-41e4-9c58-aa24b31ec503) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '788f53d7-24fa-4a60-a5db-601d43121e6f', 'volume_name': 'volume-788f53d7-24fa-4a60-a5db-601d43121e6f', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:27:08 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-b65b956b-f103-4d08-8483-ef9251907ad0 tempest-VolumesActionsTest-199631217 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1eb361e-a9ee-4dd0-89fc-7628ea926c2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:27:08 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-b65b956b-f103-4d08-8483-ef9251907ad0 tempest-VolumesActionsTest-199631217 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1eb361e-a9ee-4dd0-89fc-7628ea926c2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:27:08 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-b65b956b-f103-4d08-8483-ef9251907ad0 tempest-VolumesActionsTest-199631217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc61a0b7-c117-475f-9cdd-6181a905b6ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:27:08 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-b65b956b-f103-4d08-8483-ef9251907ad0 tempest-VolumesActionsTest-199631217 None] Volume 788f53d7-24fa-4a60-a5db-601d43121e6f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-788f53d7-24fa-4a60-a5db-601d43121e6f', 'volume_size': 1} Aug 05 06:27:08 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-b65b956b-f103-4d08-8483-ef9251907ad0 tempest-VolumesActionsTest-199631217 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:27:08 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-b65b956b-f103-4d08-8483-ef9251907ad0 tempest-VolumesActionsTest-199631217 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:27:08 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-b65b956b-f103-4d08-8483-ef9251907ad0 tempest-VolumesActionsTest-199631217 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:27:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-170039482',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=788f53d7-24fa-4a60-a5db-601d43121e6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c06f18fd2cba47dba692e7c512010699',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:27:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:27:08Z,use_quota=True,user_id='488418aa4de54217a05d643e862f1b4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)}" {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 06:27:08 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-b65b956b-f103-4d08-8483-ef9251907ad0 tempest-VolumesActionsTest-199631217 None] Creating volume 788f53d7-24fa-4a60-a5db-601d43121e6f {{(pid=88695) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 06:27:08 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-b65b956b-f103-4d08-8483-ef9251907ad0 tempest-VolumesActionsTest-199631217 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:27:08 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-b65b956b-f103-4d08-8483-ef9251907ad0 tempest-VolumesActionsTest-199631217 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:27:08 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-b65b956b-f103-4d08-8483-ef9251907ad0 tempest-VolumesActionsTest-199631217 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:27:08 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-b65b956b-f103-4d08-8483-ef9251907ad0 tempest-VolumesActionsTest-199631217 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:27:08 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-b65b956b-f103-4d08-8483-ef9251907ad0 tempest-VolumesActionsTest-199631217 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:27:08 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-b65b956b-f103-4d08-8483-ef9251907ad0 tempest-VolumesActionsTest-199631217 None] Selected osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 as target Quobyte volume. {{(pid=88695) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 06:27:08 devstack cinder-volume[88695]: INFO cinder.volume.drivers.remotefs [None req-b65b956b-f103-4d08-8483-ef9251907ad0 tempest-VolumesActionsTest-199631217 None] casted to osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 Aug 05 06:27:08 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-b65b956b-f103-4d08-8483-ef9251907ad0 tempest-VolumesActionsTest-199631217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-788f53d7-24fa-4a60-a5db-601d43121e6f 1073741824 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:27:08 devstack sudo[105508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-788f53d7-24fa-4a60-a5db-601d43121e6f 1073741824 Aug 05 06:27:08 devstack sudo[105508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:27:08 devstack sudo[105508]: pam_unix(sudo:session): session closed for user root Aug 05 06:27:08 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-b65b956b-f103-4d08-8483-ef9251907ad0 tempest-VolumesActionsTest-199631217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-788f53d7-24fa-4a60-a5db-601d43121e6f 1073741824" returned: 0 in 0.451s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:27:08 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-b65b956b-f103-4d08-8483-ef9251907ad0 tempest-VolumesActionsTest-199631217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-788f53d7-24fa-4a60-a5db-601d43121e6f {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:27:08 devstack sudo[105514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-788f53d7-24fa-4a60-a5db-601d43121e6f Aug 05 06:27:08 devstack sudo[105514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:27:08 devstack sudo[105514]: pam_unix(sudo:session): session closed for user root Aug 05 06:27:08 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-b65b956b-f103-4d08-8483-ef9251907ad0 tempest-VolumesActionsTest-199631217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-788f53d7-24fa-4a60-a5db-601d43121e6f" returned: 0 in 0.273s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:27:08 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-b65b956b-f103-4d08-8483-ef9251907ad0 tempest-VolumesActionsTest-199631217 None] <== create_volume: return (769ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'} {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 06:27:08 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-b65b956b-f103-4d08-8483-ef9251907ad0 tempest-VolumesActionsTest-199631217 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.773s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:27:08 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-b65b956b-f103-4d08-8483-ef9251907ad0 tempest-VolumesActionsTest-199631217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc61a0b7-c117-475f-9cdd-6181a905b6ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-788f53d7-24fa-4a60-a5db-601d43121e6f', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:27:08 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-b65b956b-f103-4d08-8483-ef9251907ad0 tempest-VolumesActionsTest-199631217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cf8316d-97bc-4d8f-87da-0a3805ac7da5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:27:08 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-b65b956b-f103-4d08-8483-ef9251907ad0 tempest-VolumesActionsTest-199631217 None] Volume volume-788f53d7-24fa-4a60-a5db-601d43121e6f (788f53d7-24fa-4a60-a5db-601d43121e6f): created successfully Aug 05 06:27:08 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-b65b956b-f103-4d08-8483-ef9251907ad0 tempest-VolumesActionsTest-199631217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cf8316d-97bc-4d8f-87da-0a3805ac7da5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:27:09 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-b65b956b-f103-4d08-8483-ef9251907ad0 tempest-VolumesActionsTest-199631217 None] Flow 'volume_create_manager' (004e6f05-dd80-4bbc-a88b-3b2d4eb43b50) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:27:09 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-b65b956b-f103-4d08-8483-ef9251907ad0 tempest-VolumesActionsTest-199631217 None] Created volume successfully. Aug 05 06:27:10 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-191bdf4b-4bed-4528-8c75-442b2d7226a5 tempest-VolumesActionsTest-199631217 None] Acquiring lock "cinder-788f53d7-24fa-4a60-a5db-601d43121e6f" by "attach_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:27:10 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-191bdf4b-4bed-4528-8c75-442b2d7226a5 tempest-VolumesActionsTest-199631217 None] Lock "cinder-788f53d7-24fa-4a60-a5db-601d43121e6f" acquired by "attach_volume" :: waited 0.018s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:27:10 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-191bdf4b-4bed-4528-8c75-442b2d7226a5 tempest-VolumesActionsTest-199631217 None] Attaching volume 788f53d7-24fa-4a60-a5db-601d43121e6f to instance 0221cfb2-9ca6-4b82-906f-777d70ecb4a0 at mountpoint /dev/vdb on host None. Aug 05 06:27:10 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-191bdf4b-4bed-4528-8c75-442b2d7226a5 tempest-VolumesActionsTest-199631217 None] Attach volume completed successfully. Aug 05 06:27:10 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-191bdf4b-4bed-4528-8c75-442b2d7226a5 tempest-VolumesActionsTest-199631217 None] Lock "cinder-788f53d7-24fa-4a60-a5db-601d43121e6f" released by "attach_volume" :: held 0.094s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:27:10 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-601cb2a1-0402-46cc-82b0-865ca53d2736 tempest-VolumesActionsTest-943160540 None] Terminate volume connection completed successfully. Aug 05 06:27:10 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-601cb2a1-0402-46cc-82b0-865ca53d2736 tempest-VolumesActionsTest-943160540 None] Acquiring lock "cinder-788f53d7-24fa-4a60-a5db-601d43121e6f-detach_volume" by "detach_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:27:10 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-601cb2a1-0402-46cc-82b0-865ca53d2736 tempest-VolumesActionsTest-943160540 None] Lock "cinder-788f53d7-24fa-4a60-a5db-601d43121e6f-detach_volume" acquired by "detach_volume" :: waited 0.017s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:27:10 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-601cb2a1-0402-46cc-82b0-865ca53d2736 tempest-VolumesActionsTest-943160540 None] Detaching volume 788f53d7-24fa-4a60-a5db-601d43121e6f from instance 0221cfb2-9ca6-4b82-906f-777d70ecb4a0. Aug 05 06:27:10 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-601cb2a1-0402-46cc-82b0-865ca53d2736 tempest-VolumesActionsTest-943160540 None] Detach volume completed successfully. Aug 05 06:27:10 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-601cb2a1-0402-46cc-82b0-865ca53d2736 tempest-VolumesActionsTest-943160540 None] Lock "cinder-788f53d7-24fa-4a60-a5db-601d43121e6f-detach_volume" released by "detach_volume" :: held 0.068s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:27:11 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-ffeda22f-c444-463e-87da-d675f5556dfa tempest-VolumesActionsTest-199631217 None] Acquiring lock "cinder-788f53d7-24fa-4a60-a5db-601d43121e6f-detach_volume" by "detach_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:27:11 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-ffeda22f-c444-463e-87da-d675f5556dfa tempest-VolumesActionsTest-199631217 None] Lock "cinder-788f53d7-24fa-4a60-a5db-601d43121e6f-detach_volume" acquired by "detach_volume" :: waited 0.023s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:27:11 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-ffeda22f-c444-463e-87da-d675f5556dfa tempest-VolumesActionsTest-199631217 None] Volume detach called, but volume not attached. Aug 05 06:27:11 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-ffeda22f-c444-463e-87da-d675f5556dfa tempest-VolumesActionsTest-199631217 None] Lock "cinder-788f53d7-24fa-4a60-a5db-601d43121e6f-detach_volume" released by "detach_volume" :: held 0.022s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:27:11 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-46085adc-7707-4886-901e-bc7119317222 tempest-VolumesActionsTest-199631217 None] Acquiring lock "cinder-788f53d7-24fa-4a60-a5db-601d43121e6f-delete_volume" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:27:11 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-46085adc-7707-4886-901e-bc7119317222 tempest-VolumesActionsTest-199631217 None] Lock "cinder-788f53d7-24fa-4a60-a5db-601d43121e6f-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:27:11 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-46085adc-7707-4886-901e-bc7119317222 tempest-VolumesActionsTest-199631217 None] Acquiring lock "cinder-quobyte-788f53d7-24fa-4a60-a5db-601d43121e6f" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:27:11 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-46085adc-7707-4886-901e-bc7119317222 tempest-VolumesActionsTest-199631217 None] Lock "cinder-quobyte-788f53d7-24fa-4a60-a5db-601d43121e6f" acquired by "delete_volume" :: waited 0.021s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:27:11 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[755b5af8-59f9-4ee6-82af-8ce3cf0c870a]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:27:11 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-46085adc-7707-4886-901e-bc7119317222 tempest-VolumesActionsTest-199631217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-788f53d7-24fa-4a60-a5db-601d43121e6f {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:27:11 devstack sudo[105518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-788f53d7-24fa-4a60-a5db-601d43121e6f Aug 05 06:27:11 devstack sudo[105518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:27:11 devstack sudo[105518]: pam_unix(sudo:session): session closed for user root Aug 05 06:27:11 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-46085adc-7707-4886-901e-bc7119317222 tempest-VolumesActionsTest-199631217 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-788f53d7-24fa-4a60-a5db-601d43121e6f" returned: 0 in 0.388s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:27:11 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-46085adc-7707-4886-901e-bc7119317222 tempest-VolumesActionsTest-199631217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-788f53d7-24fa-4a60-a5db-601d43121e6f {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:27:11 devstack sudo[105523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-788f53d7-24fa-4a60-a5db-601d43121e6f Aug 05 06:27:11 devstack sudo[105523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:27:12 devstack sudo[105523]: pam_unix(sudo:session): session closed for user root Aug 05 06:27:12 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-46085adc-7707-4886-901e-bc7119317222 tempest-VolumesActionsTest-199631217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-788f53d7-24fa-4a60-a5db-601d43121e6f" returned: 0 in 0.272s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:27:12 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-46085adc-7707-4886-901e-bc7119317222 tempest-VolumesActionsTest-199631217 None] Lock "cinder-quobyte-788f53d7-24fa-4a60-a5db-601d43121e6f" released by "delete_volume" :: held 0.708s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:27:12 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-46085adc-7707-4886-901e-bc7119317222 tempest-VolumesActionsTest-199631217 None] Created reservations ['a2d1d153-7b80-4149-a810-d2747cf0695b', '547a3d12-cbe5-4bce-99d0-756026fd3ed1', 'd4e86cd9-d2b6-4cd9-8197-6d002917244a', 'eee57b16-a83b-4286-8ec7-98ec73ed2fe8'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:27:12 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-46085adc-7707-4886-901e-bc7119317222 tempest-VolumesActionsTest-199631217 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:27:12 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-46085adc-7707-4886-901e-bc7119317222 tempest-VolumesActionsTest-199631217 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:27:12 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-46085adc-7707-4886-901e-bc7119317222 tempest-VolumesActionsTest-199631217 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:27:12 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-46085adc-7707-4886-901e-bc7119317222 tempest-VolumesActionsTest-199631217 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:27:12 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-46085adc-7707-4886-901e-bc7119317222 tempest-VolumesActionsTest-199631217 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:27:12 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-46085adc-7707-4886-901e-bc7119317222 tempest-VolumesActionsTest-199631217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:27:12 devstack sudo[105526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce Aug 05 06:27:12 devstack sudo[105526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:27:12 devstack sudo[105526]: pam_unix(sudo:session): session closed for user root Aug 05 06:27:12 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-46085adc-7707-4886-901e-bc7119317222 tempest-VolumesActionsTest-199631217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce" returned: 0 in 0.273s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:27:12 devstack cinder-volume[88695]: DEBUG cinder.manager [None req-46085adc-7707-4886-901e-bc7119317222 tempest-VolumesActionsTest-199631217 None] Notifying Schedulers of capabilities ... {{(pid=88695) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 06:27:12 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-46085adc-7707-4886-901e-bc7119317222 tempest-VolumesActionsTest-199631217 None] Deleted volume successfully. Aug 05 06:27:12 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-46085adc-7707-4886-901e-bc7119317222 tempest-VolumesActionsTest-199631217 None] Lock "cinder-788f53d7-24fa-4a60-a5db-601d43121e6f-delete_volume" released by "delete_volume" :: held 1.212s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:27:15 devstack cinder-volume[88695]: DEBUG cinder.volume.flows.manager.create_volume [None req-3490128d-3513-46a3-aea3-4e646a5d8b7c tempest-VolumesActionsTest-199631217 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88695) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 06:27:15 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-3490128d-3513-46a3-aea3-4e646a5d8b7c tempest-VolumesActionsTest-199631217 None] Flow 'volume_create_manager' (97abee7e-d602-4856-b4d4-dd7c650d6ef9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:27:15 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-3490128d-3513-46a3-aea3-4e646a5d8b7c tempest-VolumesActionsTest-199631217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0cbb8ec-da7f-4e92-be75-df5b2cd58720) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:27:15 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-3490128d-3513-46a3-aea3-4e646a5d8b7c tempest-VolumesActionsTest-199631217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0cbb8ec-da7f-4e92-be75-df5b2cd58720) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:27:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-607895993',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7354a2b1-0689-4bff-902a-73f439871389,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c06f18fd2cba47dba692e7c512010699',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:27:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:27:16Z,use_quota=True,user_id='488418aa4de54217a05d643e862f1b4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:27:15 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-3490128d-3513-46a3-aea3-4e646a5d8b7c tempest-VolumesActionsTest-199631217 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42f4c314-7a79-4f32-8237-8ac8436b86cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:27:15 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-3490128d-3513-46a3-aea3-4e646a5d8b7c tempest-VolumesActionsTest-199631217 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42f4c314-7a79-4f32-8237-8ac8436b86cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:27:15 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-3490128d-3513-46a3-aea3-4e646a5d8b7c tempest-VolumesActionsTest-199631217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f5a1de5-dcc5-4a9f-83b9-97fd67012003) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:27:15 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-3490128d-3513-46a3-aea3-4e646a5d8b7c tempest-VolumesActionsTest-199631217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f5a1de5-dcc5-4a9f-83b9-97fd67012003) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7354a2b1-0689-4bff-902a-73f439871389', 'volume_name': 'volume-7354a2b1-0689-4bff-902a-73f439871389', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:27:15 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-3490128d-3513-46a3-aea3-4e646a5d8b7c tempest-VolumesActionsTest-199631217 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c96ac21d-13e9-4073-91a3-e4a4b66100e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:27:15 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-3490128d-3513-46a3-aea3-4e646a5d8b7c tempest-VolumesActionsTest-199631217 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c96ac21d-13e9-4073-91a3-e4a4b66100e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:27:15 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-3490128d-3513-46a3-aea3-4e646a5d8b7c tempest-VolumesActionsTest-199631217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3004a24f-a4b2-4b81-a8a8-b1ac2a50a17f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:27:15 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-3490128d-3513-46a3-aea3-4e646a5d8b7c tempest-VolumesActionsTest-199631217 None] Volume 7354a2b1-0689-4bff-902a-73f439871389: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7354a2b1-0689-4bff-902a-73f439871389', 'volume_size': 1} Aug 05 06:27:15 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-3490128d-3513-46a3-aea3-4e646a5d8b7c tempest-VolumesActionsTest-199631217 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:27:15 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-3490128d-3513-46a3-aea3-4e646a5d8b7c tempest-VolumesActionsTest-199631217 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:27:15 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-3490128d-3513-46a3-aea3-4e646a5d8b7c tempest-VolumesActionsTest-199631217 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:27:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-607895993',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7354a2b1-0689-4bff-902a-73f439871389,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c06f18fd2cba47dba692e7c512010699',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:27:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:27:16Z,use_quota=True,user_id='488418aa4de54217a05d643e862f1b4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)}" {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 06:27:15 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-3490128d-3513-46a3-aea3-4e646a5d8b7c tempest-VolumesActionsTest-199631217 None] Creating volume 7354a2b1-0689-4bff-902a-73f439871389 {{(pid=88695) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 06:27:15 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-3490128d-3513-46a3-aea3-4e646a5d8b7c tempest-VolumesActionsTest-199631217 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:27:15 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-3490128d-3513-46a3-aea3-4e646a5d8b7c tempest-VolumesActionsTest-199631217 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:27:15 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-3490128d-3513-46a3-aea3-4e646a5d8b7c tempest-VolumesActionsTest-199631217 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:27:15 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-3490128d-3513-46a3-aea3-4e646a5d8b7c tempest-VolumesActionsTest-199631217 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:27:15 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-3490128d-3513-46a3-aea3-4e646a5d8b7c tempest-VolumesActionsTest-199631217 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:27:15 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-3490128d-3513-46a3-aea3-4e646a5d8b7c tempest-VolumesActionsTest-199631217 None] Selected osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 as target Quobyte volume. {{(pid=88695) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 06:27:15 devstack cinder-volume[88695]: INFO cinder.volume.drivers.remotefs [None req-3490128d-3513-46a3-aea3-4e646a5d8b7c tempest-VolumesActionsTest-199631217 None] casted to osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 Aug 05 06:27:15 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-3490128d-3513-46a3-aea3-4e646a5d8b7c tempest-VolumesActionsTest-199631217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7354a2b1-0689-4bff-902a-73f439871389 1073741824 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:27:15 devstack sudo[105555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7354a2b1-0689-4bff-902a-73f439871389 1073741824 Aug 05 06:27:15 devstack sudo[105555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:27:16 devstack sudo[105555]: pam_unix(sudo:session): session closed for user root Aug 05 06:27:16 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-3490128d-3513-46a3-aea3-4e646a5d8b7c tempest-VolumesActionsTest-199631217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7354a2b1-0689-4bff-902a-73f439871389 1073741824" returned: 0 in 0.455s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:27:16 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-3490128d-3513-46a3-aea3-4e646a5d8b7c tempest-VolumesActionsTest-199631217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7354a2b1-0689-4bff-902a-73f439871389 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:27:16 devstack sudo[105561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7354a2b1-0689-4bff-902a-73f439871389 Aug 05 06:27:16 devstack sudo[105561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:27:16 devstack sudo[105561]: pam_unix(sudo:session): session closed for user root Aug 05 06:27:16 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-3490128d-3513-46a3-aea3-4e646a5d8b7c tempest-VolumesActionsTest-199631217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7354a2b1-0689-4bff-902a-73f439871389" returned: 0 in 0.257s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:27:16 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-3490128d-3513-46a3-aea3-4e646a5d8b7c tempest-VolumesActionsTest-199631217 None] <== create_volume: return (758ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'} {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 06:27:16 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-3490128d-3513-46a3-aea3-4e646a5d8b7c tempest-VolumesActionsTest-199631217 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.761s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:27:16 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-3490128d-3513-46a3-aea3-4e646a5d8b7c tempest-VolumesActionsTest-199631217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3004a24f-a4b2-4b81-a8a8-b1ac2a50a17f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7354a2b1-0689-4bff-902a-73f439871389', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:27:16 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-3490128d-3513-46a3-aea3-4e646a5d8b7c tempest-VolumesActionsTest-199631217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7297162-9d0a-4547-aa96-8a0a05618f35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:27:16 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-3490128d-3513-46a3-aea3-4e646a5d8b7c tempest-VolumesActionsTest-199631217 None] Volume volume-7354a2b1-0689-4bff-902a-73f439871389 (7354a2b1-0689-4bff-902a-73f439871389): created successfully Aug 05 06:27:16 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-3490128d-3513-46a3-aea3-4e646a5d8b7c tempest-VolumesActionsTest-199631217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7297162-9d0a-4547-aa96-8a0a05618f35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:27:16 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-3490128d-3513-46a3-aea3-4e646a5d8b7c tempest-VolumesActionsTest-199631217 None] Flow 'volume_create_manager' (97abee7e-d602-4856-b4d4-dd7c650d6ef9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:27:16 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-3490128d-3513-46a3-aea3-4e646a5d8b7c tempest-VolumesActionsTest-199631217 None] Created volume successfully. Aug 05 06:27:16 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-6cbea107-0327-4a30-a29d-4d3a7ea417db tempest-VolumesActionsTest-943160540 None] Acquiring lock "cinder-7354a2b1-0689-4bff-902a-73f439871389-delete_volume" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:27:16 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-6cbea107-0327-4a30-a29d-4d3a7ea417db tempest-VolumesActionsTest-943160540 None] Lock "cinder-7354a2b1-0689-4bff-902a-73f439871389-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:27:17 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-6cbea107-0327-4a30-a29d-4d3a7ea417db tempest-VolumesActionsTest-943160540 None] Acquiring lock "cinder-quobyte-7354a2b1-0689-4bff-902a-73f439871389" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:27:17 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-6cbea107-0327-4a30-a29d-4d3a7ea417db tempest-VolumesActionsTest-943160540 None] Lock "cinder-quobyte-7354a2b1-0689-4bff-902a-73f439871389" acquired by "delete_volume" :: waited 0.017s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:27:17 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c6093a4-f66f-4256-82d0-a14958e19021]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:27:17 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-6cbea107-0327-4a30-a29d-4d3a7ea417db tempest-VolumesActionsTest-943160540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7354a2b1-0689-4bff-902a-73f439871389 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:27:17 devstack sudo[105564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7354a2b1-0689-4bff-902a-73f439871389 Aug 05 06:27:17 devstack sudo[105564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:27:17 devstack sudo[105564]: pam_unix(sudo:session): session closed for user root Aug 05 06:27:17 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-6cbea107-0327-4a30-a29d-4d3a7ea417db tempest-VolumesActionsTest-943160540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7354a2b1-0689-4bff-902a-73f439871389" returned: 0 in 0.393s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:27:17 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-6cbea107-0327-4a30-a29d-4d3a7ea417db tempest-VolumesActionsTest-943160540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7354a2b1-0689-4bff-902a-73f439871389 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:27:17 devstack sudo[105569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7354a2b1-0689-4bff-902a-73f439871389 Aug 05 06:27:17 devstack sudo[105569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:27:17 devstack sudo[105569]: pam_unix(sudo:session): session closed for user root Aug 05 06:27:17 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-6cbea107-0327-4a30-a29d-4d3a7ea417db tempest-VolumesActionsTest-943160540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7354a2b1-0689-4bff-902a-73f439871389" returned: 0 in 0.251s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:27:17 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-6cbea107-0327-4a30-a29d-4d3a7ea417db tempest-VolumesActionsTest-943160540 None] Lock "cinder-quobyte-7354a2b1-0689-4bff-902a-73f439871389" released by "delete_volume" :: held 0.689s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:27:17 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-6cbea107-0327-4a30-a29d-4d3a7ea417db tempest-VolumesActionsTest-943160540 None] Created reservations ['c2f2feb8-ccf9-4d1e-9d51-6260dbe7e16e', '9bcf0d2b-46b4-4b91-a3f5-8fa4a44e0cb1', '2ab31247-7f08-487f-b03c-8b6a47eb038f', 'b7d4aa5d-4218-43eb-924b-115b4546ef90'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:27:17 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-6cbea107-0327-4a30-a29d-4d3a7ea417db tempest-VolumesActionsTest-943160540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:27:17 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-6cbea107-0327-4a30-a29d-4d3a7ea417db tempest-VolumesActionsTest-943160540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:27:17 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-6cbea107-0327-4a30-a29d-4d3a7ea417db tempest-VolumesActionsTest-943160540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:27:17 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-6cbea107-0327-4a30-a29d-4d3a7ea417db tempest-VolumesActionsTest-943160540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:27:17 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-6cbea107-0327-4a30-a29d-4d3a7ea417db tempest-VolumesActionsTest-943160540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:27:17 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-6cbea107-0327-4a30-a29d-4d3a7ea417db tempest-VolumesActionsTest-943160540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:27:17 devstack sudo[105572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce Aug 05 06:27:17 devstack sudo[105572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:27:18 devstack sudo[105572]: pam_unix(sudo:session): session closed for user root Aug 05 06:27:18 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-6cbea107-0327-4a30-a29d-4d3a7ea417db tempest-VolumesActionsTest-943160540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce" returned: 0 in 0.301s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:27:18 devstack cinder-volume[88695]: DEBUG cinder.manager [None req-6cbea107-0327-4a30-a29d-4d3a7ea417db tempest-VolumesActionsTest-943160540 None] Notifying Schedulers of capabilities ... {{(pid=88695) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 06:27:18 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-6cbea107-0327-4a30-a29d-4d3a7ea417db tempest-VolumesActionsTest-943160540 None] Deleted volume successfully. Aug 05 06:27:18 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-6cbea107-0327-4a30-a29d-4d3a7ea417db tempest-VolumesActionsTest-943160540 None] Lock "cinder-7354a2b1-0689-4bff-902a-73f439871389-delete_volume" released by "delete_volume" :: held 1.211s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:27:18 devstack cinder-volume[88695]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc02facc-1e66-4ff4-a897-7d78c2dc67e0 tempest-VolumesActionsTest-199631217 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88695) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 06:27:18 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-fc02facc-1e66-4ff4-a897-7d78c2dc67e0 tempest-VolumesActionsTest-199631217 None] Flow 'volume_create_manager' (9a4d9411-8b22-45fc-9470-f04c802540bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:27:18 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-fc02facc-1e66-4ff4-a897-7d78c2dc67e0 tempest-VolumesActionsTest-199631217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75d0f6dc-a2fc-48d5-b43f-abfe33ad7699) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:27:18 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-fc02facc-1e66-4ff4-a897-7d78c2dc67e0 tempest-VolumesActionsTest-199631217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75d0f6dc-a2fc-48d5-b43f-abfe33ad7699) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:27:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2025856389',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=544c8575-6db8-43df-bf75-37d0ebcbbe35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c06f18fd2cba47dba692e7c512010699',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:27:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:27:19Z,use_quota=True,user_id='488418aa4de54217a05d643e862f1b4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:27:18 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-fc02facc-1e66-4ff4-a897-7d78c2dc67e0 tempest-VolumesActionsTest-199631217 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92024eb3-eb0e-4c29-8b25-9abceeee2e6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:27:18 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-fc02facc-1e66-4ff4-a897-7d78c2dc67e0 tempest-VolumesActionsTest-199631217 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92024eb3-eb0e-4c29-8b25-9abceeee2e6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:27:18 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-fc02facc-1e66-4ff4-a897-7d78c2dc67e0 tempest-VolumesActionsTest-199631217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (561a1742-ec13-4bd7-b92e-2728721eb3cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:27:18 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-fc02facc-1e66-4ff4-a897-7d78c2dc67e0 tempest-VolumesActionsTest-199631217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (561a1742-ec13-4bd7-b92e-2728721eb3cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '544c8575-6db8-43df-bf75-37d0ebcbbe35', 'volume_name': 'volume-544c8575-6db8-43df-bf75-37d0ebcbbe35', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:27:18 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-fc02facc-1e66-4ff4-a897-7d78c2dc67e0 tempest-VolumesActionsTest-199631217 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14cbed9c-1088-409d-b371-f9438ad0ffec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:27:18 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-fc02facc-1e66-4ff4-a897-7d78c2dc67e0 tempest-VolumesActionsTest-199631217 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14cbed9c-1088-409d-b371-f9438ad0ffec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:27:18 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-fc02facc-1e66-4ff4-a897-7d78c2dc67e0 tempest-VolumesActionsTest-199631217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2ee7a54-f12e-4e92-a09e-c7d607ad5f76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:27:18 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-fc02facc-1e66-4ff4-a897-7d78c2dc67e0 tempest-VolumesActionsTest-199631217 None] Volume 544c8575-6db8-43df-bf75-37d0ebcbbe35: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-544c8575-6db8-43df-bf75-37d0ebcbbe35', 'volume_size': 1} Aug 05 06:27:18 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-fc02facc-1e66-4ff4-a897-7d78c2dc67e0 tempest-VolumesActionsTest-199631217 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:27:18 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-fc02facc-1e66-4ff4-a897-7d78c2dc67e0 tempest-VolumesActionsTest-199631217 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:27:18 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-fc02facc-1e66-4ff4-a897-7d78c2dc67e0 tempest-VolumesActionsTest-199631217 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:27:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2025856389',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=544c8575-6db8-43df-bf75-37d0ebcbbe35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c06f18fd2cba47dba692e7c512010699',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:27:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:27:19Z,use_quota=True,user_id='488418aa4de54217a05d643e862f1b4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)}" {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 06:27:18 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-fc02facc-1e66-4ff4-a897-7d78c2dc67e0 tempest-VolumesActionsTest-199631217 None] Creating volume 544c8575-6db8-43df-bf75-37d0ebcbbe35 {{(pid=88695) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 06:27:18 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-fc02facc-1e66-4ff4-a897-7d78c2dc67e0 tempest-VolumesActionsTest-199631217 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:27:18 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-fc02facc-1e66-4ff4-a897-7d78c2dc67e0 tempest-VolumesActionsTest-199631217 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:27:18 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-fc02facc-1e66-4ff4-a897-7d78c2dc67e0 tempest-VolumesActionsTest-199631217 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:27:18 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-fc02facc-1e66-4ff4-a897-7d78c2dc67e0 tempest-VolumesActionsTest-199631217 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:27:18 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-fc02facc-1e66-4ff4-a897-7d78c2dc67e0 tempest-VolumesActionsTest-199631217 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:27:18 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-fc02facc-1e66-4ff4-a897-7d78c2dc67e0 tempest-VolumesActionsTest-199631217 None] Selected osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 as target Quobyte volume. {{(pid=88695) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 06:27:18 devstack cinder-volume[88695]: INFO cinder.volume.drivers.remotefs [None req-fc02facc-1e66-4ff4-a897-7d78c2dc67e0 tempest-VolumesActionsTest-199631217 None] casted to osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 Aug 05 06:27:18 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-fc02facc-1e66-4ff4-a897-7d78c2dc67e0 tempest-VolumesActionsTest-199631217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-544c8575-6db8-43df-bf75-37d0ebcbbe35 1073741824 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:27:18 devstack sudo[105576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-544c8575-6db8-43df-bf75-37d0ebcbbe35 1073741824 Aug 05 06:27:18 devstack sudo[105576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:27:19 devstack sudo[105576]: pam_unix(sudo:session): session closed for user root Aug 05 06:27:19 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-fc02facc-1e66-4ff4-a897-7d78c2dc67e0 tempest-VolumesActionsTest-199631217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-544c8575-6db8-43df-bf75-37d0ebcbbe35 1073741824" returned: 0 in 0.440s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:27:19 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-fc02facc-1e66-4ff4-a897-7d78c2dc67e0 tempest-VolumesActionsTest-199631217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-544c8575-6db8-43df-bf75-37d0ebcbbe35 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:27:19 devstack sudo[105581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-544c8575-6db8-43df-bf75-37d0ebcbbe35 Aug 05 06:27:19 devstack sudo[105581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:27:19 devstack sudo[105581]: pam_unix(sudo:session): session closed for user root Aug 05 06:27:19 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-fc02facc-1e66-4ff4-a897-7d78c2dc67e0 tempest-VolumesActionsTest-199631217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-544c8575-6db8-43df-bf75-37d0ebcbbe35" returned: 0 in 0.256s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:27:19 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-fc02facc-1e66-4ff4-a897-7d78c2dc67e0 tempest-VolumesActionsTest-199631217 None] <== create_volume: return (736ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'} {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 06:27:19 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-fc02facc-1e66-4ff4-a897-7d78c2dc67e0 tempest-VolumesActionsTest-199631217 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.738s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:27:19 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-fc02facc-1e66-4ff4-a897-7d78c2dc67e0 tempest-VolumesActionsTest-199631217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2ee7a54-f12e-4e92-a09e-c7d607ad5f76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-544c8575-6db8-43df-bf75-37d0ebcbbe35', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:27:19 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-fc02facc-1e66-4ff4-a897-7d78c2dc67e0 tempest-VolumesActionsTest-199631217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b67290be-9d28-48e6-8cb1-4ece7e70f2d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:27:19 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-fc02facc-1e66-4ff4-a897-7d78c2dc67e0 tempest-VolumesActionsTest-199631217 None] Volume volume-544c8575-6db8-43df-bf75-37d0ebcbbe35 (544c8575-6db8-43df-bf75-37d0ebcbbe35): created successfully Aug 05 06:27:19 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-fc02facc-1e66-4ff4-a897-7d78c2dc67e0 tempest-VolumesActionsTest-199631217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b67290be-9d28-48e6-8cb1-4ece7e70f2d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:27:19 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-fc02facc-1e66-4ff4-a897-7d78c2dc67e0 tempest-VolumesActionsTest-199631217 None] Flow 'volume_create_manager' (9a4d9411-8b22-45fc-9470-f04c802540bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:27:19 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-fc02facc-1e66-4ff4-a897-7d78c2dc67e0 tempest-VolumesActionsTest-199631217 None] Created volume successfully. Aug 05 06:27:19 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-b728fac6-0fc0-44de-b157-124afda216ce tempest-VolumesActionsTest-943160540 None] Acquiring lock "cinder-544c8575-6db8-43df-bf75-37d0ebcbbe35-delete_volume" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:27:19 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-b728fac6-0fc0-44de-b157-124afda216ce tempest-VolumesActionsTest-943160540 None] Lock "cinder-544c8575-6db8-43df-bf75-37d0ebcbbe35-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:27:19 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-b728fac6-0fc0-44de-b157-124afda216ce tempest-VolumesActionsTest-943160540 None] Acquiring lock "cinder-quobyte-544c8575-6db8-43df-bf75-37d0ebcbbe35" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:27:19 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-b728fac6-0fc0-44de-b157-124afda216ce tempest-VolumesActionsTest-943160540 None] Lock "cinder-quobyte-544c8575-6db8-43df-bf75-37d0ebcbbe35" acquired by "delete_volume" :: waited 0.014s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:27:19 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcf39aa3-d660-471e-a5a2-875712e1a2cd]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:27:19 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-b728fac6-0fc0-44de-b157-124afda216ce tempest-VolumesActionsTest-943160540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-544c8575-6db8-43df-bf75-37d0ebcbbe35 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:27:19 devstack sudo[105584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-544c8575-6db8-43df-bf75-37d0ebcbbe35 Aug 05 06:27:19 devstack sudo[105584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:27:20 devstack sudo[105584]: pam_unix(sudo:session): session closed for user root Aug 05 06:27:20 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-b728fac6-0fc0-44de-b157-124afda216ce tempest-VolumesActionsTest-943160540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-544c8575-6db8-43df-bf75-37d0ebcbbe35" returned: 0 in 0.363s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:27:20 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-b728fac6-0fc0-44de-b157-124afda216ce tempest-VolumesActionsTest-943160540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-544c8575-6db8-43df-bf75-37d0ebcbbe35 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:27:20 devstack sudo[105591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-544c8575-6db8-43df-bf75-37d0ebcbbe35 Aug 05 06:27:20 devstack sudo[105591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:27:20 devstack sudo[105591]: pam_unix(sudo:session): session closed for user root Aug 05 06:27:20 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-b728fac6-0fc0-44de-b157-124afda216ce tempest-VolumesActionsTest-943160540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-544c8575-6db8-43df-bf75-37d0ebcbbe35" returned: 0 in 0.265s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:27:20 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-b728fac6-0fc0-44de-b157-124afda216ce tempest-VolumesActionsTest-943160540 None] Lock "cinder-quobyte-544c8575-6db8-43df-bf75-37d0ebcbbe35" released by "delete_volume" :: held 0.664s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:27:20 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-b728fac6-0fc0-44de-b157-124afda216ce tempest-VolumesActionsTest-943160540 None] Created reservations ['b74c9f9e-ff52-4875-8cac-ea6805a4409c', '4486cf43-e632-4844-b823-b5aeb9a00251', '3051475b-0808-436f-aa96-da8522fe2ab7', 'e1d4260b-7ebc-487d-97a6-805b98411dbe'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:27:20 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-b728fac6-0fc0-44de-b157-124afda216ce tempest-VolumesActionsTest-943160540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:27:20 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-b728fac6-0fc0-44de-b157-124afda216ce tempest-VolumesActionsTest-943160540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:27:20 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-b728fac6-0fc0-44de-b157-124afda216ce tempest-VolumesActionsTest-943160540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:27:20 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-b728fac6-0fc0-44de-b157-124afda216ce tempest-VolumesActionsTest-943160540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:27:20 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-b728fac6-0fc0-44de-b157-124afda216ce tempest-VolumesActionsTest-943160540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:27:20 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-b728fac6-0fc0-44de-b157-124afda216ce tempest-VolumesActionsTest-943160540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:27:20 devstack sudo[105599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce Aug 05 06:27:20 devstack sudo[105599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:27:20 devstack sudo[105599]: pam_unix(sudo:session): session closed for user root Aug 05 06:27:20 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-b728fac6-0fc0-44de-b157-124afda216ce tempest-VolumesActionsTest-943160540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce" returned: 0 in 0.259s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:27:20 devstack cinder-volume[88695]: DEBUG cinder.manager [None req-b728fac6-0fc0-44de-b157-124afda216ce tempest-VolumesActionsTest-943160540 None] Notifying Schedulers of capabilities ... {{(pid=88695) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 06:27:20 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-b728fac6-0fc0-44de-b157-124afda216ce tempest-VolumesActionsTest-943160540 None] Deleted volume successfully. Aug 05 06:27:20 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-b728fac6-0fc0-44de-b157-124afda216ce tempest-VolumesActionsTest-943160540 None] Lock "cinder-544c8575-6db8-43df-bf75-37d0ebcbbe35-delete_volume" released by "delete_volume" :: held 1.154s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:27:21 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [req-c2459689-1f70-4db7-b445-7f73b339e176 req-64e0c6ff-54ae-4dfb-acf5-1d757fe07c47 tempest-TestStampPattern-1026635927 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:27:21 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [req-c2459689-1f70-4db7-b445-7f73b339e176 req-64e0c6ff-54ae-4dfb-acf5-1d757fe07c47 tempest-TestStampPattern-1026635927 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:27:21 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [req-c2459689-1f70-4db7-b445-7f73b339e176 req-64e0c6ff-54ae-4dfb-acf5-1d757fe07c47 tempest-TestStampPattern-1026635927 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:27:21 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [req-c2459689-1f70-4db7-b445-7f73b339e176 req-64e0c6ff-54ae-4dfb-acf5-1d757fe07c47 tempest-TestStampPattern-1026635927 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087', 'name': 'volume-c7b0e17f-ef27-406c-84a7-e9e2c18ece55', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '790f3381-45de-4d1c-8a94-d0d953c2b675', 'enforce_multipath': True} {{(pid=88695) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 05 06:27:21 devstack cinder-volume[88695]: INFO cinder.volume.manager [req-c2459689-1f70-4db7-b445-7f73b339e176 req-64e0c6ff-54ae-4dfb-acf5-1d757fe07c47 tempest-TestStampPattern-1026635927 None] attachment_update completed successfully. Aug 05 06:27:21 devstack cinder-volume[88695]: DEBUG cinder.volume.flows.manager.create_volume [None req-5486fc1f-b9e0-47c1-8e15-a6fdd979c779 tempest-VolumesActionsTest-199631217 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88695) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 06:27:21 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-5486fc1f-b9e0-47c1-8e15-a6fdd979c779 tempest-VolumesActionsTest-199631217 None] Flow 'volume_create_manager' (825ae9aa-1ef1-4d2f-88ef-915e550357bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:27:21 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-5486fc1f-b9e0-47c1-8e15-a6fdd979c779 tempest-VolumesActionsTest-199631217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11db5c6a-c6a0-436e-ba7a-dae5037620c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:27:21 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-5486fc1f-b9e0-47c1-8e15-a6fdd979c779 tempest-VolumesActionsTest-199631217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11db5c6a-c6a0-436e-ba7a-dae5037620c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:27:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1860330658',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0d79d0f-f1a2-4edc-8f2a-193b958798fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c06f18fd2cba47dba692e7c512010699',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:27:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:27:22Z,use_quota=True,user_id='488418aa4de54217a05d643e862f1b4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:27:21 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-5486fc1f-b9e0-47c1-8e15-a6fdd979c779 tempest-VolumesActionsTest-199631217 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3485d850-2dbc-456c-8590-91b17078cf0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:27:21 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-5486fc1f-b9e0-47c1-8e15-a6fdd979c779 tempest-VolumesActionsTest-199631217 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3485d850-2dbc-456c-8590-91b17078cf0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:27:21 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-5486fc1f-b9e0-47c1-8e15-a6fdd979c779 tempest-VolumesActionsTest-199631217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d5842d4-277f-489a-961a-40f7f4dc1738) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:27:21 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-5486fc1f-b9e0-47c1-8e15-a6fdd979c779 tempest-VolumesActionsTest-199631217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d5842d4-277f-489a-961a-40f7f4dc1738) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd0d79d0f-f1a2-4edc-8f2a-193b958798fa', 'volume_name': 'volume-d0d79d0f-f1a2-4edc-8f2a-193b958798fa', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:27:21 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-5486fc1f-b9e0-47c1-8e15-a6fdd979c779 tempest-VolumesActionsTest-199631217 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b556e48-4050-448c-9640-246122275434) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:27:21 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-5486fc1f-b9e0-47c1-8e15-a6fdd979c779 tempest-VolumesActionsTest-199631217 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b556e48-4050-448c-9640-246122275434) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:27:21 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-5486fc1f-b9e0-47c1-8e15-a6fdd979c779 tempest-VolumesActionsTest-199631217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (172a3e24-4d1c-409b-8e6a-c2e0d7882699) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:27:21 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-5486fc1f-b9e0-47c1-8e15-a6fdd979c779 tempest-VolumesActionsTest-199631217 None] Volume d0d79d0f-f1a2-4edc-8f2a-193b958798fa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d0d79d0f-f1a2-4edc-8f2a-193b958798fa', 'volume_size': 1} Aug 05 06:27:21 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-5486fc1f-b9e0-47c1-8e15-a6fdd979c779 tempest-VolumesActionsTest-199631217 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:27:21 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-5486fc1f-b9e0-47c1-8e15-a6fdd979c779 tempest-VolumesActionsTest-199631217 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:27:21 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-5486fc1f-b9e0-47c1-8e15-a6fdd979c779 tempest-VolumesActionsTest-199631217 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:27:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1860330658',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0d79d0f-f1a2-4edc-8f2a-193b958798fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c06f18fd2cba47dba692e7c512010699',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:27:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:27:22Z,use_quota=True,user_id='488418aa4de54217a05d643e862f1b4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)}" {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 06:27:21 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-5486fc1f-b9e0-47c1-8e15-a6fdd979c779 tempest-VolumesActionsTest-199631217 None] Creating volume d0d79d0f-f1a2-4edc-8f2a-193b958798fa {{(pid=88695) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 06:27:21 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-5486fc1f-b9e0-47c1-8e15-a6fdd979c779 tempest-VolumesActionsTest-199631217 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:27:21 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-5486fc1f-b9e0-47c1-8e15-a6fdd979c779 tempest-VolumesActionsTest-199631217 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:27:21 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-5486fc1f-b9e0-47c1-8e15-a6fdd979c779 tempest-VolumesActionsTest-199631217 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:27:21 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-5486fc1f-b9e0-47c1-8e15-a6fdd979c779 tempest-VolumesActionsTest-199631217 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:27:21 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-5486fc1f-b9e0-47c1-8e15-a6fdd979c779 tempest-VolumesActionsTest-199631217 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:27:21 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-5486fc1f-b9e0-47c1-8e15-a6fdd979c779 tempest-VolumesActionsTest-199631217 None] Selected osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 as target Quobyte volume. {{(pid=88695) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 06:27:21 devstack cinder-volume[88695]: INFO cinder.volume.drivers.remotefs [None req-5486fc1f-b9e0-47c1-8e15-a6fdd979c779 tempest-VolumesActionsTest-199631217 None] casted to osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 Aug 05 06:27:21 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-5486fc1f-b9e0-47c1-8e15-a6fdd979c779 tempest-VolumesActionsTest-199631217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-d0d79d0f-f1a2-4edc-8f2a-193b958798fa 1073741824 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:27:21 devstack sudo[105675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-d0d79d0f-f1a2-4edc-8f2a-193b958798fa 1073741824 Aug 05 06:27:21 devstack sudo[105675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:27:22 devstack sudo[105675]: pam_unix(sudo:session): session closed for user root Aug 05 06:27:22 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-5486fc1f-b9e0-47c1-8e15-a6fdd979c779 tempest-VolumesActionsTest-199631217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-d0d79d0f-f1a2-4edc-8f2a-193b958798fa 1073741824" returned: 0 in 0.523s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:27:22 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-5486fc1f-b9e0-47c1-8e15-a6fdd979c779 tempest-VolumesActionsTest-199631217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-d0d79d0f-f1a2-4edc-8f2a-193b958798fa {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:27:22 devstack sudo[106001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-d0d79d0f-f1a2-4edc-8f2a-193b958798fa Aug 05 06:27:22 devstack sudo[106001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:27:22 devstack sudo[106001]: pam_unix(sudo:session): session closed for user root Aug 05 06:27:22 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-5486fc1f-b9e0-47c1-8e15-a6fdd979c779 tempest-VolumesActionsTest-199631217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-d0d79d0f-f1a2-4edc-8f2a-193b958798fa" returned: 0 in 0.307s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:27:22 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-5486fc1f-b9e0-47c1-8e15-a6fdd979c779 tempest-VolumesActionsTest-199631217 None] <== create_volume: return (901ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'} {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 06:27:22 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-5486fc1f-b9e0-47c1-8e15-a6fdd979c779 tempest-VolumesActionsTest-199631217 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.904s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:27:22 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-5486fc1f-b9e0-47c1-8e15-a6fdd979c779 tempest-VolumesActionsTest-199631217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (172a3e24-4d1c-409b-8e6a-c2e0d7882699) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d0d79d0f-f1a2-4edc-8f2a-193b958798fa', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:27:22 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-5486fc1f-b9e0-47c1-8e15-a6fdd979c779 tempest-VolumesActionsTest-199631217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07d3a062-ee77-485a-aea0-83551fefeb0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:27:22 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-5486fc1f-b9e0-47c1-8e15-a6fdd979c779 tempest-VolumesActionsTest-199631217 None] Volume volume-d0d79d0f-f1a2-4edc-8f2a-193b958798fa (d0d79d0f-f1a2-4edc-8f2a-193b958798fa): created successfully Aug 05 06:27:22 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-5486fc1f-b9e0-47c1-8e15-a6fdd979c779 tempest-VolumesActionsTest-199631217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07d3a062-ee77-485a-aea0-83551fefeb0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:27:22 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-5486fc1f-b9e0-47c1-8e15-a6fdd979c779 tempest-VolumesActionsTest-199631217 None] Flow 'volume_create_manager' (825ae9aa-1ef1-4d2f-88ef-915e550357bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:27:22 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-5486fc1f-b9e0-47c1-8e15-a6fdd979c779 tempest-VolumesActionsTest-199631217 None] Created volume successfully. Aug 05 06:27:23 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-a9e2f5d9-4869-428e-bb8b-63733a6b0c05 tempest-VolumesActionsTest-943160540 None] Acquiring lock "cinder-d0d79d0f-f1a2-4edc-8f2a-193b958798fa-delete_volume" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:27:23 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-a9e2f5d9-4869-428e-bb8b-63733a6b0c05 tempest-VolumesActionsTest-943160540 None] Lock "cinder-d0d79d0f-f1a2-4edc-8f2a-193b958798fa-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:27:23 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-a9e2f5d9-4869-428e-bb8b-63733a6b0c05 tempest-VolumesActionsTest-943160540 None] Acquiring lock "cinder-quobyte-d0d79d0f-f1a2-4edc-8f2a-193b958798fa" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:27:23 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-a9e2f5d9-4869-428e-bb8b-63733a6b0c05 tempest-VolumesActionsTest-943160540 None] Lock "cinder-quobyte-d0d79d0f-f1a2-4edc-8f2a-193b958798fa" acquired by "delete_volume" :: waited 0.017s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:27:23 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[457411b9-c83b-4f63-a858-bd1aeae13f3b]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:27:23 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-a9e2f5d9-4869-428e-bb8b-63733a6b0c05 tempest-VolumesActionsTest-943160540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-d0d79d0f-f1a2-4edc-8f2a-193b958798fa {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:27:24 devstack sudo[106014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-d0d79d0f-f1a2-4edc-8f2a-193b958798fa Aug 05 06:27:24 devstack sudo[106014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:27:24 devstack sudo[106014]: pam_unix(sudo:session): session closed for user root Aug 05 06:27:24 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-a9e2f5d9-4869-428e-bb8b-63733a6b0c05 tempest-VolumesActionsTest-943160540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-d0d79d0f-f1a2-4edc-8f2a-193b958798fa" returned: 0 in 0.388s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:27:24 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-a9e2f5d9-4869-428e-bb8b-63733a6b0c05 tempest-VolumesActionsTest-943160540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-d0d79d0f-f1a2-4edc-8f2a-193b958798fa {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:27:24 devstack sudo[106019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-d0d79d0f-f1a2-4edc-8f2a-193b958798fa Aug 05 06:27:24 devstack sudo[106019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:27:24 devstack sudo[106019]: pam_unix(sudo:session): session closed for user root Aug 05 06:27:24 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-a9e2f5d9-4869-428e-bb8b-63733a6b0c05 tempest-VolumesActionsTest-943160540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-d0d79d0f-f1a2-4edc-8f2a-193b958798fa" returned: 0 in 0.287s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:27:24 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-a9e2f5d9-4869-428e-bb8b-63733a6b0c05 tempest-VolumesActionsTest-943160540 None] Lock "cinder-quobyte-d0d79d0f-f1a2-4edc-8f2a-193b958798fa" released by "delete_volume" :: held 0.718s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:27:24 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-a9e2f5d9-4869-428e-bb8b-63733a6b0c05 tempest-VolumesActionsTest-943160540 None] Created reservations ['e4af734b-0edd-48f3-8ccd-baca8bdc5e33', '41e61bb5-7d6f-47fd-9a99-027085c0526d', 'dfbd38c1-5bee-448b-a0b9-10b985efc195', '76f6de75-068b-46f6-b4e0-25bc32d65164'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:27:24 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-a9e2f5d9-4869-428e-bb8b-63733a6b0c05 tempest-VolumesActionsTest-943160540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:27:24 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-a9e2f5d9-4869-428e-bb8b-63733a6b0c05 tempest-VolumesActionsTest-943160540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:27:24 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-a9e2f5d9-4869-428e-bb8b-63733a6b0c05 tempest-VolumesActionsTest-943160540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:27:24 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-a9e2f5d9-4869-428e-bb8b-63733a6b0c05 tempest-VolumesActionsTest-943160540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:27:24 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-a9e2f5d9-4869-428e-bb8b-63733a6b0c05 tempest-VolumesActionsTest-943160540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:27:24 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-a9e2f5d9-4869-428e-bb8b-63733a6b0c05 tempest-VolumesActionsTest-943160540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:27:24 devstack sudo[106022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce Aug 05 06:27:24 devstack sudo[106022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:27:25 devstack sudo[106022]: pam_unix(sudo:session): session closed for user root Aug 05 06:27:25 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-a9e2f5d9-4869-428e-bb8b-63733a6b0c05 tempest-VolumesActionsTest-943160540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce" returned: 0 in 0.276s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:27:25 devstack cinder-volume[88695]: DEBUG cinder.manager [None req-a9e2f5d9-4869-428e-bb8b-63733a6b0c05 tempest-VolumesActionsTest-943160540 None] Notifying Schedulers of capabilities ... {{(pid=88695) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 06:27:25 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-a9e2f5d9-4869-428e-bb8b-63733a6b0c05 tempest-VolumesActionsTest-943160540 None] Deleted volume successfully. Aug 05 06:27:25 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-a9e2f5d9-4869-428e-bb8b-63733a6b0c05 tempest-VolumesActionsTest-943160540 None] Lock "cinder-d0d79d0f-f1a2-4edc-8f2a-193b958798fa-delete_volume" released by "delete_volume" :: held 1.219s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:27:25 devstack cinder-volume[88695]: DEBUG cinder.volume.flows.manager.create_volume [None req-a55a9582-cb83-4b5d-b5b8-79e8ff065a33 tempest-VolumesActionsTest-199631217 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88695) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 06:27:25 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-a55a9582-cb83-4b5d-b5b8-79e8ff065a33 tempest-VolumesActionsTest-199631217 None] Flow 'volume_create_manager' (a1bf8c8f-8027-4348-acb5-167bc612cb10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:27:25 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-a55a9582-cb83-4b5d-b5b8-79e8ff065a33 tempest-VolumesActionsTest-199631217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b56049c-ce78-4a58-9aa7-19498efd4efa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:27:25 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-a55a9582-cb83-4b5d-b5b8-79e8ff065a33 tempest-VolumesActionsTest-199631217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b56049c-ce78-4a58-9aa7-19498efd4efa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:27:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1015765707',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5be167b1-cb5b-468b-95ec-3737febd426f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c06f18fd2cba47dba692e7c512010699',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:27:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:27:25Z,use_quota=True,user_id='488418aa4de54217a05d643e862f1b4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:27:25 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-a55a9582-cb83-4b5d-b5b8-79e8ff065a33 tempest-VolumesActionsTest-199631217 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c18064b-0989-4156-8881-19dccaf1c3f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:27:25 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-a55a9582-cb83-4b5d-b5b8-79e8ff065a33 tempest-VolumesActionsTest-199631217 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c18064b-0989-4156-8881-19dccaf1c3f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:27:25 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-a55a9582-cb83-4b5d-b5b8-79e8ff065a33 tempest-VolumesActionsTest-199631217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b21b48f-275f-4f33-b908-0adcf6edefca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:27:25 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-a55a9582-cb83-4b5d-b5b8-79e8ff065a33 tempest-VolumesActionsTest-199631217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b21b48f-275f-4f33-b908-0adcf6edefca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5be167b1-cb5b-468b-95ec-3737febd426f', 'volume_name': 'volume-5be167b1-cb5b-468b-95ec-3737febd426f', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:27:25 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-a55a9582-cb83-4b5d-b5b8-79e8ff065a33 tempest-VolumesActionsTest-199631217 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f92e87d-cca5-4a76-bc5f-039f9086024b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:27:25 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-a55a9582-cb83-4b5d-b5b8-79e8ff065a33 tempest-VolumesActionsTest-199631217 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f92e87d-cca5-4a76-bc5f-039f9086024b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:27:25 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-a55a9582-cb83-4b5d-b5b8-79e8ff065a33 tempest-VolumesActionsTest-199631217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5460b035-4717-4019-ac60-6bb703db7702) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:27:25 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-a55a9582-cb83-4b5d-b5b8-79e8ff065a33 tempest-VolumesActionsTest-199631217 None] Volume 5be167b1-cb5b-468b-95ec-3737febd426f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5be167b1-cb5b-468b-95ec-3737febd426f', 'volume_size': 1} Aug 05 06:27:25 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-a55a9582-cb83-4b5d-b5b8-79e8ff065a33 tempest-VolumesActionsTest-199631217 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:27:25 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-a55a9582-cb83-4b5d-b5b8-79e8ff065a33 tempest-VolumesActionsTest-199631217 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:27:25 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-a55a9582-cb83-4b5d-b5b8-79e8ff065a33 tempest-VolumesActionsTest-199631217 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:27:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1015765707',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5be167b1-cb5b-468b-95ec-3737febd426f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c06f18fd2cba47dba692e7c512010699',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:27:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:27:25Z,use_quota=True,user_id='488418aa4de54217a05d643e862f1b4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)}" {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 06:27:25 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-a55a9582-cb83-4b5d-b5b8-79e8ff065a33 tempest-VolumesActionsTest-199631217 None] Creating volume 5be167b1-cb5b-468b-95ec-3737febd426f {{(pid=88695) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 06:27:25 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-a55a9582-cb83-4b5d-b5b8-79e8ff065a33 tempest-VolumesActionsTest-199631217 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:27:25 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-a55a9582-cb83-4b5d-b5b8-79e8ff065a33 tempest-VolumesActionsTest-199631217 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:27:25 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-a55a9582-cb83-4b5d-b5b8-79e8ff065a33 tempest-VolumesActionsTest-199631217 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:27:25 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-a55a9582-cb83-4b5d-b5b8-79e8ff065a33 tempest-VolumesActionsTest-199631217 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:27:25 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-a55a9582-cb83-4b5d-b5b8-79e8ff065a33 tempest-VolumesActionsTest-199631217 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:27:25 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-a55a9582-cb83-4b5d-b5b8-79e8ff065a33 tempest-VolumesActionsTest-199631217 None] Selected osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 as target Quobyte volume. {{(pid=88695) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 06:27:25 devstack cinder-volume[88695]: INFO cinder.volume.drivers.remotefs [None req-a55a9582-cb83-4b5d-b5b8-79e8ff065a33 tempest-VolumesActionsTest-199631217 None] casted to osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 Aug 05 06:27:25 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-a55a9582-cb83-4b5d-b5b8-79e8ff065a33 tempest-VolumesActionsTest-199631217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-5be167b1-cb5b-468b-95ec-3737febd426f 1073741824 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:27:25 devstack sudo[106035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-5be167b1-cb5b-468b-95ec-3737febd426f 1073741824 Aug 05 06:27:25 devstack sudo[106035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:27:26 devstack sudo[106035]: pam_unix(sudo:session): session closed for user root Aug 05 06:27:26 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-a55a9582-cb83-4b5d-b5b8-79e8ff065a33 tempest-VolumesActionsTest-199631217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-5be167b1-cb5b-468b-95ec-3737febd426f 1073741824" returned: 0 in 0.481s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:27:26 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-a55a9582-cb83-4b5d-b5b8-79e8ff065a33 tempest-VolumesActionsTest-199631217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-5be167b1-cb5b-468b-95ec-3737febd426f {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:27:26 devstack sudo[106043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-5be167b1-cb5b-468b-95ec-3737febd426f Aug 05 06:27:26 devstack sudo[106043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:27:26 devstack sudo[106043]: pam_unix(sudo:session): session closed for user root Aug 05 06:27:26 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-a55a9582-cb83-4b5d-b5b8-79e8ff065a33 tempest-VolumesActionsTest-199631217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-5be167b1-cb5b-468b-95ec-3737febd426f" returned: 0 in 0.259s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:27:26 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-a55a9582-cb83-4b5d-b5b8-79e8ff065a33 tempest-VolumesActionsTest-199631217 None] <== create_volume: return (784ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'} {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 06:27:26 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-a55a9582-cb83-4b5d-b5b8-79e8ff065a33 tempest-VolumesActionsTest-199631217 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.787s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:27:26 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-a55a9582-cb83-4b5d-b5b8-79e8ff065a33 tempest-VolumesActionsTest-199631217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5460b035-4717-4019-ac60-6bb703db7702) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5be167b1-cb5b-468b-95ec-3737febd426f', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:27:26 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-a55a9582-cb83-4b5d-b5b8-79e8ff065a33 tempest-VolumesActionsTest-199631217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d8cc80a-2c5b-473a-84ae-6423dc9da458) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:27:26 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-a55a9582-cb83-4b5d-b5b8-79e8ff065a33 tempest-VolumesActionsTest-199631217 None] Volume volume-5be167b1-cb5b-468b-95ec-3737febd426f (5be167b1-cb5b-468b-95ec-3737febd426f): created successfully Aug 05 06:27:26 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-a55a9582-cb83-4b5d-b5b8-79e8ff065a33 tempest-VolumesActionsTest-199631217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d8cc80a-2c5b-473a-84ae-6423dc9da458) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:27:26 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-a55a9582-cb83-4b5d-b5b8-79e8ff065a33 tempest-VolumesActionsTest-199631217 None] Flow 'volume_create_manager' (a1bf8c8f-8027-4348-acb5-167bc612cb10) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:27:26 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-a55a9582-cb83-4b5d-b5b8-79e8ff065a33 tempest-VolumesActionsTest-199631217 None] Created volume successfully. Aug 05 06:27:26 devstack cinder-volume[88695]: INFO cinder.volume.manager [req-b63ca0c6-e387-476b-98c2-7bbde29a9519 req-44f4a5ee-467d-4786-bbbb-24f99addab94 tempest-TestStampPattern-1026635927 None] Terminate volume connection completed successfully. Aug 05 06:27:26 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [req-b63ca0c6-e387-476b-98c2-7bbde29a9519 req-44f4a5ee-467d-4786-bbbb-24f99addab94 tempest-TestStampPattern-1026635927 None] Deleting attachment 790f3381-45de-4d1c-8a94-d0d953c2b675. {{(pid=88695) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 05 06:27:27 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-bb015ca1-94ef-46f4-8869-086660855b6f tempest-TestStampPattern-1026635927 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:27:27 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-bb015ca1-94ef-46f4-8869-086660855b6f tempest-TestStampPattern-1026635927 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:27:27 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-bb015ca1-94ef-46f4-8869-086660855b6f tempest-TestStampPattern-1026635927 None] Creating offline snapshot 79f048f0-9c89-4fd6-b44b-b5183380c965 of volume c7b0e17f-ef27-406c-84a7-e9e2c18ece55 {{(pid=88695) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 06:27:27 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[6379a3c3-4a03-4624-a8bf-8975cb74bdb0]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:27:27 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-bb015ca1-94ef-46f4-8869-086660855b6f tempest-TestStampPattern-1026635927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-c7b0e17f-ef27-406c-84a7-e9e2c18ece55 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:27:27 devstack sudo[106076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-c7b0e17f-ef27-406c-84a7-e9e2c18ece55 Aug 05 06:27:27 devstack sudo[106076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:27:27 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-4e47d361-b7c2-4170-8cab-3110e64d60ee tempest-VolumesActionsTest-943160540 None] Acquiring lock "cinder-5be167b1-cb5b-468b-95ec-3737febd426f-delete_volume" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:27:27 devstack sudo[106076]: pam_unix(sudo:session): session closed for user root Aug 05 06:27:27 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-bb015ca1-94ef-46f4-8869-086660855b6f tempest-TestStampPattern-1026635927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-c7b0e17f-ef27-406c-84a7-e9e2c18ece55" returned: 0 in 0.382s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:27:27 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-bb015ca1-94ef-46f4-8869-086660855b6f tempest-TestStampPattern-1026635927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-c7b0e17f-ef27-406c-84a7-e9e2c18ece55,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-c7b0e17f-ef27-406c-84a7-e9e2c18ece55.79f048f0-9c89-4fd6-b44b-b5183380c965 1G {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:27:27 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-4e47d361-b7c2-4170-8cab-3110e64d60ee tempest-VolumesActionsTest-943160540 None] Lock "cinder-5be167b1-cb5b-468b-95ec-3737febd426f-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:27:27 devstack sudo[106081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-c7b0e17f-ef27-406c-84a7-e9e2c18ece55,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-c7b0e17f-ef27-406c-84a7-e9e2c18ece55.79f048f0-9c89-4fd6-b44b-b5183380c965 1G Aug 05 06:27:27 devstack sudo[106081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:27:27 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-4e47d361-b7c2-4170-8cab-3110e64d60ee tempest-VolumesActionsTest-943160540 None] Acquiring lock "cinder-quobyte-5be167b1-cb5b-468b-95ec-3737febd426f" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:27:27 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-4e47d361-b7c2-4170-8cab-3110e64d60ee tempest-VolumesActionsTest-943160540 None] Lock "cinder-quobyte-5be167b1-cb5b-468b-95ec-3737febd426f" acquired by "delete_volume" :: waited 0.016s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:27:27 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[f088745d-e133-4f88-a2ed-532d82141849]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:27:27 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-4e47d361-b7c2-4170-8cab-3110e64d60ee tempest-VolumesActionsTest-943160540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-5be167b1-cb5b-468b-95ec-3737febd426f {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:27:27 devstack sudo[106083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-5be167b1-cb5b-468b-95ec-3737febd426f Aug 05 06:27:27 devstack sudo[106083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:27:28 devstack sudo[106081]: pam_unix(sudo:session): session closed for user root Aug 05 06:27:28 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-bb015ca1-94ef-46f4-8869-086660855b6f tempest-TestStampPattern-1026635927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-c7b0e17f-ef27-406c-84a7-e9e2c18ece55,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-c7b0e17f-ef27-406c-84a7-e9e2c18ece55.79f048f0-9c89-4fd6-b44b-b5183380c965 1G" returned: 0 in 0.413s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:27:28 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-bb015ca1-94ef-46f4-8869-086660855b6f tempest-TestStampPattern-1026635927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c7b0e17f-ef27-406c-84a7-e9e2c18ece55 -F qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-c7b0e17f-ef27-406c-84a7-e9e2c18ece55.79f048f0-9c89-4fd6-b44b-b5183380c965 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:27:28 devstack sudo[106091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c7b0e17f-ef27-406c-84a7-e9e2c18ece55 -F qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-c7b0e17f-ef27-406c-84a7-e9e2c18ece55.79f048f0-9c89-4fd6-b44b-b5183380c965 Aug 05 06:27:28 devstack sudo[106091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:27:28 devstack sudo[106083]: pam_unix(sudo:session): session closed for user root Aug 05 06:27:28 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-4e47d361-b7c2-4170-8cab-3110e64d60ee tempest-VolumesActionsTest-943160540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-5be167b1-cb5b-468b-95ec-3737febd426f" returned: 0 in 0.383s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:27:28 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-4e47d361-b7c2-4170-8cab-3110e64d60ee tempest-VolumesActionsTest-943160540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-5be167b1-cb5b-468b-95ec-3737febd426f {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:27:28 devstack sudo[106094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-5be167b1-cb5b-468b-95ec-3737febd426f Aug 05 06:27:28 devstack sudo[106094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:27:28 devstack sudo[106091]: pam_unix(sudo:session): session closed for user root Aug 05 06:27:28 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-bb015ca1-94ef-46f4-8869-086660855b6f tempest-TestStampPattern-1026635927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c7b0e17f-ef27-406c-84a7-e9e2c18ece55 -F qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-c7b0e17f-ef27-406c-84a7-e9e2c18ece55.79f048f0-9c89-4fd6-b44b-b5183380c965" returned: 0 in 0.293s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:27:28 devstack cinder-volume[88695]: WARNING cinder.volume.drivers.remotefs [None req-bb015ca1-94ef-46f4-8869-086660855b6f tempest-TestStampPattern-1026635927 None] /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-c7b0e17f-ef27-406c-84a7-e9e2c18ece55.79f048f0-9c89-4fd6-b44b-b5183380c965 is being set with open permissions: ugo+rw Aug 05 06:27:28 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-bb015ca1-94ef-46f4-8869-086660855b6f tempest-TestStampPattern-1026635927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-c7b0e17f-ef27-406c-84a7-e9e2c18ece55.79f048f0-9c89-4fd6-b44b-b5183380c965 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:27:28 devstack sudo[106094]: pam_unix(sudo:session): session closed for user root Aug 05 06:27:28 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-4e47d361-b7c2-4170-8cab-3110e64d60ee tempest-VolumesActionsTest-943160540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-5be167b1-cb5b-468b-95ec-3737febd426f" returned: 0 in 0.242s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:27:28 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-4e47d361-b7c2-4170-8cab-3110e64d60ee tempest-VolumesActionsTest-943160540 None] Lock "cinder-quobyte-5be167b1-cb5b-468b-95ec-3737febd426f" released by "delete_volume" :: held 0.663s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:27:28 devstack sudo[106100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-c7b0e17f-ef27-406c-84a7-e9e2c18ece55.79f048f0-9c89-4fd6-b44b-b5183380c965 Aug 05 06:27:28 devstack sudo[106100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:27:28 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-4e47d361-b7c2-4170-8cab-3110e64d60ee tempest-VolumesActionsTest-943160540 None] Created reservations ['584116a0-463c-4e71-a464-0a02bfa43139', '3a832251-fa17-4843-97f4-39f397b0c21c', '4f4b1215-4e6d-4152-9240-2155e1405ba9', '179b2bc0-6573-4d50-8942-72afe6814ee9'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:27:28 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-4e47d361-b7c2-4170-8cab-3110e64d60ee tempest-VolumesActionsTest-943160540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:27:28 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-4e47d361-b7c2-4170-8cab-3110e64d60ee tempest-VolumesActionsTest-943160540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:27:28 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-4e47d361-b7c2-4170-8cab-3110e64d60ee tempest-VolumesActionsTest-943160540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:27:28 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-4e47d361-b7c2-4170-8cab-3110e64d60ee tempest-VolumesActionsTest-943160540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:27:28 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-4e47d361-b7c2-4170-8cab-3110e64d60ee tempest-VolumesActionsTest-943160540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:27:28 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-4e47d361-b7c2-4170-8cab-3110e64d60ee tempest-VolumesActionsTest-943160540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:27:28 devstack sudo[106102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce Aug 05 06:27:28 devstack sudo[106102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:27:28 devstack sudo[106100]: pam_unix(sudo:session): session closed for user root Aug 05 06:27:28 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-bb015ca1-94ef-46f4-8869-086660855b6f tempest-TestStampPattern-1026635927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-c7b0e17f-ef27-406c-84a7-e9e2c18ece55.79f048f0-9c89-4fd6-b44b-b5183380c965" returned: 0 in 0.257s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:27:28 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-bb015ca1-94ef-46f4-8869-086660855b6f tempest-TestStampPattern-1026635927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-c7b0e17f-ef27-406c-84a7-e9e2c18ece55.info {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:27:28 devstack sudo[106105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-c7b0e17f-ef27-406c-84a7-e9e2c18ece55.info Aug 05 06:27:28 devstack sudo[106105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:27:28 devstack sudo[106102]: pam_unix(sudo:session): session closed for user root Aug 05 06:27:28 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-4e47d361-b7c2-4170-8cab-3110e64d60ee tempest-VolumesActionsTest-943160540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce" returned: 0 in 0.260s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:27:28 devstack cinder-volume[88695]: DEBUG cinder.manager [None req-4e47d361-b7c2-4170-8cab-3110e64d60ee tempest-VolumesActionsTest-943160540 None] Notifying Schedulers of capabilities ... {{(pid=88695) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 06:27:28 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-4e47d361-b7c2-4170-8cab-3110e64d60ee tempest-VolumesActionsTest-943160540 None] Deleted volume successfully. Aug 05 06:27:28 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-4e47d361-b7c2-4170-8cab-3110e64d60ee tempest-VolumesActionsTest-943160540 None] Lock "cinder-5be167b1-cb5b-468b-95ec-3737febd426f-delete_volume" released by "delete_volume" :: held 1.116s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:27:29 devstack sudo[106105]: pam_unix(sudo:session): session closed for user root Aug 05 06:27:29 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-bb015ca1-94ef-46f4-8869-086660855b6f tempest-TestStampPattern-1026635927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-c7b0e17f-ef27-406c-84a7-e9e2c18ece55.info" returned: 0 in 0.269s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:27:29 devstack cinder-volume[88695]: WARNING cinder.volume.drivers.remotefs [None req-bb015ca1-94ef-46f4-8869-086660855b6f tempest-TestStampPattern-1026635927 None] /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-c7b0e17f-ef27-406c-84a7-e9e2c18ece55.info is being set with open permissions: ugo+rw Aug 05 06:27:29 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-bb015ca1-94ef-46f4-8869-086660855b6f tempest-TestStampPattern-1026635927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-c7b0e17f-ef27-406c-84a7-e9e2c18ece55.info {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:27:29 devstack sudo[106109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-c7b0e17f-ef27-406c-84a7-e9e2c18ece55.info Aug 05 06:27:29 devstack sudo[106109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:27:29 devstack sudo[106109]: pam_unix(sudo:session): session closed for user root Aug 05 06:27:29 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-bb015ca1-94ef-46f4-8869-086660855b6f tempest-TestStampPattern-1026635927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-c7b0e17f-ef27-406c-84a7-e9e2c18ece55.info" returned: 0 in 0.275s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:27:29 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-bb015ca1-94ef-46f4-8869-086660855b6f tempest-TestStampPattern-1026635927 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.980s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:27:29 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-bb015ca1-94ef-46f4-8869-086660855b6f tempest-TestStampPattern-1026635927 None] Create snapshot completed successfully Aug 05 06:27:29 devstack cinder-volume[88695]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa6b1b4e-f84b-4408-9895-76e1b877c73a tempest-VolumesActionsTest-199631217 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88695) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 06:27:29 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-aa6b1b4e-f84b-4408-9895-76e1b877c73a tempest-VolumesActionsTest-199631217 None] Flow 'volume_create_manager' (be2fb883-6a05-4be6-86c2-7af12853aa01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:27:29 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-aa6b1b4e-f84b-4408-9895-76e1b877c73a tempest-VolumesActionsTest-199631217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18e7f91c-8ecb-44f2-baa3-60224a3f93be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:27:29 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-aa6b1b4e-f84b-4408-9895-76e1b877c73a tempest-VolumesActionsTest-199631217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18e7f91c-8ecb-44f2-baa3-60224a3f93be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:27:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1339886350',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfb89e9f-2bf6-4e00-ace8-7f75f712a170,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c06f18fd2cba47dba692e7c512010699',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:27:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:27:29Z,use_quota=True,user_id='488418aa4de54217a05d643e862f1b4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:27:29 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-aa6b1b4e-f84b-4408-9895-76e1b877c73a tempest-VolumesActionsTest-199631217 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ceb3ab36-1fe0-42c9-966c-3f02b6187e6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:27:29 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-aa6b1b4e-f84b-4408-9895-76e1b877c73a tempest-VolumesActionsTest-199631217 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ceb3ab36-1fe0-42c9-966c-3f02b6187e6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:27:29 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-aa6b1b4e-f84b-4408-9895-76e1b877c73a tempest-VolumesActionsTest-199631217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (272ac919-621f-410f-9e8d-1f10cb77bc33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:27:29 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-aa6b1b4e-f84b-4408-9895-76e1b877c73a tempest-VolumesActionsTest-199631217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (272ac919-621f-410f-9e8d-1f10cb77bc33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cfb89e9f-2bf6-4e00-ace8-7f75f712a170', 'volume_name': 'volume-cfb89e9f-2bf6-4e00-ace8-7f75f712a170', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:27:29 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-aa6b1b4e-f84b-4408-9895-76e1b877c73a tempest-VolumesActionsTest-199631217 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8683e6b7-b4bc-4752-8815-c9a42703a232) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:27:29 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-aa6b1b4e-f84b-4408-9895-76e1b877c73a tempest-VolumesActionsTest-199631217 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8683e6b7-b4bc-4752-8815-c9a42703a232) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:27:29 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-aa6b1b4e-f84b-4408-9895-76e1b877c73a tempest-VolumesActionsTest-199631217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2ec9411-5ebe-4f8d-8e3a-91631c2c4053) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:27:29 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-aa6b1b4e-f84b-4408-9895-76e1b877c73a tempest-VolumesActionsTest-199631217 None] Volume cfb89e9f-2bf6-4e00-ace8-7f75f712a170: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cfb89e9f-2bf6-4e00-ace8-7f75f712a170', 'volume_size': 1} Aug 05 06:27:29 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-aa6b1b4e-f84b-4408-9895-76e1b877c73a tempest-VolumesActionsTest-199631217 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:27:29 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-aa6b1b4e-f84b-4408-9895-76e1b877c73a tempest-VolumesActionsTest-199631217 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:27:29 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-aa6b1b4e-f84b-4408-9895-76e1b877c73a tempest-VolumesActionsTest-199631217 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:27:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1339886350',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfb89e9f-2bf6-4e00-ace8-7f75f712a170,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c06f18fd2cba47dba692e7c512010699',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:27:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:27:29Z,use_quota=True,user_id='488418aa4de54217a05d643e862f1b4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)}" {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 06:27:29 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-aa6b1b4e-f84b-4408-9895-76e1b877c73a tempest-VolumesActionsTest-199631217 None] Creating volume cfb89e9f-2bf6-4e00-ace8-7f75f712a170 {{(pid=88695) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 06:27:29 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-aa6b1b4e-f84b-4408-9895-76e1b877c73a tempest-VolumesActionsTest-199631217 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:27:29 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-aa6b1b4e-f84b-4408-9895-76e1b877c73a tempest-VolumesActionsTest-199631217 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:27:29 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-aa6b1b4e-f84b-4408-9895-76e1b877c73a tempest-VolumesActionsTest-199631217 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:27:29 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-aa6b1b4e-f84b-4408-9895-76e1b877c73a tempest-VolumesActionsTest-199631217 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:27:29 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-aa6b1b4e-f84b-4408-9895-76e1b877c73a tempest-VolumesActionsTest-199631217 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:27:29 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-aa6b1b4e-f84b-4408-9895-76e1b877c73a tempest-VolumesActionsTest-199631217 None] Selected osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 as target Quobyte volume. {{(pid=88695) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 06:27:29 devstack cinder-volume[88695]: INFO cinder.volume.drivers.remotefs [None req-aa6b1b4e-f84b-4408-9895-76e1b877c73a tempest-VolumesActionsTest-199631217 None] casted to osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 Aug 05 06:27:29 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-aa6b1b4e-f84b-4408-9895-76e1b877c73a tempest-VolumesActionsTest-199631217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-cfb89e9f-2bf6-4e00-ace8-7f75f712a170 1073741824 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:27:29 devstack sudo[106112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-cfb89e9f-2bf6-4e00-ace8-7f75f712a170 1073741824 Aug 05 06:27:29 devstack sudo[106112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:27:30 devstack sudo[106112]: pam_unix(sudo:session): session closed for user root Aug 05 06:27:30 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-aa6b1b4e-f84b-4408-9895-76e1b877c73a tempest-VolumesActionsTest-199631217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-cfb89e9f-2bf6-4e00-ace8-7f75f712a170 1073741824" returned: 0 in 0.453s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:27:30 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-aa6b1b4e-f84b-4408-9895-76e1b877c73a tempest-VolumesActionsTest-199631217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-cfb89e9f-2bf6-4e00-ace8-7f75f712a170 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:27:30 devstack sudo[106118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-cfb89e9f-2bf6-4e00-ace8-7f75f712a170 Aug 05 06:27:30 devstack sudo[106118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:27:30 devstack sudo[106118]: pam_unix(sudo:session): session closed for user root Aug 05 06:27:30 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-aa6b1b4e-f84b-4408-9895-76e1b877c73a tempest-VolumesActionsTest-199631217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-cfb89e9f-2bf6-4e00-ace8-7f75f712a170" returned: 0 in 0.289s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:27:30 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-aa6b1b4e-f84b-4408-9895-76e1b877c73a tempest-VolumesActionsTest-199631217 None] <== create_volume: return (795ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'} {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 06:27:30 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-aa6b1b4e-f84b-4408-9895-76e1b877c73a tempest-VolumesActionsTest-199631217 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.798s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:27:30 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-aa6b1b4e-f84b-4408-9895-76e1b877c73a tempest-VolumesActionsTest-199631217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2ec9411-5ebe-4f8d-8e3a-91631c2c4053) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cfb89e9f-2bf6-4e00-ace8-7f75f712a170', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:27:30 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-aa6b1b4e-f84b-4408-9895-76e1b877c73a tempest-VolumesActionsTest-199631217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1af64ef4-51e3-425a-9ac4-0dfbc2bb26f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:27:30 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-aa6b1b4e-f84b-4408-9895-76e1b877c73a tempest-VolumesActionsTest-199631217 None] Volume volume-cfb89e9f-2bf6-4e00-ace8-7f75f712a170 (cfb89e9f-2bf6-4e00-ace8-7f75f712a170): created successfully Aug 05 06:27:30 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-aa6b1b4e-f84b-4408-9895-76e1b877c73a tempest-VolumesActionsTest-199631217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1af64ef4-51e3-425a-9ac4-0dfbc2bb26f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:27:30 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-aa6b1b4e-f84b-4408-9895-76e1b877c73a tempest-VolumesActionsTest-199631217 None] Flow 'volume_create_manager' (be2fb883-6a05-4be6-86c2-7af12853aa01) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:27:30 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-aa6b1b4e-f84b-4408-9895-76e1b877c73a tempest-VolumesActionsTest-199631217 None] Created volume successfully. Aug 05 06:27:32 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-550c213b-1eae-4507-a361-4b8188185168 tempest-VolumesActionsTest-199631217 None] Acquiring lock "cinder-cfb89e9f-2bf6-4e00-ace8-7f75f712a170-delete_volume" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:27:32 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-550c213b-1eae-4507-a361-4b8188185168 tempest-VolumesActionsTest-199631217 None] Lock "cinder-cfb89e9f-2bf6-4e00-ace8-7f75f712a170-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:27:32 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-550c213b-1eae-4507-a361-4b8188185168 tempest-VolumesActionsTest-199631217 None] Acquiring lock "cinder-quobyte-cfb89e9f-2bf6-4e00-ace8-7f75f712a170" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:27:32 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-550c213b-1eae-4507-a361-4b8188185168 tempest-VolumesActionsTest-199631217 None] Lock "cinder-quobyte-cfb89e9f-2bf6-4e00-ace8-7f75f712a170" acquired by "delete_volume" :: waited 0.015s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:27:32 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9322f67-a605-472e-8ada-dd8749389fc0]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:27:32 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-550c213b-1eae-4507-a361-4b8188185168 tempest-VolumesActionsTest-199631217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-cfb89e9f-2bf6-4e00-ace8-7f75f712a170 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:27:32 devstack sudo[106144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-cfb89e9f-2bf6-4e00-ace8-7f75f712a170 Aug 05 06:27:32 devstack sudo[106144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:27:32 devstack sudo[106144]: pam_unix(sudo:session): session closed for user root Aug 05 06:27:32 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-550c213b-1eae-4507-a361-4b8188185168 tempest-VolumesActionsTest-199631217 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-cfb89e9f-2bf6-4e00-ace8-7f75f712a170" returned: 0 in 0.393s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:27:32 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-550c213b-1eae-4507-a361-4b8188185168 tempest-VolumesActionsTest-199631217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-cfb89e9f-2bf6-4e00-ace8-7f75f712a170 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:27:32 devstack sudo[106157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-cfb89e9f-2bf6-4e00-ace8-7f75f712a170 Aug 05 06:27:32 devstack sudo[106157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:27:32 devstack sudo[106157]: pam_unix(sudo:session): session closed for user root Aug 05 06:27:32 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-550c213b-1eae-4507-a361-4b8188185168 tempest-VolumesActionsTest-199631217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-cfb89e9f-2bf6-4e00-ace8-7f75f712a170" returned: 0 in 0.261s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:27:33 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-550c213b-1eae-4507-a361-4b8188185168 tempest-VolumesActionsTest-199631217 None] Lock "cinder-quobyte-cfb89e9f-2bf6-4e00-ace8-7f75f712a170" released by "delete_volume" :: held 0.694s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:27:33 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-550c213b-1eae-4507-a361-4b8188185168 tempest-VolumesActionsTest-199631217 None] Created reservations ['5824a947-e5ea-4125-b798-0112d6a33617', '0bae7f61-7246-4632-835d-1ced3541daea', '38908576-7f61-440c-bec6-0a7e1be32d15', 'a05e3c2d-626b-4160-86bc-256233e2bf46'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:27:33 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-550c213b-1eae-4507-a361-4b8188185168 tempest-VolumesActionsTest-199631217 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:27:33 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-550c213b-1eae-4507-a361-4b8188185168 tempest-VolumesActionsTest-199631217 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:27:33 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-550c213b-1eae-4507-a361-4b8188185168 tempest-VolumesActionsTest-199631217 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:27:33 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-550c213b-1eae-4507-a361-4b8188185168 tempest-VolumesActionsTest-199631217 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:27:33 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-550c213b-1eae-4507-a361-4b8188185168 tempest-VolumesActionsTest-199631217 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:27:33 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-550c213b-1eae-4507-a361-4b8188185168 tempest-VolumesActionsTest-199631217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:27:33 devstack sudo[106160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce Aug 05 06:27:33 devstack sudo[106160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:27:33 devstack sudo[106160]: pam_unix(sudo:session): session closed for user root Aug 05 06:27:33 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-550c213b-1eae-4507-a361-4b8188185168 tempest-VolumesActionsTest-199631217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce" returned: 0 in 0.290s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:27:33 devstack cinder-volume[88695]: DEBUG cinder.manager [None req-550c213b-1eae-4507-a361-4b8188185168 tempest-VolumesActionsTest-199631217 None] Notifying Schedulers of capabilities ... {{(pid=88695) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 06:27:33 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-550c213b-1eae-4507-a361-4b8188185168 tempest-VolumesActionsTest-199631217 None] Deleted volume successfully. Aug 05 06:27:33 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-550c213b-1eae-4507-a361-4b8188185168 tempest-VolumesActionsTest-199631217 None] Lock "cinder-cfb89e9f-2bf6-4e00-ace8-7f75f712a170-delete_volume" released by "delete_volume" :: held 1.204s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:27:37 devstack cinder-volume[88695]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c0b7d4f-6f97-43f1-b5ea-e504a5d6966c tempest-TestStampPattern-1026635927 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88695) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 06:27:37 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-1c0b7d4f-6f97-43f1-b5ea-e504a5d6966c tempest-TestStampPattern-1026635927 None] Flow 'volume_create_manager' (e759119a-cd69-4e48-86f9-3f18e6731d2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:27:37 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-1c0b7d4f-6f97-43f1-b5ea-e504a5d6966c tempest-TestStampPattern-1026635927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1dfbd4b7-c890-4199-b12d-f7a6630d6146) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:27:37 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-1c0b7d4f-6f97-43f1-b5ea-e504a5d6966c tempest-TestStampPattern-1026635927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1dfbd4b7-c890-4199-b12d-f7a6630d6146) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:27:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-811603986',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1df87c1e-7bc6-4d11-b025-bfea155baf5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='137a4e738e5042628029f043090aaff9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:27:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=79f048f0-9c89-4fd6-b44b-b5183380c965,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:27:37Z,use_quota=True,user_id='b9e849ea4cc74851bb64674e46270744',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:27:37 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-1c0b7d4f-6f97-43f1-b5ea-e504a5d6966c tempest-TestStampPattern-1026635927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd8e4950-4370-4772-a893-6734e430e8ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:27:37 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-1c0b7d4f-6f97-43f1-b5ea-e504a5d6966c tempest-TestStampPattern-1026635927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd8e4950-4370-4772-a893-6734e430e8ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:27:37 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-1c0b7d4f-6f97-43f1-b5ea-e504a5d6966c tempest-TestStampPattern-1026635927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4cb86258-876b-4870-8035-cef359649a75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:27:37 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-1c0b7d4f-6f97-43f1-b5ea-e504a5d6966c tempest-TestStampPattern-1026635927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4cb86258-876b-4870-8035-cef359649a75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '1df87c1e-7bc6-4d11-b025-bfea155baf5d', 'volume_name': 'volume-1df87c1e-7bc6-4d11-b025-bfea155baf5d', 'volume_size': 1, 'snapshot_id': '79f048f0-9c89-4fd6-b44b-b5183380c965'}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:27:37 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-1c0b7d4f-6f97-43f1-b5ea-e504a5d6966c tempest-TestStampPattern-1026635927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40dbecac-17af-4ab9-91e1-7dd9e1d79136) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:27:37 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-1c0b7d4f-6f97-43f1-b5ea-e504a5d6966c tempest-TestStampPattern-1026635927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40dbecac-17af-4ab9-91e1-7dd9e1d79136) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:27:37 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-1c0b7d4f-6f97-43f1-b5ea-e504a5d6966c tempest-TestStampPattern-1026635927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5dff34ae-cca5-47a6-8d0c-cec2069526f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:27:37 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-1c0b7d4f-6f97-43f1-b5ea-e504a5d6966c tempest-TestStampPattern-1026635927 None] Volume 1df87c1e-7bc6-4d11-b025-bfea155baf5d: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-1df87c1e-7bc6-4d11-b025-bfea155baf5d', 'volume_size': 1, 'snapshot_id': '79f048f0-9c89-4fd6-b44b-b5183380c965'} Aug 05 06:27:37 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-1c0b7d4f-6f97-43f1-b5ea-e504a5d6966c tempest-TestStampPattern-1026635927 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:27:37 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-1c0b7d4f-6f97-43f1-b5ea-e504a5d6966c tempest-TestStampPattern-1026635927 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:27:37 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-1c0b7d4f-6f97-43f1-b5ea-e504a5d6966c tempest-TestStampPattern-1026635927 None] Acquiring lock "cinder-quobyte-79f048f0-9c89-4fd6-b44b-b5183380c965-1df87c1e-7bc6-4d11-b025-bfea155baf5d" by "_create_volume_from_snapshot" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:27:37 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-1c0b7d4f-6f97-43f1-b5ea-e504a5d6966c tempest-TestStampPattern-1026635927 None] Lock "cinder-quobyte-79f048f0-9c89-4fd6-b44b-b5183380c965-1df87c1e-7bc6-4d11-b025-bfea155baf5d" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:27:37 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-1c0b7d4f-6f97-43f1-b5ea-e504a5d6966c tempest-TestStampPattern-1026635927 None] Creating volume 1df87c1e-7bc6-4d11-b025-bfea155baf5d from snapshot 79f048f0-9c89-4fd6-b44b-b5183380c965 {{(pid=88695) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 05 06:27:37 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-1c0b7d4f-6f97-43f1-b5ea-e504a5d6966c tempest-TestStampPattern-1026635927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:27:37 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-1c0b7d4f-6f97-43f1-b5ea-e504a5d6966c tempest-TestStampPattern-1026635927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:27:37 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-1c0b7d4f-6f97-43f1-b5ea-e504a5d6966c tempest-TestStampPattern-1026635927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:27:37 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-1c0b7d4f-6f97-43f1-b5ea-e504a5d6966c tempest-TestStampPattern-1026635927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:27:37 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-1c0b7d4f-6f97-43f1-b5ea-e504a5d6966c tempest-TestStampPattern-1026635927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:27:37 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-1c0b7d4f-6f97-43f1-b5ea-e504a5d6966c tempest-TestStampPattern-1026635927 None] Selected osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 as target Quobyte volume. {{(pid=88695) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 06:27:37 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-1c0b7d4f-6f97-43f1-b5ea-e504a5d6966c tempest-TestStampPattern-1026635927 None] Acquiring lock "cinder-quobyte-1df87c1e-7bc6-4d11-b025-bfea155baf5d" by "_copy_volume_from_snapshot" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:27:37 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-1c0b7d4f-6f97-43f1-b5ea-e504a5d6966c tempest-TestStampPattern-1026635927 None] Lock "cinder-quobyte-1df87c1e-7bc6-4d11-b025-bfea155baf5d" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:27:37 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-1c0b7d4f-6f97-43f1-b5ea-e504a5d6966c tempest-TestStampPattern-1026635927 None] snapshot: 79f048f0-9c89-4fd6-b44b-b5183380c965, volume: 1df87c1e-7bc6-4d11-b025-bfea155baf5d, {{(pid=88695) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 05 06:27:37 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-1c0b7d4f-6f97-43f1-b5ea-e504a5d6966c tempest-TestStampPattern-1026635927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:27:37 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-1c0b7d4f-6f97-43f1-b5ea-e504a5d6966c tempest-TestStampPattern-1026635927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:27:37 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-1c0b7d4f-6f97-43f1-b5ea-e504a5d6966c tempest-TestStampPattern-1026635927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:27:37 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-1c0b7d4f-6f97-43f1-b5ea-e504a5d6966c tempest-TestStampPattern-1026635927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:27:37 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-1c0b7d4f-6f97-43f1-b5ea-e504a5d6966c tempest-TestStampPattern-1026635927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:27:37 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[c724b4e7-8e1f-4766-9e34-b0fa7a84eae6]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:27:37 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-1c0b7d4f-6f97-43f1-b5ea-e504a5d6966c tempest-TestStampPattern-1026635927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-c7b0e17f-ef27-406c-84a7-e9e2c18ece55.79f048f0-9c89-4fd6-b44b-b5183380c965 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:27:37 devstack sudo[106166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-c7b0e17f-ef27-406c-84a7-e9e2c18ece55.79f048f0-9c89-4fd6-b44b-b5183380c965 Aug 05 06:27:37 devstack sudo[106166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:27:38 devstack sudo[106166]: pam_unix(sudo:session): session closed for user root Aug 05 06:27:38 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-1c0b7d4f-6f97-43f1-b5ea-e504a5d6966c tempest-TestStampPattern-1026635927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-c7b0e17f-ef27-406c-84a7-e9e2c18ece55.79f048f0-9c89-4fd6-b44b-b5183380c965" returned: 0 in 0.465s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:27:38 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-1c0b7d4f-6f97-43f1-b5ea-e504a5d6966c tempest-TestStampPattern-1026635927 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c7b0e17f-ef27-406c-84a7-e9e2c18ece55(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88695) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 06:27:38 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b7c0a48-95cb-44ca-ae8d-6f619a4e1579]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:27:38 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-1c0b7d4f-6f97-43f1-b5ea-e504a5d6966c tempest-TestStampPattern-1026635927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-c7b0e17f-ef27-406c-84a7-e9e2c18ece55 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:27:38 devstack sudo[106172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-c7b0e17f-ef27-406c-84a7-e9e2c18ece55 Aug 05 06:27:38 devstack sudo[106172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:27:38 devstack sudo[106172]: pam_unix(sudo:session): session closed for user root Aug 05 06:27:38 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-1c0b7d4f-6f97-43f1-b5ea-e504a5d6966c tempest-TestStampPattern-1026635927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-c7b0e17f-ef27-406c-84a7-e9e2c18ece55" returned: 0 in 0.468s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:27:38 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-1c0b7d4f-6f97-43f1-b5ea-e504a5d6966c tempest-TestStampPattern-1026635927 None] will copy from snapshot at /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-c7b0e17f-ef27-406c-84a7-e9e2c18ece55 {{(pid=88695) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 05 06:27:38 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-1c0b7d4f-6f97-43f1-b5ea-e504a5d6966c tempest-TestStampPattern-1026635927 None] Creating direct copy from snapshot {{(pid=88695) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 05 06:27:38 devstack cinder-volume[88695]: DEBUG cinder.utils [None req-1c0b7d4f-6f97-43f1-b5ea-e504a5d6966c tempest-TestStampPattern-1026635927 None] Path /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-1df87c1e-7bc6-4d11-b025-bfea155baf5d not found in is_blk_device check {{(pid=88695) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 05 06:27:38 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-1c0b7d4f-6f97-43f1-b5ea-e504a5d6966c tempest-TestStampPattern-1026635927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-c7b0e17f-ef27-406c-84a7-e9e2c18ece55 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-1df87c1e-7bc6-4d11-b025-bfea155baf5d {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:27:38 devstack sudo[106181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-c7b0e17f-ef27-406c-84a7-e9e2c18ece55 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-1df87c1e-7bc6-4d11-b025-bfea155baf5d Aug 05 06:27:38 devstack sudo[106181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:27:45 devstack sudo[106181]: pam_unix(sudo:session): session closed for user root Aug 05 06:27:45 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-1c0b7d4f-6f97-43f1-b5ea-e504a5d6966c tempest-TestStampPattern-1026635927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-c7b0e17f-ef27-406c-84a7-e9e2c18ece55 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-1df87c1e-7bc6-4d11-b025-bfea155baf5d" returned: 0 in 6.426s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:27:45 devstack cinder-volume[88695]: DEBUG cinder.image.image_utils [None req-1c0b7d4f-6f97-43f1-b5ea-e504a5d6966c tempest-TestStampPattern-1026635927 None] Image conversion details: src /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-c7b0e17f-ef27-406c-84a7-e9e2c18ece55, size 1024.00 MB, duration 6.43 sec, destination /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-1df87c1e-7bc6-4d11-b025-bfea155baf5d {{(pid=88695) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 05 06:27:45 devstack cinder-volume[88695]: INFO cinder.image.image_utils [None req-1c0b7d4f-6f97-43f1-b5ea-e504a5d6966c tempest-TestStampPattern-1026635927 None] Converted 1024.00 MB image at 159.33 MB/s Aug 05 06:27:45 devstack cinder-volume[88695]: WARNING cinder.volume.drivers.remotefs [None req-1c0b7d4f-6f97-43f1-b5ea-e504a5d6966c tempest-TestStampPattern-1026635927 None] /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-1df87c1e-7bc6-4d11-b025-bfea155baf5d is being set with open permissions: ugo+rw Aug 05 06:27:45 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-1c0b7d4f-6f97-43f1-b5ea-e504a5d6966c tempest-TestStampPattern-1026635927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-1df87c1e-7bc6-4d11-b025-bfea155baf5d {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:27:45 devstack sudo[106233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-1df87c1e-7bc6-4d11-b025-bfea155baf5d Aug 05 06:27:45 devstack sudo[106233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:27:45 devstack sudo[106233]: pam_unix(sudo:session): session closed for user root Aug 05 06:27:45 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-1c0b7d4f-6f97-43f1-b5ea-e504a5d6966c tempest-TestStampPattern-1026635927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-1df87c1e-7bc6-4d11-b025-bfea155baf5d" returned: 0 in 0.244s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:27:45 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-1c0b7d4f-6f97-43f1-b5ea-e504a5d6966c tempest-TestStampPattern-1026635927 None] Lock "cinder-quobyte-1df87c1e-7bc6-4d11-b025-bfea155baf5d" released by "_copy_volume_from_snapshot" :: held 7.708s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:27:50 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-1c0b7d4f-6f97-43f1-b5ea-e504a5d6966c tempest-TestStampPattern-1026635927 None] Lock "cinder-quobyte-79f048f0-9c89-4fd6-b44b-b5183380c965-1df87c1e-7bc6-4d11-b025-bfea155baf5d" released by "_create_volume_from_snapshot" :: held 12.542s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:27:50 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-1c0b7d4f-6f97-43f1-b5ea-e504a5d6966c tempest-TestStampPattern-1026635927 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.559s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:27:50 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-1c0b7d4f-6f97-43f1-b5ea-e504a5d6966c tempest-TestStampPattern-1026635927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5dff34ae-cca5-47a6-8d0c-cec2069526f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1df87c1e-7bc6-4d11-b025-bfea155baf5d', 'volume_size': 1, 'snapshot_id': '79f048f0-9c89-4fd6-b44b-b5183380c965'}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:27:50 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-1c0b7d4f-6f97-43f1-b5ea-e504a5d6966c tempest-TestStampPattern-1026635927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53aea4ba-8f25-4f3f-8f0d-d4367f10de11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:27:50 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-1c0b7d4f-6f97-43f1-b5ea-e504a5d6966c tempest-TestStampPattern-1026635927 None] Volume volume-1df87c1e-7bc6-4d11-b025-bfea155baf5d (1df87c1e-7bc6-4d11-b025-bfea155baf5d): created successfully Aug 05 06:27:50 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-1c0b7d4f-6f97-43f1-b5ea-e504a5d6966c tempest-TestStampPattern-1026635927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53aea4ba-8f25-4f3f-8f0d-d4367f10de11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:27:50 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-1c0b7d4f-6f97-43f1-b5ea-e504a5d6966c tempest-TestStampPattern-1026635927 None] Flow 'volume_create_manager' (e759119a-cd69-4e48-86f9-3f18e6731d2b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:27:50 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-1c0b7d4f-6f97-43f1-b5ea-e504a5d6966c tempest-TestStampPattern-1026635927 None] Created volume successfully. Aug 05 06:27:58 devstack cinder-volume[88695]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d796a64-f171-48f4-acaf-16f9cbe8b78c tempest-VolumesDeleteCascade-1263279327 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88695) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 06:27:58 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-9d796a64-f171-48f4-acaf-16f9cbe8b78c tempest-VolumesDeleteCascade-1263279327 None] Flow 'volume_create_manager' (dff39e36-234f-4c94-9753-3f76c1657d29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:27:58 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-9d796a64-f171-48f4-acaf-16f9cbe8b78c tempest-VolumesDeleteCascade-1263279327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac97cb74-6784-42f5-89df-5fc7975d78c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:27:58 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-9d796a64-f171-48f4-acaf-16f9cbe8b78c tempest-VolumesDeleteCascade-1263279327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac97cb74-6784-42f5-89df-5fc7975d78c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:27:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-897988295',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62b6c364-e4cb-484c-8e03-ea88e92790da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4a7021274d748a988571d3ab32bbc0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:27:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:27:58Z,use_quota=True,user_id='3ac9554f9dd547838338c314470a2451',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:27:58 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-9d796a64-f171-48f4-acaf-16f9cbe8b78c tempest-VolumesDeleteCascade-1263279327 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5439b98-fde5-4761-bd89-49493d5e0a91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:27:58 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-9d796a64-f171-48f4-acaf-16f9cbe8b78c tempest-VolumesDeleteCascade-1263279327 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5439b98-fde5-4761-bd89-49493d5e0a91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:27:58 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-9d796a64-f171-48f4-acaf-16f9cbe8b78c tempest-VolumesDeleteCascade-1263279327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7848388a-8a81-49f4-a571-0fcf9b8f7ec8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:27:58 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-9d796a64-f171-48f4-acaf-16f9cbe8b78c tempest-VolumesDeleteCascade-1263279327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7848388a-8a81-49f4-a571-0fcf9b8f7ec8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '62b6c364-e4cb-484c-8e03-ea88e92790da', 'volume_name': 'volume-62b6c364-e4cb-484c-8e03-ea88e92790da', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:27:58 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-9d796a64-f171-48f4-acaf-16f9cbe8b78c tempest-VolumesDeleteCascade-1263279327 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e4be7cd-1575-4224-848a-74b1fd968a94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:27:58 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-9d796a64-f171-48f4-acaf-16f9cbe8b78c tempest-VolumesDeleteCascade-1263279327 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e4be7cd-1575-4224-848a-74b1fd968a94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:27:58 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-9d796a64-f171-48f4-acaf-16f9cbe8b78c tempest-VolumesDeleteCascade-1263279327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f392e66-ef75-4a2b-bb6e-c454fa0e62f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:27:58 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-9d796a64-f171-48f4-acaf-16f9cbe8b78c tempest-VolumesDeleteCascade-1263279327 None] Volume 62b6c364-e4cb-484c-8e03-ea88e92790da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-62b6c364-e4cb-484c-8e03-ea88e92790da', 'volume_size': 1} Aug 05 06:27:58 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-9d796a64-f171-48f4-acaf-16f9cbe8b78c tempest-VolumesDeleteCascade-1263279327 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:27:58 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-9d796a64-f171-48f4-acaf-16f9cbe8b78c tempest-VolumesDeleteCascade-1263279327 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:27:58 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-9d796a64-f171-48f4-acaf-16f9cbe8b78c tempest-VolumesDeleteCascade-1263279327 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:27:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-897988295',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62b6c364-e4cb-484c-8e03-ea88e92790da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4a7021274d748a988571d3ab32bbc0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:27:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:27:58Z,use_quota=True,user_id='3ac9554f9dd547838338c314470a2451',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)}" {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 06:27:58 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-9d796a64-f171-48f4-acaf-16f9cbe8b78c tempest-VolumesDeleteCascade-1263279327 None] Creating volume 62b6c364-e4cb-484c-8e03-ea88e92790da {{(pid=88695) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 06:27:58 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-9d796a64-f171-48f4-acaf-16f9cbe8b78c tempest-VolumesDeleteCascade-1263279327 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:27:58 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-9d796a64-f171-48f4-acaf-16f9cbe8b78c tempest-VolumesDeleteCascade-1263279327 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:27:58 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-9d796a64-f171-48f4-acaf-16f9cbe8b78c tempest-VolumesDeleteCascade-1263279327 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:27:58 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-9d796a64-f171-48f4-acaf-16f9cbe8b78c tempest-VolumesDeleteCascade-1263279327 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:27:58 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-9d796a64-f171-48f4-acaf-16f9cbe8b78c tempest-VolumesDeleteCascade-1263279327 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:27:58 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-9d796a64-f171-48f4-acaf-16f9cbe8b78c tempest-VolumesDeleteCascade-1263279327 None] Selected osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 as target Quobyte volume. {{(pid=88695) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 06:27:58 devstack cinder-volume[88695]: INFO cinder.volume.drivers.remotefs [None req-9d796a64-f171-48f4-acaf-16f9cbe8b78c tempest-VolumesDeleteCascade-1263279327 None] casted to osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 Aug 05 06:27:58 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-9d796a64-f171-48f4-acaf-16f9cbe8b78c tempest-VolumesDeleteCascade-1263279327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-62b6c364-e4cb-484c-8e03-ea88e92790da 1073741824 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:27:58 devstack sudo[106331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-62b6c364-e4cb-484c-8e03-ea88e92790da 1073741824 Aug 05 06:27:58 devstack sudo[106331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:27:58 devstack sudo[106331]: pam_unix(sudo:session): session closed for user root Aug 05 06:27:58 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-9d796a64-f171-48f4-acaf-16f9cbe8b78c tempest-VolumesDeleteCascade-1263279327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-62b6c364-e4cb-484c-8e03-ea88e92790da 1073741824" returned: 0 in 0.463s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:27:58 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-9d796a64-f171-48f4-acaf-16f9cbe8b78c tempest-VolumesDeleteCascade-1263279327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-62b6c364-e4cb-484c-8e03-ea88e92790da {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:27:58 devstack sudo[106336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-62b6c364-e4cb-484c-8e03-ea88e92790da Aug 05 06:27:58 devstack sudo[106336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:27:59 devstack sudo[106336]: pam_unix(sudo:session): session closed for user root Aug 05 06:27:59 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-9d796a64-f171-48f4-acaf-16f9cbe8b78c tempest-VolumesDeleteCascade-1263279327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-62b6c364-e4cb-484c-8e03-ea88e92790da" returned: 0 in 0.270s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:27:59 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-9d796a64-f171-48f4-acaf-16f9cbe8b78c tempest-VolumesDeleteCascade-1263279327 None] <== create_volume: return (779ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'} {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 06:27:59 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-9d796a64-f171-48f4-acaf-16f9cbe8b78c tempest-VolumesDeleteCascade-1263279327 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.782s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:27:59 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-9d796a64-f171-48f4-acaf-16f9cbe8b78c tempest-VolumesDeleteCascade-1263279327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f392e66-ef75-4a2b-bb6e-c454fa0e62f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62b6c364-e4cb-484c-8e03-ea88e92790da', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:27:59 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-9d796a64-f171-48f4-acaf-16f9cbe8b78c tempest-VolumesDeleteCascade-1263279327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9127e13-4f59-4b9c-b51e-702bcb4c407d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:27:59 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-9d796a64-f171-48f4-acaf-16f9cbe8b78c tempest-VolumesDeleteCascade-1263279327 None] Volume volume-62b6c364-e4cb-484c-8e03-ea88e92790da (62b6c364-e4cb-484c-8e03-ea88e92790da): created successfully Aug 05 06:27:59 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-9d796a64-f171-48f4-acaf-16f9cbe8b78c tempest-VolumesDeleteCascade-1263279327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9127e13-4f59-4b9c-b51e-702bcb4c407d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:27:59 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-9d796a64-f171-48f4-acaf-16f9cbe8b78c tempest-VolumesDeleteCascade-1263279327 None] Flow 'volume_create_manager' (dff39e36-234f-4c94-9753-3f76c1657d29) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:27:59 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-9d796a64-f171-48f4-acaf-16f9cbe8b78c tempest-VolumesDeleteCascade-1263279327 None] Created volume successfully. Aug 05 06:28:00 devstack cinder-volume[88695]: DEBUG oslo_service.periodic_task [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88695) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 06:28:00 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:28:00 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:28:00 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:28:00 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:28:00 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:28:00 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:28:00 devstack sudo[106339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce Aug 05 06:28:00 devstack sudo[106339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:28:00 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-90dbbc3d-e83e-4f21-9463-693a6b09fa2c tempest-VolumesDeleteCascade-1263279327 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:28:00 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-90dbbc3d-e83e-4f21-9463-693a6b09fa2c tempest-VolumesDeleteCascade-1263279327 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:28:00 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-90dbbc3d-e83e-4f21-9463-693a6b09fa2c tempest-VolumesDeleteCascade-1263279327 None] Creating offline snapshot 8ead1892-261a-4abd-af16-20dd83c44432 of volume 62b6c364-e4cb-484c-8e03-ea88e92790da {{(pid=88695) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 06:28:00 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce44a4cb-18a0-4282-9eb4-d874b12a95e0]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:28:00 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-90dbbc3d-e83e-4f21-9463-693a6b09fa2c tempest-VolumesDeleteCascade-1263279327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-62b6c364-e4cb-484c-8e03-ea88e92790da {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:28:00 devstack sudo[106341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-62b6c364-e4cb-484c-8e03-ea88e92790da Aug 05 06:28:00 devstack sudo[106341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:28:00 devstack sudo[106339]: pam_unix(sudo:session): session closed for user root Aug 05 06:28:00 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce" returned: 0 in 0.287s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:28:00 devstack cinder-volume[88695]: DEBUG cinder.manager [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] Notifying Schedulers of capabilities ... {{(pid=88695) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 06:28:00 devstack cinder-volume[88695]: DEBUG oslo_service.periodic_task [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] Running periodic task VolumeManager._thread_info {{(pid=88695) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 06:28:00 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] thread count: 28 {{(pid=88695) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 05 06:28:00 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] thread info: [<_MainThread(MainThread, started 134469211893888)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88695) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 05 06:28:00 devstack sudo[106341]: pam_unix(sudo:session): session closed for user root Aug 05 06:28:00 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-90dbbc3d-e83e-4f21-9463-693a6b09fa2c tempest-VolumesDeleteCascade-1263279327 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-62b6c364-e4cb-484c-8e03-ea88e92790da" returned: 0 in 0.364s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:28:00 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-90dbbc3d-e83e-4f21-9463-693a6b09fa2c tempest-VolumesDeleteCascade-1263279327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-62b6c364-e4cb-484c-8e03-ea88e92790da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-62b6c364-e4cb-484c-8e03-ea88e92790da.8ead1892-261a-4abd-af16-20dd83c44432 1G {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:28:00 devstack sudo[106347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-62b6c364-e4cb-484c-8e03-ea88e92790da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-62b6c364-e4cb-484c-8e03-ea88e92790da.8ead1892-261a-4abd-af16-20dd83c44432 1G Aug 05 06:28:00 devstack sudo[106347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:28:01 devstack sudo[106347]: pam_unix(sudo:session): session closed for user root Aug 05 06:28:01 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-90dbbc3d-e83e-4f21-9463-693a6b09fa2c tempest-VolumesDeleteCascade-1263279327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-62b6c364-e4cb-484c-8e03-ea88e92790da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-62b6c364-e4cb-484c-8e03-ea88e92790da.8ead1892-261a-4abd-af16-20dd83c44432 1G" returned: 0 in 0.391s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:28:01 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-90dbbc3d-e83e-4f21-9463-693a6b09fa2c tempest-VolumesDeleteCascade-1263279327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-62b6c364-e4cb-484c-8e03-ea88e92790da -F qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-62b6c364-e4cb-484c-8e03-ea88e92790da.8ead1892-261a-4abd-af16-20dd83c44432 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:28:01 devstack sudo[106352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-62b6c364-e4cb-484c-8e03-ea88e92790da -F qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-62b6c364-e4cb-484c-8e03-ea88e92790da.8ead1892-261a-4abd-af16-20dd83c44432 Aug 05 06:28:01 devstack sudo[106352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:28:01 devstack sudo[106352]: pam_unix(sudo:session): session closed for user root Aug 05 06:28:01 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-90dbbc3d-e83e-4f21-9463-693a6b09fa2c tempest-VolumesDeleteCascade-1263279327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-62b6c364-e4cb-484c-8e03-ea88e92790da -F qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-62b6c364-e4cb-484c-8e03-ea88e92790da.8ead1892-261a-4abd-af16-20dd83c44432" returned: 0 in 0.303s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:28:01 devstack cinder-volume[88695]: WARNING cinder.volume.drivers.remotefs [None req-90dbbc3d-e83e-4f21-9463-693a6b09fa2c tempest-VolumesDeleteCascade-1263279327 None] /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-62b6c364-e4cb-484c-8e03-ea88e92790da.8ead1892-261a-4abd-af16-20dd83c44432 is being set with open permissions: ugo+rw Aug 05 06:28:01 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-90dbbc3d-e83e-4f21-9463-693a6b09fa2c tempest-VolumesDeleteCascade-1263279327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-62b6c364-e4cb-484c-8e03-ea88e92790da.8ead1892-261a-4abd-af16-20dd83c44432 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:28:01 devstack sudo[106357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-62b6c364-e4cb-484c-8e03-ea88e92790da.8ead1892-261a-4abd-af16-20dd83c44432 Aug 05 06:28:01 devstack sudo[106357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:28:01 devstack sudo[106357]: pam_unix(sudo:session): session closed for user root Aug 05 06:28:01 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-90dbbc3d-e83e-4f21-9463-693a6b09fa2c tempest-VolumesDeleteCascade-1263279327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-62b6c364-e4cb-484c-8e03-ea88e92790da.8ead1892-261a-4abd-af16-20dd83c44432" returned: 0 in 0.242s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:28:01 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-90dbbc3d-e83e-4f21-9463-693a6b09fa2c tempest-VolumesDeleteCascade-1263279327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-62b6c364-e4cb-484c-8e03-ea88e92790da.info {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:28:01 devstack sudo[106360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-62b6c364-e4cb-484c-8e03-ea88e92790da.info Aug 05 06:28:01 devstack sudo[106360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:28:02 devstack sudo[106360]: pam_unix(sudo:session): session closed for user root Aug 05 06:28:02 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-90dbbc3d-e83e-4f21-9463-693a6b09fa2c tempest-VolumesDeleteCascade-1263279327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-62b6c364-e4cb-484c-8e03-ea88e92790da.info" returned: 0 in 0.249s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:28:02 devstack cinder-volume[88695]: WARNING cinder.volume.drivers.remotefs [None req-90dbbc3d-e83e-4f21-9463-693a6b09fa2c tempest-VolumesDeleteCascade-1263279327 None] /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-62b6c364-e4cb-484c-8e03-ea88e92790da.info is being set with open permissions: ugo+rw Aug 05 06:28:02 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-90dbbc3d-e83e-4f21-9463-693a6b09fa2c tempest-VolumesDeleteCascade-1263279327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-62b6c364-e4cb-484c-8e03-ea88e92790da.info {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:28:02 devstack sudo[106363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-62b6c364-e4cb-484c-8e03-ea88e92790da.info Aug 05 06:28:02 devstack sudo[106363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:28:02 devstack sudo[106363]: pam_unix(sudo:session): session closed for user root Aug 05 06:28:02 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-90dbbc3d-e83e-4f21-9463-693a6b09fa2c tempest-VolumesDeleteCascade-1263279327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-62b6c364-e4cb-484c-8e03-ea88e92790da.info" returned: 0 in 0.248s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:28:02 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-90dbbc3d-e83e-4f21-9463-693a6b09fa2c tempest-VolumesDeleteCascade-1263279327 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.892s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:28:02 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-90dbbc3d-e83e-4f21-9463-693a6b09fa2c tempest-VolumesDeleteCascade-1263279327 None] Create snapshot completed successfully Aug 05 06:28:02 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-d27afc8c-27ae-4d93-ae44-3446e656f11f tempest-VolumesDeleteCascade-1263279327 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:28:02 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-d27afc8c-27ae-4d93-ae44-3446e656f11f tempest-VolumesDeleteCascade-1263279327 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:28:02 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-d27afc8c-27ae-4d93-ae44-3446e656f11f tempest-VolumesDeleteCascade-1263279327 None] Creating offline snapshot 49fe9731-459d-4c08-b508-cfc93b2a9676 of volume 62b6c364-e4cb-484c-8e03-ea88e92790da {{(pid=88695) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 06:28:02 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[af94bfef-53ab-4ee0-b64c-8dc8083bfc11]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:28:02 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-d27afc8c-27ae-4d93-ae44-3446e656f11f tempest-VolumesDeleteCascade-1263279327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-62b6c364-e4cb-484c-8e03-ea88e92790da.8ead1892-261a-4abd-af16-20dd83c44432 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:28:03 devstack sudo[106366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-62b6c364-e4cb-484c-8e03-ea88e92790da.8ead1892-261a-4abd-af16-20dd83c44432 Aug 05 06:28:03 devstack sudo[106366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:28:03 devstack sudo[106366]: pam_unix(sudo:session): session closed for user root Aug 05 06:28:03 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-d27afc8c-27ae-4d93-ae44-3446e656f11f tempest-VolumesDeleteCascade-1263279327 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-62b6c364-e4cb-484c-8e03-ea88e92790da.8ead1892-261a-4abd-af16-20dd83c44432" returned: 0 in 0.382s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:28:03 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-d27afc8c-27ae-4d93-ae44-3446e656f11f tempest-VolumesDeleteCascade-1263279327 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-62b6c364-e4cb-484c-8e03-ea88e92790da(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88695) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 06:28:03 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-d27afc8c-27ae-4d93-ae44-3446e656f11f tempest-VolumesDeleteCascade-1263279327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-62b6c364-e4cb-484c-8e03-ea88e92790da.8ead1892-261a-4abd-af16-20dd83c44432,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-62b6c364-e4cb-484c-8e03-ea88e92790da.49fe9731-459d-4c08-b508-cfc93b2a9676 1G {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:28:03 devstack sudo[106371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-62b6c364-e4cb-484c-8e03-ea88e92790da.8ead1892-261a-4abd-af16-20dd83c44432,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-62b6c364-e4cb-484c-8e03-ea88e92790da.49fe9731-459d-4c08-b508-cfc93b2a9676 1G Aug 05 06:28:03 devstack sudo[106371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:28:03 devstack sudo[106371]: pam_unix(sudo:session): session closed for user root Aug 05 06:28:03 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-d27afc8c-27ae-4d93-ae44-3446e656f11f tempest-VolumesDeleteCascade-1263279327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-62b6c364-e4cb-484c-8e03-ea88e92790da.8ead1892-261a-4abd-af16-20dd83c44432,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-62b6c364-e4cb-484c-8e03-ea88e92790da.49fe9731-459d-4c08-b508-cfc93b2a9676 1G" returned: 0 in 0.477s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:28:03 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-d27afc8c-27ae-4d93-ae44-3446e656f11f tempest-VolumesDeleteCascade-1263279327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-62b6c364-e4cb-484c-8e03-ea88e92790da.8ead1892-261a-4abd-af16-20dd83c44432 -F qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-62b6c364-e4cb-484c-8e03-ea88e92790da.49fe9731-459d-4c08-b508-cfc93b2a9676 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:28:03 devstack sudo[106376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-62b6c364-e4cb-484c-8e03-ea88e92790da.8ead1892-261a-4abd-af16-20dd83c44432 -F qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-62b6c364-e4cb-484c-8e03-ea88e92790da.49fe9731-459d-4c08-b508-cfc93b2a9676 Aug 05 06:28:03 devstack sudo[106376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:28:04 devstack sudo[106376]: pam_unix(sudo:session): session closed for user root Aug 05 06:28:04 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-d27afc8c-27ae-4d93-ae44-3446e656f11f tempest-VolumesDeleteCascade-1263279327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-62b6c364-e4cb-484c-8e03-ea88e92790da.8ead1892-261a-4abd-af16-20dd83c44432 -F qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-62b6c364-e4cb-484c-8e03-ea88e92790da.49fe9731-459d-4c08-b508-cfc93b2a9676" returned: 0 in 0.315s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:28:04 devstack cinder-volume[88695]: WARNING cinder.volume.drivers.remotefs [None req-d27afc8c-27ae-4d93-ae44-3446e656f11f tempest-VolumesDeleteCascade-1263279327 None] /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-62b6c364-e4cb-484c-8e03-ea88e92790da.49fe9731-459d-4c08-b508-cfc93b2a9676 is being set with open permissions: ugo+rw Aug 05 06:28:04 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-d27afc8c-27ae-4d93-ae44-3446e656f11f tempest-VolumesDeleteCascade-1263279327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-62b6c364-e4cb-484c-8e03-ea88e92790da.49fe9731-459d-4c08-b508-cfc93b2a9676 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:28:04 devstack sudo[106381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-62b6c364-e4cb-484c-8e03-ea88e92790da.49fe9731-459d-4c08-b508-cfc93b2a9676 Aug 05 06:28:04 devstack sudo[106381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:28:04 devstack sudo[106381]: pam_unix(sudo:session): session closed for user root Aug 05 06:28:04 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-d27afc8c-27ae-4d93-ae44-3446e656f11f tempest-VolumesDeleteCascade-1263279327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-62b6c364-e4cb-484c-8e03-ea88e92790da.49fe9731-459d-4c08-b508-cfc93b2a9676" returned: 0 in 0.277s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:28:04 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-d27afc8c-27ae-4d93-ae44-3446e656f11f tempest-VolumesDeleteCascade-1263279327 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.554s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:28:04 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-d27afc8c-27ae-4d93-ae44-3446e656f11f tempest-VolumesDeleteCascade-1263279327 None] Create snapshot completed successfully Aug 05 06:28:05 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-d0254000-5d37-4a5e-9e95-9fec14ac2104 tempest-VolumesDeleteCascade-1263279327 None] Acquiring lock "cinder-62b6c364-e4cb-484c-8e03-ea88e92790da-delete_volume" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:28:05 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-d0254000-5d37-4a5e-9e95-9fec14ac2104 tempest-VolumesDeleteCascade-1263279327 None] Lock "cinder-62b6c364-e4cb-484c-8e03-ea88e92790da-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:28:05 devstack cinder-volume[88695]: DEBUG dbcounter [-] [88695] Writing DB stats cinder:SELECT=72,cinder:INSERT=16,cinder:UPDATE=82,cinder:DELETE=10 {{(pid=88695) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 06:28:05 devstack cinder-volume[88695]: DEBUG dbcounter [-] [88695] Writing DB stats cinder:UPDATE=82,cinder:SELECT=74,cinder:DELETE=7,cinder:INSERT=20 {{(pid=88695) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 06:28:05 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-d0254000-5d37-4a5e-9e95-9fec14ac2104 tempest-VolumesDeleteCascade-1263279327 None] Performing cascade delete. {{(pid=88695) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Aug 05 06:28:05 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-d0254000-5d37-4a5e-9e95-9fec14ac2104 tempest-VolumesDeleteCascade-1263279327 None] Acquiring lock "cinder-49fe9731-459d-4c08-b508-cfc93b2a9676-delete_snapshot" by "delete_snapshot" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:28:05 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-d0254000-5d37-4a5e-9e95-9fec14ac2104 tempest-VolumesDeleteCascade-1263279327 None] Lock "cinder-49fe9731-459d-4c08-b508-cfc93b2a9676-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:28:05 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-d0254000-5d37-4a5e-9e95-9fec14ac2104 tempest-VolumesDeleteCascade-1263279327 None] Acquiring lock "cinder-quobyte-62b6c364-e4cb-484c-8e03-ea88e92790da" by "delete_snapshot" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:28:05 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-d0254000-5d37-4a5e-9e95-9fec14ac2104 tempest-VolumesDeleteCascade-1263279327 None] Lock "cinder-quobyte-62b6c364-e4cb-484c-8e03-ea88e92790da" acquired by "delete_snapshot" :: waited 0.015s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:28:05 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-d0254000-5d37-4a5e-9e95-9fec14ac2104 tempest-VolumesDeleteCascade-1263279327 None] Acquiring lock "cinder-quobyte-49fe9731-459d-4c08-b508-cfc93b2a9676" by "_delete_snapshot" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:28:05 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-d0254000-5d37-4a5e-9e95-9fec14ac2104 tempest-VolumesDeleteCascade-1263279327 None] Lock "cinder-quobyte-49fe9731-459d-4c08-b508-cfc93b2a9676" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:28:05 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-d0254000-5d37-4a5e-9e95-9fec14ac2104 tempest-VolumesDeleteCascade-1263279327 None] Deleting offline snapshot 49fe9731-459d-4c08-b508-cfc93b2a9676 of volume 62b6c364-e4cb-484c-8e03-ea88e92790da {{(pid=88695) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 06:28:05 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-d0254000-5d37-4a5e-9e95-9fec14ac2104 tempest-VolumesDeleteCascade-1263279327 None] snapshot_file for this snap is: volume-62b6c364-e4cb-484c-8e03-ea88e92790da.49fe9731-459d-4c08-b508-cfc93b2a9676 {{(pid=88695) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 06:28:05 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[46a6a51e-133f-4e8a-8708-3d27221a1fa6]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:28:05 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-d0254000-5d37-4a5e-9e95-9fec14ac2104 tempest-VolumesDeleteCascade-1263279327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-62b6c364-e4cb-484c-8e03-ea88e92790da.49fe9731-459d-4c08-b508-cfc93b2a9676 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:28:05 devstack sudo[106393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-62b6c364-e4cb-484c-8e03-ea88e92790da.49fe9731-459d-4c08-b508-cfc93b2a9676 Aug 05 06:28:05 devstack sudo[106393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:28:05 devstack sudo[106393]: pam_unix(sudo:session): session closed for user root Aug 05 06:28:05 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-d0254000-5d37-4a5e-9e95-9fec14ac2104 tempest-VolumesDeleteCascade-1263279327 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-62b6c364-e4cb-484c-8e03-ea88e92790da.49fe9731-459d-4c08-b508-cfc93b2a9676" returned: 0 in 0.422s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:28:05 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-d0254000-5d37-4a5e-9e95-9fec14ac2104 tempest-VolumesDeleteCascade-1263279327 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-62b6c364-e4cb-484c-8e03-ea88e92790da(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88695) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 06:28:05 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[a128a793-f611-426f-9e90-a617144ec388]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:28:05 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-d0254000-5d37-4a5e-9e95-9fec14ac2104 tempest-VolumesDeleteCascade-1263279327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-62b6c364-e4cb-484c-8e03-ea88e92790da.8ead1892-261a-4abd-af16-20dd83c44432 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:28:05 devstack sudo[106404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-62b6c364-e4cb-484c-8e03-ea88e92790da.8ead1892-261a-4abd-af16-20dd83c44432 Aug 05 06:28:05 devstack sudo[106404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:28:06 devstack sudo[106404]: pam_unix(sudo:session): session closed for user root Aug 05 06:28:06 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-d0254000-5d37-4a5e-9e95-9fec14ac2104 tempest-VolumesDeleteCascade-1263279327 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-62b6c364-e4cb-484c-8e03-ea88e92790da.8ead1892-261a-4abd-af16-20dd83c44432" returned: 0 in 0.366s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:28:06 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-d0254000-5d37-4a5e-9e95-9fec14ac2104 tempest-VolumesDeleteCascade-1263279327 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-62b6c364-e4cb-484c-8e03-ea88e92790da(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88695) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 06:28:06 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-d0254000-5d37-4a5e-9e95-9fec14ac2104 tempest-VolumesDeleteCascade-1263279327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-62b6c364-e4cb-484c-8e03-ea88e92790da.49fe9731-459d-4c08-b508-cfc93b2a9676 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:28:06 devstack sudo[106409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-62b6c364-e4cb-484c-8e03-ea88e92790da.49fe9731-459d-4c08-b508-cfc93b2a9676 Aug 05 06:28:06 devstack sudo[106409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:28:06 devstack sudo[106409]: pam_unix(sudo:session): session closed for user root Aug 05 06:28:06 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-d0254000-5d37-4a5e-9e95-9fec14ac2104 tempest-VolumesDeleteCascade-1263279327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-62b6c364-e4cb-484c-8e03-ea88e92790da.49fe9731-459d-4c08-b508-cfc93b2a9676" returned: 0 in 0.391s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:28:06 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-d0254000-5d37-4a5e-9e95-9fec14ac2104 tempest-VolumesDeleteCascade-1263279327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-62b6c364-e4cb-484c-8e03-ea88e92790da.49fe9731-459d-4c08-b508-cfc93b2a9676 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:28:06 devstack sudo[106429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-62b6c364-e4cb-484c-8e03-ea88e92790da.49fe9731-459d-4c08-b508-cfc93b2a9676 Aug 05 06:28:06 devstack sudo[106429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:28:06 devstack sudo[106429]: pam_unix(sudo:session): session closed for user root Aug 05 06:28:06 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-d0254000-5d37-4a5e-9e95-9fec14ac2104 tempest-VolumesDeleteCascade-1263279327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-62b6c364-e4cb-484c-8e03-ea88e92790da.49fe9731-459d-4c08-b508-cfc93b2a9676" returned: 0 in 0.251s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:28:06 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-d0254000-5d37-4a5e-9e95-9fec14ac2104 tempest-VolumesDeleteCascade-1263279327 None] Lock "cinder-quobyte-49fe9731-459d-4c08-b508-cfc93b2a9676" released by "_delete_snapshot" :: held 1.535s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:28:06 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-d0254000-5d37-4a5e-9e95-9fec14ac2104 tempest-VolumesDeleteCascade-1263279327 None] Lock "cinder-quobyte-62b6c364-e4cb-484c-8e03-ea88e92790da" released by "delete_snapshot" :: held 1.559s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:28:06 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-d0254000-5d37-4a5e-9e95-9fec14ac2104 tempest-VolumesDeleteCascade-1263279327 None] Created reservations ['14430ac3-a3df-4ed5-9ab5-48fa80abce6b', '843165fd-e784-4eaa-b197-a9fdc1c3723b', '4225882e-5325-476d-8afe-678310c37321', 'a55444aa-e82d-424d-afbe-d7c966a2d175'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:28:06 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-d0254000-5d37-4a5e-9e95-9fec14ac2104 tempest-VolumesDeleteCascade-1263279327 None] Delete snapshot completed successfully. Aug 05 06:28:06 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-d0254000-5d37-4a5e-9e95-9fec14ac2104 tempest-VolumesDeleteCascade-1263279327 None] Lock "cinder-49fe9731-459d-4c08-b508-cfc93b2a9676-delete_snapshot" released by "delete_snapshot" :: held 1.709s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:28:06 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-d0254000-5d37-4a5e-9e95-9fec14ac2104 tempest-VolumesDeleteCascade-1263279327 None] Acquiring lock "cinder-8ead1892-261a-4abd-af16-20dd83c44432-delete_snapshot" by "delete_snapshot" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:28:06 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-d0254000-5d37-4a5e-9e95-9fec14ac2104 tempest-VolumesDeleteCascade-1263279327 None] Lock "cinder-8ead1892-261a-4abd-af16-20dd83c44432-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:28:06 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-d0254000-5d37-4a5e-9e95-9fec14ac2104 tempest-VolumesDeleteCascade-1263279327 None] Acquiring lock "cinder-quobyte-62b6c364-e4cb-484c-8e03-ea88e92790da" by "delete_snapshot" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:28:06 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-d0254000-5d37-4a5e-9e95-9fec14ac2104 tempest-VolumesDeleteCascade-1263279327 None] Lock "cinder-quobyte-62b6c364-e4cb-484c-8e03-ea88e92790da" acquired by "delete_snapshot" :: waited 0.014s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:28:06 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-d0254000-5d37-4a5e-9e95-9fec14ac2104 tempest-VolumesDeleteCascade-1263279327 None] Acquiring lock "cinder-quobyte-8ead1892-261a-4abd-af16-20dd83c44432" by "_delete_snapshot" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:28:06 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-d0254000-5d37-4a5e-9e95-9fec14ac2104 tempest-VolumesDeleteCascade-1263279327 None] Lock "cinder-quobyte-8ead1892-261a-4abd-af16-20dd83c44432" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:28:06 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-d0254000-5d37-4a5e-9e95-9fec14ac2104 tempest-VolumesDeleteCascade-1263279327 None] Deleting offline snapshot 8ead1892-261a-4abd-af16-20dd83c44432 of volume 62b6c364-e4cb-484c-8e03-ea88e92790da {{(pid=88695) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 06:28:06 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-d0254000-5d37-4a5e-9e95-9fec14ac2104 tempest-VolumesDeleteCascade-1263279327 None] snapshot_file for this snap is: volume-62b6c364-e4cb-484c-8e03-ea88e92790da.8ead1892-261a-4abd-af16-20dd83c44432 {{(pid=88695) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 06:28:06 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[9775dc70-07c9-4888-9b30-ea7f00b3ae62]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:28:06 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-d0254000-5d37-4a5e-9e95-9fec14ac2104 tempest-VolumesDeleteCascade-1263279327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-62b6c364-e4cb-484c-8e03-ea88e92790da.8ead1892-261a-4abd-af16-20dd83c44432 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:28:07 devstack sudo[106432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-62b6c364-e4cb-484c-8e03-ea88e92790da.8ead1892-261a-4abd-af16-20dd83c44432 Aug 05 06:28:07 devstack sudo[106432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:28:07 devstack sudo[106432]: pam_unix(sudo:session): session closed for user root Aug 05 06:28:07 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-d0254000-5d37-4a5e-9e95-9fec14ac2104 tempest-VolumesDeleteCascade-1263279327 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-62b6c364-e4cb-484c-8e03-ea88e92790da.8ead1892-261a-4abd-af16-20dd83c44432" returned: 0 in 0.379s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:28:07 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-d0254000-5d37-4a5e-9e95-9fec14ac2104 tempest-VolumesDeleteCascade-1263279327 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-62b6c364-e4cb-484c-8e03-ea88e92790da(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88695) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 06:28:07 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[867e4f9d-74f1-4967-8688-b1a766bedfd7]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:28:07 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-d0254000-5d37-4a5e-9e95-9fec14ac2104 tempest-VolumesDeleteCascade-1263279327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-62b6c364-e4cb-484c-8e03-ea88e92790da {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:28:07 devstack sudo[106437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-62b6c364-e4cb-484c-8e03-ea88e92790da Aug 05 06:28:07 devstack sudo[106437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:28:07 devstack sudo[106437]: pam_unix(sudo:session): session closed for user root Aug 05 06:28:07 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-d0254000-5d37-4a5e-9e95-9fec14ac2104 tempest-VolumesDeleteCascade-1263279327 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-62b6c364-e4cb-484c-8e03-ea88e92790da" returned: 0 in 0.366s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:28:07 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-d0254000-5d37-4a5e-9e95-9fec14ac2104 tempest-VolumesDeleteCascade-1263279327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-62b6c364-e4cb-484c-8e03-ea88e92790da.8ead1892-261a-4abd-af16-20dd83c44432 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:28:07 devstack sudo[106442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-62b6c364-e4cb-484c-8e03-ea88e92790da.8ead1892-261a-4abd-af16-20dd83c44432 Aug 05 06:28:07 devstack sudo[106442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:28:08 devstack sudo[106442]: pam_unix(sudo:session): session closed for user root Aug 05 06:28:08 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-d0254000-5d37-4a5e-9e95-9fec14ac2104 tempest-VolumesDeleteCascade-1263279327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-62b6c364-e4cb-484c-8e03-ea88e92790da.8ead1892-261a-4abd-af16-20dd83c44432" returned: 0 in 0.333s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:28:08 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-d0254000-5d37-4a5e-9e95-9fec14ac2104 tempest-VolumesDeleteCascade-1263279327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-62b6c364-e4cb-484c-8e03-ea88e92790da.8ead1892-261a-4abd-af16-20dd83c44432 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:28:08 devstack sudo[106448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-62b6c364-e4cb-484c-8e03-ea88e92790da.8ead1892-261a-4abd-af16-20dd83c44432 Aug 05 06:28:08 devstack sudo[106448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:28:08 devstack sudo[106448]: pam_unix(sudo:session): session closed for user root Aug 05 06:28:08 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-d0254000-5d37-4a5e-9e95-9fec14ac2104 tempest-VolumesDeleteCascade-1263279327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-62b6c364-e4cb-484c-8e03-ea88e92790da.8ead1892-261a-4abd-af16-20dd83c44432" returned: 0 in 0.253s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:28:08 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-d0254000-5d37-4a5e-9e95-9fec14ac2104 tempest-VolumesDeleteCascade-1263279327 None] Lock "cinder-quobyte-8ead1892-261a-4abd-af16-20dd83c44432" released by "_delete_snapshot" :: held 1.409s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:28:08 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-d0254000-5d37-4a5e-9e95-9fec14ac2104 tempest-VolumesDeleteCascade-1263279327 None] Lock "cinder-quobyte-62b6c364-e4cb-484c-8e03-ea88e92790da" released by "delete_snapshot" :: held 1.429s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:28:08 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-d0254000-5d37-4a5e-9e95-9fec14ac2104 tempest-VolumesDeleteCascade-1263279327 None] Created reservations ['ac6a09b5-d473-4e52-add8-1c6c64e6764b', '29142eec-7df2-4ea9-b7e1-64ba55e123ef', '6a3dab16-524d-46cd-8bdc-131a40157302', '28c8242f-d2e8-46b8-9ac5-697294b10f03'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:28:08 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-d0254000-5d37-4a5e-9e95-9fec14ac2104 tempest-VolumesDeleteCascade-1263279327 None] Delete snapshot completed successfully. Aug 05 06:28:08 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-d0254000-5d37-4a5e-9e95-9fec14ac2104 tempest-VolumesDeleteCascade-1263279327 None] Lock "cinder-8ead1892-261a-4abd-af16-20dd83c44432-delete_snapshot" released by "delete_snapshot" :: held 1.580s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:28:08 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-d0254000-5d37-4a5e-9e95-9fec14ac2104 tempest-VolumesDeleteCascade-1263279327 None] Snapshots deleted, issuing volume delete {{(pid=88695) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Aug 05 06:28:08 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-d0254000-5d37-4a5e-9e95-9fec14ac2104 tempest-VolumesDeleteCascade-1263279327 None] Acquiring lock "cinder-quobyte-62b6c364-e4cb-484c-8e03-ea88e92790da" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:28:08 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-d0254000-5d37-4a5e-9e95-9fec14ac2104 tempest-VolumesDeleteCascade-1263279327 None] Lock "cinder-quobyte-62b6c364-e4cb-484c-8e03-ea88e92790da" acquired by "delete_volume" :: waited 0.016s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:28:08 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[55aacb51-7d4c-4408-a1d8-88f09e406ee2]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:28:08 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-d0254000-5d37-4a5e-9e95-9fec14ac2104 tempest-VolumesDeleteCascade-1263279327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-62b6c364-e4cb-484c-8e03-ea88e92790da {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:28:08 devstack sudo[106452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-62b6c364-e4cb-484c-8e03-ea88e92790da Aug 05 06:28:08 devstack sudo[106452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:28:08 devstack sudo[106452]: pam_unix(sudo:session): session closed for user root Aug 05 06:28:08 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-d0254000-5d37-4a5e-9e95-9fec14ac2104 tempest-VolumesDeleteCascade-1263279327 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-62b6c364-e4cb-484c-8e03-ea88e92790da" returned: 0 in 0.355s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:28:08 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-d0254000-5d37-4a5e-9e95-9fec14ac2104 tempest-VolumesDeleteCascade-1263279327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-62b6c364-e4cb-484c-8e03-ea88e92790da {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:28:08 devstack sudo[106457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-62b6c364-e4cb-484c-8e03-ea88e92790da Aug 05 06:28:08 devstack sudo[106457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:28:09 devstack sudo[106457]: pam_unix(sudo:session): session closed for user root Aug 05 06:28:09 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-d0254000-5d37-4a5e-9e95-9fec14ac2104 tempest-VolumesDeleteCascade-1263279327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-62b6c364-e4cb-484c-8e03-ea88e92790da" returned: 0 in 0.243s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:28:09 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-d0254000-5d37-4a5e-9e95-9fec14ac2104 tempest-VolumesDeleteCascade-1263279327 None] Lock "cinder-quobyte-62b6c364-e4cb-484c-8e03-ea88e92790da" released by "delete_volume" :: held 0.652s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:28:09 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-d0254000-5d37-4a5e-9e95-9fec14ac2104 tempest-VolumesDeleteCascade-1263279327 None] Created reservations ['b42b6ed9-7be9-4602-9d8a-b9e743f8991a', 'b1f694f4-34dd-441e-89c1-7e0a08a99c23', '562af0c2-b897-44cd-9b65-66c90c64b109', 'ac38e952-7b57-427f-8173-a514861ef251'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:28:09 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-d0254000-5d37-4a5e-9e95-9fec14ac2104 tempest-VolumesDeleteCascade-1263279327 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:28:09 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-d0254000-5d37-4a5e-9e95-9fec14ac2104 tempest-VolumesDeleteCascade-1263279327 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:28:09 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-d0254000-5d37-4a5e-9e95-9fec14ac2104 tempest-VolumesDeleteCascade-1263279327 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:28:09 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-d0254000-5d37-4a5e-9e95-9fec14ac2104 tempest-VolumesDeleteCascade-1263279327 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:28:09 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-d0254000-5d37-4a5e-9e95-9fec14ac2104 tempest-VolumesDeleteCascade-1263279327 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:28:09 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-d0254000-5d37-4a5e-9e95-9fec14ac2104 tempest-VolumesDeleteCascade-1263279327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:28:09 devstack sudo[106460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce Aug 05 06:28:09 devstack sudo[106460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:28:09 devstack sudo[106460]: pam_unix(sudo:session): session closed for user root Aug 05 06:28:09 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-d0254000-5d37-4a5e-9e95-9fec14ac2104 tempest-VolumesDeleteCascade-1263279327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce" returned: 0 in 0.259s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:28:09 devstack cinder-volume[88695]: DEBUG cinder.manager [None req-d0254000-5d37-4a5e-9e95-9fec14ac2104 tempest-VolumesDeleteCascade-1263279327 None] Notifying Schedulers of capabilities ... {{(pid=88695) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 06:28:09 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-d0254000-5d37-4a5e-9e95-9fec14ac2104 tempest-VolumesDeleteCascade-1263279327 None] Deleted volume successfully. Aug 05 06:28:09 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-d0254000-5d37-4a5e-9e95-9fec14ac2104 tempest-VolumesDeleteCascade-1263279327 None] Lock "cinder-62b6c364-e4cb-484c-8e03-ea88e92790da-delete_volume" released by "delete_volume" :: held 4.502s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:28:10 devstack cinder-volume[88695]: DEBUG cinder.volume.flows.manager.create_volume [None req-a297268c-a596-4fd3-bdf9-ac90b8bec201 tempest-VolumesDeleteCascade-1263279327 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88695) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 06:28:10 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-a297268c-a596-4fd3-bdf9-ac90b8bec201 tempest-VolumesDeleteCascade-1263279327 None] Flow 'volume_create_manager' (94dd7d3b-5b02-43f8-b198-51e142ee5191) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:28:10 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-a297268c-a596-4fd3-bdf9-ac90b8bec201 tempest-VolumesDeleteCascade-1263279327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14bd7f07-dc35-4107-8da2-85b1cfac403b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:28:10 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-a297268c-a596-4fd3-bdf9-ac90b8bec201 tempest-VolumesDeleteCascade-1263279327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14bd7f07-dc35-4107-8da2-85b1cfac403b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:28:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1850024791',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c276906c-97ed-4f6e-91aa-0cc79f6958d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4a7021274d748a988571d3ab32bbc0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:28:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:28:10Z,use_quota=True,user_id='3ac9554f9dd547838338c314470a2451',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:28:10 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-a297268c-a596-4fd3-bdf9-ac90b8bec201 tempest-VolumesDeleteCascade-1263279327 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87204a32-1680-4b6d-bdfd-53df9d877dd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:28:10 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-a297268c-a596-4fd3-bdf9-ac90b8bec201 tempest-VolumesDeleteCascade-1263279327 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87204a32-1680-4b6d-bdfd-53df9d877dd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:28:10 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-a297268c-a596-4fd3-bdf9-ac90b8bec201 tempest-VolumesDeleteCascade-1263279327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a34bf12-2197-4c1b-bda6-ec48d1aee692) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:28:10 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-a297268c-a596-4fd3-bdf9-ac90b8bec201 tempest-VolumesDeleteCascade-1263279327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a34bf12-2197-4c1b-bda6-ec48d1aee692) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c276906c-97ed-4f6e-91aa-0cc79f6958d0', 'volume_name': 'volume-c276906c-97ed-4f6e-91aa-0cc79f6958d0', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:28:10 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-a297268c-a596-4fd3-bdf9-ac90b8bec201 tempest-VolumesDeleteCascade-1263279327 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c72a7315-ab2f-4645-97a7-5d581f5cfbd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:28:10 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-a297268c-a596-4fd3-bdf9-ac90b8bec201 tempest-VolumesDeleteCascade-1263279327 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c72a7315-ab2f-4645-97a7-5d581f5cfbd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:28:10 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-a297268c-a596-4fd3-bdf9-ac90b8bec201 tempest-VolumesDeleteCascade-1263279327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0a22014-4c47-4652-9a10-98cb9daf192d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:28:10 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-a297268c-a596-4fd3-bdf9-ac90b8bec201 tempest-VolumesDeleteCascade-1263279327 None] Volume c276906c-97ed-4f6e-91aa-0cc79f6958d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c276906c-97ed-4f6e-91aa-0cc79f6958d0', 'volume_size': 1} Aug 05 06:28:10 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-a297268c-a596-4fd3-bdf9-ac90b8bec201 tempest-VolumesDeleteCascade-1263279327 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:28:10 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-a297268c-a596-4fd3-bdf9-ac90b8bec201 tempest-VolumesDeleteCascade-1263279327 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:28:10 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-a297268c-a596-4fd3-bdf9-ac90b8bec201 tempest-VolumesDeleteCascade-1263279327 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:28:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1850024791',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c276906c-97ed-4f6e-91aa-0cc79f6958d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4a7021274d748a988571d3ab32bbc0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:28:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:28:10Z,use_quota=True,user_id='3ac9554f9dd547838338c314470a2451',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)}" {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 06:28:10 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-a297268c-a596-4fd3-bdf9-ac90b8bec201 tempest-VolumesDeleteCascade-1263279327 None] Creating volume c276906c-97ed-4f6e-91aa-0cc79f6958d0 {{(pid=88695) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 06:28:10 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-a297268c-a596-4fd3-bdf9-ac90b8bec201 tempest-VolumesDeleteCascade-1263279327 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:28:10 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-a297268c-a596-4fd3-bdf9-ac90b8bec201 tempest-VolumesDeleteCascade-1263279327 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:28:10 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-a297268c-a596-4fd3-bdf9-ac90b8bec201 tempest-VolumesDeleteCascade-1263279327 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:28:10 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-a297268c-a596-4fd3-bdf9-ac90b8bec201 tempest-VolumesDeleteCascade-1263279327 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:28:10 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-a297268c-a596-4fd3-bdf9-ac90b8bec201 tempest-VolumesDeleteCascade-1263279327 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:28:10 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-a297268c-a596-4fd3-bdf9-ac90b8bec201 tempest-VolumesDeleteCascade-1263279327 None] Selected osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 as target Quobyte volume. {{(pid=88695) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 06:28:10 devstack cinder-volume[88695]: INFO cinder.volume.drivers.remotefs [None req-a297268c-a596-4fd3-bdf9-ac90b8bec201 tempest-VolumesDeleteCascade-1263279327 None] casted to osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 Aug 05 06:28:10 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-a297268c-a596-4fd3-bdf9-ac90b8bec201 tempest-VolumesDeleteCascade-1263279327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-c276906c-97ed-4f6e-91aa-0cc79f6958d0 1073741824 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:28:10 devstack sudo[106463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-c276906c-97ed-4f6e-91aa-0cc79f6958d0 1073741824 Aug 05 06:28:10 devstack sudo[106463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:28:10 devstack sudo[106463]: pam_unix(sudo:session): session closed for user root Aug 05 06:28:10 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-a297268c-a596-4fd3-bdf9-ac90b8bec201 tempest-VolumesDeleteCascade-1263279327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-c276906c-97ed-4f6e-91aa-0cc79f6958d0 1073741824" returned: 0 in 0.423s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:28:10 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-a297268c-a596-4fd3-bdf9-ac90b8bec201 tempest-VolumesDeleteCascade-1263279327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-c276906c-97ed-4f6e-91aa-0cc79f6958d0 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:28:10 devstack sudo[106470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-c276906c-97ed-4f6e-91aa-0cc79f6958d0 Aug 05 06:28:10 devstack sudo[106470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:28:10 devstack sudo[106470]: pam_unix(sudo:session): session closed for user root Aug 05 06:28:10 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-a297268c-a596-4fd3-bdf9-ac90b8bec201 tempest-VolumesDeleteCascade-1263279327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-c276906c-97ed-4f6e-91aa-0cc79f6958d0" returned: 0 in 0.233s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:28:10 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-a297268c-a596-4fd3-bdf9-ac90b8bec201 tempest-VolumesDeleteCascade-1263279327 None] <== create_volume: return (699ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'} {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 06:28:10 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-a297268c-a596-4fd3-bdf9-ac90b8bec201 tempest-VolumesDeleteCascade-1263279327 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.701s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:28:11 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-a297268c-a596-4fd3-bdf9-ac90b8bec201 tempest-VolumesDeleteCascade-1263279327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0a22014-4c47-4652-9a10-98cb9daf192d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c276906c-97ed-4f6e-91aa-0cc79f6958d0', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:28:11 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-a297268c-a596-4fd3-bdf9-ac90b8bec201 tempest-VolumesDeleteCascade-1263279327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfdf354d-cc05-4867-aa39-d2805f02c970) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:28:11 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-a297268c-a596-4fd3-bdf9-ac90b8bec201 tempest-VolumesDeleteCascade-1263279327 None] Volume volume-c276906c-97ed-4f6e-91aa-0cc79f6958d0 (c276906c-97ed-4f6e-91aa-0cc79f6958d0): created successfully Aug 05 06:28:11 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-a297268c-a596-4fd3-bdf9-ac90b8bec201 tempest-VolumesDeleteCascade-1263279327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfdf354d-cc05-4867-aa39-d2805f02c970) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:28:11 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-a297268c-a596-4fd3-bdf9-ac90b8bec201 tempest-VolumesDeleteCascade-1263279327 None] Flow 'volume_create_manager' (94dd7d3b-5b02-43f8-b198-51e142ee5191) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:28:11 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-a297268c-a596-4fd3-bdf9-ac90b8bec201 tempest-VolumesDeleteCascade-1263279327 None] Created volume successfully. Aug 05 06:28:11 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-b62fa380-0c5c-4f85-b055-714c67631118 tempest-VolumesDeleteCascade-1263279327 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:28:11 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-b62fa380-0c5c-4f85-b055-714c67631118 tempest-VolumesDeleteCascade-1263279327 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:28:11 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-b62fa380-0c5c-4f85-b055-714c67631118 tempest-VolumesDeleteCascade-1263279327 None] Creating offline snapshot 4e0bf61e-0959-46d8-b42e-ff43c75e9f1b of volume c276906c-97ed-4f6e-91aa-0cc79f6958d0 {{(pid=88695) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 06:28:11 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cf74cc9-9197-4f59-9204-47b4080a10fb]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:28:11 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-b62fa380-0c5c-4f85-b055-714c67631118 tempest-VolumesDeleteCascade-1263279327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-c276906c-97ed-4f6e-91aa-0cc79f6958d0 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:28:11 devstack sudo[106473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-c276906c-97ed-4f6e-91aa-0cc79f6958d0 Aug 05 06:28:11 devstack sudo[106473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:28:11 devstack sudo[106473]: pam_unix(sudo:session): session closed for user root Aug 05 06:28:11 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-b62fa380-0c5c-4f85-b055-714c67631118 tempest-VolumesDeleteCascade-1263279327 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-c276906c-97ed-4f6e-91aa-0cc79f6958d0" returned: 0 in 0.371s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:28:11 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-b62fa380-0c5c-4f85-b055-714c67631118 tempest-VolumesDeleteCascade-1263279327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-c276906c-97ed-4f6e-91aa-0cc79f6958d0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-c276906c-97ed-4f6e-91aa-0cc79f6958d0.4e0bf61e-0959-46d8-b42e-ff43c75e9f1b 1G {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:28:11 devstack sudo[106478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-c276906c-97ed-4f6e-91aa-0cc79f6958d0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-c276906c-97ed-4f6e-91aa-0cc79f6958d0.4e0bf61e-0959-46d8-b42e-ff43c75e9f1b 1G Aug 05 06:28:11 devstack sudo[106478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:28:12 devstack sudo[106478]: pam_unix(sudo:session): session closed for user root Aug 05 06:28:12 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-b62fa380-0c5c-4f85-b055-714c67631118 tempest-VolumesDeleteCascade-1263279327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-c276906c-97ed-4f6e-91aa-0cc79f6958d0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-c276906c-97ed-4f6e-91aa-0cc79f6958d0.4e0bf61e-0959-46d8-b42e-ff43c75e9f1b 1G" returned: 0 in 0.389s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:28:12 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-b62fa380-0c5c-4f85-b055-714c67631118 tempest-VolumesDeleteCascade-1263279327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c276906c-97ed-4f6e-91aa-0cc79f6958d0 -F qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-c276906c-97ed-4f6e-91aa-0cc79f6958d0.4e0bf61e-0959-46d8-b42e-ff43c75e9f1b {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:28:12 devstack sudo[106484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c276906c-97ed-4f6e-91aa-0cc79f6958d0 -F qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-c276906c-97ed-4f6e-91aa-0cc79f6958d0.4e0bf61e-0959-46d8-b42e-ff43c75e9f1b Aug 05 06:28:12 devstack sudo[106484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:28:12 devstack sudo[106484]: pam_unix(sudo:session): session closed for user root Aug 05 06:28:12 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-b62fa380-0c5c-4f85-b055-714c67631118 tempest-VolumesDeleteCascade-1263279327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c276906c-97ed-4f6e-91aa-0cc79f6958d0 -F qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-c276906c-97ed-4f6e-91aa-0cc79f6958d0.4e0bf61e-0959-46d8-b42e-ff43c75e9f1b" returned: 0 in 0.295s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:28:12 devstack cinder-volume[88695]: WARNING cinder.volume.drivers.remotefs [None req-b62fa380-0c5c-4f85-b055-714c67631118 tempest-VolumesDeleteCascade-1263279327 None] /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-c276906c-97ed-4f6e-91aa-0cc79f6958d0.4e0bf61e-0959-46d8-b42e-ff43c75e9f1b is being set with open permissions: ugo+rw Aug 05 06:28:12 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-b62fa380-0c5c-4f85-b055-714c67631118 tempest-VolumesDeleteCascade-1263279327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-c276906c-97ed-4f6e-91aa-0cc79f6958d0.4e0bf61e-0959-46d8-b42e-ff43c75e9f1b {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:28:12 devstack sudo[106489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-c276906c-97ed-4f6e-91aa-0cc79f6958d0.4e0bf61e-0959-46d8-b42e-ff43c75e9f1b Aug 05 06:28:12 devstack sudo[106489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:28:12 devstack sudo[106489]: pam_unix(sudo:session): session closed for user root Aug 05 06:28:12 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-b62fa380-0c5c-4f85-b055-714c67631118 tempest-VolumesDeleteCascade-1263279327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-c276906c-97ed-4f6e-91aa-0cc79f6958d0.4e0bf61e-0959-46d8-b42e-ff43c75e9f1b" returned: 0 in 0.247s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:28:12 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-b62fa380-0c5c-4f85-b055-714c67631118 tempest-VolumesDeleteCascade-1263279327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-c276906c-97ed-4f6e-91aa-0cc79f6958d0.info {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:28:12 devstack sudo[106492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-c276906c-97ed-4f6e-91aa-0cc79f6958d0.info Aug 05 06:28:12 devstack sudo[106492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:28:13 devstack sudo[106492]: pam_unix(sudo:session): session closed for user root Aug 05 06:28:13 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-b62fa380-0c5c-4f85-b055-714c67631118 tempest-VolumesDeleteCascade-1263279327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-c276906c-97ed-4f6e-91aa-0cc79f6958d0.info" returned: 0 in 0.261s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:28:13 devstack cinder-volume[88695]: WARNING cinder.volume.drivers.remotefs [None req-b62fa380-0c5c-4f85-b055-714c67631118 tempest-VolumesDeleteCascade-1263279327 None] /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-c276906c-97ed-4f6e-91aa-0cc79f6958d0.info is being set with open permissions: ugo+rw Aug 05 06:28:13 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-b62fa380-0c5c-4f85-b055-714c67631118 tempest-VolumesDeleteCascade-1263279327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-c276906c-97ed-4f6e-91aa-0cc79f6958d0.info {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:28:13 devstack sudo[106495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-c276906c-97ed-4f6e-91aa-0cc79f6958d0.info Aug 05 06:28:13 devstack sudo[106495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:28:13 devstack sudo[106495]: pam_unix(sudo:session): session closed for user root Aug 05 06:28:13 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-b62fa380-0c5c-4f85-b055-714c67631118 tempest-VolumesDeleteCascade-1263279327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-c276906c-97ed-4f6e-91aa-0cc79f6958d0.info" returned: 0 in 0.243s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:28:13 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-b62fa380-0c5c-4f85-b055-714c67631118 tempest-VolumesDeleteCascade-1263279327 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.895s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:28:13 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-b62fa380-0c5c-4f85-b055-714c67631118 tempest-VolumesDeleteCascade-1263279327 None] Create snapshot completed successfully Aug 05 06:28:13 devstack cinder-volume[88695]: DEBUG cinder.volume.flows.manager.create_volume [None req-776abf70-d061-4ca8-9aa4-b55185302a8a tempest-VolumesDeleteCascade-1263279327 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88695) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 06:28:14 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-776abf70-d061-4ca8-9aa4-b55185302a8a tempest-VolumesDeleteCascade-1263279327 None] Flow 'volume_create_manager' (4d06615e-4a89-47d9-8cf1-e3b6533cea37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:28:14 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-776abf70-d061-4ca8-9aa4-b55185302a8a tempest-VolumesDeleteCascade-1263279327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (390ddcc9-e175-4ff7-ac94-9096105d5294) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:28:14 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-776abf70-d061-4ca8-9aa4-b55185302a8a tempest-VolumesDeleteCascade-1263279327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (390ddcc9-e175-4ff7-ac94-9096105d5294) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:28:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2128701442',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7973c3eb-25d6-4473-89f5-78bfbc1466fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4a7021274d748a988571d3ab32bbc0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:28:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=4e0bf61e-0959-46d8-b42e-ff43c75e9f1b,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:28:14Z,use_quota=True,user_id='3ac9554f9dd547838338c314470a2451',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:28:14 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-776abf70-d061-4ca8-9aa4-b55185302a8a tempest-VolumesDeleteCascade-1263279327 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b8f8ed0-5066-4875-9109-ff5597b0e817) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:28:14 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-776abf70-d061-4ca8-9aa4-b55185302a8a tempest-VolumesDeleteCascade-1263279327 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b8f8ed0-5066-4875-9109-ff5597b0e817) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:28:14 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-776abf70-d061-4ca8-9aa4-b55185302a8a tempest-VolumesDeleteCascade-1263279327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (601c6adf-babd-49f4-89a0-a47f1b807014) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:28:14 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-776abf70-d061-4ca8-9aa4-b55185302a8a tempest-VolumesDeleteCascade-1263279327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (601c6adf-babd-49f4-89a0-a47f1b807014) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '7973c3eb-25d6-4473-89f5-78bfbc1466fd', 'volume_name': 'volume-7973c3eb-25d6-4473-89f5-78bfbc1466fd', 'volume_size': 1, 'snapshot_id': '4e0bf61e-0959-46d8-b42e-ff43c75e9f1b'}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:28:14 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-776abf70-d061-4ca8-9aa4-b55185302a8a tempest-VolumesDeleteCascade-1263279327 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a803732-39bb-468d-bf79-e2d01e4d43cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:28:14 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-776abf70-d061-4ca8-9aa4-b55185302a8a tempest-VolumesDeleteCascade-1263279327 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a803732-39bb-468d-bf79-e2d01e4d43cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:28:14 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-776abf70-d061-4ca8-9aa4-b55185302a8a tempest-VolumesDeleteCascade-1263279327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13dfb284-c719-46ae-bf46-ff607a99c8f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:28:14 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-776abf70-d061-4ca8-9aa4-b55185302a8a tempest-VolumesDeleteCascade-1263279327 None] Volume 7973c3eb-25d6-4473-89f5-78bfbc1466fd: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-7973c3eb-25d6-4473-89f5-78bfbc1466fd', 'volume_size': 1, 'snapshot_id': '4e0bf61e-0959-46d8-b42e-ff43c75e9f1b'} Aug 05 06:28:14 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-776abf70-d061-4ca8-9aa4-b55185302a8a tempest-VolumesDeleteCascade-1263279327 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:28:14 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-776abf70-d061-4ca8-9aa4-b55185302a8a tempest-VolumesDeleteCascade-1263279327 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:28:14 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-776abf70-d061-4ca8-9aa4-b55185302a8a tempest-VolumesDeleteCascade-1263279327 None] Acquiring lock "cinder-quobyte-4e0bf61e-0959-46d8-b42e-ff43c75e9f1b-7973c3eb-25d6-4473-89f5-78bfbc1466fd" by "_create_volume_from_snapshot" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:28:14 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-776abf70-d061-4ca8-9aa4-b55185302a8a tempest-VolumesDeleteCascade-1263279327 None] Lock "cinder-quobyte-4e0bf61e-0959-46d8-b42e-ff43c75e9f1b-7973c3eb-25d6-4473-89f5-78bfbc1466fd" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:28:14 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-776abf70-d061-4ca8-9aa4-b55185302a8a tempest-VolumesDeleteCascade-1263279327 None] Creating volume 7973c3eb-25d6-4473-89f5-78bfbc1466fd from snapshot 4e0bf61e-0959-46d8-b42e-ff43c75e9f1b {{(pid=88695) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 05 06:28:14 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-776abf70-d061-4ca8-9aa4-b55185302a8a tempest-VolumesDeleteCascade-1263279327 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:28:14 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-776abf70-d061-4ca8-9aa4-b55185302a8a tempest-VolumesDeleteCascade-1263279327 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:28:14 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-776abf70-d061-4ca8-9aa4-b55185302a8a tempest-VolumesDeleteCascade-1263279327 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:28:14 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-776abf70-d061-4ca8-9aa4-b55185302a8a tempest-VolumesDeleteCascade-1263279327 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:28:14 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-776abf70-d061-4ca8-9aa4-b55185302a8a tempest-VolumesDeleteCascade-1263279327 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:28:14 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-776abf70-d061-4ca8-9aa4-b55185302a8a tempest-VolumesDeleteCascade-1263279327 None] Selected osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 as target Quobyte volume. {{(pid=88695) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 06:28:14 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-776abf70-d061-4ca8-9aa4-b55185302a8a tempest-VolumesDeleteCascade-1263279327 None] Acquiring lock "cinder-quobyte-7973c3eb-25d6-4473-89f5-78bfbc1466fd" by "_copy_volume_from_snapshot" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:28:14 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-776abf70-d061-4ca8-9aa4-b55185302a8a tempest-VolumesDeleteCascade-1263279327 None] Lock "cinder-quobyte-7973c3eb-25d6-4473-89f5-78bfbc1466fd" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:28:14 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-776abf70-d061-4ca8-9aa4-b55185302a8a tempest-VolumesDeleteCascade-1263279327 None] snapshot: 4e0bf61e-0959-46d8-b42e-ff43c75e9f1b, volume: 7973c3eb-25d6-4473-89f5-78bfbc1466fd, {{(pid=88695) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 05 06:28:14 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-776abf70-d061-4ca8-9aa4-b55185302a8a tempest-VolumesDeleteCascade-1263279327 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:28:14 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-776abf70-d061-4ca8-9aa4-b55185302a8a tempest-VolumesDeleteCascade-1263279327 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:28:14 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-776abf70-d061-4ca8-9aa4-b55185302a8a tempest-VolumesDeleteCascade-1263279327 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:28:14 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-776abf70-d061-4ca8-9aa4-b55185302a8a tempest-VolumesDeleteCascade-1263279327 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:28:14 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-776abf70-d061-4ca8-9aa4-b55185302a8a tempest-VolumesDeleteCascade-1263279327 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:28:14 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[64a2114a-2d54-48d9-99dc-6e0d1851831b]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:28:14 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-776abf70-d061-4ca8-9aa4-b55185302a8a tempest-VolumesDeleteCascade-1263279327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-c276906c-97ed-4f6e-91aa-0cc79f6958d0.4e0bf61e-0959-46d8-b42e-ff43c75e9f1b {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:28:14 devstack sudo[106498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-c276906c-97ed-4f6e-91aa-0cc79f6958d0.4e0bf61e-0959-46d8-b42e-ff43c75e9f1b Aug 05 06:28:14 devstack sudo[106498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:28:14 devstack sudo[106498]: pam_unix(sudo:session): session closed for user root Aug 05 06:28:14 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-776abf70-d061-4ca8-9aa4-b55185302a8a tempest-VolumesDeleteCascade-1263279327 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-c276906c-97ed-4f6e-91aa-0cc79f6958d0.4e0bf61e-0959-46d8-b42e-ff43c75e9f1b" returned: 0 in 0.385s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:28:14 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-776abf70-d061-4ca8-9aa4-b55185302a8a tempest-VolumesDeleteCascade-1263279327 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c276906c-97ed-4f6e-91aa-0cc79f6958d0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88695) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 06:28:14 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac0cad36-e1ab-4a86-8a83-e3d0efc93144]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:28:14 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-776abf70-d061-4ca8-9aa4-b55185302a8a tempest-VolumesDeleteCascade-1263279327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-c276906c-97ed-4f6e-91aa-0cc79f6958d0 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:28:14 devstack sudo[106504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-c276906c-97ed-4f6e-91aa-0cc79f6958d0 Aug 05 06:28:14 devstack sudo[106504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:28:14 devstack sudo[106504]: pam_unix(sudo:session): session closed for user root Aug 05 06:28:14 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-776abf70-d061-4ca8-9aa4-b55185302a8a tempest-VolumesDeleteCascade-1263279327 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-c276906c-97ed-4f6e-91aa-0cc79f6958d0" returned: 0 in 0.382s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:28:14 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-776abf70-d061-4ca8-9aa4-b55185302a8a tempest-VolumesDeleteCascade-1263279327 None] will copy from snapshot at /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-c276906c-97ed-4f6e-91aa-0cc79f6958d0 {{(pid=88695) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 05 06:28:14 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-776abf70-d061-4ca8-9aa4-b55185302a8a tempest-VolumesDeleteCascade-1263279327 None] Creating direct copy from snapshot {{(pid=88695) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 05 06:28:14 devstack cinder-volume[88695]: DEBUG cinder.utils [None req-776abf70-d061-4ca8-9aa4-b55185302a8a tempest-VolumesDeleteCascade-1263279327 None] Path /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7973c3eb-25d6-4473-89f5-78bfbc1466fd not found in is_blk_device check {{(pid=88695) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 05 06:28:14 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-776abf70-d061-4ca8-9aa4-b55185302a8a tempest-VolumesDeleteCascade-1263279327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-c276906c-97ed-4f6e-91aa-0cc79f6958d0 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7973c3eb-25d6-4473-89f5-78bfbc1466fd {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:28:15 devstack sudo[106510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-c276906c-97ed-4f6e-91aa-0cc79f6958d0 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7973c3eb-25d6-4473-89f5-78bfbc1466fd Aug 05 06:28:15 devstack sudo[106510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:28:19 devstack sudo[106510]: pam_unix(sudo:session): session closed for user root Aug 05 06:28:19 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-776abf70-d061-4ca8-9aa4-b55185302a8a tempest-VolumesDeleteCascade-1263279327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-c276906c-97ed-4f6e-91aa-0cc79f6958d0 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7973c3eb-25d6-4473-89f5-78bfbc1466fd" returned: 0 in 4.181s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:28:19 devstack cinder-volume[88695]: DEBUG cinder.image.image_utils [None req-776abf70-d061-4ca8-9aa4-b55185302a8a tempest-VolumesDeleteCascade-1263279327 None] Image conversion details: src /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-c276906c-97ed-4f6e-91aa-0cc79f6958d0, size 1024.00 MB, duration 4.18 sec, destination /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7973c3eb-25d6-4473-89f5-78bfbc1466fd {{(pid=88695) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 05 06:28:19 devstack cinder-volume[88695]: INFO cinder.image.image_utils [None req-776abf70-d061-4ca8-9aa4-b55185302a8a tempest-VolumesDeleteCascade-1263279327 None] Converted 1024.00 MB image at 244.83 MB/s Aug 05 06:28:19 devstack cinder-volume[88695]: WARNING cinder.volume.drivers.remotefs [None req-776abf70-d061-4ca8-9aa4-b55185302a8a tempest-VolumesDeleteCascade-1263279327 None] /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7973c3eb-25d6-4473-89f5-78bfbc1466fd is being set with open permissions: ugo+rw Aug 05 06:28:19 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-776abf70-d061-4ca8-9aa4-b55185302a8a tempest-VolumesDeleteCascade-1263279327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7973c3eb-25d6-4473-89f5-78bfbc1466fd {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:28:19 devstack sudo[106524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7973c3eb-25d6-4473-89f5-78bfbc1466fd Aug 05 06:28:19 devstack sudo[106524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:28:19 devstack sudo[106524]: pam_unix(sudo:session): session closed for user root Aug 05 06:28:19 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-776abf70-d061-4ca8-9aa4-b55185302a8a tempest-VolumesDeleteCascade-1263279327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7973c3eb-25d6-4473-89f5-78bfbc1466fd" returned: 0 in 0.240s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:28:19 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-776abf70-d061-4ca8-9aa4-b55185302a8a tempest-VolumesDeleteCascade-1263279327 None] Lock "cinder-quobyte-7973c3eb-25d6-4473-89f5-78bfbc1466fd" released by "_copy_volume_from_snapshot" :: held 5.274s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:28:19 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-776abf70-d061-4ca8-9aa4-b55185302a8a tempest-VolumesDeleteCascade-1263279327 None] Lock "cinder-quobyte-4e0bf61e-0959-46d8-b42e-ff43c75e9f1b-7973c3eb-25d6-4473-89f5-78bfbc1466fd" released by "_create_volume_from_snapshot" :: held 5.343s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:28:19 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-776abf70-d061-4ca8-9aa4-b55185302a8a tempest-VolumesDeleteCascade-1263279327 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.359s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:28:19 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-776abf70-d061-4ca8-9aa4-b55185302a8a tempest-VolumesDeleteCascade-1263279327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13dfb284-c719-46ae-bf46-ff607a99c8f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7973c3eb-25d6-4473-89f5-78bfbc1466fd', 'volume_size': 1, 'snapshot_id': '4e0bf61e-0959-46d8-b42e-ff43c75e9f1b'}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:28:19 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-776abf70-d061-4ca8-9aa4-b55185302a8a tempest-VolumesDeleteCascade-1263279327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b0e3a57-c07d-441d-a3a2-15ea2a17965b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:28:19 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-776abf70-d061-4ca8-9aa4-b55185302a8a tempest-VolumesDeleteCascade-1263279327 None] Volume volume-7973c3eb-25d6-4473-89f5-78bfbc1466fd (7973c3eb-25d6-4473-89f5-78bfbc1466fd): created successfully Aug 05 06:28:19 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-776abf70-d061-4ca8-9aa4-b55185302a8a tempest-VolumesDeleteCascade-1263279327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b0e3a57-c07d-441d-a3a2-15ea2a17965b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:28:19 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-776abf70-d061-4ca8-9aa4-b55185302a8a tempest-VolumesDeleteCascade-1263279327 None] Flow 'volume_create_manager' (4d06615e-4a89-47d9-8cf1-e3b6533cea37) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:28:19 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-776abf70-d061-4ca8-9aa4-b55185302a8a tempest-VolumesDeleteCascade-1263279327 None] Created volume successfully. Aug 05 06:28:20 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-823cd4b0-990e-42f4-a08a-cdd6bf33c85e tempest-VolumesDeleteCascade-1263279327 None] Acquiring lock "cinder-c276906c-97ed-4f6e-91aa-0cc79f6958d0-delete_volume" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:28:20 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-823cd4b0-990e-42f4-a08a-cdd6bf33c85e tempest-VolumesDeleteCascade-1263279327 None] Lock "cinder-c276906c-97ed-4f6e-91aa-0cc79f6958d0-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:28:20 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-823cd4b0-990e-42f4-a08a-cdd6bf33c85e tempest-VolumesDeleteCascade-1263279327 None] Performing cascade delete. {{(pid=88695) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Aug 05 06:28:20 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-823cd4b0-990e-42f4-a08a-cdd6bf33c85e tempest-VolumesDeleteCascade-1263279327 None] Acquiring lock "cinder-4e0bf61e-0959-46d8-b42e-ff43c75e9f1b-delete_snapshot" by "delete_snapshot" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:28:20 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-823cd4b0-990e-42f4-a08a-cdd6bf33c85e tempest-VolumesDeleteCascade-1263279327 None] Lock "cinder-4e0bf61e-0959-46d8-b42e-ff43c75e9f1b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:28:20 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-823cd4b0-990e-42f4-a08a-cdd6bf33c85e tempest-VolumesDeleteCascade-1263279327 None] Acquiring lock "cinder-quobyte-c276906c-97ed-4f6e-91aa-0cc79f6958d0" by "delete_snapshot" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:28:20 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-823cd4b0-990e-42f4-a08a-cdd6bf33c85e tempest-VolumesDeleteCascade-1263279327 None] Lock "cinder-quobyte-c276906c-97ed-4f6e-91aa-0cc79f6958d0" acquired by "delete_snapshot" :: waited 0.013s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:28:20 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-823cd4b0-990e-42f4-a08a-cdd6bf33c85e tempest-VolumesDeleteCascade-1263279327 None] Acquiring lock "cinder-quobyte-4e0bf61e-0959-46d8-b42e-ff43c75e9f1b" by "_delete_snapshot" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:28:20 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-823cd4b0-990e-42f4-a08a-cdd6bf33c85e tempest-VolumesDeleteCascade-1263279327 None] Lock "cinder-quobyte-4e0bf61e-0959-46d8-b42e-ff43c75e9f1b" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:28:20 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-823cd4b0-990e-42f4-a08a-cdd6bf33c85e tempest-VolumesDeleteCascade-1263279327 None] Deleting offline snapshot 4e0bf61e-0959-46d8-b42e-ff43c75e9f1b of volume c276906c-97ed-4f6e-91aa-0cc79f6958d0 {{(pid=88695) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 06:28:20 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-823cd4b0-990e-42f4-a08a-cdd6bf33c85e tempest-VolumesDeleteCascade-1263279327 None] snapshot_file for this snap is: volume-c276906c-97ed-4f6e-91aa-0cc79f6958d0.4e0bf61e-0959-46d8-b42e-ff43c75e9f1b {{(pid=88695) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 06:28:20 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[c914be8a-b3a7-4dc5-b020-82872fc69ad9]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:28:20 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-823cd4b0-990e-42f4-a08a-cdd6bf33c85e tempest-VolumesDeleteCascade-1263279327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-c276906c-97ed-4f6e-91aa-0cc79f6958d0.4e0bf61e-0959-46d8-b42e-ff43c75e9f1b {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:28:20 devstack sudo[106527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-c276906c-97ed-4f6e-91aa-0cc79f6958d0.4e0bf61e-0959-46d8-b42e-ff43c75e9f1b Aug 05 06:28:20 devstack sudo[106527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:28:21 devstack sudo[106527]: pam_unix(sudo:session): session closed for user root Aug 05 06:28:21 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-823cd4b0-990e-42f4-a08a-cdd6bf33c85e tempest-VolumesDeleteCascade-1263279327 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-c276906c-97ed-4f6e-91aa-0cc79f6958d0.4e0bf61e-0959-46d8-b42e-ff43c75e9f1b" returned: 0 in 0.340s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:28:21 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-823cd4b0-990e-42f4-a08a-cdd6bf33c85e tempest-VolumesDeleteCascade-1263279327 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c276906c-97ed-4f6e-91aa-0cc79f6958d0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88695) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 06:28:21 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[53e8d366-c310-4e8e-ad6d-b761c739efae]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:28:21 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-823cd4b0-990e-42f4-a08a-cdd6bf33c85e tempest-VolumesDeleteCascade-1263279327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-c276906c-97ed-4f6e-91aa-0cc79f6958d0 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:28:21 devstack sudo[106532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-c276906c-97ed-4f6e-91aa-0cc79f6958d0 Aug 05 06:28:21 devstack sudo[106532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:28:21 devstack sudo[106532]: pam_unix(sudo:session): session closed for user root Aug 05 06:28:21 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-823cd4b0-990e-42f4-a08a-cdd6bf33c85e tempest-VolumesDeleteCascade-1263279327 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-c276906c-97ed-4f6e-91aa-0cc79f6958d0" returned: 0 in 0.506s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:28:21 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-823cd4b0-990e-42f4-a08a-cdd6bf33c85e tempest-VolumesDeleteCascade-1263279327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-c276906c-97ed-4f6e-91aa-0cc79f6958d0.4e0bf61e-0959-46d8-b42e-ff43c75e9f1b {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:28:21 devstack sudo[106537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-c276906c-97ed-4f6e-91aa-0cc79f6958d0.4e0bf61e-0959-46d8-b42e-ff43c75e9f1b Aug 05 06:28:21 devstack sudo[106537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:28:21 devstack sudo[106537]: pam_unix(sudo:session): session closed for user root Aug 05 06:28:21 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-823cd4b0-990e-42f4-a08a-cdd6bf33c85e tempest-VolumesDeleteCascade-1263279327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-c276906c-97ed-4f6e-91aa-0cc79f6958d0.4e0bf61e-0959-46d8-b42e-ff43c75e9f1b" returned: 0 in 0.343s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:28:21 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-823cd4b0-990e-42f4-a08a-cdd6bf33c85e tempest-VolumesDeleteCascade-1263279327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-c276906c-97ed-4f6e-91aa-0cc79f6958d0.4e0bf61e-0959-46d8-b42e-ff43c75e9f1b {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:28:21 devstack sudo[106542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-c276906c-97ed-4f6e-91aa-0cc79f6958d0.4e0bf61e-0959-46d8-b42e-ff43c75e9f1b Aug 05 06:28:21 devstack sudo[106542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:28:22 devstack sudo[106542]: pam_unix(sudo:session): session closed for user root Aug 05 06:28:22 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-823cd4b0-990e-42f4-a08a-cdd6bf33c85e tempest-VolumesDeleteCascade-1263279327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-c276906c-97ed-4f6e-91aa-0cc79f6958d0.4e0bf61e-0959-46d8-b42e-ff43c75e9f1b" returned: 0 in 0.252s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:28:22 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-823cd4b0-990e-42f4-a08a-cdd6bf33c85e tempest-VolumesDeleteCascade-1263279327 None] Lock "cinder-quobyte-4e0bf61e-0959-46d8-b42e-ff43c75e9f1b" released by "_delete_snapshot" :: held 1.521s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:28:22 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-823cd4b0-990e-42f4-a08a-cdd6bf33c85e tempest-VolumesDeleteCascade-1263279327 None] Lock "cinder-quobyte-c276906c-97ed-4f6e-91aa-0cc79f6958d0" released by "delete_snapshot" :: held 1.541s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:28:22 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-823cd4b0-990e-42f4-a08a-cdd6bf33c85e tempest-VolumesDeleteCascade-1263279327 None] Created reservations ['a761e815-b7a7-435a-9696-09676405ba16', 'bea19e2a-b531-4c44-9d43-b6ebd54e0739', '5c88cedd-92f6-4adc-9e40-1cc57bfae1da', 'ee651e0e-e851-4e42-b99e-82bbab8a5e51'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:28:22 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-823cd4b0-990e-42f4-a08a-cdd6bf33c85e tempest-VolumesDeleteCascade-1263279327 None] Delete snapshot completed successfully. Aug 05 06:28:22 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-823cd4b0-990e-42f4-a08a-cdd6bf33c85e tempest-VolumesDeleteCascade-1263279327 None] Lock "cinder-4e0bf61e-0959-46d8-b42e-ff43c75e9f1b-delete_snapshot" released by "delete_snapshot" :: held 1.682s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:28:22 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-823cd4b0-990e-42f4-a08a-cdd6bf33c85e tempest-VolumesDeleteCascade-1263279327 None] Snapshots deleted, issuing volume delete {{(pid=88695) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Aug 05 06:28:22 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-823cd4b0-990e-42f4-a08a-cdd6bf33c85e tempest-VolumesDeleteCascade-1263279327 None] Acquiring lock "cinder-quobyte-c276906c-97ed-4f6e-91aa-0cc79f6958d0" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:28:22 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-823cd4b0-990e-42f4-a08a-cdd6bf33c85e tempest-VolumesDeleteCascade-1263279327 None] Lock "cinder-quobyte-c276906c-97ed-4f6e-91aa-0cc79f6958d0" acquired by "delete_volume" :: waited 0.014s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:28:22 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[cebcd0cd-8417-4cc9-927b-aa5105b33753]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:28:22 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-823cd4b0-990e-42f4-a08a-cdd6bf33c85e tempest-VolumesDeleteCascade-1263279327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-c276906c-97ed-4f6e-91aa-0cc79f6958d0 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:28:22 devstack sudo[106545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-c276906c-97ed-4f6e-91aa-0cc79f6958d0 Aug 05 06:28:22 devstack sudo[106545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:28:22 devstack sudo[106545]: pam_unix(sudo:session): session closed for user root Aug 05 06:28:22 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-823cd4b0-990e-42f4-a08a-cdd6bf33c85e tempest-VolumesDeleteCascade-1263279327 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-c276906c-97ed-4f6e-91aa-0cc79f6958d0" returned: 0 in 0.361s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:28:22 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-823cd4b0-990e-42f4-a08a-cdd6bf33c85e tempest-VolumesDeleteCascade-1263279327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-c276906c-97ed-4f6e-91aa-0cc79f6958d0 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:28:22 devstack sudo[106550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-c276906c-97ed-4f6e-91aa-0cc79f6958d0 Aug 05 06:28:22 devstack sudo[106550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:28:23 devstack sudo[106550]: pam_unix(sudo:session): session closed for user root Aug 05 06:28:23 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-823cd4b0-990e-42f4-a08a-cdd6bf33c85e tempest-VolumesDeleteCascade-1263279327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-c276906c-97ed-4f6e-91aa-0cc79f6958d0" returned: 0 in 0.244s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:28:23 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-823cd4b0-990e-42f4-a08a-cdd6bf33c85e tempest-VolumesDeleteCascade-1263279327 None] Lock "cinder-quobyte-c276906c-97ed-4f6e-91aa-0cc79f6958d0" released by "delete_volume" :: held 0.662s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:28:23 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-823cd4b0-990e-42f4-a08a-cdd6bf33c85e tempest-VolumesDeleteCascade-1263279327 None] Created reservations ['e16af64b-58ba-4569-93cf-6a54047b82fa', '117b4442-cb25-449c-9aba-af7aca5f88af', '67bfaf33-3c56-4871-831a-242477e7ca74', '7513ca57-66b4-4b26-94a0-d5195e9d6569'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:28:23 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-823cd4b0-990e-42f4-a08a-cdd6bf33c85e tempest-VolumesDeleteCascade-1263279327 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:28:23 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-823cd4b0-990e-42f4-a08a-cdd6bf33c85e tempest-VolumesDeleteCascade-1263279327 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:28:23 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-823cd4b0-990e-42f4-a08a-cdd6bf33c85e tempest-VolumesDeleteCascade-1263279327 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:28:23 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-823cd4b0-990e-42f4-a08a-cdd6bf33c85e tempest-VolumesDeleteCascade-1263279327 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:28:23 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-823cd4b0-990e-42f4-a08a-cdd6bf33c85e tempest-VolumesDeleteCascade-1263279327 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:28:23 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-823cd4b0-990e-42f4-a08a-cdd6bf33c85e tempest-VolumesDeleteCascade-1263279327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:28:23 devstack sudo[106553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce Aug 05 06:28:23 devstack sudo[106553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:28:23 devstack sudo[106553]: pam_unix(sudo:session): session closed for user root Aug 05 06:28:23 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-823cd4b0-990e-42f4-a08a-cdd6bf33c85e tempest-VolumesDeleteCascade-1263279327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce" returned: 0 in 0.261s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:28:23 devstack cinder-volume[88695]: DEBUG cinder.manager [None req-823cd4b0-990e-42f4-a08a-cdd6bf33c85e tempest-VolumesDeleteCascade-1263279327 None] Notifying Schedulers of capabilities ... {{(pid=88695) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 06:28:23 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-823cd4b0-990e-42f4-a08a-cdd6bf33c85e tempest-VolumesDeleteCascade-1263279327 None] Deleted volume successfully. Aug 05 06:28:23 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-823cd4b0-990e-42f4-a08a-cdd6bf33c85e tempest-VolumesDeleteCascade-1263279327 None] Lock "cinder-c276906c-97ed-4f6e-91aa-0cc79f6958d0-delete_volume" released by "delete_volume" :: held 2.806s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:28:23 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-1f373b5e-57e2-4362-bb5e-52db07b26ee3 tempest-VolumesDeleteCascade-1263279327 None] Acquiring lock "cinder-7973c3eb-25d6-4473-89f5-78bfbc1466fd-delete_volume" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:28:24 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-1f373b5e-57e2-4362-bb5e-52db07b26ee3 tempest-VolumesDeleteCascade-1263279327 None] Lock "cinder-7973c3eb-25d6-4473-89f5-78bfbc1466fd-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:28:24 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-1f373b5e-57e2-4362-bb5e-52db07b26ee3 tempest-VolumesDeleteCascade-1263279327 None] Acquiring lock "cinder-quobyte-7973c3eb-25d6-4473-89f5-78bfbc1466fd" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:28:24 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-1f373b5e-57e2-4362-bb5e-52db07b26ee3 tempest-VolumesDeleteCascade-1263279327 None] Lock "cinder-quobyte-7973c3eb-25d6-4473-89f5-78bfbc1466fd" acquired by "delete_volume" :: waited 0.015s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:28:24 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[85ddc012-a9ce-40f1-aee4-feb6def70399]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:28:24 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-1f373b5e-57e2-4362-bb5e-52db07b26ee3 tempest-VolumesDeleteCascade-1263279327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7973c3eb-25d6-4473-89f5-78bfbc1466fd {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:28:24 devstack sudo[106556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7973c3eb-25d6-4473-89f5-78bfbc1466fd Aug 05 06:28:24 devstack sudo[106556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:28:24 devstack sudo[106556]: pam_unix(sudo:session): session closed for user root Aug 05 06:28:24 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-1f373b5e-57e2-4362-bb5e-52db07b26ee3 tempest-VolumesDeleteCascade-1263279327 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7973c3eb-25d6-4473-89f5-78bfbc1466fd" returned: 0 in 0.363s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:28:24 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-1f373b5e-57e2-4362-bb5e-52db07b26ee3 tempest-VolumesDeleteCascade-1263279327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7973c3eb-25d6-4473-89f5-78bfbc1466fd {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:28:24 devstack sudo[106561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7973c3eb-25d6-4473-89f5-78bfbc1466fd Aug 05 06:28:24 devstack sudo[106561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:28:24 devstack sudo[106561]: pam_unix(sudo:session): session closed for user root Aug 05 06:28:24 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-1f373b5e-57e2-4362-bb5e-52db07b26ee3 tempest-VolumesDeleteCascade-1263279327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7973c3eb-25d6-4473-89f5-78bfbc1466fd" returned: 0 in 0.244s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:28:24 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-1f373b5e-57e2-4362-bb5e-52db07b26ee3 tempest-VolumesDeleteCascade-1263279327 None] Lock "cinder-quobyte-7973c3eb-25d6-4473-89f5-78bfbc1466fd" released by "delete_volume" :: held 0.645s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:28:24 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-1f373b5e-57e2-4362-bb5e-52db07b26ee3 tempest-VolumesDeleteCascade-1263279327 None] Created reservations ['dc31c46b-0c53-4282-826f-a263539394cb', 'f8d575b0-f3b6-494c-8d80-2bedcd67faf2', '4dc54031-49d8-4b61-ba2d-784cc7005fb6', 'c268b88b-cc82-4ac4-8448-ccdacea995d0'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:28:24 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-1f373b5e-57e2-4362-bb5e-52db07b26ee3 tempest-VolumesDeleteCascade-1263279327 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:28:24 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-1f373b5e-57e2-4362-bb5e-52db07b26ee3 tempest-VolumesDeleteCascade-1263279327 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:28:24 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-1f373b5e-57e2-4362-bb5e-52db07b26ee3 tempest-VolumesDeleteCascade-1263279327 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:28:24 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-1f373b5e-57e2-4362-bb5e-52db07b26ee3 tempest-VolumesDeleteCascade-1263279327 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:28:24 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-1f373b5e-57e2-4362-bb5e-52db07b26ee3 tempest-VolumesDeleteCascade-1263279327 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:28:24 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-1f373b5e-57e2-4362-bb5e-52db07b26ee3 tempest-VolumesDeleteCascade-1263279327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:28:24 devstack sudo[106564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce Aug 05 06:28:24 devstack sudo[106564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:28:25 devstack sudo[106564]: pam_unix(sudo:session): session closed for user root Aug 05 06:28:25 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-1f373b5e-57e2-4362-bb5e-52db07b26ee3 tempest-VolumesDeleteCascade-1263279327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce" returned: 0 in 0.241s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:28:25 devstack cinder-volume[88695]: DEBUG cinder.manager [None req-1f373b5e-57e2-4362-bb5e-52db07b26ee3 tempest-VolumesDeleteCascade-1263279327 None] Notifying Schedulers of capabilities ... {{(pid=88695) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 06:28:25 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-1f373b5e-57e2-4362-bb5e-52db07b26ee3 tempest-VolumesDeleteCascade-1263279327 None] Deleted volume successfully. Aug 05 06:28:25 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-1f373b5e-57e2-4362-bb5e-52db07b26ee3 tempest-VolumesDeleteCascade-1263279327 None] Lock "cinder-7973c3eb-25d6-4473-89f5-78bfbc1466fd-delete_volume" released by "delete_volume" :: held 1.074s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:28:34 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [req-4633e365-355a-4526-8375-427c2868505e req-40cb5c19-b6f9-4190-92c6-58c5fba57f94 tempest-TestStampPattern-1026635927 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:28:34 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [req-4633e365-355a-4526-8375-427c2868505e req-40cb5c19-b6f9-4190-92c6-58c5fba57f94 tempest-TestStampPattern-1026635927 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:28:34 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [req-4633e365-355a-4526-8375-427c2868505e req-40cb5c19-b6f9-4190-92c6-58c5fba57f94 tempest-TestStampPattern-1026635927 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:28:34 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [req-4633e365-355a-4526-8375-427c2868505e req-40cb5c19-b6f9-4190-92c6-58c5fba57f94 tempest-TestStampPattern-1026635927 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087', 'name': 'volume-1df87c1e-7bc6-4d11-b025-bfea155baf5d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bd8c6f06-7b5f-428a-8d76-30a21b6dabac', 'enforce_multipath': True} {{(pid=88695) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 05 06:28:34 devstack cinder-volume[88695]: INFO cinder.volume.manager [req-4633e365-355a-4526-8375-427c2868505e req-40cb5c19-b6f9-4190-92c6-58c5fba57f94 tempest-TestStampPattern-1026635927 None] attachment_update completed successfully. Aug 05 06:28:38 devstack cinder-volume[88695]: INFO cinder.volume.manager [req-d5ef6d1f-fa94-4a88-80cd-a49c14cc0611 req-7c16d524-66b8-4063-a3f0-b40d277f2e85 tempest-TestStampPattern-1026635927 None] Terminate volume connection completed successfully. Aug 05 06:28:38 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [req-d5ef6d1f-fa94-4a88-80cd-a49c14cc0611 req-7c16d524-66b8-4063-a3f0-b40d277f2e85 tempest-TestStampPattern-1026635927 None] Deleting attachment bd8c6f06-7b5f-428a-8d76-30a21b6dabac. {{(pid=88695) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 05 06:28:42 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-9be8d3cb-7f4f-4cc6-8562-0853d97226cb tempest-TestStampPattern-1026635927 None] Acquiring lock "cinder-1df87c1e-7bc6-4d11-b025-bfea155baf5d-delete_volume" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:28:42 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-9be8d3cb-7f4f-4cc6-8562-0853d97226cb tempest-TestStampPattern-1026635927 None] Lock "cinder-1df87c1e-7bc6-4d11-b025-bfea155baf5d-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:28:42 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-9be8d3cb-7f4f-4cc6-8562-0853d97226cb tempest-TestStampPattern-1026635927 None] Acquiring lock "cinder-quobyte-1df87c1e-7bc6-4d11-b025-bfea155baf5d" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:28:42 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-9be8d3cb-7f4f-4cc6-8562-0853d97226cb tempest-TestStampPattern-1026635927 None] Lock "cinder-quobyte-1df87c1e-7bc6-4d11-b025-bfea155baf5d" acquired by "delete_volume" :: waited 0.016s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:28:42 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0b0c9d5-e7c3-4399-816f-3ebab1465491]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:28:42 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-9be8d3cb-7f4f-4cc6-8562-0853d97226cb tempest-TestStampPattern-1026635927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-1df87c1e-7bc6-4d11-b025-bfea155baf5d {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:28:42 devstack sudo[107086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-1df87c1e-7bc6-4d11-b025-bfea155baf5d Aug 05 06:28:42 devstack sudo[107086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:28:42 devstack sudo[107086]: pam_unix(sudo:session): session closed for user root Aug 05 06:28:42 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-9be8d3cb-7f4f-4cc6-8562-0853d97226cb tempest-TestStampPattern-1026635927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-1df87c1e-7bc6-4d11-b025-bfea155baf5d" returned: 0 in 0.375s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:28:42 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-9be8d3cb-7f4f-4cc6-8562-0853d97226cb tempest-TestStampPattern-1026635927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-1df87c1e-7bc6-4d11-b025-bfea155baf5d {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:28:42 devstack sudo[107091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-1df87c1e-7bc6-4d11-b025-bfea155baf5d Aug 05 06:28:42 devstack sudo[107091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:28:43 devstack sudo[107091]: pam_unix(sudo:session): session closed for user root Aug 05 06:28:43 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-9be8d3cb-7f4f-4cc6-8562-0853d97226cb tempest-TestStampPattern-1026635927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-1df87c1e-7bc6-4d11-b025-bfea155baf5d" returned: 0 in 0.257s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:28:43 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-9be8d3cb-7f4f-4cc6-8562-0853d97226cb tempest-TestStampPattern-1026635927 None] Lock "cinder-quobyte-1df87c1e-7bc6-4d11-b025-bfea155baf5d" released by "delete_volume" :: held 0.683s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:28:43 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-9be8d3cb-7f4f-4cc6-8562-0853d97226cb tempest-TestStampPattern-1026635927 None] Created reservations ['aa47427c-5bec-4ea1-8466-030997457dbb', '0e488ecc-5350-42f4-8c9e-292eefd84c34', 'd2d962d7-aa51-4e43-9822-de8f11940166', '278dfc31-d186-4102-982c-f92bb03bd364'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:28:43 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-9be8d3cb-7f4f-4cc6-8562-0853d97226cb tempest-TestStampPattern-1026635927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:28:43 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-9be8d3cb-7f4f-4cc6-8562-0853d97226cb tempest-TestStampPattern-1026635927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:28:43 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-9be8d3cb-7f4f-4cc6-8562-0853d97226cb tempest-TestStampPattern-1026635927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:28:43 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-9be8d3cb-7f4f-4cc6-8562-0853d97226cb tempest-TestStampPattern-1026635927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:28:43 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-9be8d3cb-7f4f-4cc6-8562-0853d97226cb tempest-TestStampPattern-1026635927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:28:43 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-9be8d3cb-7f4f-4cc6-8562-0853d97226cb tempest-TestStampPattern-1026635927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:28:43 devstack sudo[107094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce Aug 05 06:28:43 devstack sudo[107094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:28:43 devstack sudo[107094]: pam_unix(sudo:session): session closed for user root Aug 05 06:28:43 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-9be8d3cb-7f4f-4cc6-8562-0853d97226cb tempest-TestStampPattern-1026635927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce" returned: 0 in 0.268s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:28:43 devstack cinder-volume[88695]: DEBUG cinder.manager [None req-9be8d3cb-7f4f-4cc6-8562-0853d97226cb tempest-TestStampPattern-1026635927 None] Notifying Schedulers of capabilities ... {{(pid=88695) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 06:28:43 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-9be8d3cb-7f4f-4cc6-8562-0853d97226cb tempest-TestStampPattern-1026635927 None] Deleted volume successfully. Aug 05 06:28:43 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-9be8d3cb-7f4f-4cc6-8562-0853d97226cb tempest-TestStampPattern-1026635927 None] Lock "cinder-1df87c1e-7bc6-4d11-b025-bfea155baf5d-delete_volume" released by "delete_volume" :: held 1.178s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:28:44 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-bba4eea7-0010-48ea-a05e-53da275f4467 tempest-TestStampPattern-1026635927 None] Acquiring lock "cinder-79f048f0-9c89-4fd6-b44b-b5183380c965-delete_snapshot" by "delete_snapshot" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:28:44 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-bba4eea7-0010-48ea-a05e-53da275f4467 tempest-TestStampPattern-1026635927 None] Lock "cinder-79f048f0-9c89-4fd6-b44b-b5183380c965-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:28:44 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-bba4eea7-0010-48ea-a05e-53da275f4467 tempest-TestStampPattern-1026635927 None] Acquiring lock "cinder-quobyte-c7b0e17f-ef27-406c-84a7-e9e2c18ece55" by "delete_snapshot" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:28:44 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-bba4eea7-0010-48ea-a05e-53da275f4467 tempest-TestStampPattern-1026635927 None] Lock "cinder-quobyte-c7b0e17f-ef27-406c-84a7-e9e2c18ece55" acquired by "delete_snapshot" :: waited 0.029s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:28:44 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-bba4eea7-0010-48ea-a05e-53da275f4467 tempest-TestStampPattern-1026635927 None] Acquiring lock "cinder-quobyte-79f048f0-9c89-4fd6-b44b-b5183380c965" by "_delete_snapshot" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:28:44 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-bba4eea7-0010-48ea-a05e-53da275f4467 tempest-TestStampPattern-1026635927 None] Lock "cinder-quobyte-79f048f0-9c89-4fd6-b44b-b5183380c965" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:28:44 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-bba4eea7-0010-48ea-a05e-53da275f4467 tempest-TestStampPattern-1026635927 None] Deleting offline snapshot 79f048f0-9c89-4fd6-b44b-b5183380c965 of volume c7b0e17f-ef27-406c-84a7-e9e2c18ece55 {{(pid=88695) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 06:28:44 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-bba4eea7-0010-48ea-a05e-53da275f4467 tempest-TestStampPattern-1026635927 None] snapshot_file for this snap is: volume-c7b0e17f-ef27-406c-84a7-e9e2c18ece55.79f048f0-9c89-4fd6-b44b-b5183380c965 {{(pid=88695) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 06:28:44 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccd99475-ecb0-45e2-867a-207abc8e8ea4]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:28:44 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-bba4eea7-0010-48ea-a05e-53da275f4467 tempest-TestStampPattern-1026635927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-c7b0e17f-ef27-406c-84a7-e9e2c18ece55.79f048f0-9c89-4fd6-b44b-b5183380c965 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:28:44 devstack sudo[107097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-c7b0e17f-ef27-406c-84a7-e9e2c18ece55.79f048f0-9c89-4fd6-b44b-b5183380c965 Aug 05 06:28:44 devstack sudo[107097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:28:44 devstack sudo[107097]: pam_unix(sudo:session): session closed for user root Aug 05 06:28:44 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-bba4eea7-0010-48ea-a05e-53da275f4467 tempest-TestStampPattern-1026635927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-c7b0e17f-ef27-406c-84a7-e9e2c18ece55.79f048f0-9c89-4fd6-b44b-b5183380c965" returned: 0 in 0.403s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:28:44 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-bba4eea7-0010-48ea-a05e-53da275f4467 tempest-TestStampPattern-1026635927 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c7b0e17f-ef27-406c-84a7-e9e2c18ece55(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88695) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 06:28:44 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1dc0d11-22e7-4ce1-bfd5-cc7bb4b1fba6]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:28:44 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-bba4eea7-0010-48ea-a05e-53da275f4467 tempest-TestStampPattern-1026635927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-c7b0e17f-ef27-406c-84a7-e9e2c18ece55 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:28:44 devstack sudo[107102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-c7b0e17f-ef27-406c-84a7-e9e2c18ece55 Aug 05 06:28:44 devstack sudo[107102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:28:45 devstack sudo[107102]: pam_unix(sudo:session): session closed for user root Aug 05 06:28:45 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-bba4eea7-0010-48ea-a05e-53da275f4467 tempest-TestStampPattern-1026635927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-c7b0e17f-ef27-406c-84a7-e9e2c18ece55" returned: 0 in 0.587s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:28:45 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-bba4eea7-0010-48ea-a05e-53da275f4467 tempest-TestStampPattern-1026635927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-c7b0e17f-ef27-406c-84a7-e9e2c18ece55.79f048f0-9c89-4fd6-b44b-b5183380c965 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:28:45 devstack sudo[107107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-c7b0e17f-ef27-406c-84a7-e9e2c18ece55.79f048f0-9c89-4fd6-b44b-b5183380c965 Aug 05 06:28:45 devstack sudo[107107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:28:45 devstack sudo[107107]: pam_unix(sudo:session): session closed for user root Aug 05 06:28:45 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-bba4eea7-0010-48ea-a05e-53da275f4467 tempest-TestStampPattern-1026635927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-c7b0e17f-ef27-406c-84a7-e9e2c18ece55.79f048f0-9c89-4fd6-b44b-b5183380c965" returned: 0 in 0.387s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:28:45 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-bba4eea7-0010-48ea-a05e-53da275f4467 tempest-TestStampPattern-1026635927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-c7b0e17f-ef27-406c-84a7-e9e2c18ece55.79f048f0-9c89-4fd6-b44b-b5183380c965 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:28:45 devstack sudo[107112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-c7b0e17f-ef27-406c-84a7-e9e2c18ece55.79f048f0-9c89-4fd6-b44b-b5183380c965 Aug 05 06:28:45 devstack sudo[107112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:28:45 devstack sudo[107112]: pam_unix(sudo:session): session closed for user root Aug 05 06:28:45 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-bba4eea7-0010-48ea-a05e-53da275f4467 tempest-TestStampPattern-1026635927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-c7b0e17f-ef27-406c-84a7-e9e2c18ece55.79f048f0-9c89-4fd6-b44b-b5183380c965" returned: 0 in 0.282s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:28:45 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-bba4eea7-0010-48ea-a05e-53da275f4467 tempest-TestStampPattern-1026635927 None] Lock "cinder-quobyte-79f048f0-9c89-4fd6-b44b-b5183380c965" released by "_delete_snapshot" :: held 1.822s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:28:45 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-bba4eea7-0010-48ea-a05e-53da275f4467 tempest-TestStampPattern-1026635927 None] Lock "cinder-quobyte-c7b0e17f-ef27-406c-84a7-e9e2c18ece55" released by "delete_snapshot" :: held 1.857s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:28:46 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-bba4eea7-0010-48ea-a05e-53da275f4467 tempest-TestStampPattern-1026635927 None] Created reservations ['eea8b6a9-3e32-4d64-96a3-91ef928d7ad2', 'b049ac40-1579-4f6a-b2bf-cf4f74f31617', 'f5c9cb37-3125-471b-b405-c3d84878217d', 'cbcf7e4a-2d3a-4151-b39b-42512b0c211d'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:28:46 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-bba4eea7-0010-48ea-a05e-53da275f4467 tempest-TestStampPattern-1026635927 None] Delete snapshot completed successfully. Aug 05 06:28:46 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-bba4eea7-0010-48ea-a05e-53da275f4467 tempest-TestStampPattern-1026635927 None] Lock "cinder-79f048f0-9c89-4fd6-b44b-b5183380c965-delete_snapshot" released by "delete_snapshot" :: held 2.012s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:28:50 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-a1bef86a-06e8-4610-af5c-06a67f8e3767 tempest-TestStampPattern-1026635927 None] Acquiring lock "cinder-c7b0e17f-ef27-406c-84a7-e9e2c18ece55-delete_volume" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:28:50 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-a1bef86a-06e8-4610-af5c-06a67f8e3767 tempest-TestStampPattern-1026635927 None] Lock "cinder-c7b0e17f-ef27-406c-84a7-e9e2c18ece55-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:28:50 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-a1bef86a-06e8-4610-af5c-06a67f8e3767 tempest-TestStampPattern-1026635927 None] Acquiring lock "cinder-quobyte-c7b0e17f-ef27-406c-84a7-e9e2c18ece55" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:28:50 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-a1bef86a-06e8-4610-af5c-06a67f8e3767 tempest-TestStampPattern-1026635927 None] Lock "cinder-quobyte-c7b0e17f-ef27-406c-84a7-e9e2c18ece55" acquired by "delete_volume" :: waited 0.024s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:28:50 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[df058cd6-52ba-4d9c-b767-73e0bf88c480]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:28:50 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-a1bef86a-06e8-4610-af5c-06a67f8e3767 tempest-TestStampPattern-1026635927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-c7b0e17f-ef27-406c-84a7-e9e2c18ece55 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:28:50 devstack sudo[107143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-c7b0e17f-ef27-406c-84a7-e9e2c18ece55 Aug 05 06:28:50 devstack sudo[107143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:28:50 devstack sudo[107143]: pam_unix(sudo:session): session closed for user root Aug 05 06:28:50 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-a1bef86a-06e8-4610-af5c-06a67f8e3767 tempest-TestStampPattern-1026635927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-c7b0e17f-ef27-406c-84a7-e9e2c18ece55" returned: 0 in 0.391s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:28:50 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-a1bef86a-06e8-4610-af5c-06a67f8e3767 tempest-TestStampPattern-1026635927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-c7b0e17f-ef27-406c-84a7-e9e2c18ece55 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:28:50 devstack sudo[107148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-c7b0e17f-ef27-406c-84a7-e9e2c18ece55 Aug 05 06:28:50 devstack sudo[107148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:28:50 devstack sudo[107148]: pam_unix(sudo:session): session closed for user root Aug 05 06:28:50 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-a1bef86a-06e8-4610-af5c-06a67f8e3767 tempest-TestStampPattern-1026635927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-c7b0e17f-ef27-406c-84a7-e9e2c18ece55" returned: 0 in 0.281s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:28:51 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-a1bef86a-06e8-4610-af5c-06a67f8e3767 tempest-TestStampPattern-1026635927 None] Lock "cinder-quobyte-c7b0e17f-ef27-406c-84a7-e9e2c18ece55" released by "delete_volume" :: held 0.786s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:28:51 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-a1bef86a-06e8-4610-af5c-06a67f8e3767 tempest-TestStampPattern-1026635927 None] Created reservations ['7665748e-dbba-4b2a-b4e6-e5f2b0c4fffd', '077948a6-a9c5-4871-a41c-499e1e6811b4', 'a09dfb7f-5d84-455e-88cc-c0958789019f', '712860ce-0b8c-4918-bbd6-23440841413e'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:28:51 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-a1bef86a-06e8-4610-af5c-06a67f8e3767 tempest-TestStampPattern-1026635927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:28:51 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-a1bef86a-06e8-4610-af5c-06a67f8e3767 tempest-TestStampPattern-1026635927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:28:51 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-a1bef86a-06e8-4610-af5c-06a67f8e3767 tempest-TestStampPattern-1026635927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:28:51 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-a1bef86a-06e8-4610-af5c-06a67f8e3767 tempest-TestStampPattern-1026635927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:28:51 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-a1bef86a-06e8-4610-af5c-06a67f8e3767 tempest-TestStampPattern-1026635927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:28:51 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-a1bef86a-06e8-4610-af5c-06a67f8e3767 tempest-TestStampPattern-1026635927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:28:51 devstack sudo[107151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce Aug 05 06:28:51 devstack sudo[107151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:28:51 devstack sudo[107151]: pam_unix(sudo:session): session closed for user root Aug 05 06:28:51 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-a1bef86a-06e8-4610-af5c-06a67f8e3767 tempest-TestStampPattern-1026635927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce" returned: 0 in 0.331s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:28:51 devstack cinder-volume[88695]: DEBUG cinder.manager [None req-a1bef86a-06e8-4610-af5c-06a67f8e3767 tempest-TestStampPattern-1026635927 None] Notifying Schedulers of capabilities ... {{(pid=88695) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 06:28:51 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-a1bef86a-06e8-4610-af5c-06a67f8e3767 tempest-TestStampPattern-1026635927 None] Deleted volume successfully. Aug 05 06:28:51 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-a1bef86a-06e8-4610-af5c-06a67f8e3767 tempest-TestStampPattern-1026635927 None] Lock "cinder-c7b0e17f-ef27-406c-84a7-e9e2c18ece55-delete_volume" released by "delete_volume" :: held 1.343s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:29:00 devstack cinder-volume[88695]: DEBUG oslo_service.periodic_task [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] Running periodic task VolumeManager._thread_info {{(pid=88695) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 06:29:00 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] thread count: 28 {{(pid=88695) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 05 06:29:00 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] thread info: [<_MainThread(MainThread, started 134469211893888)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88695) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 05 06:29:01 devstack cinder-volume[88695]: DEBUG dbcounter [-] [88695] Writing DB stats cinder:SELECT=59,cinder:INSERT=21,cinder:UPDATE=71,cinder:DELETE=2 {{(pid=88695) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 06:29:01 devstack cinder-volume[88695]: DEBUG dbcounter [-] [88695] Writing DB stats cinder:SELECT=66,cinder:INSERT=18,cinder:UPDATE=70,cinder:DELETE=6 {{(pid=88695) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 06:29:04 devstack cinder-volume[88695]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c33b1c0-e927-425e-80f3-8e6669bd340b tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88695) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 06:29:04 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-9c33b1c0-e927-425e-80f3-8e6669bd340b tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Flow 'volume_create_manager' (e309d5c8-6e31-4471-bd70-cf9c502a57eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:29:04 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-9c33b1c0-e927-425e-80f3-8e6669bd340b tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6882ef3f-1e9b-4d7f-a909-f5dd300dcec4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:29:04 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-9c33b1c0-e927-425e-80f3-8e6669bd340b tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6882ef3f-1e9b-4d7f-a909-f5dd300dcec4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:29:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-336357101',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4403eb1a-dafe-41f3-b0a3-22de91212eb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbe2c54880a7426fa9a624e470508cee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:29:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:29:04Z,use_quota=True,user_id='95dd7f6f1b7d4f65bc39052d3d8de93d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:29:04 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-9c33b1c0-e927-425e-80f3-8e6669bd340b tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e39ef952-8bdc-4e39-ab96-3675067aeb5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:29:04 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-9c33b1c0-e927-425e-80f3-8e6669bd340b tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e39ef952-8bdc-4e39-ab96-3675067aeb5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:29:04 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-9c33b1c0-e927-425e-80f3-8e6669bd340b tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82f9f003-d97c-4bba-8fa9-dad821079f38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:29:04 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-9c33b1c0-e927-425e-80f3-8e6669bd340b tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82f9f003-d97c-4bba-8fa9-dad821079f38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4403eb1a-dafe-41f3-b0a3-22de91212eb8', 'volume_name': 'volume-4403eb1a-dafe-41f3-b0a3-22de91212eb8', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:29:04 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-9c33b1c0-e927-425e-80f3-8e6669bd340b tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (924936df-4f69-4b6d-b8e7-d0924b0cbe7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:29:04 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-9c33b1c0-e927-425e-80f3-8e6669bd340b tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (924936df-4f69-4b6d-b8e7-d0924b0cbe7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:29:04 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-9c33b1c0-e927-425e-80f3-8e6669bd340b tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3d203f4-659d-4521-a67d-950789f116bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:29:04 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-9c33b1c0-e927-425e-80f3-8e6669bd340b tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Volume 4403eb1a-dafe-41f3-b0a3-22de91212eb8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4403eb1a-dafe-41f3-b0a3-22de91212eb8', 'volume_size': 1} Aug 05 06:29:04 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-9c33b1c0-e927-425e-80f3-8e6669bd340b tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:29:04 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-9c33b1c0-e927-425e-80f3-8e6669bd340b tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:29:04 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-9c33b1c0-e927-425e-80f3-8e6669bd340b tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:29:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-336357101',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4403eb1a-dafe-41f3-b0a3-22de91212eb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbe2c54880a7426fa9a624e470508cee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:29:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:29:04Z,use_quota=True,user_id='95dd7f6f1b7d4f65bc39052d3d8de93d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)}" {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 06:29:04 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-9c33b1c0-e927-425e-80f3-8e6669bd340b tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Creating volume 4403eb1a-dafe-41f3-b0a3-22de91212eb8 {{(pid=88695) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 06:29:04 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-9c33b1c0-e927-425e-80f3-8e6669bd340b tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:29:04 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-9c33b1c0-e927-425e-80f3-8e6669bd340b tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:29:04 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-9c33b1c0-e927-425e-80f3-8e6669bd340b tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:29:04 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-9c33b1c0-e927-425e-80f3-8e6669bd340b tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:29:04 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-9c33b1c0-e927-425e-80f3-8e6669bd340b tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:29:04 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-9c33b1c0-e927-425e-80f3-8e6669bd340b tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Selected osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 as target Quobyte volume. {{(pid=88695) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 06:29:04 devstack cinder-volume[88695]: INFO cinder.volume.drivers.remotefs [None req-9c33b1c0-e927-425e-80f3-8e6669bd340b tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] casted to osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 Aug 05 06:29:04 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-9c33b1c0-e927-425e-80f3-8e6669bd340b tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-4403eb1a-dafe-41f3-b0a3-22de91212eb8 1073741824 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:29:04 devstack sudo[107269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-4403eb1a-dafe-41f3-b0a3-22de91212eb8 1073741824 Aug 05 06:29:04 devstack sudo[107269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:29:05 devstack sudo[107269]: pam_unix(sudo:session): session closed for user root Aug 05 06:29:05 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-9c33b1c0-e927-425e-80f3-8e6669bd340b tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-4403eb1a-dafe-41f3-b0a3-22de91212eb8 1073741824" returned: 0 in 0.484s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:29:05 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-9c33b1c0-e927-425e-80f3-8e6669bd340b tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-4403eb1a-dafe-41f3-b0a3-22de91212eb8 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:29:05 devstack sudo[107279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-4403eb1a-dafe-41f3-b0a3-22de91212eb8 Aug 05 06:29:05 devstack sudo[107279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:29:05 devstack sudo[107279]: pam_unix(sudo:session): session closed for user root Aug 05 06:29:05 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-9c33b1c0-e927-425e-80f3-8e6669bd340b tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-4403eb1a-dafe-41f3-b0a3-22de91212eb8" returned: 0 in 0.291s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:29:05 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-9c33b1c0-e927-425e-80f3-8e6669bd340b tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] <== create_volume: return (822ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'} {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 06:29:05 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-9c33b1c0-e927-425e-80f3-8e6669bd340b tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.824s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:29:05 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-9c33b1c0-e927-425e-80f3-8e6669bd340b tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3d203f4-659d-4521-a67d-950789f116bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4403eb1a-dafe-41f3-b0a3-22de91212eb8', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:29:05 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-9c33b1c0-e927-425e-80f3-8e6669bd340b tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (436ad13a-2491-4b88-a904-3c7cd7cc86b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:29:05 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-9c33b1c0-e927-425e-80f3-8e6669bd340b tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Volume volume-4403eb1a-dafe-41f3-b0a3-22de91212eb8 (4403eb1a-dafe-41f3-b0a3-22de91212eb8): created successfully Aug 05 06:29:05 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-9c33b1c0-e927-425e-80f3-8e6669bd340b tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (436ad13a-2491-4b88-a904-3c7cd7cc86b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:29:05 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-9c33b1c0-e927-425e-80f3-8e6669bd340b tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Flow 'volume_create_manager' (e309d5c8-6e31-4471-bd70-cf9c502a57eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:29:05 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-9c33b1c0-e927-425e-80f3-8e6669bd340b tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Created volume successfully. Aug 05 06:29:07 devstack cinder-volume[88695]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ecb09ad-1062-4351-86e1-6d8e59d60a01 tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88695) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 06:29:07 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-5ecb09ad-1062-4351-86e1-6d8e59d60a01 tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Flow 'volume_create_manager' (1917b7cf-bbac-4805-a1df-720fb5afe564) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:29:07 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-5ecb09ad-1062-4351-86e1-6d8e59d60a01 tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41fa8e99-b834-4763-ae8d-6036b8fabff0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:29:07 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-5ecb09ad-1062-4351-86e1-6d8e59d60a01 tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41fa8e99-b834-4763-ae8d-6036b8fabff0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:29:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1528871918',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3754b55c-fb01-4107-aba3-cd896aabd7e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbe2c54880a7426fa9a624e470508cee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:29:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:29:07Z,use_quota=True,user_id='95dd7f6f1b7d4f65bc39052d3d8de93d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:29:07 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-5ecb09ad-1062-4351-86e1-6d8e59d60a01 tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e473d726-d2b7-434e-88d8-0d90d546961d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:29:07 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-5ecb09ad-1062-4351-86e1-6d8e59d60a01 tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e473d726-d2b7-434e-88d8-0d90d546961d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:29:07 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-5ecb09ad-1062-4351-86e1-6d8e59d60a01 tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eca9ae25-c236-4f17-a842-29a37b0d4c83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:29:07 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-5ecb09ad-1062-4351-86e1-6d8e59d60a01 tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eca9ae25-c236-4f17-a842-29a37b0d4c83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3754b55c-fb01-4107-aba3-cd896aabd7e6', 'volume_name': 'volume-3754b55c-fb01-4107-aba3-cd896aabd7e6', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:29:07 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-5ecb09ad-1062-4351-86e1-6d8e59d60a01 tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (166c89c3-291b-40cb-8549-e6116e57ea17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:29:07 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-5ecb09ad-1062-4351-86e1-6d8e59d60a01 tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (166c89c3-291b-40cb-8549-e6116e57ea17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:29:07 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-5ecb09ad-1062-4351-86e1-6d8e59d60a01 tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83f56609-068a-465c-af8d-3b6b808032df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:29:07 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-5ecb09ad-1062-4351-86e1-6d8e59d60a01 tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Volume 3754b55c-fb01-4107-aba3-cd896aabd7e6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3754b55c-fb01-4107-aba3-cd896aabd7e6', 'volume_size': 1} Aug 05 06:29:07 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-5ecb09ad-1062-4351-86e1-6d8e59d60a01 tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:29:07 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-5ecb09ad-1062-4351-86e1-6d8e59d60a01 tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:29:07 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-5ecb09ad-1062-4351-86e1-6d8e59d60a01 tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:29:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1528871918',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3754b55c-fb01-4107-aba3-cd896aabd7e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbe2c54880a7426fa9a624e470508cee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:29:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:29:07Z,use_quota=True,user_id='95dd7f6f1b7d4f65bc39052d3d8de93d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)}" {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 06:29:07 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-5ecb09ad-1062-4351-86e1-6d8e59d60a01 tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Creating volume 3754b55c-fb01-4107-aba3-cd896aabd7e6 {{(pid=88695) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 06:29:07 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-5ecb09ad-1062-4351-86e1-6d8e59d60a01 tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:29:07 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-5ecb09ad-1062-4351-86e1-6d8e59d60a01 tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:29:07 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-5ecb09ad-1062-4351-86e1-6d8e59d60a01 tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:29:07 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-5ecb09ad-1062-4351-86e1-6d8e59d60a01 tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:29:07 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-5ecb09ad-1062-4351-86e1-6d8e59d60a01 tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:29:07 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-5ecb09ad-1062-4351-86e1-6d8e59d60a01 tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Selected osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 as target Quobyte volume. {{(pid=88695) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 06:29:07 devstack cinder-volume[88695]: INFO cinder.volume.drivers.remotefs [None req-5ecb09ad-1062-4351-86e1-6d8e59d60a01 tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] casted to osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 Aug 05 06:29:07 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-5ecb09ad-1062-4351-86e1-6d8e59d60a01 tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-3754b55c-fb01-4107-aba3-cd896aabd7e6 1073741824 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:29:07 devstack sudo[107286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-3754b55c-fb01-4107-aba3-cd896aabd7e6 1073741824 Aug 05 06:29:07 devstack sudo[107286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:29:07 devstack cinder-volume[88695]: DEBUG cinder.volume.flows.manager.create_volume [None req-c813918d-b2ef-4b18-80c8-fc6677c12c57 tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88695) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 06:29:07 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-c813918d-b2ef-4b18-80c8-fc6677c12c57 tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Flow 'volume_create_manager' (0fb1c278-b1bd-40b7-85df-bdecd0e93ff2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:29:07 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-c813918d-b2ef-4b18-80c8-fc6677c12c57 tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bdb5aae5-6cfb-4f4b-8f21-4b5300821338) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:29:07 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-c813918d-b2ef-4b18-80c8-fc6677c12c57 tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bdb5aae5-6cfb-4f4b-8f21-4b5300821338) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:29:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1485087730',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cdc69407-7062-426b-88c2-a9a81588f327,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbe2c54880a7426fa9a624e470508cee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:29:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:29:08Z,use_quota=True,user_id='95dd7f6f1b7d4f65bc39052d3d8de93d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:29:07 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-c813918d-b2ef-4b18-80c8-fc6677c12c57 tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ec2b69d-463c-4965-a6c7-a6cb66b737e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:29:07 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-c813918d-b2ef-4b18-80c8-fc6677c12c57 tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ec2b69d-463c-4965-a6c7-a6cb66b737e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:29:07 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-c813918d-b2ef-4b18-80c8-fc6677c12c57 tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69011c72-66b7-4b27-9756-3e8aa50b71e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:29:07 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-c813918d-b2ef-4b18-80c8-fc6677c12c57 tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69011c72-66b7-4b27-9756-3e8aa50b71e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cdc69407-7062-426b-88c2-a9a81588f327', 'volume_name': 'volume-cdc69407-7062-426b-88c2-a9a81588f327', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:29:07 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-c813918d-b2ef-4b18-80c8-fc6677c12c57 tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1dbdf76-6a6a-48ed-9f68-e3de25fbe894) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:29:07 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-c813918d-b2ef-4b18-80c8-fc6677c12c57 tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1dbdf76-6a6a-48ed-9f68-e3de25fbe894) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:29:07 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-c813918d-b2ef-4b18-80c8-fc6677c12c57 tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (678018e3-7ae7-4766-9204-d4c1d87ed06b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:29:07 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-c813918d-b2ef-4b18-80c8-fc6677c12c57 tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Volume cdc69407-7062-426b-88c2-a9a81588f327: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cdc69407-7062-426b-88c2-a9a81588f327', 'volume_size': 1} Aug 05 06:29:07 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-c813918d-b2ef-4b18-80c8-fc6677c12c57 tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:29:07 devstack sudo[107286]: pam_unix(sudo:session): session closed for user root Aug 05 06:29:07 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-5ecb09ad-1062-4351-86e1-6d8e59d60a01 tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-3754b55c-fb01-4107-aba3-cd896aabd7e6 1073741824" returned: 0 in 0.578s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:29:07 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-5ecb09ad-1062-4351-86e1-6d8e59d60a01 tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-3754b55c-fb01-4107-aba3-cd896aabd7e6 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:29:07 devstack sudo[107292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-3754b55c-fb01-4107-aba3-cd896aabd7e6 Aug 05 06:29:07 devstack sudo[107292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:29:07 devstack cinder-volume[88695]: DEBUG cinder.volume.flows.manager.create_volume [None req-09ee5389-6b70-4c0b-8ae4-ec3b5fcf6645 tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88695) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 06:29:07 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-09ee5389-6b70-4c0b-8ae4-ec3b5fcf6645 tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Flow 'volume_create_manager' (91b9ae81-a2d0-4af0-a685-f2b37a3098de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:29:07 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-09ee5389-6b70-4c0b-8ae4-ec3b5fcf6645 tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2101fb45-72f2-419b-b8b2-c207f03f9f78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:29:08 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-09ee5389-6b70-4c0b-8ae4-ec3b5fcf6645 tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2101fb45-72f2-419b-b8b2-c207f03f9f78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:29:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-974052389',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=511a6e01-a014-4dcd-ac8c-b2a7ac12d76d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbe2c54880a7426fa9a624e470508cee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:29:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:29:08Z,use_quota=True,user_id='95dd7f6f1b7d4f65bc39052d3d8de93d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:29:08 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-09ee5389-6b70-4c0b-8ae4-ec3b5fcf6645 tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c940556e-cd16-45ce-ae42-6de0656da7e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:29:08 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-09ee5389-6b70-4c0b-8ae4-ec3b5fcf6645 tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c940556e-cd16-45ce-ae42-6de0656da7e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:29:08 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-09ee5389-6b70-4c0b-8ae4-ec3b5fcf6645 tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbbc6360-8d85-4789-8351-2c98613f517d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:29:08 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-09ee5389-6b70-4c0b-8ae4-ec3b5fcf6645 tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbbc6360-8d85-4789-8351-2c98613f517d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '511a6e01-a014-4dcd-ac8c-b2a7ac12d76d', 'volume_name': 'volume-511a6e01-a014-4dcd-ac8c-b2a7ac12d76d', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:29:08 devstack sudo[107292]: pam_unix(sudo:session): session closed for user root Aug 05 06:29:08 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-09ee5389-6b70-4c0b-8ae4-ec3b5fcf6645 tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (235e6792-f6b7-483d-b430-38b9f761753d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:29:08 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-09ee5389-6b70-4c0b-8ae4-ec3b5fcf6645 tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (235e6792-f6b7-483d-b430-38b9f761753d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:29:08 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-09ee5389-6b70-4c0b-8ae4-ec3b5fcf6645 tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (480822d1-a37a-48d7-b105-7483f4bfc912) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:29:08 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-09ee5389-6b70-4c0b-8ae4-ec3b5fcf6645 tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Volume 511a6e01-a014-4dcd-ac8c-b2a7ac12d76d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-511a6e01-a014-4dcd-ac8c-b2a7ac12d76d', 'volume_size': 1} Aug 05 06:29:08 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-09ee5389-6b70-4c0b-8ae4-ec3b5fcf6645 tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:29:08 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-5ecb09ad-1062-4351-86e1-6d8e59d60a01 tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-3754b55c-fb01-4107-aba3-cd896aabd7e6" returned: 0 in 0.340s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:29:08 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-5ecb09ad-1062-4351-86e1-6d8e59d60a01 tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] <== create_volume: return (966ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'} {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 06:29:08 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-5ecb09ad-1062-4351-86e1-6d8e59d60a01 tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.968s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:29:08 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-c813918d-b2ef-4b18-80c8-fc6677c12c57 tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.400s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:29:08 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-c813918d-b2ef-4b18-80c8-fc6677c12c57 tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:29:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1485087730',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cdc69407-7062-426b-88c2-a9a81588f327,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbe2c54880a7426fa9a624e470508cee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:29:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:29:08Z,use_quota=True,user_id='95dd7f6f1b7d4f65bc39052d3d8de93d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)}" {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 06:29:08 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-c813918d-b2ef-4b18-80c8-fc6677c12c57 tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Creating volume cdc69407-7062-426b-88c2-a9a81588f327 {{(pid=88695) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 06:29:08 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-c813918d-b2ef-4b18-80c8-fc6677c12c57 tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:29:08 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-c813918d-b2ef-4b18-80c8-fc6677c12c57 tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:29:08 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-c813918d-b2ef-4b18-80c8-fc6677c12c57 tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:29:08 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-c813918d-b2ef-4b18-80c8-fc6677c12c57 tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:29:08 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-c813918d-b2ef-4b18-80c8-fc6677c12c57 tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:29:08 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-c813918d-b2ef-4b18-80c8-fc6677c12c57 tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Selected osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 as target Quobyte volume. {{(pid=88695) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 06:29:08 devstack cinder-volume[88695]: INFO cinder.volume.drivers.remotefs [None req-c813918d-b2ef-4b18-80c8-fc6677c12c57 tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] casted to osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 Aug 05 06:29:08 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-c813918d-b2ef-4b18-80c8-fc6677c12c57 tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-cdc69407-7062-426b-88c2-a9a81588f327 1073741824 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:29:08 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-5ecb09ad-1062-4351-86e1-6d8e59d60a01 tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83f56609-068a-465c-af8d-3b6b808032df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3754b55c-fb01-4107-aba3-cd896aabd7e6', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:29:08 devstack sudo[107295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-cdc69407-7062-426b-88c2-a9a81588f327 1073741824 Aug 05 06:29:08 devstack sudo[107295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:29:08 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-5ecb09ad-1062-4351-86e1-6d8e59d60a01 tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d29c2884-7406-40f5-84a8-2df4fcaebd02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:29:08 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-5ecb09ad-1062-4351-86e1-6d8e59d60a01 tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Volume volume-3754b55c-fb01-4107-aba3-cd896aabd7e6 (3754b55c-fb01-4107-aba3-cd896aabd7e6): created successfully Aug 05 06:29:08 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-5ecb09ad-1062-4351-86e1-6d8e59d60a01 tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d29c2884-7406-40f5-84a8-2df4fcaebd02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:29:08 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-5ecb09ad-1062-4351-86e1-6d8e59d60a01 tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Flow 'volume_create_manager' (1917b7cf-bbac-4805-a1df-720fb5afe564) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:29:08 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-5ecb09ad-1062-4351-86e1-6d8e59d60a01 tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Created volume successfully. Aug 05 06:29:08 devstack cinder-volume[88695]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d5bdc11-6aeb-4444-879c-06eebbb52f3a tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88695) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 06:29:08 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-4d5bdc11-6aeb-4444-879c-06eebbb52f3a tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Flow 'volume_create_manager' (ee3f1fdb-4647-41da-aaae-e23196cea028) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:29:08 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-4d5bdc11-6aeb-4444-879c-06eebbb52f3a tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a407b92-37f2-4c6d-a368-639617182161) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:29:08 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-4d5bdc11-6aeb-4444-879c-06eebbb52f3a tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a407b92-37f2-4c6d-a368-639617182161) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:29:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1083009024',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=030ff96a-5608-4c5a-a0b4-88eb658d8298,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbe2c54880a7426fa9a624e470508cee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:29:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:29:08Z,use_quota=True,user_id='95dd7f6f1b7d4f65bc39052d3d8de93d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:29:08 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-4d5bdc11-6aeb-4444-879c-06eebbb52f3a tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (293770c6-6962-48a3-b48e-ce36c5cce4d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:29:08 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-4d5bdc11-6aeb-4444-879c-06eebbb52f3a tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (293770c6-6962-48a3-b48e-ce36c5cce4d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:29:08 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-4d5bdc11-6aeb-4444-879c-06eebbb52f3a tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d8a4789-5c09-4a77-9b15-89af0a4cdaf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:29:08 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-4d5bdc11-6aeb-4444-879c-06eebbb52f3a tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d8a4789-5c09-4a77-9b15-89af0a4cdaf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '030ff96a-5608-4c5a-a0b4-88eb658d8298', 'volume_name': 'volume-030ff96a-5608-4c5a-a0b4-88eb658d8298', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:29:08 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-4d5bdc11-6aeb-4444-879c-06eebbb52f3a tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4144ef3f-2f7d-4fc8-aa15-7195d9416739) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:29:08 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-4d5bdc11-6aeb-4444-879c-06eebbb52f3a tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4144ef3f-2f7d-4fc8-aa15-7195d9416739) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:29:08 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-4d5bdc11-6aeb-4444-879c-06eebbb52f3a tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3e0675f-ec62-4f9c-8607-a69c577b31c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:29:08 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-4d5bdc11-6aeb-4444-879c-06eebbb52f3a tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Volume 030ff96a-5608-4c5a-a0b4-88eb658d8298: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-030ff96a-5608-4c5a-a0b4-88eb658d8298', 'volume_size': 1} Aug 05 06:29:08 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-4d5bdc11-6aeb-4444-879c-06eebbb52f3a tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:29:08 devstack sudo[107295]: pam_unix(sudo:session): session closed for user root Aug 05 06:29:08 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-c813918d-b2ef-4b18-80c8-fc6677c12c57 tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-cdc69407-7062-426b-88c2-a9a81588f327 1073741824" returned: 0 in 0.578s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:29:08 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-c813918d-b2ef-4b18-80c8-fc6677c12c57 tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-cdc69407-7062-426b-88c2-a9a81588f327 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:29:08 devstack sudo[107303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-cdc69407-7062-426b-88c2-a9a81588f327 Aug 05 06:29:08 devstack sudo[107303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:29:09 devstack cinder-volume[88695]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8e90f83-216b-4c94-a046-33bc0919a0ef tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88695) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 06:29:09 devstack sudo[107303]: pam_unix(sudo:session): session closed for user root Aug 05 06:29:09 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-d8e90f83-216b-4c94-a046-33bc0919a0ef tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Flow 'volume_create_manager' (3cecab23-3c2c-4100-aa1f-423b6eb0f3e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:29:09 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-d8e90f83-216b-4c94-a046-33bc0919a0ef tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (daa58d85-109b-4e31-84b4-3ded347d9243) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:29:09 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-c813918d-b2ef-4b18-80c8-fc6677c12c57 tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-cdc69407-7062-426b-88c2-a9a81588f327" returned: 0 in 0.337s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:29:09 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-c813918d-b2ef-4b18-80c8-fc6677c12c57 tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] <== create_volume: return (975ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'} {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 06:29:09 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-c813918d-b2ef-4b18-80c8-fc6677c12c57 tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.978s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:29:09 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-09ee5389-6b70-4c0b-8ae4-ec3b5fcf6645 tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.989s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:29:09 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-09ee5389-6b70-4c0b-8ae4-ec3b5fcf6645 tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:29:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-974052389',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=511a6e01-a014-4dcd-ac8c-b2a7ac12d76d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbe2c54880a7426fa9a624e470508cee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:29:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:29:08Z,use_quota=True,user_id='95dd7f6f1b7d4f65bc39052d3d8de93d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)}" {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 06:29:09 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-09ee5389-6b70-4c0b-8ae4-ec3b5fcf6645 tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Creating volume 511a6e01-a014-4dcd-ac8c-b2a7ac12d76d {{(pid=88695) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 06:29:09 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-09ee5389-6b70-4c0b-8ae4-ec3b5fcf6645 tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:29:09 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-09ee5389-6b70-4c0b-8ae4-ec3b5fcf6645 tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:29:09 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-09ee5389-6b70-4c0b-8ae4-ec3b5fcf6645 tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:29:09 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-09ee5389-6b70-4c0b-8ae4-ec3b5fcf6645 tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:29:09 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-09ee5389-6b70-4c0b-8ae4-ec3b5fcf6645 tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:29:09 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-09ee5389-6b70-4c0b-8ae4-ec3b5fcf6645 tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Selected osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 as target Quobyte volume. {{(pid=88695) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 06:29:09 devstack cinder-volume[88695]: INFO cinder.volume.drivers.remotefs [None req-09ee5389-6b70-4c0b-8ae4-ec3b5fcf6645 tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] casted to osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 Aug 05 06:29:09 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-09ee5389-6b70-4c0b-8ae4-ec3b5fcf6645 tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-511a6e01-a014-4dcd-ac8c-b2a7ac12d76d 1073741824 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:29:09 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-d8e90f83-216b-4c94-a046-33bc0919a0ef tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (daa58d85-109b-4e31-84b4-3ded347d9243) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:29:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-621899946',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb778424-2c20-4769-a550-ffc92f88196d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbe2c54880a7426fa9a624e470508cee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:29:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:29:09Z,use_quota=True,user_id='95dd7f6f1b7d4f65bc39052d3d8de93d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:29:09 devstack sudo[107306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-511a6e01-a014-4dcd-ac8c-b2a7ac12d76d 1073741824 Aug 05 06:29:09 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-d8e90f83-216b-4c94-a046-33bc0919a0ef tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da182414-2931-4b6c-9772-4bea0a0ec25f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:29:09 devstack sudo[107306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:29:09 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-d8e90f83-216b-4c94-a046-33bc0919a0ef tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da182414-2931-4b6c-9772-4bea0a0ec25f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:29:09 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-d8e90f83-216b-4c94-a046-33bc0919a0ef tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0285a90c-ece9-441a-b747-bf524d76c9e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:29:09 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-d8e90f83-216b-4c94-a046-33bc0919a0ef tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0285a90c-ece9-441a-b747-bf524d76c9e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb778424-2c20-4769-a550-ffc92f88196d', 'volume_name': 'volume-cb778424-2c20-4769-a550-ffc92f88196d', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:29:09 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-d8e90f83-216b-4c94-a046-33bc0919a0ef tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95305d10-4f54-4b40-870c-91a75927732e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:29:09 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-d8e90f83-216b-4c94-a046-33bc0919a0ef tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95305d10-4f54-4b40-870c-91a75927732e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:29:09 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-d8e90f83-216b-4c94-a046-33bc0919a0ef tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (211a80d5-27ba-4f76-99c6-a2571c677592) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:29:09 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-d8e90f83-216b-4c94-a046-33bc0919a0ef tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Volume cb778424-2c20-4769-a550-ffc92f88196d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb778424-2c20-4769-a550-ffc92f88196d', 'volume_size': 1} Aug 05 06:29:09 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-d8e90f83-216b-4c94-a046-33bc0919a0ef tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:29:09 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-c813918d-b2ef-4b18-80c8-fc6677c12c57 tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (678018e3-7ae7-4766-9204-d4c1d87ed06b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cdc69407-7062-426b-88c2-a9a81588f327', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:29:09 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-c813918d-b2ef-4b18-80c8-fc6677c12c57 tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb34134c-c0bc-44a9-8017-a5c3a3e5c033) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:29:09 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-c813918d-b2ef-4b18-80c8-fc6677c12c57 tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Volume volume-cdc69407-7062-426b-88c2-a9a81588f327 (cdc69407-7062-426b-88c2-a9a81588f327): created successfully Aug 05 06:29:09 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-c813918d-b2ef-4b18-80c8-fc6677c12c57 tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb34134c-c0bc-44a9-8017-a5c3a3e5c033) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:29:09 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-c813918d-b2ef-4b18-80c8-fc6677c12c57 tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Flow 'volume_create_manager' (0fb1c278-b1bd-40b7-85df-bdecd0e93ff2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:29:09 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-c813918d-b2ef-4b18-80c8-fc6677c12c57 tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Created volume successfully. Aug 05 06:29:09 devstack sudo[107306]: pam_unix(sudo:session): session closed for user root Aug 05 06:29:09 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-09ee5389-6b70-4c0b-8ae4-ec3b5fcf6645 tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-511a6e01-a014-4dcd-ac8c-b2a7ac12d76d 1073741824" returned: 0 in 0.496s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:29:09 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-09ee5389-6b70-4c0b-8ae4-ec3b5fcf6645 tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-511a6e01-a014-4dcd-ac8c-b2a7ac12d76d {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:29:09 devstack sudo[107312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-511a6e01-a014-4dcd-ac8c-b2a7ac12d76d Aug 05 06:29:09 devstack sudo[107312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:29:09 devstack sudo[107312]: pam_unix(sudo:session): session closed for user root Aug 05 06:29:09 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-09ee5389-6b70-4c0b-8ae4-ec3b5fcf6645 tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-511a6e01-a014-4dcd-ac8c-b2a7ac12d76d" returned: 0 in 0.260s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:29:09 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-09ee5389-6b70-4c0b-8ae4-ec3b5fcf6645 tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] <== create_volume: return (793ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'} {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 06:29:09 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-09ee5389-6b70-4c0b-8ae4-ec3b5fcf6645 tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.795s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:29:09 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-4d5bdc11-6aeb-4444-879c-06eebbb52f3a tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.239s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:29:09 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-4d5bdc11-6aeb-4444-879c-06eebbb52f3a tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:29:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1083009024',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=030ff96a-5608-4c5a-a0b4-88eb658d8298,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbe2c54880a7426fa9a624e470508cee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:29:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:29:08Z,use_quota=True,user_id='95dd7f6f1b7d4f65bc39052d3d8de93d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)}" {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 06:29:09 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-4d5bdc11-6aeb-4444-879c-06eebbb52f3a tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Creating volume 030ff96a-5608-4c5a-a0b4-88eb658d8298 {{(pid=88695) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 06:29:09 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-4d5bdc11-6aeb-4444-879c-06eebbb52f3a tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:29:09 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-4d5bdc11-6aeb-4444-879c-06eebbb52f3a tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:29:09 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-4d5bdc11-6aeb-4444-879c-06eebbb52f3a tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:29:09 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-4d5bdc11-6aeb-4444-879c-06eebbb52f3a tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:29:09 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-4d5bdc11-6aeb-4444-879c-06eebbb52f3a tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:29:09 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-4d5bdc11-6aeb-4444-879c-06eebbb52f3a tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Selected osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 as target Quobyte volume. {{(pid=88695) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 06:29:09 devstack cinder-volume[88695]: INFO cinder.volume.drivers.remotefs [None req-4d5bdc11-6aeb-4444-879c-06eebbb52f3a tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] casted to osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 Aug 05 06:29:09 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-4d5bdc11-6aeb-4444-879c-06eebbb52f3a tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-030ff96a-5608-4c5a-a0b4-88eb658d8298 1073741824 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:29:09 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-09ee5389-6b70-4c0b-8ae4-ec3b5fcf6645 tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (480822d1-a37a-48d7-b105-7483f4bfc912) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-511a6e01-a014-4dcd-ac8c-b2a7ac12d76d', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:29:09 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-09ee5389-6b70-4c0b-8ae4-ec3b5fcf6645 tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be8263d0-c53d-442e-a3c7-0f4cc7f1587c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:29:09 devstack sudo[107315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-030ff96a-5608-4c5a-a0b4-88eb658d8298 1073741824 Aug 05 06:29:09 devstack sudo[107315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:29:09 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-09ee5389-6b70-4c0b-8ae4-ec3b5fcf6645 tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Volume volume-511a6e01-a014-4dcd-ac8c-b2a7ac12d76d (511a6e01-a014-4dcd-ac8c-b2a7ac12d76d): created successfully Aug 05 06:29:09 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-09ee5389-6b70-4c0b-8ae4-ec3b5fcf6645 tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be8263d0-c53d-442e-a3c7-0f4cc7f1587c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:29:09 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-09ee5389-6b70-4c0b-8ae4-ec3b5fcf6645 tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Flow 'volume_create_manager' (91b9ae81-a2d0-4af0-a685-f2b37a3098de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:29:09 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-09ee5389-6b70-4c0b-8ae4-ec3b5fcf6645 tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Created volume successfully. Aug 05 06:29:10 devstack sudo[107315]: pam_unix(sudo:session): session closed for user root Aug 05 06:29:10 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-4d5bdc11-6aeb-4444-879c-06eebbb52f3a tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-030ff96a-5608-4c5a-a0b4-88eb658d8298 1073741824" returned: 0 in 0.442s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:29:10 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-4d5bdc11-6aeb-4444-879c-06eebbb52f3a tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-030ff96a-5608-4c5a-a0b4-88eb658d8298 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:29:10 devstack sudo[107320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-030ff96a-5608-4c5a-a0b4-88eb658d8298 Aug 05 06:29:10 devstack sudo[107320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:29:10 devstack sudo[107320]: pam_unix(sudo:session): session closed for user root Aug 05 06:29:10 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-4d5bdc11-6aeb-4444-879c-06eebbb52f3a tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-030ff96a-5608-4c5a-a0b4-88eb658d8298" returned: 0 in 0.265s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:29:10 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-4d5bdc11-6aeb-4444-879c-06eebbb52f3a tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] <== create_volume: return (752ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'} {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 06:29:10 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-4d5bdc11-6aeb-4444-879c-06eebbb52f3a tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.756s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:29:10 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-d8e90f83-216b-4c94-a046-33bc0919a0ef tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.493s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:29:10 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-d8e90f83-216b-4c94-a046-33bc0919a0ef tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:29:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-621899946',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb778424-2c20-4769-a550-ffc92f88196d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbe2c54880a7426fa9a624e470508cee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:29:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:29:09Z,use_quota=True,user_id='95dd7f6f1b7d4f65bc39052d3d8de93d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)}" {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 06:29:10 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-d8e90f83-216b-4c94-a046-33bc0919a0ef tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Creating volume cb778424-2c20-4769-a550-ffc92f88196d {{(pid=88695) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 06:29:10 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-d8e90f83-216b-4c94-a046-33bc0919a0ef tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:29:10 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-d8e90f83-216b-4c94-a046-33bc0919a0ef tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:29:10 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-d8e90f83-216b-4c94-a046-33bc0919a0ef tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:29:10 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-d8e90f83-216b-4c94-a046-33bc0919a0ef tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:29:10 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-d8e90f83-216b-4c94-a046-33bc0919a0ef tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:29:10 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-d8e90f83-216b-4c94-a046-33bc0919a0ef tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Selected osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 as target Quobyte volume. {{(pid=88695) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 06:29:10 devstack cinder-volume[88695]: INFO cinder.volume.drivers.remotefs [None req-d8e90f83-216b-4c94-a046-33bc0919a0ef tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] casted to osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 Aug 05 06:29:10 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-d8e90f83-216b-4c94-a046-33bc0919a0ef tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-cb778424-2c20-4769-a550-ffc92f88196d 1073741824 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:29:10 devstack sudo[107324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-cb778424-2c20-4769-a550-ffc92f88196d 1073741824 Aug 05 06:29:10 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-4d5bdc11-6aeb-4444-879c-06eebbb52f3a tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3e0675f-ec62-4f9c-8607-a69c577b31c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-030ff96a-5608-4c5a-a0b4-88eb658d8298', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:29:10 devstack sudo[107324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:29:10 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-4d5bdc11-6aeb-4444-879c-06eebbb52f3a tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79263344-f7fc-4764-8228-9e9ae6ffe7f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:29:10 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-4d5bdc11-6aeb-4444-879c-06eebbb52f3a tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Volume volume-030ff96a-5608-4c5a-a0b4-88eb658d8298 (030ff96a-5608-4c5a-a0b4-88eb658d8298): created successfully Aug 05 06:29:10 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-4d5bdc11-6aeb-4444-879c-06eebbb52f3a tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79263344-f7fc-4764-8228-9e9ae6ffe7f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:29:10 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-4d5bdc11-6aeb-4444-879c-06eebbb52f3a tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Flow 'volume_create_manager' (ee3f1fdb-4647-41da-aaae-e23196cea028) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:29:10 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-4d5bdc11-6aeb-4444-879c-06eebbb52f3a tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Created volume successfully. Aug 05 06:29:11 devstack sudo[107324]: pam_unix(sudo:session): session closed for user root Aug 05 06:29:11 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-d8e90f83-216b-4c94-a046-33bc0919a0ef tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-cb778424-2c20-4769-a550-ffc92f88196d 1073741824" returned: 0 in 0.439s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:29:11 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-d8e90f83-216b-4c94-a046-33bc0919a0ef tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-cb778424-2c20-4769-a550-ffc92f88196d {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:29:11 devstack sudo[107329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-cb778424-2c20-4769-a550-ffc92f88196d Aug 05 06:29:11 devstack sudo[107329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:29:11 devstack sudo[107329]: pam_unix(sudo:session): session closed for user root Aug 05 06:29:11 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-d8e90f83-216b-4c94-a046-33bc0919a0ef tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-cb778424-2c20-4769-a550-ffc92f88196d" returned: 0 in 0.258s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:29:11 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-d8e90f83-216b-4c94-a046-33bc0919a0ef tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] <== create_volume: return (761ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'} {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 06:29:11 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-d8e90f83-216b-4c94-a046-33bc0919a0ef tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.767s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:29:11 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-d8e90f83-216b-4c94-a046-33bc0919a0ef tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (211a80d5-27ba-4f76-99c6-a2571c677592) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb778424-2c20-4769-a550-ffc92f88196d', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:29:11 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-d8e90f83-216b-4c94-a046-33bc0919a0ef tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a105649-0823-4217-8a4e-4acfecb05e00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:29:11 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-d8e90f83-216b-4c94-a046-33bc0919a0ef tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Volume volume-cb778424-2c20-4769-a550-ffc92f88196d (cb778424-2c20-4769-a550-ffc92f88196d): created successfully Aug 05 06:29:11 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-d8e90f83-216b-4c94-a046-33bc0919a0ef tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a105649-0823-4217-8a4e-4acfecb05e00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:29:11 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-d8e90f83-216b-4c94-a046-33bc0919a0ef tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Flow 'volume_create_manager' (3cecab23-3c2c-4100-aa1f-423b6eb0f3e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:29:11 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-d8e90f83-216b-4c94-a046-33bc0919a0ef tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Created volume successfully. Aug 05 06:29:12 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-1bdb2e3c-bd31-4579-ac96-979e027e21f5 tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Acquiring lock "cinder-cb778424-2c20-4769-a550-ffc92f88196d-delete_volume" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:29:12 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-1bdb2e3c-bd31-4579-ac96-979e027e21f5 tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Lock "cinder-cb778424-2c20-4769-a550-ffc92f88196d-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:29:12 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-1bdb2e3c-bd31-4579-ac96-979e027e21f5 tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Acquiring lock "cinder-quobyte-cb778424-2c20-4769-a550-ffc92f88196d" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:29:12 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-1bdb2e3c-bd31-4579-ac96-979e027e21f5 tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Lock "cinder-quobyte-cb778424-2c20-4769-a550-ffc92f88196d" acquired by "delete_volume" :: waited 0.016s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:29:12 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[51e5d95d-18ec-4b42-a471-9f1c1a124253]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:29:12 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-1bdb2e3c-bd31-4579-ac96-979e027e21f5 tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-cb778424-2c20-4769-a550-ffc92f88196d {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:29:12 devstack sudo[107332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-cb778424-2c20-4769-a550-ffc92f88196d Aug 05 06:29:12 devstack sudo[107332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:29:12 devstack sudo[107332]: pam_unix(sudo:session): session closed for user root Aug 05 06:29:12 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-1bdb2e3c-bd31-4579-ac96-979e027e21f5 tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-cb778424-2c20-4769-a550-ffc92f88196d" returned: 0 in 0.398s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:29:12 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-1bdb2e3c-bd31-4579-ac96-979e027e21f5 tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-cb778424-2c20-4769-a550-ffc92f88196d {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:29:12 devstack sudo[107352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-cb778424-2c20-4769-a550-ffc92f88196d Aug 05 06:29:12 devstack sudo[107352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:29:13 devstack sudo[107352]: pam_unix(sudo:session): session closed for user root Aug 05 06:29:13 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-1bdb2e3c-bd31-4579-ac96-979e027e21f5 tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-cb778424-2c20-4769-a550-ffc92f88196d" returned: 0 in 0.258s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:29:13 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-1bdb2e3c-bd31-4579-ac96-979e027e21f5 tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Lock "cinder-quobyte-cb778424-2c20-4769-a550-ffc92f88196d" released by "delete_volume" :: held 0.699s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:29:13 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-1bdb2e3c-bd31-4579-ac96-979e027e21f5 tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Created reservations ['2779e986-af33-44da-9062-250fbc61b8d7', '36eebd7a-3945-4a00-a411-e173adffd0cf', 'dbc675c5-a12c-4d3e-87c0-6484e3da6089', '59c1fec4-f54f-4b5c-b27c-44eb40a41eab'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:29:13 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-1bdb2e3c-bd31-4579-ac96-979e027e21f5 tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:29:13 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-1bdb2e3c-bd31-4579-ac96-979e027e21f5 tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:29:13 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-1bdb2e3c-bd31-4579-ac96-979e027e21f5 tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:29:13 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-1bdb2e3c-bd31-4579-ac96-979e027e21f5 tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:29:13 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-1bdb2e3c-bd31-4579-ac96-979e027e21f5 tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:29:13 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-1bdb2e3c-bd31-4579-ac96-979e027e21f5 tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:29:13 devstack sudo[107355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce Aug 05 06:29:13 devstack sudo[107355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:29:13 devstack sudo[107355]: pam_unix(sudo:session): session closed for user root Aug 05 06:29:13 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-1bdb2e3c-bd31-4579-ac96-979e027e21f5 tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce" returned: 0 in 0.252s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:29:13 devstack cinder-volume[88695]: DEBUG cinder.manager [None req-1bdb2e3c-bd31-4579-ac96-979e027e21f5 tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Notifying Schedulers of capabilities ... {{(pid=88695) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 06:29:13 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-1bdb2e3c-bd31-4579-ac96-979e027e21f5 tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Deleted volume successfully. Aug 05 06:29:13 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-dea6bea7-e9ef-436b-9682-2a7a1e977fc2 tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Acquiring lock "cinder-030ff96a-5608-4c5a-a0b4-88eb658d8298-delete_volume" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:29:13 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-dea6bea7-e9ef-436b-9682-2a7a1e977fc2 tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Lock "cinder-030ff96a-5608-4c5a-a0b4-88eb658d8298-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:29:13 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-1bdb2e3c-bd31-4579-ac96-979e027e21f5 tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Lock "cinder-cb778424-2c20-4769-a550-ffc92f88196d-delete_volume" released by "delete_volume" :: held 1.173s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:29:13 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-dea6bea7-e9ef-436b-9682-2a7a1e977fc2 tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Acquiring lock "cinder-quobyte-030ff96a-5608-4c5a-a0b4-88eb658d8298" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:29:13 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-dea6bea7-e9ef-436b-9682-2a7a1e977fc2 tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Lock "cinder-quobyte-030ff96a-5608-4c5a-a0b4-88eb658d8298" acquired by "delete_volume" :: waited 0.013s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:29:13 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2347299-ee2b-4339-a56e-8e15ff67d875]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:29:13 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-dea6bea7-e9ef-436b-9682-2a7a1e977fc2 tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-030ff96a-5608-4c5a-a0b4-88eb658d8298 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:29:13 devstack sudo[107358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-030ff96a-5608-4c5a-a0b4-88eb658d8298 Aug 05 06:29:13 devstack sudo[107358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:29:13 devstack sudo[107358]: pam_unix(sudo:session): session closed for user root Aug 05 06:29:13 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-dea6bea7-e9ef-436b-9682-2a7a1e977fc2 tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-030ff96a-5608-4c5a-a0b4-88eb658d8298" returned: 0 in 0.352s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:29:13 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-dea6bea7-e9ef-436b-9682-2a7a1e977fc2 tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-030ff96a-5608-4c5a-a0b4-88eb658d8298 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:29:14 devstack sudo[107363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-030ff96a-5608-4c5a-a0b4-88eb658d8298 Aug 05 06:29:14 devstack sudo[107363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:29:14 devstack sudo[107363]: pam_unix(sudo:session): session closed for user root Aug 05 06:29:14 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-dea6bea7-e9ef-436b-9682-2a7a1e977fc2 tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-030ff96a-5608-4c5a-a0b4-88eb658d8298" returned: 0 in 0.256s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:29:14 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-dea6bea7-e9ef-436b-9682-2a7a1e977fc2 tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Lock "cinder-quobyte-030ff96a-5608-4c5a-a0b4-88eb658d8298" released by "delete_volume" :: held 0.651s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:29:14 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-dea6bea7-e9ef-436b-9682-2a7a1e977fc2 tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Created reservations ['0474c7b7-de71-4ece-8b72-69722063f4f4', 'c289c5ea-ea31-4143-807e-2df8797aaee9', '17fc0547-2fcf-4027-810a-b97961bf0ab9', '70c8f3fe-8542-4481-8636-c66ed40c288f'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:29:14 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-dea6bea7-e9ef-436b-9682-2a7a1e977fc2 tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:29:14 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-dea6bea7-e9ef-436b-9682-2a7a1e977fc2 tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:29:14 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-dea6bea7-e9ef-436b-9682-2a7a1e977fc2 tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:29:14 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-dea6bea7-e9ef-436b-9682-2a7a1e977fc2 tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:29:14 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-dea6bea7-e9ef-436b-9682-2a7a1e977fc2 tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:29:14 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-dea6bea7-e9ef-436b-9682-2a7a1e977fc2 tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:29:14 devstack sudo[107366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce Aug 05 06:29:14 devstack sudo[107366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:29:14 devstack sudo[107366]: pam_unix(sudo:session): session closed for user root Aug 05 06:29:14 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-dea6bea7-e9ef-436b-9682-2a7a1e977fc2 tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce" returned: 0 in 0.268s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:29:14 devstack cinder-volume[88695]: DEBUG cinder.manager [None req-dea6bea7-e9ef-436b-9682-2a7a1e977fc2 tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Notifying Schedulers of capabilities ... {{(pid=88695) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 06:29:14 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-dea6bea7-e9ef-436b-9682-2a7a1e977fc2 tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Deleted volume successfully. Aug 05 06:29:14 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-94d46089-e442-4623-bb52-b5f74049a06c tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Acquiring lock "cinder-511a6e01-a014-4dcd-ac8c-b2a7ac12d76d-delete_volume" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:29:14 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-dea6bea7-e9ef-436b-9682-2a7a1e977fc2 tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Lock "cinder-030ff96a-5608-4c5a-a0b4-88eb658d8298-delete_volume" released by "delete_volume" :: held 1.144s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:29:14 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-94d46089-e442-4623-bb52-b5f74049a06c tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Lock "cinder-511a6e01-a014-4dcd-ac8c-b2a7ac12d76d-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:29:14 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-94d46089-e442-4623-bb52-b5f74049a06c tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Acquiring lock "cinder-quobyte-511a6e01-a014-4dcd-ac8c-b2a7ac12d76d" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:29:14 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-94d46089-e442-4623-bb52-b5f74049a06c tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Lock "cinder-quobyte-511a6e01-a014-4dcd-ac8c-b2a7ac12d76d" acquired by "delete_volume" :: waited 0.014s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:29:14 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b9e1e97-ed24-40bc-ba4c-59421945494f]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:29:14 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-94d46089-e442-4623-bb52-b5f74049a06c tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-511a6e01-a014-4dcd-ac8c-b2a7ac12d76d {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:29:14 devstack sudo[107369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-511a6e01-a014-4dcd-ac8c-b2a7ac12d76d Aug 05 06:29:14 devstack sudo[107369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:29:15 devstack sudo[107369]: pam_unix(sudo:session): session closed for user root Aug 05 06:29:15 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-94d46089-e442-4623-bb52-b5f74049a06c tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-511a6e01-a014-4dcd-ac8c-b2a7ac12d76d" returned: 0 in 0.344s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:29:15 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-94d46089-e442-4623-bb52-b5f74049a06c tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-511a6e01-a014-4dcd-ac8c-b2a7ac12d76d {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:29:15 devstack sudo[107374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-511a6e01-a014-4dcd-ac8c-b2a7ac12d76d Aug 05 06:29:15 devstack sudo[107374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:29:15 devstack sudo[107374]: pam_unix(sudo:session): session closed for user root Aug 05 06:29:15 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-94d46089-e442-4623-bb52-b5f74049a06c tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-511a6e01-a014-4dcd-ac8c-b2a7ac12d76d" returned: 0 in 0.260s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:29:15 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-94d46089-e442-4623-bb52-b5f74049a06c tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Lock "cinder-quobyte-511a6e01-a014-4dcd-ac8c-b2a7ac12d76d" released by "delete_volume" :: held 0.645s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:29:15 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-94d46089-e442-4623-bb52-b5f74049a06c tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Created reservations ['71f79ef7-e4f2-450e-a5f0-66faa8196a18', '89715175-8208-4e37-b390-59a157114e3c', '1655f917-9998-4101-92db-f6a4c6abba10', 'e79e8e3e-8952-4170-9d31-67200e60a7f3'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:29:15 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-94d46089-e442-4623-bb52-b5f74049a06c tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:29:15 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-94d46089-e442-4623-bb52-b5f74049a06c tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:29:15 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-94d46089-e442-4623-bb52-b5f74049a06c tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:29:15 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-94d46089-e442-4623-bb52-b5f74049a06c tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:29:15 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-94d46089-e442-4623-bb52-b5f74049a06c tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:29:15 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-94d46089-e442-4623-bb52-b5f74049a06c tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:29:15 devstack sudo[107377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce Aug 05 06:29:15 devstack sudo[107377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:29:15 devstack sudo[107377]: pam_unix(sudo:session): session closed for user root Aug 05 06:29:15 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-94d46089-e442-4623-bb52-b5f74049a06c tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce" returned: 0 in 0.256s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:29:15 devstack cinder-volume[88695]: DEBUG cinder.manager [None req-94d46089-e442-4623-bb52-b5f74049a06c tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Notifying Schedulers of capabilities ... {{(pid=88695) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 06:29:15 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-94d46089-e442-4623-bb52-b5f74049a06c tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Deleted volume successfully. Aug 05 06:29:15 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-94d46089-e442-4623-bb52-b5f74049a06c tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Lock "cinder-511a6e01-a014-4dcd-ac8c-b2a7ac12d76d-delete_volume" released by "delete_volume" :: held 1.103s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:29:15 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-34fe4e19-bd1f-4c1b-a988-2c212f125276 tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Acquiring lock "cinder-cdc69407-7062-426b-88c2-a9a81588f327-delete_volume" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:29:15 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-34fe4e19-bd1f-4c1b-a988-2c212f125276 tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Lock "cinder-cdc69407-7062-426b-88c2-a9a81588f327-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:29:15 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-34fe4e19-bd1f-4c1b-a988-2c212f125276 tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Acquiring lock "cinder-quobyte-cdc69407-7062-426b-88c2-a9a81588f327" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:29:15 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-34fe4e19-bd1f-4c1b-a988-2c212f125276 tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Lock "cinder-quobyte-cdc69407-7062-426b-88c2-a9a81588f327" acquired by "delete_volume" :: waited 0.013s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:29:15 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[c756f68f-354c-4e6a-8ad2-c8ac5abe0e45]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:29:15 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-34fe4e19-bd1f-4c1b-a988-2c212f125276 tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-cdc69407-7062-426b-88c2-a9a81588f327 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:29:16 devstack sudo[107380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-cdc69407-7062-426b-88c2-a9a81588f327 Aug 05 06:29:16 devstack sudo[107380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:29:16 devstack sudo[107380]: pam_unix(sudo:session): session closed for user root Aug 05 06:29:16 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-34fe4e19-bd1f-4c1b-a988-2c212f125276 tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-cdc69407-7062-426b-88c2-a9a81588f327" returned: 0 in 0.342s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:29:16 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-34fe4e19-bd1f-4c1b-a988-2c212f125276 tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-cdc69407-7062-426b-88c2-a9a81588f327 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:29:16 devstack sudo[107385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-cdc69407-7062-426b-88c2-a9a81588f327 Aug 05 06:29:16 devstack sudo[107385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:29:16 devstack sudo[107385]: pam_unix(sudo:session): session closed for user root Aug 05 06:29:16 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-34fe4e19-bd1f-4c1b-a988-2c212f125276 tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-cdc69407-7062-426b-88c2-a9a81588f327" returned: 0 in 0.234s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:29:16 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-34fe4e19-bd1f-4c1b-a988-2c212f125276 tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Lock "cinder-quobyte-cdc69407-7062-426b-88c2-a9a81588f327" released by "delete_volume" :: held 0.612s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:29:16 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-34fe4e19-bd1f-4c1b-a988-2c212f125276 tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Created reservations ['0b51c7c1-0df3-4e90-b460-0ab80c636d1d', 'd34b77d3-4355-4e57-9ccd-47289ca99ced', '0069c4c2-4cea-4e5d-b443-1b95397d7c5c', '20049c90-06f0-416d-9d7e-478d21b00926'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:29:16 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-34fe4e19-bd1f-4c1b-a988-2c212f125276 tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:29:16 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-34fe4e19-bd1f-4c1b-a988-2c212f125276 tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:29:16 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-34fe4e19-bd1f-4c1b-a988-2c212f125276 tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:29:16 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-34fe4e19-bd1f-4c1b-a988-2c212f125276 tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:29:16 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-34fe4e19-bd1f-4c1b-a988-2c212f125276 tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:29:16 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-34fe4e19-bd1f-4c1b-a988-2c212f125276 tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:29:16 devstack sudo[107388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce Aug 05 06:29:16 devstack sudo[107388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:29:16 devstack sudo[107388]: pam_unix(sudo:session): session closed for user root Aug 05 06:29:16 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-34fe4e19-bd1f-4c1b-a988-2c212f125276 tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce" returned: 0 in 0.244s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:29:16 devstack cinder-volume[88695]: DEBUG cinder.manager [None req-34fe4e19-bd1f-4c1b-a988-2c212f125276 tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Notifying Schedulers of capabilities ... {{(pid=88695) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 06:29:16 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-34fe4e19-bd1f-4c1b-a988-2c212f125276 tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Deleted volume successfully. Aug 05 06:29:16 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-34fe4e19-bd1f-4c1b-a988-2c212f125276 tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Lock "cinder-cdc69407-7062-426b-88c2-a9a81588f327-delete_volume" released by "delete_volume" :: held 1.040s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:29:17 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-54c7125f-8c9d-485d-8ad2-5e8f1dc9409e tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Acquiring lock "cinder-3754b55c-fb01-4107-aba3-cd896aabd7e6-delete_volume" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:29:17 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-54c7125f-8c9d-485d-8ad2-5e8f1dc9409e tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Lock "cinder-3754b55c-fb01-4107-aba3-cd896aabd7e6-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:29:17 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-54c7125f-8c9d-485d-8ad2-5e8f1dc9409e tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Acquiring lock "cinder-quobyte-3754b55c-fb01-4107-aba3-cd896aabd7e6" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:29:17 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-54c7125f-8c9d-485d-8ad2-5e8f1dc9409e tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Lock "cinder-quobyte-3754b55c-fb01-4107-aba3-cd896aabd7e6" acquired by "delete_volume" :: waited 0.013s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:29:17 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[efaab62b-05ef-4296-9ba3-fe9f687803df]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:29:17 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-54c7125f-8c9d-485d-8ad2-5e8f1dc9409e tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-3754b55c-fb01-4107-aba3-cd896aabd7e6 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:29:17 devstack sudo[107391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-3754b55c-fb01-4107-aba3-cd896aabd7e6 Aug 05 06:29:17 devstack sudo[107391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:29:17 devstack sudo[107391]: pam_unix(sudo:session): session closed for user root Aug 05 06:29:17 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-54c7125f-8c9d-485d-8ad2-5e8f1dc9409e tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-3754b55c-fb01-4107-aba3-cd896aabd7e6" returned: 0 in 0.365s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:29:17 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-54c7125f-8c9d-485d-8ad2-5e8f1dc9409e tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-3754b55c-fb01-4107-aba3-cd896aabd7e6 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:29:17 devstack sudo[107396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-3754b55c-fb01-4107-aba3-cd896aabd7e6 Aug 05 06:29:17 devstack sudo[107396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:29:17 devstack sudo[107396]: pam_unix(sudo:session): session closed for user root Aug 05 06:29:17 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-54c7125f-8c9d-485d-8ad2-5e8f1dc9409e tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-3754b55c-fb01-4107-aba3-cd896aabd7e6" returned: 0 in 0.244s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:29:17 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-54c7125f-8c9d-485d-8ad2-5e8f1dc9409e tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Lock "cinder-quobyte-3754b55c-fb01-4107-aba3-cd896aabd7e6" released by "delete_volume" :: held 0.645s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:29:17 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-54c7125f-8c9d-485d-8ad2-5e8f1dc9409e tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Created reservations ['e6178edd-7cf7-440a-b9ad-de3472991545', '3eaf7a2e-fbbd-4a5d-b3f6-605fd58c0730', '1f452445-f85b-4b4e-af2d-a5390ebe5d61', 'b3d842af-9f08-4a4e-ba4d-6e1842c85ca4'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:29:17 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-54c7125f-8c9d-485d-8ad2-5e8f1dc9409e tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:29:17 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-54c7125f-8c9d-485d-8ad2-5e8f1dc9409e tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:29:17 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-54c7125f-8c9d-485d-8ad2-5e8f1dc9409e tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:29:17 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-54c7125f-8c9d-485d-8ad2-5e8f1dc9409e tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:29:17 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-54c7125f-8c9d-485d-8ad2-5e8f1dc9409e tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:29:17 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-54c7125f-8c9d-485d-8ad2-5e8f1dc9409e tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:29:17 devstack sudo[107399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce Aug 05 06:29:17 devstack sudo[107399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:29:18 devstack sudo[107399]: pam_unix(sudo:session): session closed for user root Aug 05 06:29:18 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-54c7125f-8c9d-485d-8ad2-5e8f1dc9409e tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce" returned: 0 in 0.237s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:29:18 devstack cinder-volume[88695]: DEBUG cinder.manager [None req-54c7125f-8c9d-485d-8ad2-5e8f1dc9409e tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Notifying Schedulers of capabilities ... {{(pid=88695) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 06:29:18 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-54c7125f-8c9d-485d-8ad2-5e8f1dc9409e tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Deleted volume successfully. Aug 05 06:29:18 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-54c7125f-8c9d-485d-8ad2-5e8f1dc9409e tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Lock "cinder-3754b55c-fb01-4107-aba3-cd896aabd7e6-delete_volume" released by "delete_volume" :: held 1.074s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:29:18 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-463f13f5-3679-49db-81ea-e922604d56e4 tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Acquiring lock "cinder-4403eb1a-dafe-41f3-b0a3-22de91212eb8-delete_volume" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:29:18 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-463f13f5-3679-49db-81ea-e922604d56e4 tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Lock "cinder-4403eb1a-dafe-41f3-b0a3-22de91212eb8-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:29:18 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-463f13f5-3679-49db-81ea-e922604d56e4 tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Acquiring lock "cinder-quobyte-4403eb1a-dafe-41f3-b0a3-22de91212eb8" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:29:18 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-463f13f5-3679-49db-81ea-e922604d56e4 tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Lock "cinder-quobyte-4403eb1a-dafe-41f3-b0a3-22de91212eb8" acquired by "delete_volume" :: waited 0.014s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:29:18 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[baf93593-c02e-4654-8136-6de237bcd170]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:29:18 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-463f13f5-3679-49db-81ea-e922604d56e4 tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-4403eb1a-dafe-41f3-b0a3-22de91212eb8 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:29:18 devstack sudo[107403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-4403eb1a-dafe-41f3-b0a3-22de91212eb8 Aug 05 06:29:18 devstack sudo[107403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:29:18 devstack sudo[107403]: pam_unix(sudo:session): session closed for user root Aug 05 06:29:18 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-463f13f5-3679-49db-81ea-e922604d56e4 tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-4403eb1a-dafe-41f3-b0a3-22de91212eb8" returned: 0 in 0.339s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:29:18 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-463f13f5-3679-49db-81ea-e922604d56e4 tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-4403eb1a-dafe-41f3-b0a3-22de91212eb8 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:29:18 devstack sudo[107408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-4403eb1a-dafe-41f3-b0a3-22de91212eb8 Aug 05 06:29:18 devstack sudo[107408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:29:18 devstack sudo[107408]: pam_unix(sudo:session): session closed for user root Aug 05 06:29:18 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-463f13f5-3679-49db-81ea-e922604d56e4 tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-4403eb1a-dafe-41f3-b0a3-22de91212eb8" returned: 0 in 0.240s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:29:18 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-463f13f5-3679-49db-81ea-e922604d56e4 tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Lock "cinder-quobyte-4403eb1a-dafe-41f3-b0a3-22de91212eb8" released by "delete_volume" :: held 0.617s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:29:18 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-463f13f5-3679-49db-81ea-e922604d56e4 tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Created reservations ['2f11aeb1-1ced-4248-a188-2b9916ed3ebe', '5165b13a-c429-4fc7-bbb1-5480f67df118', '86af0e7a-a0b9-4401-bf05-2bf82b09ce71', '32f90dfd-0078-43be-aa53-e586baadb686'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:29:18 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-463f13f5-3679-49db-81ea-e922604d56e4 tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:29:18 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-463f13f5-3679-49db-81ea-e922604d56e4 tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:29:18 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-463f13f5-3679-49db-81ea-e922604d56e4 tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:29:18 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-463f13f5-3679-49db-81ea-e922604d56e4 tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:29:18 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-463f13f5-3679-49db-81ea-e922604d56e4 tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:29:18 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-463f13f5-3679-49db-81ea-e922604d56e4 tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:29:19 devstack sudo[107411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce Aug 05 06:29:19 devstack sudo[107411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:29:19 devstack sudo[107411]: pam_unix(sudo:session): session closed for user root Aug 05 06:29:19 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-463f13f5-3679-49db-81ea-e922604d56e4 tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce" returned: 0 in 0.238s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:29:19 devstack cinder-volume[88695]: DEBUG cinder.manager [None req-463f13f5-3679-49db-81ea-e922604d56e4 tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Notifying Schedulers of capabilities ... {{(pid=88695) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 06:29:19 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-463f13f5-3679-49db-81ea-e922604d56e4 tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Deleted volume successfully. Aug 05 06:29:19 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-463f13f5-3679-49db-81ea-e922604d56e4 tempest-CreateVolumesFromSourceVolumeTest-1615698329 None] Lock "cinder-4403eb1a-dafe-41f3-b0a3-22de91212eb8-delete_volume" released by "delete_volume" :: held 1.056s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:29:23 devstack cinder-volume[88695]: DEBUG cinder.volume.flows.manager.create_volume [None req-85431d56-8fea-41bb-beaa-3c3d89c5221e tempest-TestServerVolumeAttachScenarioOldVersion-1673585251 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88695) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 06:29:23 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-85431d56-8fea-41bb-beaa-3c3d89c5221e tempest-TestServerVolumeAttachScenarioOldVersion-1673585251 None] Flow 'volume_create_manager' (6b7425e9-32db-4401-99ef-2505f85d115c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:29:23 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-85431d56-8fea-41bb-beaa-3c3d89c5221e tempest-TestServerVolumeAttachScenarioOldVersion-1673585251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (030843eb-93b6-4d88-9fdf-410a3cce2599) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:29:23 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-85431d56-8fea-41bb-beaa-3c3d89c5221e tempest-TestServerVolumeAttachScenarioOldVersion-1673585251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (030843eb-93b6-4d88-9fdf-410a3cce2599) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:29:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1393501822',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5020462-2260-417e-b197-e651d41f2ffe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76add619fb464d379b04ddea7c9524a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:29:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:29:24Z,use_quota=True,user_id='1d329a67fadb4d45b4129531e7030e19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:29:23 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-85431d56-8fea-41bb-beaa-3c3d89c5221e tempest-TestServerVolumeAttachScenarioOldVersion-1673585251 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (069d7df2-ab5d-4b76-8488-36f49ab96da8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:29:23 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-85431d56-8fea-41bb-beaa-3c3d89c5221e tempest-TestServerVolumeAttachScenarioOldVersion-1673585251 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (069d7df2-ab5d-4b76-8488-36f49ab96da8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:29:23 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-85431d56-8fea-41bb-beaa-3c3d89c5221e tempest-TestServerVolumeAttachScenarioOldVersion-1673585251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48aa4d6f-4548-444e-bd61-be5affb30783) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:29:23 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-85431d56-8fea-41bb-beaa-3c3d89c5221e tempest-TestServerVolumeAttachScenarioOldVersion-1673585251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48aa4d6f-4548-444e-bd61-be5affb30783) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a5020462-2260-417e-b197-e651d41f2ffe', 'volume_name': 'volume-a5020462-2260-417e-b197-e651d41f2ffe', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:29:23 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-85431d56-8fea-41bb-beaa-3c3d89c5221e tempest-TestServerVolumeAttachScenarioOldVersion-1673585251 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a589e6e-aed6-4348-b081-6020cb9bb6b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:29:23 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-85431d56-8fea-41bb-beaa-3c3d89c5221e tempest-TestServerVolumeAttachScenarioOldVersion-1673585251 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a589e6e-aed6-4348-b081-6020cb9bb6b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:29:23 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-85431d56-8fea-41bb-beaa-3c3d89c5221e tempest-TestServerVolumeAttachScenarioOldVersion-1673585251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98bc259f-835e-4cff-94f0-461165712dac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:29:23 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-85431d56-8fea-41bb-beaa-3c3d89c5221e tempest-TestServerVolumeAttachScenarioOldVersion-1673585251 None] Volume a5020462-2260-417e-b197-e651d41f2ffe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a5020462-2260-417e-b197-e651d41f2ffe', 'volume_size': 1} Aug 05 06:29:23 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-85431d56-8fea-41bb-beaa-3c3d89c5221e tempest-TestServerVolumeAttachScenarioOldVersion-1673585251 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:29:23 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-85431d56-8fea-41bb-beaa-3c3d89c5221e tempest-TestServerVolumeAttachScenarioOldVersion-1673585251 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:29:23 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-85431d56-8fea-41bb-beaa-3c3d89c5221e tempest-TestServerVolumeAttachScenarioOldVersion-1673585251 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:29:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1393501822',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5020462-2260-417e-b197-e651d41f2ffe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76add619fb464d379b04ddea7c9524a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:29:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:29:24Z,use_quota=True,user_id='1d329a67fadb4d45b4129531e7030e19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)}" {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 06:29:23 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-85431d56-8fea-41bb-beaa-3c3d89c5221e tempest-TestServerVolumeAttachScenarioOldVersion-1673585251 None] Creating volume a5020462-2260-417e-b197-e651d41f2ffe {{(pid=88695) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 06:29:23 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-85431d56-8fea-41bb-beaa-3c3d89c5221e tempest-TestServerVolumeAttachScenarioOldVersion-1673585251 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:29:23 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-85431d56-8fea-41bb-beaa-3c3d89c5221e tempest-TestServerVolumeAttachScenarioOldVersion-1673585251 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:29:23 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-85431d56-8fea-41bb-beaa-3c3d89c5221e tempest-TestServerVolumeAttachScenarioOldVersion-1673585251 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:29:23 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-85431d56-8fea-41bb-beaa-3c3d89c5221e tempest-TestServerVolumeAttachScenarioOldVersion-1673585251 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:29:23 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-85431d56-8fea-41bb-beaa-3c3d89c5221e tempest-TestServerVolumeAttachScenarioOldVersion-1673585251 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:29:23 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-85431d56-8fea-41bb-beaa-3c3d89c5221e tempest-TestServerVolumeAttachScenarioOldVersion-1673585251 None] Selected osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 as target Quobyte volume. {{(pid=88695) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 06:29:23 devstack cinder-volume[88695]: INFO cinder.volume.drivers.remotefs [None req-85431d56-8fea-41bb-beaa-3c3d89c5221e tempest-TestServerVolumeAttachScenarioOldVersion-1673585251 None] casted to osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 Aug 05 06:29:23 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-85431d56-8fea-41bb-beaa-3c3d89c5221e tempest-TestServerVolumeAttachScenarioOldVersion-1673585251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a5020462-2260-417e-b197-e651d41f2ffe 1073741824 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:29:23 devstack sudo[107416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a5020462-2260-417e-b197-e651d41f2ffe 1073741824 Aug 05 06:29:23 devstack sudo[107416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:29:24 devstack sudo[107416]: pam_unix(sudo:session): session closed for user root Aug 05 06:29:24 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-85431d56-8fea-41bb-beaa-3c3d89c5221e tempest-TestServerVolumeAttachScenarioOldVersion-1673585251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a5020462-2260-417e-b197-e651d41f2ffe 1073741824" returned: 0 in 0.456s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:29:24 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-85431d56-8fea-41bb-beaa-3c3d89c5221e tempest-TestServerVolumeAttachScenarioOldVersion-1673585251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a5020462-2260-417e-b197-e651d41f2ffe {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:29:24 devstack sudo[107422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a5020462-2260-417e-b197-e651d41f2ffe Aug 05 06:29:24 devstack sudo[107422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:29:24 devstack sudo[107422]: pam_unix(sudo:session): session closed for user root Aug 05 06:29:24 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-85431d56-8fea-41bb-beaa-3c3d89c5221e tempest-TestServerVolumeAttachScenarioOldVersion-1673585251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a5020462-2260-417e-b197-e651d41f2ffe" returned: 0 in 0.258s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:29:24 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-85431d56-8fea-41bb-beaa-3c3d89c5221e tempest-TestServerVolumeAttachScenarioOldVersion-1673585251 None] <== create_volume: return (760ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'} {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 06:29:24 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-85431d56-8fea-41bb-beaa-3c3d89c5221e tempest-TestServerVolumeAttachScenarioOldVersion-1673585251 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.762s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:29:24 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-85431d56-8fea-41bb-beaa-3c3d89c5221e tempest-TestServerVolumeAttachScenarioOldVersion-1673585251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98bc259f-835e-4cff-94f0-461165712dac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a5020462-2260-417e-b197-e651d41f2ffe', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:29:24 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-85431d56-8fea-41bb-beaa-3c3d89c5221e tempest-TestServerVolumeAttachScenarioOldVersion-1673585251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (592c9668-aa21-44a6-ab14-1211f5cbbc4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:29:24 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-85431d56-8fea-41bb-beaa-3c3d89c5221e tempest-TestServerVolumeAttachScenarioOldVersion-1673585251 None] Volume volume-a5020462-2260-417e-b197-e651d41f2ffe (a5020462-2260-417e-b197-e651d41f2ffe): created successfully Aug 05 06:29:24 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-85431d56-8fea-41bb-beaa-3c3d89c5221e tempest-TestServerVolumeAttachScenarioOldVersion-1673585251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (592c9668-aa21-44a6-ab14-1211f5cbbc4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:29:24 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-85431d56-8fea-41bb-beaa-3c3d89c5221e tempest-TestServerVolumeAttachScenarioOldVersion-1673585251 None] Flow 'volume_create_manager' (6b7425e9-32db-4401-99ef-2505f85d115c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:29:24 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-85431d56-8fea-41bb-beaa-3c3d89c5221e tempest-TestServerVolumeAttachScenarioOldVersion-1673585251 None] Created volume successfully. Aug 05 06:29:27 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [req-3ba0236e-2347-49d9-9d36-ac7cf9585ab4 req-ca31b819-3371-4995-812b-4d8cc2a16373 tempest-TestServerVolumeAttachScenarioOldVersion-1673585251 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:29:27 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [req-3ba0236e-2347-49d9-9d36-ac7cf9585ab4 req-ca31b819-3371-4995-812b-4d8cc2a16373 tempest-TestServerVolumeAttachScenarioOldVersion-1673585251 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:29:27 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [req-3ba0236e-2347-49d9-9d36-ac7cf9585ab4 req-ca31b819-3371-4995-812b-4d8cc2a16373 tempest-TestServerVolumeAttachScenarioOldVersion-1673585251 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:29:27 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [req-3ba0236e-2347-49d9-9d36-ac7cf9585ab4 req-ca31b819-3371-4995-812b-4d8cc2a16373 tempest-TestServerVolumeAttachScenarioOldVersion-1673585251 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087', 'name': 'volume-a5020462-2260-417e-b197-e651d41f2ffe', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f87c58a4-9658-4fa4-a280-fc717417027f', 'enforce_multipath': True} {{(pid=88695) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 05 06:29:27 devstack cinder-volume[88695]: INFO cinder.volume.manager [req-3ba0236e-2347-49d9-9d36-ac7cf9585ab4 req-ca31b819-3371-4995-812b-4d8cc2a16373 tempest-TestServerVolumeAttachScenarioOldVersion-1673585251 None] attachment_update completed successfully. Aug 05 06:29:30 devstack cinder-volume[88695]: INFO cinder.volume.manager [req-db29c679-b360-45cf-91fb-dc36747b6e5d req-f7a7447a-5478-4b1f-a3a3-0a7a93385d77 tempest-TestServerVolumeAttachScenarioOldVersion-1673585251 None] Terminate volume connection completed successfully. Aug 05 06:29:30 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [req-db29c679-b360-45cf-91fb-dc36747b6e5d req-f7a7447a-5478-4b1f-a3a3-0a7a93385d77 tempest-TestServerVolumeAttachScenarioOldVersion-1673585251 None] Deleting attachment f87c58a4-9658-4fa4-a280-fc717417027f. {{(pid=88695) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 05 06:29:31 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-f36c8377-3d91-4e8b-bf81-2a5eefd1cc22 tempest-TestServerVolumeAttachScenarioOldVersion-1673585251 None] Acquiring lock "cinder-a5020462-2260-417e-b197-e651d41f2ffe-delete_volume" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:29:31 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-f36c8377-3d91-4e8b-bf81-2a5eefd1cc22 tempest-TestServerVolumeAttachScenarioOldVersion-1673585251 None] Lock "cinder-a5020462-2260-417e-b197-e651d41f2ffe-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:29:31 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-f36c8377-3d91-4e8b-bf81-2a5eefd1cc22 tempest-TestServerVolumeAttachScenarioOldVersion-1673585251 None] Acquiring lock "cinder-quobyte-a5020462-2260-417e-b197-e651d41f2ffe" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:29:31 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-f36c8377-3d91-4e8b-bf81-2a5eefd1cc22 tempest-TestServerVolumeAttachScenarioOldVersion-1673585251 None] Lock "cinder-quobyte-a5020462-2260-417e-b197-e651d41f2ffe" acquired by "delete_volume" :: waited 0.018s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:29:31 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3a06ba7-8ee7-4db6-a077-469be2c86b7d]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:29:31 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-f36c8377-3d91-4e8b-bf81-2a5eefd1cc22 tempest-TestServerVolumeAttachScenarioOldVersion-1673585251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a5020462-2260-417e-b197-e651d41f2ffe {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:29:31 devstack sudo[107853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a5020462-2260-417e-b197-e651d41f2ffe Aug 05 06:29:31 devstack sudo[107853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:29:31 devstack sudo[107853]: pam_unix(sudo:session): session closed for user root Aug 05 06:29:31 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-f36c8377-3d91-4e8b-bf81-2a5eefd1cc22 tempest-TestServerVolumeAttachScenarioOldVersion-1673585251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a5020462-2260-417e-b197-e651d41f2ffe" returned: 0 in 0.380s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:29:31 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-f36c8377-3d91-4e8b-bf81-2a5eefd1cc22 tempest-TestServerVolumeAttachScenarioOldVersion-1673585251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a5020462-2260-417e-b197-e651d41f2ffe {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:29:31 devstack sudo[107858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a5020462-2260-417e-b197-e651d41f2ffe Aug 05 06:29:31 devstack sudo[107858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:29:31 devstack sudo[107858]: pam_unix(sudo:session): session closed for user root Aug 05 06:29:31 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-f36c8377-3d91-4e8b-bf81-2a5eefd1cc22 tempest-TestServerVolumeAttachScenarioOldVersion-1673585251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a5020462-2260-417e-b197-e651d41f2ffe" returned: 0 in 0.309s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:29:31 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-f36c8377-3d91-4e8b-bf81-2a5eefd1cc22 tempest-TestServerVolumeAttachScenarioOldVersion-1673585251 None] Lock "cinder-quobyte-a5020462-2260-417e-b197-e651d41f2ffe" released by "delete_volume" :: held 0.743s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:29:32 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-f36c8377-3d91-4e8b-bf81-2a5eefd1cc22 tempest-TestServerVolumeAttachScenarioOldVersion-1673585251 None] Created reservations ['73f222fd-7041-45cf-b1ad-310e2c9d02ee', '2f1c0f4c-e5ea-4f88-9d2c-eacc52414068', '9bd4fe2a-1246-44ea-9866-7cc9db597494', '9cb84451-0582-442c-9d92-fcecf3a5c025'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:29:32 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-f36c8377-3d91-4e8b-bf81-2a5eefd1cc22 tempest-TestServerVolumeAttachScenarioOldVersion-1673585251 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:29:32 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-f36c8377-3d91-4e8b-bf81-2a5eefd1cc22 tempest-TestServerVolumeAttachScenarioOldVersion-1673585251 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:29:32 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-f36c8377-3d91-4e8b-bf81-2a5eefd1cc22 tempest-TestServerVolumeAttachScenarioOldVersion-1673585251 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:29:32 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-f36c8377-3d91-4e8b-bf81-2a5eefd1cc22 tempest-TestServerVolumeAttachScenarioOldVersion-1673585251 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:29:32 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-f36c8377-3d91-4e8b-bf81-2a5eefd1cc22 tempest-TestServerVolumeAttachScenarioOldVersion-1673585251 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:29:32 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-f36c8377-3d91-4e8b-bf81-2a5eefd1cc22 tempest-TestServerVolumeAttachScenarioOldVersion-1673585251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:29:32 devstack sudo[107861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce Aug 05 06:29:32 devstack sudo[107861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:29:32 devstack sudo[107861]: pam_unix(sudo:session): session closed for user root Aug 05 06:29:32 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-f36c8377-3d91-4e8b-bf81-2a5eefd1cc22 tempest-TestServerVolumeAttachScenarioOldVersion-1673585251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce" returned: 0 in 0.287s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:29:32 devstack cinder-volume[88695]: DEBUG cinder.manager [None req-f36c8377-3d91-4e8b-bf81-2a5eefd1cc22 tempest-TestServerVolumeAttachScenarioOldVersion-1673585251 None] Notifying Schedulers of capabilities ... {{(pid=88695) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 06:29:32 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-f36c8377-3d91-4e8b-bf81-2a5eefd1cc22 tempest-TestServerVolumeAttachScenarioOldVersion-1673585251 None] Deleted volume successfully. Aug 05 06:29:32 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-f36c8377-3d91-4e8b-bf81-2a5eefd1cc22 tempest-TestServerVolumeAttachScenarioOldVersion-1673585251 None] Lock "cinder-a5020462-2260-417e-b197-e651d41f2ffe-delete_volume" released by "delete_volume" :: held 1.278s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:29:42 devstack cinder-volume[88695]: DEBUG dbcounter [-] [88695] Writing DB stats cinder:SELECT=55,cinder:UPDATE=81,cinder:INSERT=21,cinder:DELETE=3 {{(pid=88695) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 06:29:42 devstack cinder-volume[88695]: DEBUG dbcounter [-] [88695] Writing DB stats cinder:UPDATE=76,cinder:SELECT=58,cinder:DELETE=11,cinder:INSERT=14 {{(pid=88695) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 06:29:46 devstack cinder-volume[88695]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e29d527-6704-4ba0-9e01-08a597a9791e tempest-SnapshotDependencyTests-172778483 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88695) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 06:29:46 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-2e29d527-6704-4ba0-9e01-08a597a9791e tempest-SnapshotDependencyTests-172778483 None] Flow 'volume_create_manager' (c8a2f5b8-6be2-4b7a-b3a5-d86cf61363b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:29:46 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-2e29d527-6704-4ba0-9e01-08a597a9791e tempest-SnapshotDependencyTests-172778483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09c3250b-6f36-48d9-ac40-66be0cbe37b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:29:46 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-2e29d527-6704-4ba0-9e01-08a597a9791e tempest-SnapshotDependencyTests-172778483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09c3250b-6f36-48d9-ac40-66be0cbe37b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:29:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-268350274',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d019fad-28ef-4e2f-89c5-3e9a87e68ae4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f60c53a47494552a9660e64d835bfb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:29:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:29:47Z,use_quota=True,user_id='d6633e5f591848c58e9165cb6f00cef0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:29:46 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-2e29d527-6704-4ba0-9e01-08a597a9791e tempest-SnapshotDependencyTests-172778483 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f464cce9-18e3-4b83-8dcf-4133bc780512) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:29:46 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-2e29d527-6704-4ba0-9e01-08a597a9791e tempest-SnapshotDependencyTests-172778483 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f464cce9-18e3-4b83-8dcf-4133bc780512) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:29:46 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-2e29d527-6704-4ba0-9e01-08a597a9791e tempest-SnapshotDependencyTests-172778483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (681acda9-ce4e-48fa-adf5-d6babd5d3803) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:29:46 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-2e29d527-6704-4ba0-9e01-08a597a9791e tempest-SnapshotDependencyTests-172778483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (681acda9-ce4e-48fa-adf5-d6babd5d3803) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d019fad-28ef-4e2f-89c5-3e9a87e68ae4', 'volume_name': 'volume-8d019fad-28ef-4e2f-89c5-3e9a87e68ae4', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:29:46 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-2e29d527-6704-4ba0-9e01-08a597a9791e tempest-SnapshotDependencyTests-172778483 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (645e3534-1934-4c4a-b3cc-f3d96038a10e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:29:46 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-2e29d527-6704-4ba0-9e01-08a597a9791e tempest-SnapshotDependencyTests-172778483 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (645e3534-1934-4c4a-b3cc-f3d96038a10e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:29:46 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-2e29d527-6704-4ba0-9e01-08a597a9791e tempest-SnapshotDependencyTests-172778483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d90bae81-5d5f-4efc-befd-4fc5f94c31d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:29:46 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-2e29d527-6704-4ba0-9e01-08a597a9791e tempest-SnapshotDependencyTests-172778483 None] Volume 8d019fad-28ef-4e2f-89c5-3e9a87e68ae4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d019fad-28ef-4e2f-89c5-3e9a87e68ae4', 'volume_size': 1} Aug 05 06:29:46 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-2e29d527-6704-4ba0-9e01-08a597a9791e tempest-SnapshotDependencyTests-172778483 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:29:46 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-2e29d527-6704-4ba0-9e01-08a597a9791e tempest-SnapshotDependencyTests-172778483 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:29:46 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-2e29d527-6704-4ba0-9e01-08a597a9791e tempest-SnapshotDependencyTests-172778483 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:29:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-268350274',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d019fad-28ef-4e2f-89c5-3e9a87e68ae4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f60c53a47494552a9660e64d835bfb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:29:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:29:47Z,use_quota=True,user_id='d6633e5f591848c58e9165cb6f00cef0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)}" {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 06:29:46 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-2e29d527-6704-4ba0-9e01-08a597a9791e tempest-SnapshotDependencyTests-172778483 None] Creating volume 8d019fad-28ef-4e2f-89c5-3e9a87e68ae4 {{(pid=88695) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 06:29:46 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-2e29d527-6704-4ba0-9e01-08a597a9791e tempest-SnapshotDependencyTests-172778483 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:29:46 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-2e29d527-6704-4ba0-9e01-08a597a9791e tempest-SnapshotDependencyTests-172778483 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:29:46 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-2e29d527-6704-4ba0-9e01-08a597a9791e tempest-SnapshotDependencyTests-172778483 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:29:46 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-2e29d527-6704-4ba0-9e01-08a597a9791e tempest-SnapshotDependencyTests-172778483 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:29:46 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-2e29d527-6704-4ba0-9e01-08a597a9791e tempest-SnapshotDependencyTests-172778483 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:29:46 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-2e29d527-6704-4ba0-9e01-08a597a9791e tempest-SnapshotDependencyTests-172778483 None] Selected osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 as target Quobyte volume. {{(pid=88695) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 06:29:46 devstack cinder-volume[88695]: INFO cinder.volume.drivers.remotefs [None req-2e29d527-6704-4ba0-9e01-08a597a9791e tempest-SnapshotDependencyTests-172778483 None] casted to osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 Aug 05 06:29:46 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-2e29d527-6704-4ba0-9e01-08a597a9791e tempest-SnapshotDependencyTests-172778483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8d019fad-28ef-4e2f-89c5-3e9a87e68ae4 1073741824 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:29:46 devstack sudo[107935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8d019fad-28ef-4e2f-89c5-3e9a87e68ae4 1073741824 Aug 05 06:29:46 devstack sudo[107935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:29:47 devstack sudo[107935]: pam_unix(sudo:session): session closed for user root Aug 05 06:29:47 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-2e29d527-6704-4ba0-9e01-08a597a9791e tempest-SnapshotDependencyTests-172778483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8d019fad-28ef-4e2f-89c5-3e9a87e68ae4 1073741824" returned: 0 in 0.465s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:29:47 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-2e29d527-6704-4ba0-9e01-08a597a9791e tempest-SnapshotDependencyTests-172778483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8d019fad-28ef-4e2f-89c5-3e9a87e68ae4 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:29:47 devstack sudo[107941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8d019fad-28ef-4e2f-89c5-3e9a87e68ae4 Aug 05 06:29:47 devstack sudo[107941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:29:47 devstack sudo[107941]: pam_unix(sudo:session): session closed for user root Aug 05 06:29:47 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-2e29d527-6704-4ba0-9e01-08a597a9791e tempest-SnapshotDependencyTests-172778483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8d019fad-28ef-4e2f-89c5-3e9a87e68ae4" returned: 0 in 0.265s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:29:47 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-2e29d527-6704-4ba0-9e01-08a597a9791e tempest-SnapshotDependencyTests-172778483 None] <== create_volume: return (775ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'} {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 06:29:47 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-2e29d527-6704-4ba0-9e01-08a597a9791e tempest-SnapshotDependencyTests-172778483 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.778s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:29:47 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-2e29d527-6704-4ba0-9e01-08a597a9791e tempest-SnapshotDependencyTests-172778483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d90bae81-5d5f-4efc-befd-4fc5f94c31d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d019fad-28ef-4e2f-89c5-3e9a87e68ae4', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:29:47 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-2e29d527-6704-4ba0-9e01-08a597a9791e tempest-SnapshotDependencyTests-172778483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (744ec34b-6e74-4bdc-b85a-81da9a89f3c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:29:47 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-2e29d527-6704-4ba0-9e01-08a597a9791e tempest-SnapshotDependencyTests-172778483 None] Volume volume-8d019fad-28ef-4e2f-89c5-3e9a87e68ae4 (8d019fad-28ef-4e2f-89c5-3e9a87e68ae4): created successfully Aug 05 06:29:47 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-2e29d527-6704-4ba0-9e01-08a597a9791e tempest-SnapshotDependencyTests-172778483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (744ec34b-6e74-4bdc-b85a-81da9a89f3c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:29:47 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-2e29d527-6704-4ba0-9e01-08a597a9791e tempest-SnapshotDependencyTests-172778483 None] Flow 'volume_create_manager' (c8a2f5b8-6be2-4b7a-b3a5-d86cf61363b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:29:47 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-2e29d527-6704-4ba0-9e01-08a597a9791e tempest-SnapshotDependencyTests-172778483 None] Created volume successfully. Aug 05 06:29:49 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-a982b1b2-b102-4620-81a6-ad5ec1a0f818 tempest-SnapshotDependencyTests-172778483 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:29:49 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-a982b1b2-b102-4620-81a6-ad5ec1a0f818 tempest-SnapshotDependencyTests-172778483 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:29:49 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-a982b1b2-b102-4620-81a6-ad5ec1a0f818 tempest-SnapshotDependencyTests-172778483 None] Creating offline snapshot d0e5ab46-ec7d-40d9-a8cb-a1781215b697 of volume 8d019fad-28ef-4e2f-89c5-3e9a87e68ae4 {{(pid=88695) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 06:29:49 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[82cd3c8c-b481-4111-91b1-8e47193e5df6]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:29:49 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-a982b1b2-b102-4620-81a6-ad5ec1a0f818 tempest-SnapshotDependencyTests-172778483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8d019fad-28ef-4e2f-89c5-3e9a87e68ae4 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:29:49 devstack sudo[107945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8d019fad-28ef-4e2f-89c5-3e9a87e68ae4 Aug 05 06:29:49 devstack sudo[107945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:29:49 devstack sudo[107945]: pam_unix(sudo:session): session closed for user root Aug 05 06:29:49 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-a982b1b2-b102-4620-81a6-ad5ec1a0f818 tempest-SnapshotDependencyTests-172778483 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8d019fad-28ef-4e2f-89c5-3e9a87e68ae4" returned: 0 in 0.395s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:29:49 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-a982b1b2-b102-4620-81a6-ad5ec1a0f818 tempest-SnapshotDependencyTests-172778483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8d019fad-28ef-4e2f-89c5-3e9a87e68ae4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8d019fad-28ef-4e2f-89c5-3e9a87e68ae4.d0e5ab46-ec7d-40d9-a8cb-a1781215b697 1G {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:29:49 devstack sudo[107950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8d019fad-28ef-4e2f-89c5-3e9a87e68ae4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8d019fad-28ef-4e2f-89c5-3e9a87e68ae4.d0e5ab46-ec7d-40d9-a8cb-a1781215b697 1G Aug 05 06:29:49 devstack sudo[107950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:29:49 devstack sudo[107950]: pam_unix(sudo:session): session closed for user root Aug 05 06:29:49 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-a982b1b2-b102-4620-81a6-ad5ec1a0f818 tempest-SnapshotDependencyTests-172778483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8d019fad-28ef-4e2f-89c5-3e9a87e68ae4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8d019fad-28ef-4e2f-89c5-3e9a87e68ae4.d0e5ab46-ec7d-40d9-a8cb-a1781215b697 1G" returned: 0 in 0.411s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:29:49 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-a982b1b2-b102-4620-81a6-ad5ec1a0f818 tempest-SnapshotDependencyTests-172778483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d019fad-28ef-4e2f-89c5-3e9a87e68ae4 -F qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8d019fad-28ef-4e2f-89c5-3e9a87e68ae4.d0e5ab46-ec7d-40d9-a8cb-a1781215b697 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:29:49 devstack sudo[107956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d019fad-28ef-4e2f-89c5-3e9a87e68ae4 -F qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8d019fad-28ef-4e2f-89c5-3e9a87e68ae4.d0e5ab46-ec7d-40d9-a8cb-a1781215b697 Aug 05 06:29:49 devstack sudo[107956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:29:50 devstack sudo[107956]: pam_unix(sudo:session): session closed for user root Aug 05 06:29:50 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-a982b1b2-b102-4620-81a6-ad5ec1a0f818 tempest-SnapshotDependencyTests-172778483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d019fad-28ef-4e2f-89c5-3e9a87e68ae4 -F qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8d019fad-28ef-4e2f-89c5-3e9a87e68ae4.d0e5ab46-ec7d-40d9-a8cb-a1781215b697" returned: 0 in 0.294s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:29:50 devstack cinder-volume[88695]: WARNING cinder.volume.drivers.remotefs [None req-a982b1b2-b102-4620-81a6-ad5ec1a0f818 tempest-SnapshotDependencyTests-172778483 None] /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8d019fad-28ef-4e2f-89c5-3e9a87e68ae4.d0e5ab46-ec7d-40d9-a8cb-a1781215b697 is being set with open permissions: ugo+rw Aug 05 06:29:50 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-a982b1b2-b102-4620-81a6-ad5ec1a0f818 tempest-SnapshotDependencyTests-172778483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8d019fad-28ef-4e2f-89c5-3e9a87e68ae4.d0e5ab46-ec7d-40d9-a8cb-a1781215b697 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:29:50 devstack sudo[107961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8d019fad-28ef-4e2f-89c5-3e9a87e68ae4.d0e5ab46-ec7d-40d9-a8cb-a1781215b697 Aug 05 06:29:50 devstack sudo[107961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:29:50 devstack sudo[107961]: pam_unix(sudo:session): session closed for user root Aug 05 06:29:50 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-a982b1b2-b102-4620-81a6-ad5ec1a0f818 tempest-SnapshotDependencyTests-172778483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8d019fad-28ef-4e2f-89c5-3e9a87e68ae4.d0e5ab46-ec7d-40d9-a8cb-a1781215b697" returned: 0 in 0.275s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:29:50 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-a982b1b2-b102-4620-81a6-ad5ec1a0f818 tempest-SnapshotDependencyTests-172778483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8d019fad-28ef-4e2f-89c5-3e9a87e68ae4.info {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:29:50 devstack sudo[107964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8d019fad-28ef-4e2f-89c5-3e9a87e68ae4.info Aug 05 06:29:50 devstack sudo[107964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:29:50 devstack sudo[107964]: pam_unix(sudo:session): session closed for user root Aug 05 06:29:50 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-a982b1b2-b102-4620-81a6-ad5ec1a0f818 tempest-SnapshotDependencyTests-172778483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8d019fad-28ef-4e2f-89c5-3e9a87e68ae4.info" returned: 0 in 0.291s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:29:50 devstack cinder-volume[88695]: WARNING cinder.volume.drivers.remotefs [None req-a982b1b2-b102-4620-81a6-ad5ec1a0f818 tempest-SnapshotDependencyTests-172778483 None] /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8d019fad-28ef-4e2f-89c5-3e9a87e68ae4.info is being set with open permissions: ugo+rw Aug 05 06:29:50 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-a982b1b2-b102-4620-81a6-ad5ec1a0f818 tempest-SnapshotDependencyTests-172778483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8d019fad-28ef-4e2f-89c5-3e9a87e68ae4.info {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:29:50 devstack sudo[107967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8d019fad-28ef-4e2f-89c5-3e9a87e68ae4.info Aug 05 06:29:50 devstack sudo[107967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:29:51 devstack sudo[107967]: pam_unix(sudo:session): session closed for user root Aug 05 06:29:51 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-a982b1b2-b102-4620-81a6-ad5ec1a0f818 tempest-SnapshotDependencyTests-172778483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8d019fad-28ef-4e2f-89c5-3e9a87e68ae4.info" returned: 0 in 0.258s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:29:51 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-a982b1b2-b102-4620-81a6-ad5ec1a0f818 tempest-SnapshotDependencyTests-172778483 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.028s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:29:51 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-a982b1b2-b102-4620-81a6-ad5ec1a0f818 tempest-SnapshotDependencyTests-172778483 None] Create snapshot completed successfully Aug 05 06:29:51 devstack cinder-volume[88695]: DEBUG cinder.volume.flows.manager.create_volume [None req-9473d113-1f89-422c-adb5-7d5e98a7f4c9 tempest-VolumeAndVolumeTypeFromImageTest-472752503 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88695) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 06:29:51 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-9473d113-1f89-422c-adb5-7d5e98a7f4c9 tempest-VolumeAndVolumeTypeFromImageTest-472752503 None] Flow 'volume_create_manager' (b2708520-87da-4d33-a861-7a881b164bde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:29:51 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-9473d113-1f89-422c-adb5-7d5e98a7f4c9 tempest-VolumeAndVolumeTypeFromImageTest-472752503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b76bc8c-cece-46f4-b27c-8cb2df5b027e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:29:51 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-9473d113-1f89-422c-adb5-7d5e98a7f4c9 tempest-VolumeAndVolumeTypeFromImageTest-472752503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b76bc8c-cece-46f4-b27c-8cb2df5b027e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:29:51Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5605fce-2009-4488-b9b1-424b506b3997,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a56a4a3f070c41328bbb172e764fd2b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:29:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:29:52Z,use_quota=True,user_id='dcfe26adac374921910a1804947222ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31475e2c-3f7a-47c3-9a09-d85c56a771b1),volume_type_id=31475e2c-3f7a-47c3-9a09-d85c56a771b1)' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:29:51 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-9473d113-1f89-422c-adb5-7d5e98a7f4c9 tempest-VolumeAndVolumeTypeFromImageTest-472752503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06c714c6-4436-4a3f-8c4b-44930deb72fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:29:51 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-9473d113-1f89-422c-adb5-7d5e98a7f4c9 tempest-VolumeAndVolumeTypeFromImageTest-472752503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06c714c6-4436-4a3f-8c4b-44930deb72fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:29:51 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-9473d113-1f89-422c-adb5-7d5e98a7f4c9 tempest-VolumeAndVolumeTypeFromImageTest-472752503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (140a7b29-cb46-4124-aa0f-0db74b87928f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:29:51 devstack cinder-volume[88695]: DEBUG cinder.image.glance [None req-9473d113-1f89-422c-adb5-7d5e98a7f4c9 tempest-VolumeAndVolumeTypeFromImageTest-472752503 None] Creating Keystone auth plugin from conf {{(pid=88695) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 05 06:29:52 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-9473d113-1f89-422c-adb5-7d5e98a7f4c9 tempest-VolumeAndVolumeTypeFromImageTest-472752503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (140a7b29-cb46-4124-aa0f-0db74b87928f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a5605fce-2009-4488-b9b1-424b506b3997', 'volume_name': 'volume-a5605fce-2009-4488-b9b1-424b506b3997', 'volume_size': 1, 'image_id': '483c28ac-7bc2-408d-a440-4f52c5f47f37', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/483c28ac-7bc2-408d-a440-4f52c5f47f37', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '4631e25580d1dcae2a833e58edcde029', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a56a4a3f070c41328bbb172e764fd2b7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd5d4f3c73028163f5a6052777a0fbd5a6f474715ab270f1c0bafec226842e98184d9985f123c3339c958a565c1801514de5085f7c04476ac8a7469c8b3b56fce', 'id': '483c28ac-7bc2-408d-a440-4f52c5f47f37', 'created_at': datetime.datetime(2026, 8, 5, 4, 29, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 5, 4, 29, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/483c28ac-7bc2-408d-a440-4f52c5f47f37/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:29:52 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-9473d113-1f89-422c-adb5-7d5e98a7f4c9 tempest-VolumeAndVolumeTypeFromImageTest-472752503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05d29bd6-012c-4210-a4dd-9e0195e975ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:29:52 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-9473d113-1f89-422c-adb5-7d5e98a7f4c9 tempest-VolumeAndVolumeTypeFromImageTest-472752503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05d29bd6-012c-4210-a4dd-9e0195e975ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:29:52 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-9473d113-1f89-422c-adb5-7d5e98a7f4c9 tempest-VolumeAndVolumeTypeFromImageTest-472752503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85d6101a-ad78-49d6-b001-9fdb165e2757) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:29:52 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-9473d113-1f89-422c-adb5-7d5e98a7f4c9 tempest-VolumeAndVolumeTypeFromImageTest-472752503 None] Volume a5605fce-2009-4488-b9b1-424b506b3997: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a5605fce-2009-4488-b9b1-424b506b3997', 'volume_size': 1, 'image_id': '483c28ac-7bc2-408d-a440-4f52c5f47f37', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/483c28ac-7bc2-408d-a440-4f52c5f47f37', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '4631e25580d1dcae2a833e58edcde029', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a56a4a3f070c41328bbb172e764fd2b7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd5d4f3c73028163f5a6052777a0fbd5a6f474715ab270f1c0bafec226842e98184d9985f123c3339c958a565c1801514de5085f7c04476ac8a7469c8b3b56fce', 'id': '483c28ac-7bc2-408d-a440-4f52c5f47f37', 'created_at': datetime.datetime(2026, 8, 5, 4, 29, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 5, 4, 29, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/483c28ac-7bc2-408d-a440-4f52c5f47f37/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Aug 05 06:29:52 devstack cinder-volume[88695]: DEBUG cinder.volume.flows.manager.create_volume [None req-9473d113-1f89-422c-adb5-7d5e98a7f4c9 tempest-VolumeAndVolumeTypeFromImageTest-472752503 None] Trying to clone a5605fce-2009-4488-b9b1-424b506b3997 from image 483c28ac-7bc2-408d-a440-4f52c5f47f37 at location (None, [{'url': 'file:///opt/stack/data/glance/images/483c28ac-7bc2-408d-a440-4f52c5f47f37', 'metadata': {}}]). {{(pid=88695) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 05 06:29:52 devstack cinder-volume[88695]: DEBUG cinder.image.image_utils [None req-9473d113-1f89-422c-adb5-7d5e98a7f4c9 tempest-VolumeAndVolumeTypeFromImageTest-472752503 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_483c28ac-7bc2-408d-a440-4f52c5f47f37_swd977y4devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=88695) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 05 06:29:52 devstack cinder-volume[88695]: INFO cinder.image.image_utils [None req-9473d113-1f89-422c-adb5-7d5e98a7f4c9 tempest-VolumeAndVolumeTypeFromImageTest-472752503 None] Image download 0.00 MB at 0.00 MB/s Aug 05 06:29:52 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[c72ad9f1-d007-417e-873a-9aff27585ab5]: (4, 'raw') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:29:52 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-9473d113-1f89-422c-adb5-7d5e98a7f4c9 tempest-VolumeAndVolumeTypeFromImageTest-472752503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_483c28ac-7bc2-408d-a440-4f52c5f47f37_swd977y4devstack@QuobyteHD {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:29:52 devstack sudo[107976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_483c28ac-7bc2-408d-a440-4f52c5f47f37_swd977y4devstack@QuobyteHD Aug 05 06:29:52 devstack sudo[107976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:29:52 devstack sudo[107976]: pam_unix(sudo:session): session closed for user root Aug 05 06:29:52 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-9473d113-1f89-422c-adb5-7d5e98a7f4c9 tempest-VolumeAndVolumeTypeFromImageTest-472752503 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_483c28ac-7bc2-408d-a440-4f52c5f47f37_swd977y4devstack@QuobyteHD" returned: 0 in 0.332s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:29:52 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-9473d113-1f89-422c-adb5-7d5e98a7f4c9 tempest-VolumeAndVolumeTypeFromImageTest-472752503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_483c28ac-7bc2-408d-a440-4f52c5f47f37_swd977y4devstack@QuobyteHD {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:29:52 devstack sudo[107980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_483c28ac-7bc2-408d-a440-4f52c5f47f37_swd977y4devstack@QuobyteHD Aug 05 06:29:52 devstack sudo[107980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:29:52 devstack sudo[107980]: pam_unix(sudo:session): session closed for user root Aug 05 06:29:52 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-9473d113-1f89-422c-adb5-7d5e98a7f4c9 tempest-VolumeAndVolumeTypeFromImageTest-472752503 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_483c28ac-7bc2-408d-a440-4f52c5f47f37_swd977y4devstack@QuobyteHD" returned: 1 in 0.346s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:29:52 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-9473d113-1f89-422c-adb5-7d5e98a7f4c9 tempest-VolumeAndVolumeTypeFromImageTest-472752503 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_483c28ac-7bc2-408d-a440-4f52c5f47f37_swd977y4devstack@QuobyteHD' failed. Not Retrying. {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 05 06:29:52 devstack cinder-volume[88695]: DEBUG cinder.image.image_utils [None req-9473d113-1f89-422c-adb5-7d5e98a7f4c9 tempest-VolumeAndVolumeTypeFromImageTest-472752503 None] Temporary image 483c28ac-7bc2-408d-a440-4f52c5f47f37 is fetched for user dcfe26adac374921910a1804947222ba. {{(pid=88695) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 05 06:29:52 devstack cinder-volume[88695]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4b27b72-4e98-4c5a-894f-c5cd2d01ce00 tempest-SnapshotDependencyTests-172778483 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88695) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 06:29:52 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-a4b27b72-4e98-4c5a-894f-c5cd2d01ce00 tempest-SnapshotDependencyTests-172778483 None] Flow 'volume_create_manager' (2d3e200b-0bf1-474a-9c06-5d00a863f32d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:29:52 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-a4b27b72-4e98-4c5a-894f-c5cd2d01ce00 tempest-SnapshotDependencyTests-172778483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2dd7dfb6-e5ee-4bad-835d-06b1f854d1d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:29:52 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c8e81ef-4aee-4d2b-b41f-ca70f49d83c8]: (4, 'raw') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:29:52 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-9473d113-1f89-422c-adb5-7d5e98a7f4c9 tempest-VolumeAndVolumeTypeFromImageTest-472752503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_483c28ac-7bc2-408d-a440-4f52c5f47f37_swd977y4devstack@QuobyteHD {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:29:52 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-a4b27b72-4e98-4c5a-894f-c5cd2d01ce00 tempest-SnapshotDependencyTests-172778483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2dd7dfb6-e5ee-4bad-835d-06b1f854d1d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:29:53Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45e7cb77-a1c4-4fe1-b0c3-44e6b64a8c48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f60c53a47494552a9660e64d835bfb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:29:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=d0e5ab46-ec7d-40d9-a8cb-a1781215b697,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:29:53Z,use_quota=True,user_id='d6633e5f591848c58e9165cb6f00cef0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:29:52 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-a4b27b72-4e98-4c5a-894f-c5cd2d01ce00 tempest-SnapshotDependencyTests-172778483 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ba98c85-8dc3-4f53-828e-b0c4752cd39c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:29:52 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-a4b27b72-4e98-4c5a-894f-c5cd2d01ce00 tempest-SnapshotDependencyTests-172778483 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ba98c85-8dc3-4f53-828e-b0c4752cd39c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:29:52 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-a4b27b72-4e98-4c5a-894f-c5cd2d01ce00 tempest-SnapshotDependencyTests-172778483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b658547-9e0e-4ca3-9f63-7ee06e059ae4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:29:52 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-a4b27b72-4e98-4c5a-894f-c5cd2d01ce00 tempest-SnapshotDependencyTests-172778483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b658547-9e0e-4ca3-9f63-7ee06e059ae4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '45e7cb77-a1c4-4fe1-b0c3-44e6b64a8c48', 'volume_name': 'volume-45e7cb77-a1c4-4fe1-b0c3-44e6b64a8c48', 'volume_size': 1, 'snapshot_id': 'd0e5ab46-ec7d-40d9-a8cb-a1781215b697'}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:29:52 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-a4b27b72-4e98-4c5a-894f-c5cd2d01ce00 tempest-SnapshotDependencyTests-172778483 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f53aac7a-2d6d-4ab6-9e46-92ef76558968) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:29:52 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-a4b27b72-4e98-4c5a-894f-c5cd2d01ce00 tempest-SnapshotDependencyTests-172778483 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f53aac7a-2d6d-4ab6-9e46-92ef76558968) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:29:53 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-a4b27b72-4e98-4c5a-894f-c5cd2d01ce00 tempest-SnapshotDependencyTests-172778483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c446020-8d8b-4c52-add5-7440a88e6ef6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:29:53 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-a4b27b72-4e98-4c5a-894f-c5cd2d01ce00 tempest-SnapshotDependencyTests-172778483 None] Volume 45e7cb77-a1c4-4fe1-b0c3-44e6b64a8c48: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-45e7cb77-a1c4-4fe1-b0c3-44e6b64a8c48', 'volume_size': 1, 'snapshot_id': 'd0e5ab46-ec7d-40d9-a8cb-a1781215b697'} Aug 05 06:29:53 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-a4b27b72-4e98-4c5a-894f-c5cd2d01ce00 tempest-SnapshotDependencyTests-172778483 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:29:53 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-a4b27b72-4e98-4c5a-894f-c5cd2d01ce00 tempest-SnapshotDependencyTests-172778483 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:29:53 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-a4b27b72-4e98-4c5a-894f-c5cd2d01ce00 tempest-SnapshotDependencyTests-172778483 None] Acquiring lock "cinder-quobyte-d0e5ab46-ec7d-40d9-a8cb-a1781215b697-45e7cb77-a1c4-4fe1-b0c3-44e6b64a8c48" by "_create_volume_from_snapshot" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:29:53 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-a4b27b72-4e98-4c5a-894f-c5cd2d01ce00 tempest-SnapshotDependencyTests-172778483 None] Lock "cinder-quobyte-d0e5ab46-ec7d-40d9-a8cb-a1781215b697-45e7cb77-a1c4-4fe1-b0c3-44e6b64a8c48" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:29:53 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-a4b27b72-4e98-4c5a-894f-c5cd2d01ce00 tempest-SnapshotDependencyTests-172778483 None] Creating volume 45e7cb77-a1c4-4fe1-b0c3-44e6b64a8c48 from snapshot d0e5ab46-ec7d-40d9-a8cb-a1781215b697 {{(pid=88695) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 05 06:29:53 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-a4b27b72-4e98-4c5a-894f-c5cd2d01ce00 tempest-SnapshotDependencyTests-172778483 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:29:53 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-a4b27b72-4e98-4c5a-894f-c5cd2d01ce00 tempest-SnapshotDependencyTests-172778483 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:29:53 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-a4b27b72-4e98-4c5a-894f-c5cd2d01ce00 tempest-SnapshotDependencyTests-172778483 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:29:53 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-a4b27b72-4e98-4c5a-894f-c5cd2d01ce00 tempest-SnapshotDependencyTests-172778483 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:29:53 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-a4b27b72-4e98-4c5a-894f-c5cd2d01ce00 tempest-SnapshotDependencyTests-172778483 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:29:53 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-a4b27b72-4e98-4c5a-894f-c5cd2d01ce00 tempest-SnapshotDependencyTests-172778483 None] Selected osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 as target Quobyte volume. {{(pid=88695) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 06:29:53 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-a4b27b72-4e98-4c5a-894f-c5cd2d01ce00 tempest-SnapshotDependencyTests-172778483 None] Acquiring lock "cinder-quobyte-45e7cb77-a1c4-4fe1-b0c3-44e6b64a8c48" by "_copy_volume_from_snapshot" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:29:53 devstack sudo[107985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_483c28ac-7bc2-408d-a440-4f52c5f47f37_swd977y4devstack@QuobyteHD Aug 05 06:29:53 devstack sudo[107985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:29:53 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-a4b27b72-4e98-4c5a-894f-c5cd2d01ce00 tempest-SnapshotDependencyTests-172778483 None] Lock "cinder-quobyte-45e7cb77-a1c4-4fe1-b0c3-44e6b64a8c48" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:29:53 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-a4b27b72-4e98-4c5a-894f-c5cd2d01ce00 tempest-SnapshotDependencyTests-172778483 None] snapshot: d0e5ab46-ec7d-40d9-a8cb-a1781215b697, volume: 45e7cb77-a1c4-4fe1-b0c3-44e6b64a8c48, {{(pid=88695) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 05 06:29:53 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-a4b27b72-4e98-4c5a-894f-c5cd2d01ce00 tempest-SnapshotDependencyTests-172778483 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:29:53 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-a4b27b72-4e98-4c5a-894f-c5cd2d01ce00 tempest-SnapshotDependencyTests-172778483 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:29:53 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-a4b27b72-4e98-4c5a-894f-c5cd2d01ce00 tempest-SnapshotDependencyTests-172778483 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:29:53 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-a4b27b72-4e98-4c5a-894f-c5cd2d01ce00 tempest-SnapshotDependencyTests-172778483 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:29:53 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-a4b27b72-4e98-4c5a-894f-c5cd2d01ce00 tempest-SnapshotDependencyTests-172778483 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:29:53 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[34c4fd6c-c3cd-48bb-959f-9f04d1535d7e]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:29:53 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-a4b27b72-4e98-4c5a-894f-c5cd2d01ce00 tempest-SnapshotDependencyTests-172778483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8d019fad-28ef-4e2f-89c5-3e9a87e68ae4.d0e5ab46-ec7d-40d9-a8cb-a1781215b697 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:29:53 devstack sudo[107987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8d019fad-28ef-4e2f-89c5-3e9a87e68ae4.d0e5ab46-ec7d-40d9-a8cb-a1781215b697 Aug 05 06:29:53 devstack sudo[107987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:29:53 devstack sudo[107985]: pam_unix(sudo:session): session closed for user root Aug 05 06:29:53 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-9473d113-1f89-422c-adb5-7d5e98a7f4c9 tempest-VolumeAndVolumeTypeFromImageTest-472752503 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_483c28ac-7bc2-408d-a440-4f52c5f47f37_swd977y4devstack@QuobyteHD" returned: 0 in 0.329s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:29:53 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-9473d113-1f89-422c-adb5-7d5e98a7f4c9 tempest-VolumeAndVolumeTypeFromImageTest-472752503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_483c28ac-7bc2-408d-a440-4f52c5f47f37_swd977y4devstack@QuobyteHD {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:29:53 devstack sudo[107991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_483c28ac-7bc2-408d-a440-4f52c5f47f37_swd977y4devstack@QuobyteHD Aug 05 06:29:53 devstack sudo[107991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:29:53 devstack sudo[107987]: pam_unix(sudo:session): session closed for user root Aug 05 06:29:53 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-a4b27b72-4e98-4c5a-894f-c5cd2d01ce00 tempest-SnapshotDependencyTests-172778483 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8d019fad-28ef-4e2f-89c5-3e9a87e68ae4.d0e5ab46-ec7d-40d9-a8cb-a1781215b697" returned: 0 in 0.369s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:29:53 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-a4b27b72-4e98-4c5a-894f-c5cd2d01ce00 tempest-SnapshotDependencyTests-172778483 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8d019fad-28ef-4e2f-89c5-3e9a87e68ae4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88695) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 06:29:53 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[38cfc80a-d05d-49e1-9869-084c8e05690a]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:29:53 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-a4b27b72-4e98-4c5a-894f-c5cd2d01ce00 tempest-SnapshotDependencyTests-172778483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8d019fad-28ef-4e2f-89c5-3e9a87e68ae4 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:29:53 devstack sudo[107996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8d019fad-28ef-4e2f-89c5-3e9a87e68ae4 Aug 05 06:29:53 devstack sudo[107996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:29:53 devstack sudo[107991]: pam_unix(sudo:session): session closed for user root Aug 05 06:29:53 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-9473d113-1f89-422c-adb5-7d5e98a7f4c9 tempest-VolumeAndVolumeTypeFromImageTest-472752503 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_483c28ac-7bc2-408d-a440-4f52c5f47f37_swd977y4devstack@QuobyteHD" returned: 1 in 0.340s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:29:53 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-9473d113-1f89-422c-adb5-7d5e98a7f4c9 tempest-VolumeAndVolumeTypeFromImageTest-472752503 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_483c28ac-7bc2-408d-a440-4f52c5f47f37_swd977y4devstack@QuobyteHD' failed. Not Retrying. {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 05 06:29:53 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-9473d113-1f89-422c-adb5-7d5e98a7f4c9 tempest-VolumeAndVolumeTypeFromImageTest-472752503 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:29:53 devstack sudo[107996]: pam_unix(sudo:session): session closed for user root Aug 05 06:29:53 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-a4b27b72-4e98-4c5a-894f-c5cd2d01ce00 tempest-SnapshotDependencyTests-172778483 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8d019fad-28ef-4e2f-89c5-3e9a87e68ae4" returned: 0 in 0.390s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:29:53 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-a4b27b72-4e98-4c5a-894f-c5cd2d01ce00 tempest-SnapshotDependencyTests-172778483 None] will copy from snapshot at /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8d019fad-28ef-4e2f-89c5-3e9a87e68ae4 {{(pid=88695) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 05 06:29:53 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-a4b27b72-4e98-4c5a-894f-c5cd2d01ce00 tempest-SnapshotDependencyTests-172778483 None] Creating direct copy from snapshot {{(pid=88695) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 05 06:29:53 devstack cinder-volume[88695]: DEBUG cinder.utils [None req-a4b27b72-4e98-4c5a-894f-c5cd2d01ce00 tempest-SnapshotDependencyTests-172778483 None] Path /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-45e7cb77-a1c4-4fe1-b0c3-44e6b64a8c48 not found in is_blk_device check {{(pid=88695) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 05 06:29:53 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-a4b27b72-4e98-4c5a-894f-c5cd2d01ce00 tempest-SnapshotDependencyTests-172778483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8d019fad-28ef-4e2f-89c5-3e9a87e68ae4 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-45e7cb77-a1c4-4fe1-b0c3-44e6b64a8c48 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:29:53 devstack sudo[108004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8d019fad-28ef-4e2f-89c5-3e9a87e68ae4 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-45e7cb77-a1c4-4fe1-b0c3-44e6b64a8c48 Aug 05 06:29:53 devstack sudo[108004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:29:58 devstack sudo[108004]: pam_unix(sudo:session): session closed for user root Aug 05 06:29:58 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-a4b27b72-4e98-4c5a-894f-c5cd2d01ce00 tempest-SnapshotDependencyTests-172778483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8d019fad-28ef-4e2f-89c5-3e9a87e68ae4 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-45e7cb77-a1c4-4fe1-b0c3-44e6b64a8c48" returned: 0 in 4.139s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:29:58 devstack cinder-volume[88695]: DEBUG cinder.image.image_utils [None req-a4b27b72-4e98-4c5a-894f-c5cd2d01ce00 tempest-SnapshotDependencyTests-172778483 None] Image conversion details: src /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8d019fad-28ef-4e2f-89c5-3e9a87e68ae4, size 1024.00 MB, duration 4.14 sec, destination /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-45e7cb77-a1c4-4fe1-b0c3-44e6b64a8c48 {{(pid=88695) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 05 06:29:58 devstack cinder-volume[88695]: INFO cinder.image.image_utils [None req-a4b27b72-4e98-4c5a-894f-c5cd2d01ce00 tempest-SnapshotDependencyTests-172778483 None] Converted 1024.00 MB image at 247.29 MB/s Aug 05 06:29:58 devstack cinder-volume[88695]: WARNING cinder.volume.drivers.remotefs [None req-a4b27b72-4e98-4c5a-894f-c5cd2d01ce00 tempest-SnapshotDependencyTests-172778483 None] /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-45e7cb77-a1c4-4fe1-b0c3-44e6b64a8c48 is being set with open permissions: ugo+rw Aug 05 06:29:58 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-a4b27b72-4e98-4c5a-894f-c5cd2d01ce00 tempest-SnapshotDependencyTests-172778483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-45e7cb77-a1c4-4fe1-b0c3-44e6b64a8c48 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:29:58 devstack sudo[108019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-45e7cb77-a1c4-4fe1-b0c3-44e6b64a8c48 Aug 05 06:29:58 devstack sudo[108019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:29:58 devstack sudo[108019]: pam_unix(sudo:session): session closed for user root Aug 05 06:29:58 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-a4b27b72-4e98-4c5a-894f-c5cd2d01ce00 tempest-SnapshotDependencyTests-172778483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-45e7cb77-a1c4-4fe1-b0c3-44e6b64a8c48" returned: 0 in 0.251s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:29:58 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-a4b27b72-4e98-4c5a-894f-c5cd2d01ce00 tempest-SnapshotDependencyTests-172778483 None] Lock "cinder-quobyte-45e7cb77-a1c4-4fe1-b0c3-44e6b64a8c48" released by "_copy_volume_from_snapshot" :: held 5.236s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:29:58 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-a4b27b72-4e98-4c5a-894f-c5cd2d01ce00 tempest-SnapshotDependencyTests-172778483 None] Lock "cinder-quobyte-d0e5ab46-ec7d-40d9-a8cb-a1781215b697-45e7cb77-a1c4-4fe1-b0c3-44e6b64a8c48" released by "_create_volume_from_snapshot" :: held 5.304s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:29:58 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-a4b27b72-4e98-4c5a-894f-c5cd2d01ce00 tempest-SnapshotDependencyTests-172778483 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.324s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:29:58 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-9473d113-1f89-422c-adb5-7d5e98a7f4c9 tempest-VolumeAndVolumeTypeFromImageTest-472752503 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.727s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:29:58 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-9473d113-1f89-422c-adb5-7d5e98a7f4c9 tempest-VolumeAndVolumeTypeFromImageTest-472752503 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:29:51Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5605fce-2009-4488-b9b1-424b506b3997,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a56a4a3f070c41328bbb172e764fd2b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:29:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:29:52Z,use_quota=True,user_id='dcfe26adac374921910a1804947222ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31475e2c-3f7a-47c3-9a09-d85c56a771b1),volume_type_id=31475e2c-3f7a-47c3-9a09-d85c56a771b1)}" {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 06:29:58 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-9473d113-1f89-422c-adb5-7d5e98a7f4c9 tempest-VolumeAndVolumeTypeFromImageTest-472752503 None] Creating volume a5605fce-2009-4488-b9b1-424b506b3997 {{(pid=88695) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 06:29:58 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-9473d113-1f89-422c-adb5-7d5e98a7f4c9 tempest-VolumeAndVolumeTypeFromImageTest-472752503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:29:58 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-9473d113-1f89-422c-adb5-7d5e98a7f4c9 tempest-VolumeAndVolumeTypeFromImageTest-472752503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:29:58 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-9473d113-1f89-422c-adb5-7d5e98a7f4c9 tempest-VolumeAndVolumeTypeFromImageTest-472752503 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:29:58 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-9473d113-1f89-422c-adb5-7d5e98a7f4c9 tempest-VolumeAndVolumeTypeFromImageTest-472752503 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:29:58 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-9473d113-1f89-422c-adb5-7d5e98a7f4c9 tempest-VolumeAndVolumeTypeFromImageTest-472752503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:29:58 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-9473d113-1f89-422c-adb5-7d5e98a7f4c9 tempest-VolumeAndVolumeTypeFromImageTest-472752503 None] Selected osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 as target Quobyte volume. {{(pid=88695) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 06:29:58 devstack cinder-volume[88695]: INFO cinder.volume.drivers.remotefs [None req-9473d113-1f89-422c-adb5-7d5e98a7f4c9 tempest-VolumeAndVolumeTypeFromImageTest-472752503 None] casted to osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 Aug 05 06:29:58 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-9473d113-1f89-422c-adb5-7d5e98a7f4c9 tempest-VolumeAndVolumeTypeFromImageTest-472752503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a5605fce-2009-4488-b9b1-424b506b3997 1073741824 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:29:58 devstack sudo[108023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a5605fce-2009-4488-b9b1-424b506b3997 1073741824 Aug 05 06:29:58 devstack sudo[108023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:29:58 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-a4b27b72-4e98-4c5a-894f-c5cd2d01ce00 tempest-SnapshotDependencyTests-172778483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c446020-8d8b-4c52-add5-7440a88e6ef6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45e7cb77-a1c4-4fe1-b0c3-44e6b64a8c48', 'volume_size': 1, 'snapshot_id': 'd0e5ab46-ec7d-40d9-a8cb-a1781215b697'}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:29:58 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-a4b27b72-4e98-4c5a-894f-c5cd2d01ce00 tempest-SnapshotDependencyTests-172778483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9cea1fcf-b7c0-408e-9e01-510eb13aa934) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:29:58 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-a4b27b72-4e98-4c5a-894f-c5cd2d01ce00 tempest-SnapshotDependencyTests-172778483 None] Volume volume-45e7cb77-a1c4-4fe1-b0c3-44e6b64a8c48 (45e7cb77-a1c4-4fe1-b0c3-44e6b64a8c48): created successfully Aug 05 06:29:58 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-a4b27b72-4e98-4c5a-894f-c5cd2d01ce00 tempest-SnapshotDependencyTests-172778483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9cea1fcf-b7c0-408e-9e01-510eb13aa934) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:29:58 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-a4b27b72-4e98-4c5a-894f-c5cd2d01ce00 tempest-SnapshotDependencyTests-172778483 None] Flow 'volume_create_manager' (2d3e200b-0bf1-474a-9c06-5d00a863f32d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:29:58 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-a4b27b72-4e98-4c5a-894f-c5cd2d01ce00 tempest-SnapshotDependencyTests-172778483 None] Created volume successfully. Aug 05 06:29:58 devstack sudo[108023]: pam_unix(sudo:session): session closed for user root Aug 05 06:29:58 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-9473d113-1f89-422c-adb5-7d5e98a7f4c9 tempest-VolumeAndVolumeTypeFromImageTest-472752503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a5605fce-2009-4488-b9b1-424b506b3997 1073741824" returned: 0 in 0.429s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:29:58 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-9473d113-1f89-422c-adb5-7d5e98a7f4c9 tempest-VolumeAndVolumeTypeFromImageTest-472752503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a5605fce-2009-4488-b9b1-424b506b3997 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:29:58 devstack sudo[108029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a5605fce-2009-4488-b9b1-424b506b3997 Aug 05 06:29:58 devstack sudo[108029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:29:59 devstack sudo[108029]: pam_unix(sudo:session): session closed for user root Aug 05 06:29:59 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-9473d113-1f89-422c-adb5-7d5e98a7f4c9 tempest-VolumeAndVolumeTypeFromImageTest-472752503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a5605fce-2009-4488-b9b1-424b506b3997" returned: 0 in 0.254s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:29:59 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-9473d113-1f89-422c-adb5-7d5e98a7f4c9 tempest-VolumeAndVolumeTypeFromImageTest-472752503 None] <== create_volume: return (728ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'} {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 06:29:59 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-9473d113-1f89-422c-adb5-7d5e98a7f4c9 tempest-VolumeAndVolumeTypeFromImageTest-472752503 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.732s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:29:59 devstack cinder-volume[88695]: DEBUG cinder.volume.volume_utils [None req-9473d113-1f89-422c-adb5-7d5e98a7f4c9 tempest-VolumeAndVolumeTypeFromImageTest-472752503 None] Attempting download of 483c28ac-7bc2-408d-a440-4f52c5f47f37 ((None, [{'url': 'file:///opt/stack/data/glance/images/483c28ac-7bc2-408d-a440-4f52c5f47f37', 'metadata': {}}])) to volume a5605fce-2009-4488-b9b1-424b506b3997. {{(pid=88695) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 05 06:29:59 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b97b344-a850-4736-9643-d409d8e0fedf]: (4, 'raw') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:29:59 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-9473d113-1f89-422c-adb5-7d5e98a7f4c9 tempest-VolumeAndVolumeTypeFromImageTest-472752503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_483c28ac-7bc2-408d-a440-4f52c5f47f37_k3y_mde6 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:29:59 devstack sudo[108032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_483c28ac-7bc2-408d-a440-4f52c5f47f37_k3y_mde6 Aug 05 06:29:59 devstack sudo[108032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:29:59 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-488b7989-792e-4197-9d42-e78424d48b2e tempest-SnapshotDependencyTests-172778483 None] Acquiring lock "cinder-d0e5ab46-ec7d-40d9-a8cb-a1781215b697-delete_snapshot" by "delete_snapshot" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:29:59 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-488b7989-792e-4197-9d42-e78424d48b2e tempest-SnapshotDependencyTests-172778483 None] Lock "cinder-d0e5ab46-ec7d-40d9-a8cb-a1781215b697-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:29:59 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-488b7989-792e-4197-9d42-e78424d48b2e tempest-SnapshotDependencyTests-172778483 None] Acquiring lock "cinder-quobyte-8d019fad-28ef-4e2f-89c5-3e9a87e68ae4" by "delete_snapshot" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:29:59 devstack sudo[108032]: pam_unix(sudo:session): session closed for user root Aug 05 06:29:59 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-488b7989-792e-4197-9d42-e78424d48b2e tempest-SnapshotDependencyTests-172778483 None] Lock "cinder-quobyte-8d019fad-28ef-4e2f-89c5-3e9a87e68ae4" acquired by "delete_snapshot" :: waited 0.022s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:29:59 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-488b7989-792e-4197-9d42-e78424d48b2e tempest-SnapshotDependencyTests-172778483 None] Acquiring lock "cinder-quobyte-d0e5ab46-ec7d-40d9-a8cb-a1781215b697" by "_delete_snapshot" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:29:59 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-9473d113-1f89-422c-adb5-7d5e98a7f4c9 tempest-VolumeAndVolumeTypeFromImageTest-472752503 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_483c28ac-7bc2-408d-a440-4f52c5f47f37_k3y_mde6" returned: 0 in 0.372s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:29:59 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-9473d113-1f89-422c-adb5-7d5e98a7f4c9 tempest-VolumeAndVolumeTypeFromImageTest-472752503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_483c28ac-7bc2-408d-a440-4f52c5f47f37_k3y_mde6 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:29:59 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-488b7989-792e-4197-9d42-e78424d48b2e tempest-SnapshotDependencyTests-172778483 None] Lock "cinder-quobyte-d0e5ab46-ec7d-40d9-a8cb-a1781215b697" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:29:59 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-488b7989-792e-4197-9d42-e78424d48b2e tempest-SnapshotDependencyTests-172778483 None] Deleting offline snapshot d0e5ab46-ec7d-40d9-a8cb-a1781215b697 of volume 8d019fad-28ef-4e2f-89c5-3e9a87e68ae4 {{(pid=88695) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 06:29:59 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-488b7989-792e-4197-9d42-e78424d48b2e tempest-SnapshotDependencyTests-172778483 None] snapshot_file for this snap is: volume-8d019fad-28ef-4e2f-89c5-3e9a87e68ae4.d0e5ab46-ec7d-40d9-a8cb-a1781215b697 {{(pid=88695) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 06:29:59 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6da41ae-f82f-458d-bbd1-d1c26c7b8c8f]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:29:59 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-488b7989-792e-4197-9d42-e78424d48b2e tempest-SnapshotDependencyTests-172778483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8d019fad-28ef-4e2f-89c5-3e9a87e68ae4.d0e5ab46-ec7d-40d9-a8cb-a1781215b697 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:29:59 devstack sudo[108036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_483c28ac-7bc2-408d-a440-4f52c5f47f37_k3y_mde6 Aug 05 06:29:59 devstack sudo[108036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:29:59 devstack sudo[108037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8d019fad-28ef-4e2f-89c5-3e9a87e68ae4.d0e5ab46-ec7d-40d9-a8cb-a1781215b697 Aug 05 06:29:59 devstack sudo[108037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:29:59 devstack sudo[108036]: pam_unix(sudo:session): session closed for user root Aug 05 06:29:59 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-9473d113-1f89-422c-adb5-7d5e98a7f4c9 tempest-VolumeAndVolumeTypeFromImageTest-472752503 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_483c28ac-7bc2-408d-a440-4f52c5f47f37_k3y_mde6" returned: 1 in 0.338s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:29:59 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-9473d113-1f89-422c-adb5-7d5e98a7f4c9 tempest-VolumeAndVolumeTypeFromImageTest-472752503 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_483c28ac-7bc2-408d-a440-4f52c5f47f37_k3y_mde6' failed. Not Retrying. {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 05 06:29:59 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[db71571d-ce0e-424f-b6ca-aaa1ec6cee18]: (4, 'raw') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:29:59 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-9473d113-1f89-422c-adb5-7d5e98a7f4c9 tempest-VolumeAndVolumeTypeFromImageTest-472752503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_483c28ac-7bc2-408d-a440-4f52c5f47f37_swd977y4devstack@QuobyteHD {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:29:59 devstack sudo[108037]: pam_unix(sudo:session): session closed for user root Aug 05 06:29:59 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-488b7989-792e-4197-9d42-e78424d48b2e tempest-SnapshotDependencyTests-172778483 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8d019fad-28ef-4e2f-89c5-3e9a87e68ae4.d0e5ab46-ec7d-40d9-a8cb-a1781215b697" returned: 0 in 0.374s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:29:59 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-488b7989-792e-4197-9d42-e78424d48b2e tempest-SnapshotDependencyTests-172778483 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8d019fad-28ef-4e2f-89c5-3e9a87e68ae4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88695) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 06:29:59 devstack sudo[108042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_483c28ac-7bc2-408d-a440-4f52c5f47f37_swd977y4devstack@QuobyteHD Aug 05 06:29:59 devstack sudo[108042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:29:59 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2db0941-f2ba-4ebf-9693-431b2483bb87]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:29:59 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-488b7989-792e-4197-9d42-e78424d48b2e tempest-SnapshotDependencyTests-172778483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8d019fad-28ef-4e2f-89c5-3e9a87e68ae4 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:30:00 devstack sudo[108047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8d019fad-28ef-4e2f-89c5-3e9a87e68ae4 Aug 05 06:30:00 devstack sudo[108047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:30:00 devstack sudo[108042]: pam_unix(sudo:session): session closed for user root Aug 05 06:30:00 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-9473d113-1f89-422c-adb5-7d5e98a7f4c9 tempest-VolumeAndVolumeTypeFromImageTest-472752503 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_483c28ac-7bc2-408d-a440-4f52c5f47f37_swd977y4devstack@QuobyteHD" returned: 0 in 0.325s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:30:00 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-9473d113-1f89-422c-adb5-7d5e98a7f4c9 tempest-VolumeAndVolumeTypeFromImageTest-472752503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_483c28ac-7bc2-408d-a440-4f52c5f47f37_swd977y4devstack@QuobyteHD {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:30:00 devstack sudo[108051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_483c28ac-7bc2-408d-a440-4f52c5f47f37_swd977y4devstack@QuobyteHD Aug 05 06:30:00 devstack sudo[108051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:30:00 devstack cinder-volume[88695]: DEBUG oslo_service.periodic_task [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88695) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 06:30:00 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:30:00 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:30:00 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:30:00 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:30:00 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:30:00 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:30:00 devstack sudo[108056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce Aug 05 06:30:00 devstack sudo[108056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:30:00 devstack sudo[108051]: pam_unix(sudo:session): session closed for user root Aug 05 06:30:00 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-9473d113-1f89-422c-adb5-7d5e98a7f4c9 tempest-VolumeAndVolumeTypeFromImageTest-472752503 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_483c28ac-7bc2-408d-a440-4f52c5f47f37_swd977y4devstack@QuobyteHD" returned: 1 in 0.419s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:30:00 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-9473d113-1f89-422c-adb5-7d5e98a7f4c9 tempest-VolumeAndVolumeTypeFromImageTest-472752503 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_483c28ac-7bc2-408d-a440-4f52c5f47f37_swd977y4devstack@QuobyteHD' failed. Not Retrying. {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 05 06:30:00 devstack cinder-volume[88695]: DEBUG cinder.image.image_utils [None req-9473d113-1f89-422c-adb5-7d5e98a7f4c9 tempest-VolumeAndVolumeTypeFromImageTest-472752503 None] 483c28ac-7bc2-408d-a440-4f52c5f47f37 was raw, converting to qcow2 {{(pid=88695) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 05 06:30:00 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-9473d113-1f89-422c-adb5-7d5e98a7f4c9 tempest-VolumeAndVolumeTypeFromImageTest-472752503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_483c28ac-7bc2-408d-a440-4f52c5f47f37_swd977y4devstack@QuobyteHD /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a5605fce-2009-4488-b9b1-424b506b3997 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:30:00 devstack sudo[108047]: pam_unix(sudo:session): session closed for user root Aug 05 06:30:00 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-488b7989-792e-4197-9d42-e78424d48b2e tempest-SnapshotDependencyTests-172778483 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8d019fad-28ef-4e2f-89c5-3e9a87e68ae4" returned: 0 in 0.655s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:30:00 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-488b7989-792e-4197-9d42-e78424d48b2e tempest-SnapshotDependencyTests-172778483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8d019fad-28ef-4e2f-89c5-3e9a87e68ae4.d0e5ab46-ec7d-40d9-a8cb-a1781215b697 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:30:00 devstack sudo[108063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_483c28ac-7bc2-408d-a440-4f52c5f47f37_swd977y4devstack@QuobyteHD /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a5605fce-2009-4488-b9b1-424b506b3997 Aug 05 06:30:00 devstack sudo[108063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:30:00 devstack sudo[108064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8d019fad-28ef-4e2f-89c5-3e9a87e68ae4.d0e5ab46-ec7d-40d9-a8cb-a1781215b697 Aug 05 06:30:00 devstack sudo[108064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:30:00 devstack sudo[108056]: pam_unix(sudo:session): session closed for user root Aug 05 06:30:00 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce" returned: 0 in 0.351s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:30:00 devstack cinder-volume[88695]: DEBUG cinder.manager [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] Notifying Schedulers of capabilities ... {{(pid=88695) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 06:30:00 devstack cinder-volume[88695]: DEBUG oslo_service.periodic_task [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] Running periodic task VolumeManager._thread_info {{(pid=88695) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 06:30:00 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] thread count: 28 {{(pid=88695) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 05 06:30:00 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] thread info: [<_MainThread(MainThread, started 134469211893888)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88695) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 05 06:30:01 devstack sudo[108064]: pam_unix(sudo:session): session closed for user root Aug 05 06:30:01 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-488b7989-792e-4197-9d42-e78424d48b2e tempest-SnapshotDependencyTests-172778483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8d019fad-28ef-4e2f-89c5-3e9a87e68ae4.d0e5ab46-ec7d-40d9-a8cb-a1781215b697" returned: 0 in 0.421s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:30:01 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-488b7989-792e-4197-9d42-e78424d48b2e tempest-SnapshotDependencyTests-172778483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8d019fad-28ef-4e2f-89c5-3e9a87e68ae4.d0e5ab46-ec7d-40d9-a8cb-a1781215b697 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:30:01 devstack sudo[108063]: pam_unix(sudo:session): session closed for user root Aug 05 06:30:01 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-9473d113-1f89-422c-adb5-7d5e98a7f4c9 tempest-VolumeAndVolumeTypeFromImageTest-472752503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_483c28ac-7bc2-408d-a440-4f52c5f47f37_swd977y4devstack@QuobyteHD /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a5605fce-2009-4488-b9b1-424b506b3997" returned: 0 in 0.479s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:30:01 devstack cinder-volume[88695]: DEBUG cinder.image.image_utils [None req-9473d113-1f89-422c-adb5-7d5e98a7f4c9 tempest-VolumeAndVolumeTypeFromImageTest-472752503 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_483c28ac-7bc2-408d-a440-4f52c5f47f37_swd977y4devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a5605fce-2009-4488-b9b1-424b506b3997 {{(pid=88695) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 05 06:30:01 devstack cinder-volume[88695]: INFO cinder.image.image_utils [None req-9473d113-1f89-422c-adb5-7d5e98a7f4c9 tempest-VolumeAndVolumeTypeFromImageTest-472752503 None] Converted 0.00 MB image at 0.00 MB/s Aug 05 06:30:01 devstack sudo[108076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8d019fad-28ef-4e2f-89c5-3e9a87e68ae4.d0e5ab46-ec7d-40d9-a8cb-a1781215b697 Aug 05 06:30:01 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-9473d113-1f89-422c-adb5-7d5e98a7f4c9 tempest-VolumeAndVolumeTypeFromImageTest-472752503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a5605fce-2009-4488-b9b1-424b506b3997 1G {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:30:01 devstack sudo[108076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:30:01 devstack sudo[108078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a5605fce-2009-4488-b9b1-424b506b3997 1G Aug 05 06:30:01 devstack sudo[108078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:30:01 devstack sudo[108076]: pam_unix(sudo:session): session closed for user root Aug 05 06:30:01 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-488b7989-792e-4197-9d42-e78424d48b2e tempest-SnapshotDependencyTests-172778483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8d019fad-28ef-4e2f-89c5-3e9a87e68ae4.d0e5ab46-ec7d-40d9-a8cb-a1781215b697" returned: 0 in 0.294s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:30:01 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-488b7989-792e-4197-9d42-e78424d48b2e tempest-SnapshotDependencyTests-172778483 None] Lock "cinder-quobyte-d0e5ab46-ec7d-40d9-a8cb-a1781215b697" released by "_delete_snapshot" :: held 1.870s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:30:01 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-488b7989-792e-4197-9d42-e78424d48b2e tempest-SnapshotDependencyTests-172778483 None] Lock "cinder-quobyte-8d019fad-28ef-4e2f-89c5-3e9a87e68ae4" released by "delete_snapshot" :: held 1.913s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:30:01 devstack sudo[108078]: pam_unix(sudo:session): session closed for user root Aug 05 06:30:01 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-9473d113-1f89-422c-adb5-7d5e98a7f4c9 tempest-VolumeAndVolumeTypeFromImageTest-472752503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a5605fce-2009-4488-b9b1-424b506b3997 1G" returned: 0 in 0.362s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:30:01 devstack cinder-volume[88695]: DEBUG cinder.volume.volume_utils [None req-9473d113-1f89-422c-adb5-7d5e98a7f4c9 tempest-VolumeAndVolumeTypeFromImageTest-472752503 None] Downloaded image 483c28ac-7bc2-408d-a440-4f52c5f47f37 ((None, [{'url': 'file:///opt/stack/data/glance/images/483c28ac-7bc2-408d-a440-4f52c5f47f37', 'metadata': {}}])) to volume a5605fce-2009-4488-b9b1-424b506b3997 successfully. {{(pid=88695) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 05 06:30:01 devstack cinder-volume[88695]: DEBUG cinder.image.image_utils [None req-9473d113-1f89-422c-adb5-7d5e98a7f4c9 tempest-VolumeAndVolumeTypeFromImageTest-472752503 None] Temporary image 483c28ac-7bc2-408d-a440-4f52c5f47f37 for user dcfe26adac374921910a1804947222ba is deleted. {{(pid=88695) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 05 06:30:01 devstack cinder-volume[88695]: DEBUG cinder.volume.volume_utils [None req-9473d113-1f89-422c-adb5-7d5e98a7f4c9 tempest-VolumeAndVolumeTypeFromImageTest-472752503 None] Marking volume a5605fce-2009-4488-b9b1-424b506b3997 as bootable. {{(pid=88695) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 05 06:30:01 devstack cinder-volume[88695]: DEBUG cinder.volume.flows.manager.create_volume [None req-9473d113-1f89-422c-adb5-7d5e98a7f4c9 tempest-VolumeAndVolumeTypeFromImageTest-472752503 None] Copying metadata from image 483c28ac-7bc2-408d-a440-4f52c5f47f37 to a5605fce-2009-4488-b9b1-424b506b3997. {{(pid=88695) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 05 06:30:01 devstack cinder-volume[88695]: DEBUG cinder.volume.flows.manager.create_volume [None req-9473d113-1f89-422c-adb5-7d5e98a7f4c9 tempest-VolumeAndVolumeTypeFromImageTest-472752503 None] Creating volume glance metadata for volume a5605fce-2009-4488-b9b1-424b506b3997 backed by image 483c28ac-7bc2-408d-a440-4f52c5f47f37 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '483c28ac-7bc2-408d-a440-4f52c5f47f37', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '4631e25580d1dcae2a833e58edcde029', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=88695) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 05 06:30:01 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-488b7989-792e-4197-9d42-e78424d48b2e tempest-SnapshotDependencyTests-172778483 None] Created reservations ['6ca21763-d762-4b65-b1b3-c4caca08a234', 'e98b794f-242f-4fd3-b136-2e22473e853a', '03a88ccb-c7bd-402f-816f-f646cff952f9', '7a5de25b-6af9-4369-b7f5-848fa8dc394c'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:30:01 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-488b7989-792e-4197-9d42-e78424d48b2e tempest-SnapshotDependencyTests-172778483 None] Delete snapshot completed successfully. Aug 05 06:30:01 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-9473d113-1f89-422c-adb5-7d5e98a7f4c9 tempest-VolumeAndVolumeTypeFromImageTest-472752503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85d6101a-ad78-49d6-b001-9fdb165e2757) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a5605fce-2009-4488-b9b1-424b506b3997', 'volume_size': 1, 'image_id': '483c28ac-7bc2-408d-a440-4f52c5f47f37', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/483c28ac-7bc2-408d-a440-4f52c5f47f37', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '4631e25580d1dcae2a833e58edcde029', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a56a4a3f070c41328bbb172e764fd2b7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd5d4f3c73028163f5a6052777a0fbd5a6f474715ab270f1c0bafec226842e98184d9985f123c3339c958a565c1801514de5085f7c04476ac8a7469c8b3b56fce', 'id': '483c28ac-7bc2-408d-a440-4f52c5f47f37', 'created_at': datetime.datetime(2026, 8, 5, 4, 29, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 5, 4, 29, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/483c28ac-7bc2-408d-a440-4f52c5f47f37/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:30:01 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-9473d113-1f89-422c-adb5-7d5e98a7f4c9 tempest-VolumeAndVolumeTypeFromImageTest-472752503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36d16272-66cb-4133-aea2-168bc3e68198) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:30:01 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-488b7989-792e-4197-9d42-e78424d48b2e tempest-SnapshotDependencyTests-172778483 None] Lock "cinder-d0e5ab46-ec7d-40d9-a8cb-a1781215b697-delete_snapshot" released by "delete_snapshot" :: held 2.109s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:30:01 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-9473d113-1f89-422c-adb5-7d5e98a7f4c9 tempest-VolumeAndVolumeTypeFromImageTest-472752503 None] Volume volume-a5605fce-2009-4488-b9b1-424b506b3997 (a5605fce-2009-4488-b9b1-424b506b3997): created successfully Aug 05 06:30:01 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-9473d113-1f89-422c-adb5-7d5e98a7f4c9 tempest-VolumeAndVolumeTypeFromImageTest-472752503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36d16272-66cb-4133-aea2-168bc3e68198) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:30:01 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-9473d113-1f89-422c-adb5-7d5e98a7f4c9 tempest-VolumeAndVolumeTypeFromImageTest-472752503 None] Flow 'volume_create_manager' (b2708520-87da-4d33-a861-7a881b164bde) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:30:01 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-9473d113-1f89-422c-adb5-7d5e98a7f4c9 tempest-VolumeAndVolumeTypeFromImageTest-472752503 None] Created volume successfully. Aug 05 06:30:01 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-226e6d45-3b56-41bd-863d-d18c089249f6 tempest-SnapshotDependencyTests-172778483 None] Acquiring lock "cinder-8d019fad-28ef-4e2f-89c5-3e9a87e68ae4-delete_volume" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:30:01 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-226e6d45-3b56-41bd-863d-d18c089249f6 tempest-SnapshotDependencyTests-172778483 None] Lock "cinder-8d019fad-28ef-4e2f-89c5-3e9a87e68ae4-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:30:01 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-226e6d45-3b56-41bd-863d-d18c089249f6 tempest-SnapshotDependencyTests-172778483 None] Acquiring lock "cinder-quobyte-8d019fad-28ef-4e2f-89c5-3e9a87e68ae4" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:30:01 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-226e6d45-3b56-41bd-863d-d18c089249f6 tempest-SnapshotDependencyTests-172778483 None] Lock "cinder-quobyte-8d019fad-28ef-4e2f-89c5-3e9a87e68ae4" acquired by "delete_volume" :: waited 0.013s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:30:01 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[359b9a08-214e-4220-83ea-ca62cba9a18d]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:30:01 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-226e6d45-3b56-41bd-863d-d18c089249f6 tempest-SnapshotDependencyTests-172778483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8d019fad-28ef-4e2f-89c5-3e9a87e68ae4 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:30:01 devstack sudo[108085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8d019fad-28ef-4e2f-89c5-3e9a87e68ae4 Aug 05 06:30:01 devstack sudo[108085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:30:02 devstack sudo[108085]: pam_unix(sudo:session): session closed for user root Aug 05 06:30:02 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-226e6d45-3b56-41bd-863d-d18c089249f6 tempest-SnapshotDependencyTests-172778483 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8d019fad-28ef-4e2f-89c5-3e9a87e68ae4" returned: 0 in 0.398s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:30:02 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-226e6d45-3b56-41bd-863d-d18c089249f6 tempest-SnapshotDependencyTests-172778483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8d019fad-28ef-4e2f-89c5-3e9a87e68ae4 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:30:02 devstack sudo[108090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8d019fad-28ef-4e2f-89c5-3e9a87e68ae4 Aug 05 06:30:02 devstack sudo[108090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:30:02 devstack sudo[108090]: pam_unix(sudo:session): session closed for user root Aug 05 06:30:02 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-226e6d45-3b56-41bd-863d-d18c089249f6 tempest-SnapshotDependencyTests-172778483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8d019fad-28ef-4e2f-89c5-3e9a87e68ae4" returned: 0 in 0.253s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:30:02 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-226e6d45-3b56-41bd-863d-d18c089249f6 tempest-SnapshotDependencyTests-172778483 None] Lock "cinder-quobyte-8d019fad-28ef-4e2f-89c5-3e9a87e68ae4" released by "delete_volume" :: held 0.711s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:30:02 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-226e6d45-3b56-41bd-863d-d18c089249f6 tempest-SnapshotDependencyTests-172778483 None] Created reservations ['677ef6df-06d2-4d5c-817f-c2b9997c51ef', 'f8b6691e-5ff2-41cd-a0df-e92503288547', '3ef9c2ed-8c53-4075-84a1-9d9dcd5bc278', '89d9246b-182f-43cf-af60-126094495480'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:30:02 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-060bb10a-18cf-4681-b520-4a70f11f5f80 tempest-VolumeAndVolumeTypeFromImageTest-472752503 None] Acquiring lock "cinder-a5605fce-2009-4488-b9b1-424b506b3997-delete_volume" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:30:02 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-060bb10a-18cf-4681-b520-4a70f11f5f80 tempest-VolumeAndVolumeTypeFromImageTest-472752503 None] Lock "cinder-a5605fce-2009-4488-b9b1-424b506b3997-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:30:02 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-060bb10a-18cf-4681-b520-4a70f11f5f80 tempest-VolumeAndVolumeTypeFromImageTest-472752503 None] Acquiring lock "cinder-quobyte-a5605fce-2009-4488-b9b1-424b506b3997" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:30:02 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-060bb10a-18cf-4681-b520-4a70f11f5f80 tempest-VolumeAndVolumeTypeFromImageTest-472752503 None] Lock "cinder-quobyte-a5605fce-2009-4488-b9b1-424b506b3997" acquired by "delete_volume" :: waited 0.021s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:30:02 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[2576881d-1762-48bf-82c6-32bb3d6bf8f9]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:30:02 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-060bb10a-18cf-4681-b520-4a70f11f5f80 tempest-VolumeAndVolumeTypeFromImageTest-472752503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a5605fce-2009-4488-b9b1-424b506b3997 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:30:02 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-226e6d45-3b56-41bd-863d-d18c089249f6 tempest-SnapshotDependencyTests-172778483 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:30:02 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-226e6d45-3b56-41bd-863d-d18c089249f6 tempest-SnapshotDependencyTests-172778483 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:30:02 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-226e6d45-3b56-41bd-863d-d18c089249f6 tempest-SnapshotDependencyTests-172778483 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:30:02 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-226e6d45-3b56-41bd-863d-d18c089249f6 tempest-SnapshotDependencyTests-172778483 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:30:02 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-226e6d45-3b56-41bd-863d-d18c089249f6 tempest-SnapshotDependencyTests-172778483 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:30:02 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-226e6d45-3b56-41bd-863d-d18c089249f6 tempest-SnapshotDependencyTests-172778483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:30:02 devstack sudo[108094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce Aug 05 06:30:02 devstack sudo[108094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:30:02 devstack sudo[108093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a5605fce-2009-4488-b9b1-424b506b3997 Aug 05 06:30:02 devstack sudo[108093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:30:02 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-55ac375d-d714-47c4-aaeb-5d2578ab0473 tempest-SnapshotDependencyTests-172778483 None] Acquiring lock "cinder-45e7cb77-a1c4-4fe1-b0c3-44e6b64a8c48-delete_volume" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:30:02 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-55ac375d-d714-47c4-aaeb-5d2578ab0473 tempest-SnapshotDependencyTests-172778483 None] Lock "cinder-45e7cb77-a1c4-4fe1-b0c3-44e6b64a8c48-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:30:02 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-55ac375d-d714-47c4-aaeb-5d2578ab0473 tempest-SnapshotDependencyTests-172778483 None] Acquiring lock "cinder-quobyte-45e7cb77-a1c4-4fe1-b0c3-44e6b64a8c48" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:30:02 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-55ac375d-d714-47c4-aaeb-5d2578ab0473 tempest-SnapshotDependencyTests-172778483 None] Lock "cinder-quobyte-45e7cb77-a1c4-4fe1-b0c3-44e6b64a8c48" acquired by "delete_volume" :: waited 0.026s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:30:03 devstack sudo[108094]: pam_unix(sudo:session): session closed for user root Aug 05 06:30:03 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-226e6d45-3b56-41bd-863d-d18c089249f6 tempest-SnapshotDependencyTests-172778483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce" returned: 0 in 0.297s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:30:03 devstack cinder-volume[88695]: DEBUG cinder.manager [None req-226e6d45-3b56-41bd-863d-d18c089249f6 tempest-SnapshotDependencyTests-172778483 None] Notifying Schedulers of capabilities ... {{(pid=88695) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 06:30:03 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ab10499-fb45-44fc-b6c6-5679db491501]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:30:03 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-55ac375d-d714-47c4-aaeb-5d2578ab0473 tempest-SnapshotDependencyTests-172778483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-45e7cb77-a1c4-4fe1-b0c3-44e6b64a8c48 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:30:03 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-226e6d45-3b56-41bd-863d-d18c089249f6 tempest-SnapshotDependencyTests-172778483 None] Deleted volume successfully. Aug 05 06:30:03 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-226e6d45-3b56-41bd-863d-d18c089249f6 tempest-SnapshotDependencyTests-172778483 None] Lock "cinder-8d019fad-28ef-4e2f-89c5-3e9a87e68ae4-delete_volume" released by "delete_volume" :: held 1.374s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:30:03 devstack sudo[108093]: pam_unix(sudo:session): session closed for user root Aug 05 06:30:03 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-060bb10a-18cf-4681-b520-4a70f11f5f80 tempest-VolumeAndVolumeTypeFromImageTest-472752503 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a5605fce-2009-4488-b9b1-424b506b3997" returned: 0 in 0.416s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:30:03 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-060bb10a-18cf-4681-b520-4a70f11f5f80 tempest-VolumeAndVolumeTypeFromImageTest-472752503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a5605fce-2009-4488-b9b1-424b506b3997 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:30:03 devstack sudo[108102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a5605fce-2009-4488-b9b1-424b506b3997 Aug 05 06:30:03 devstack sudo[108102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:30:03 devstack sudo[108101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-45e7cb77-a1c4-4fe1-b0c3-44e6b64a8c48 Aug 05 06:30:03 devstack sudo[108101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:30:03 devstack sudo[108102]: pam_unix(sudo:session): session closed for user root Aug 05 06:30:03 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-060bb10a-18cf-4681-b520-4a70f11f5f80 tempest-VolumeAndVolumeTypeFromImageTest-472752503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a5605fce-2009-4488-b9b1-424b506b3997" returned: 0 in 0.280s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:30:03 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-060bb10a-18cf-4681-b520-4a70f11f5f80 tempest-VolumeAndVolumeTypeFromImageTest-472752503 None] Lock "cinder-quobyte-a5605fce-2009-4488-b9b1-424b506b3997" released by "delete_volume" :: held 0.740s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:30:03 devstack cinder-volume[88695]: WARNING cinder.quota [None req-060bb10a-18cf-4681-b520-4a70f11f5f80 tempest-VolumeAndVolumeTypeFromImageTest-472752503 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Aug 05 06:30:03 devstack cinder-volume[88695]: WARNING cinder.quota [None req-060bb10a-18cf-4681-b520-4a70f11f5f80 tempest-VolumeAndVolumeTypeFromImageTest-472752503 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Aug 05 06:30:03 devstack sudo[108101]: pam_unix(sudo:session): session closed for user root Aug 05 06:30:03 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-55ac375d-d714-47c4-aaeb-5d2578ab0473 tempest-SnapshotDependencyTests-172778483 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-45e7cb77-a1c4-4fe1-b0c3-44e6b64a8c48" returned: 0 in 0.448s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:30:03 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-060bb10a-18cf-4681-b520-4a70f11f5f80 tempest-VolumeAndVolumeTypeFromImageTest-472752503 None] Created reservations ['d1d88992-0469-4dae-974e-dc1b393b48ef', 'f7df6007-a779-469e-a77b-1d22fe9d2ac5', '8a670bb4-b943-4a5d-b7e2-2bef07a1606d', '55288b33-00a1-4f17-801d-3abfa9c49d90'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:30:03 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-55ac375d-d714-47c4-aaeb-5d2578ab0473 tempest-SnapshotDependencyTests-172778483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-45e7cb77-a1c4-4fe1-b0c3-44e6b64a8c48 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:30:03 devstack sudo[108109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-45e7cb77-a1c4-4fe1-b0c3-44e6b64a8c48 Aug 05 06:30:03 devstack sudo[108109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:30:03 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-060bb10a-18cf-4681-b520-4a70f11f5f80 tempest-VolumeAndVolumeTypeFromImageTest-472752503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:30:03 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-060bb10a-18cf-4681-b520-4a70f11f5f80 tempest-VolumeAndVolumeTypeFromImageTest-472752503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:30:03 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-060bb10a-18cf-4681-b520-4a70f11f5f80 tempest-VolumeAndVolumeTypeFromImageTest-472752503 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:30:03 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-060bb10a-18cf-4681-b520-4a70f11f5f80 tempest-VolumeAndVolumeTypeFromImageTest-472752503 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:30:03 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-060bb10a-18cf-4681-b520-4a70f11f5f80 tempest-VolumeAndVolumeTypeFromImageTest-472752503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:30:03 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-060bb10a-18cf-4681-b520-4a70f11f5f80 tempest-VolumeAndVolumeTypeFromImageTest-472752503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:30:03 devstack sudo[108111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce Aug 05 06:30:03 devstack sudo[108111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:30:03 devstack sudo[108109]: pam_unix(sudo:session): session closed for user root Aug 05 06:30:03 devstack sudo[108111]: pam_unix(sudo:session): session closed for user root Aug 05 06:30:03 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-55ac375d-d714-47c4-aaeb-5d2578ab0473 tempest-SnapshotDependencyTests-172778483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-45e7cb77-a1c4-4fe1-b0c3-44e6b64a8c48" returned: 0 in 0.406s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:30:03 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-060bb10a-18cf-4681-b520-4a70f11f5f80 tempest-VolumeAndVolumeTypeFromImageTest-472752503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce" returned: 0 in 0.303s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:30:03 devstack cinder-volume[88695]: DEBUG cinder.manager [None req-060bb10a-18cf-4681-b520-4a70f11f5f80 tempest-VolumeAndVolumeTypeFromImageTest-472752503 None] Notifying Schedulers of capabilities ... {{(pid=88695) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 06:30:03 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-55ac375d-d714-47c4-aaeb-5d2578ab0473 tempest-SnapshotDependencyTests-172778483 None] Lock "cinder-quobyte-45e7cb77-a1c4-4fe1-b0c3-44e6b64a8c48" released by "delete_volume" :: held 0.918s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:30:03 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-060bb10a-18cf-4681-b520-4a70f11f5f80 tempest-VolumeAndVolumeTypeFromImageTest-472752503 None] Deleted volume successfully. Aug 05 06:30:03 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-060bb10a-18cf-4681-b520-4a70f11f5f80 tempest-VolumeAndVolumeTypeFromImageTest-472752503 None] Lock "cinder-a5605fce-2009-4488-b9b1-424b506b3997-delete_volume" released by "delete_volume" :: held 1.373s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:30:03 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-55ac375d-d714-47c4-aaeb-5d2578ab0473 tempest-SnapshotDependencyTests-172778483 None] Created reservations ['db05871c-eff2-445c-bf2c-a466bfc78efd', '742800c3-5916-4fe8-a6f7-3f8778ea22c6', '7dc36694-8423-4847-b128-e067ee03426b', '19a4daa4-207e-433e-a83f-a1411a1988e2'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:30:04 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-55ac375d-d714-47c4-aaeb-5d2578ab0473 tempest-SnapshotDependencyTests-172778483 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:30:04 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-55ac375d-d714-47c4-aaeb-5d2578ab0473 tempest-SnapshotDependencyTests-172778483 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:30:04 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-55ac375d-d714-47c4-aaeb-5d2578ab0473 tempest-SnapshotDependencyTests-172778483 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:30:04 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-55ac375d-d714-47c4-aaeb-5d2578ab0473 tempest-SnapshotDependencyTests-172778483 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:30:04 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-55ac375d-d714-47c4-aaeb-5d2578ab0473 tempest-SnapshotDependencyTests-172778483 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:30:04 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-55ac375d-d714-47c4-aaeb-5d2578ab0473 tempest-SnapshotDependencyTests-172778483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:30:04 devstack sudo[108115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce Aug 05 06:30:04 devstack sudo[108115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:30:04 devstack sudo[108115]: pam_unix(sudo:session): session closed for user root Aug 05 06:30:04 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-55ac375d-d714-47c4-aaeb-5d2578ab0473 tempest-SnapshotDependencyTests-172778483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce" returned: 0 in 0.306s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:30:04 devstack cinder-volume[88695]: DEBUG cinder.manager [None req-55ac375d-d714-47c4-aaeb-5d2578ab0473 tempest-SnapshotDependencyTests-172778483 None] Notifying Schedulers of capabilities ... {{(pid=88695) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 06:30:04 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-55ac375d-d714-47c4-aaeb-5d2578ab0473 tempest-SnapshotDependencyTests-172778483 None] Deleted volume successfully. Aug 05 06:30:04 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-55ac375d-d714-47c4-aaeb-5d2578ab0473 tempest-SnapshotDependencyTests-172778483 None] Lock "cinder-45e7cb77-a1c4-4fe1-b0c3-44e6b64a8c48-delete_volume" released by "delete_volume" :: held 1.537s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:30:11 devstack cinder-volume[88695]: DEBUG cinder.volume.flows.manager.create_volume [None req-9eeffcc0-46e2-4376-9f2e-6bfec29eb8fc tempest-VolumeImageDependencyTests-203370525 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88695) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 06:30:11 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-9eeffcc0-46e2-4376-9f2e-6bfec29eb8fc tempest-VolumeImageDependencyTests-203370525 None] Flow 'volume_create_manager' (1eede916-0166-4e64-b2a5-5a4266a6297d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:30:11 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-9eeffcc0-46e2-4376-9f2e-6bfec29eb8fc tempest-VolumeImageDependencyTests-203370525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2c6fd2c-7618-44fd-af26-16583d34d557) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:30:11 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-9eeffcc0-46e2-4376-9f2e-6bfec29eb8fc tempest-VolumeImageDependencyTests-203370525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2c6fd2c-7618-44fd-af26-16583d34d557) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:30:11Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6cf3b2b-704b-4cd8-9694-098e29a53944,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee9725e494ec4a4cbc5e496c8b281372',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:30:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:30:11Z,use_quota=True,user_id='c47bd3dce35e460b845d1c16bc0d63f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:30:11 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-9eeffcc0-46e2-4376-9f2e-6bfec29eb8fc tempest-VolumeImageDependencyTests-203370525 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d69f9366-9f3b-4a9e-a8f6-53f1c90d6feb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:30:11 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-9eeffcc0-46e2-4376-9f2e-6bfec29eb8fc tempest-VolumeImageDependencyTests-203370525 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d69f9366-9f3b-4a9e-a8f6-53f1c90d6feb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:30:11 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-9eeffcc0-46e2-4376-9f2e-6bfec29eb8fc tempest-VolumeImageDependencyTests-203370525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (938f9762-d9f3-4feb-ba2c-88a71ddaeae4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:30:11 devstack cinder-volume[88695]: DEBUG cinder.image.glance [None req-9eeffcc0-46e2-4376-9f2e-6bfec29eb8fc tempest-VolumeImageDependencyTests-203370525 None] Creating Keystone auth plugin from conf {{(pid=88695) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 05 06:30:11 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-9eeffcc0-46e2-4376-9f2e-6bfec29eb8fc tempest-VolumeImageDependencyTests-203370525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (938f9762-d9f3-4feb-ba2c-88a71ddaeae4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a6cf3b2b-704b-4cd8-9694-098e29a53944', 'volume_name': 'volume-a6cf3b2b-704b-4cd8-9694-098e29a53944', 'volume_size': 1, 'image_id': 'dfa1d9e4-562e-4b94-bc48-0e76f7f49094', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/dfa1d9e4-562e-4b94-bc48-0e76f7f49094', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ccd9badab4fd55612d6c12ff0586dd0f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'ee9725e494ec4a4cbc5e496c8b281372', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'c00944ded54ced7db8fac7e0915a1de0e35e2e894b0db3e6bfaa0b766c64976d1e670926ca9f40e6652d379066a60593535f2b39f2955f31d575fcb7e04045e6', 'id': 'dfa1d9e4-562e-4b94-bc48-0e76f7f49094', 'created_at': datetime.datetime(2026, 8, 5, 4, 30, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 5, 4, 30, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dfa1d9e4-562e-4b94-bc48-0e76f7f49094/file', 'properties': {}}, 'image_service': }' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:30:11 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-9eeffcc0-46e2-4376-9f2e-6bfec29eb8fc tempest-VolumeImageDependencyTests-203370525 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fbad84e-e05b-4613-a59e-a6e4f9c06531) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:30:11 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-9eeffcc0-46e2-4376-9f2e-6bfec29eb8fc tempest-VolumeImageDependencyTests-203370525 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fbad84e-e05b-4613-a59e-a6e4f9c06531) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:30:11 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-9eeffcc0-46e2-4376-9f2e-6bfec29eb8fc tempest-VolumeImageDependencyTests-203370525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1cd005a-ac74-47fd-b0d4-a2d3f563273c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:30:11 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-9eeffcc0-46e2-4376-9f2e-6bfec29eb8fc tempest-VolumeImageDependencyTests-203370525 None] Volume a6cf3b2b-704b-4cd8-9694-098e29a53944: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a6cf3b2b-704b-4cd8-9694-098e29a53944', 'volume_size': 1, 'image_id': 'dfa1d9e4-562e-4b94-bc48-0e76f7f49094', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/dfa1d9e4-562e-4b94-bc48-0e76f7f49094', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ccd9badab4fd55612d6c12ff0586dd0f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'ee9725e494ec4a4cbc5e496c8b281372', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'c00944ded54ced7db8fac7e0915a1de0e35e2e894b0db3e6bfaa0b766c64976d1e670926ca9f40e6652d379066a60593535f2b39f2955f31d575fcb7e04045e6', 'id': 'dfa1d9e4-562e-4b94-bc48-0e76f7f49094', 'created_at': datetime.datetime(2026, 8, 5, 4, 30, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 5, 4, 30, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dfa1d9e4-562e-4b94-bc48-0e76f7f49094/file', 'properties': {}}, 'image_service': } Aug 05 06:30:11 devstack cinder-volume[88695]: DEBUG cinder.volume.flows.manager.create_volume [None req-9eeffcc0-46e2-4376-9f2e-6bfec29eb8fc tempest-VolumeImageDependencyTests-203370525 None] Trying to clone a6cf3b2b-704b-4cd8-9694-098e29a53944 from image dfa1d9e4-562e-4b94-bc48-0e76f7f49094 at location (None, [{'url': 'file:///opt/stack/data/glance/images/dfa1d9e4-562e-4b94-bc48-0e76f7f49094', 'metadata': {}}]). {{(pid=88695) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 05 06:30:11 devstack cinder-volume[88695]: DEBUG cinder.image.image_utils [None req-9eeffcc0-46e2-4376-9f2e-6bfec29eb8fc tempest-VolumeImageDependencyTests-203370525 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_dfa1d9e4-562e-4b94-bc48-0e76f7f49094_lrmx4pyrdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=88695) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 05 06:30:11 devstack cinder-volume[88695]: INFO cinder.image.image_utils [None req-9eeffcc0-46e2-4376-9f2e-6bfec29eb8fc tempest-VolumeImageDependencyTests-203370525 None] Image download 0.00 MB at 0.00 MB/s Aug 05 06:30:11 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[722a2f53-045a-496e-9edb-d8d19b1478c0]: (4, 'raw') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:30:11 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-9eeffcc0-46e2-4376-9f2e-6bfec29eb8fc tempest-VolumeImageDependencyTests-203370525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dfa1d9e4-562e-4b94-bc48-0e76f7f49094_lrmx4pyrdevstack@QuobyteHD {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:30:11 devstack sudo[108125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dfa1d9e4-562e-4b94-bc48-0e76f7f49094_lrmx4pyrdevstack@QuobyteHD Aug 05 06:30:11 devstack sudo[108125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:30:11 devstack sudo[108125]: pam_unix(sudo:session): session closed for user root Aug 05 06:30:11 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-9eeffcc0-46e2-4376-9f2e-6bfec29eb8fc tempest-VolumeImageDependencyTests-203370525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dfa1d9e4-562e-4b94-bc48-0e76f7f49094_lrmx4pyrdevstack@QuobyteHD" returned: 0 in 0.349s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:30:11 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-9eeffcc0-46e2-4376-9f2e-6bfec29eb8fc tempest-VolumeImageDependencyTests-203370525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dfa1d9e4-562e-4b94-bc48-0e76f7f49094_lrmx4pyrdevstack@QuobyteHD {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:30:12 devstack sudo[108129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dfa1d9e4-562e-4b94-bc48-0e76f7f49094_lrmx4pyrdevstack@QuobyteHD Aug 05 06:30:12 devstack sudo[108129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:30:12 devstack sudo[108129]: pam_unix(sudo:session): session closed for user root Aug 05 06:30:12 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-9eeffcc0-46e2-4376-9f2e-6bfec29eb8fc tempest-VolumeImageDependencyTests-203370525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dfa1d9e4-562e-4b94-bc48-0e76f7f49094_lrmx4pyrdevstack@QuobyteHD" returned: 1 in 0.397s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:30:12 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-9eeffcc0-46e2-4376-9f2e-6bfec29eb8fc tempest-VolumeImageDependencyTests-203370525 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dfa1d9e4-562e-4b94-bc48-0e76f7f49094_lrmx4pyrdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 05 06:30:12 devstack cinder-volume[88695]: DEBUG cinder.image.image_utils [None req-9eeffcc0-46e2-4376-9f2e-6bfec29eb8fc tempest-VolumeImageDependencyTests-203370525 None] Temporary image dfa1d9e4-562e-4b94-bc48-0e76f7f49094 is fetched for user c47bd3dce35e460b845d1c16bc0d63f6. {{(pid=88695) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 05 06:30:12 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[400a752f-fc48-4c50-a65f-163a39595371]: (4, 'raw') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:30:12 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-9eeffcc0-46e2-4376-9f2e-6bfec29eb8fc tempest-VolumeImageDependencyTests-203370525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dfa1d9e4-562e-4b94-bc48-0e76f7f49094_lrmx4pyrdevstack@QuobyteHD {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:30:12 devstack sudo[108134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dfa1d9e4-562e-4b94-bc48-0e76f7f49094_lrmx4pyrdevstack@QuobyteHD Aug 05 06:30:12 devstack sudo[108134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:30:12 devstack sudo[108134]: pam_unix(sudo:session): session closed for user root Aug 05 06:30:12 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-9eeffcc0-46e2-4376-9f2e-6bfec29eb8fc tempest-VolumeImageDependencyTests-203370525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dfa1d9e4-562e-4b94-bc48-0e76f7f49094_lrmx4pyrdevstack@QuobyteHD" returned: 0 in 0.384s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:30:12 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-9eeffcc0-46e2-4376-9f2e-6bfec29eb8fc tempest-VolumeImageDependencyTests-203370525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dfa1d9e4-562e-4b94-bc48-0e76f7f49094_lrmx4pyrdevstack@QuobyteHD {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:30:12 devstack sudo[108138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dfa1d9e4-562e-4b94-bc48-0e76f7f49094_lrmx4pyrdevstack@QuobyteHD Aug 05 06:30:12 devstack sudo[108138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:30:13 devstack sudo[108138]: pam_unix(sudo:session): session closed for user root Aug 05 06:30:13 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-9eeffcc0-46e2-4376-9f2e-6bfec29eb8fc tempest-VolumeImageDependencyTests-203370525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dfa1d9e4-562e-4b94-bc48-0e76f7f49094_lrmx4pyrdevstack@QuobyteHD" returned: 1 in 0.356s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:30:13 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-9eeffcc0-46e2-4376-9f2e-6bfec29eb8fc tempest-VolumeImageDependencyTests-203370525 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dfa1d9e4-562e-4b94-bc48-0e76f7f49094_lrmx4pyrdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 05 06:30:13 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-9eeffcc0-46e2-4376-9f2e-6bfec29eb8fc tempest-VolumeImageDependencyTests-203370525 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:30:13 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-9eeffcc0-46e2-4376-9f2e-6bfec29eb8fc tempest-VolumeImageDependencyTests-203370525 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:30:13 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-9eeffcc0-46e2-4376-9f2e-6bfec29eb8fc tempest-VolumeImageDependencyTests-203370525 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:30:11Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6cf3b2b-704b-4cd8-9694-098e29a53944,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee9725e494ec4a4cbc5e496c8b281372',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:30:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:30:11Z,use_quota=True,user_id='c47bd3dce35e460b845d1c16bc0d63f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)}" {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 06:30:13 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-9eeffcc0-46e2-4376-9f2e-6bfec29eb8fc tempest-VolumeImageDependencyTests-203370525 None] Creating volume a6cf3b2b-704b-4cd8-9694-098e29a53944 {{(pid=88695) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 06:30:13 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-9eeffcc0-46e2-4376-9f2e-6bfec29eb8fc tempest-VolumeImageDependencyTests-203370525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:30:13 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-9eeffcc0-46e2-4376-9f2e-6bfec29eb8fc tempest-VolumeImageDependencyTests-203370525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:30:13 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-9eeffcc0-46e2-4376-9f2e-6bfec29eb8fc tempest-VolumeImageDependencyTests-203370525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:30:13 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-9eeffcc0-46e2-4376-9f2e-6bfec29eb8fc tempest-VolumeImageDependencyTests-203370525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:30:13 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-9eeffcc0-46e2-4376-9f2e-6bfec29eb8fc tempest-VolumeImageDependencyTests-203370525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:30:13 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-9eeffcc0-46e2-4376-9f2e-6bfec29eb8fc tempest-VolumeImageDependencyTests-203370525 None] Selected osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 as target Quobyte volume. {{(pid=88695) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 06:30:13 devstack cinder-volume[88695]: INFO cinder.volume.drivers.remotefs [None req-9eeffcc0-46e2-4376-9f2e-6bfec29eb8fc tempest-VolumeImageDependencyTests-203370525 None] casted to osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 Aug 05 06:30:13 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-9eeffcc0-46e2-4376-9f2e-6bfec29eb8fc tempest-VolumeImageDependencyTests-203370525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a6cf3b2b-704b-4cd8-9694-098e29a53944 1073741824 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:30:13 devstack sudo[108143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a6cf3b2b-704b-4cd8-9694-098e29a53944 1073741824 Aug 05 06:30:13 devstack sudo[108143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:30:13 devstack sudo[108143]: pam_unix(sudo:session): session closed for user root Aug 05 06:30:13 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-9eeffcc0-46e2-4376-9f2e-6bfec29eb8fc tempest-VolumeImageDependencyTests-203370525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a6cf3b2b-704b-4cd8-9694-098e29a53944 1073741824" returned: 0 in 0.491s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:30:13 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-9eeffcc0-46e2-4376-9f2e-6bfec29eb8fc tempest-VolumeImageDependencyTests-203370525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a6cf3b2b-704b-4cd8-9694-098e29a53944 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:30:13 devstack sudo[108150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a6cf3b2b-704b-4cd8-9694-098e29a53944 Aug 05 06:30:13 devstack sudo[108150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:30:13 devstack sudo[108150]: pam_unix(sudo:session): session closed for user root Aug 05 06:30:13 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-9eeffcc0-46e2-4376-9f2e-6bfec29eb8fc tempest-VolumeImageDependencyTests-203370525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a6cf3b2b-704b-4cd8-9694-098e29a53944" returned: 0 in 0.266s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:30:13 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-9eeffcc0-46e2-4376-9f2e-6bfec29eb8fc tempest-VolumeImageDependencyTests-203370525 None] <== create_volume: return (801ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'} {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 06:30:13 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-9eeffcc0-46e2-4376-9f2e-6bfec29eb8fc tempest-VolumeImageDependencyTests-203370525 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.803s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:30:13 devstack cinder-volume[88695]: DEBUG cinder.volume.volume_utils [None req-9eeffcc0-46e2-4376-9f2e-6bfec29eb8fc tempest-VolumeImageDependencyTests-203370525 None] Attempting download of dfa1d9e4-562e-4b94-bc48-0e76f7f49094 ((None, [{'url': 'file:///opt/stack/data/glance/images/dfa1d9e4-562e-4b94-bc48-0e76f7f49094', 'metadata': {}}])) to volume a6cf3b2b-704b-4cd8-9694-098e29a53944. {{(pid=88695) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 05 06:30:14 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[73b4f495-ea52-41d6-954d-fce9951844e8]: (4, 'raw') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:30:14 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-9eeffcc0-46e2-4376-9f2e-6bfec29eb8fc tempest-VolumeImageDependencyTests-203370525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_dfa1d9e4-562e-4b94-bc48-0e76f7f49094_42pz62ma {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:30:14 devstack sudo[108153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_dfa1d9e4-562e-4b94-bc48-0e76f7f49094_42pz62ma Aug 05 06:30:14 devstack sudo[108153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:30:14 devstack sudo[108153]: pam_unix(sudo:session): session closed for user root Aug 05 06:30:14 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-9eeffcc0-46e2-4376-9f2e-6bfec29eb8fc tempest-VolumeImageDependencyTests-203370525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_dfa1d9e4-562e-4b94-bc48-0e76f7f49094_42pz62ma" returned: 0 in 0.363s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:30:14 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-9eeffcc0-46e2-4376-9f2e-6bfec29eb8fc tempest-VolumeImageDependencyTests-203370525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dfa1d9e4-562e-4b94-bc48-0e76f7f49094_42pz62ma {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:30:14 devstack sudo[108157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dfa1d9e4-562e-4b94-bc48-0e76f7f49094_42pz62ma Aug 05 06:30:14 devstack sudo[108157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:30:14 devstack sudo[108157]: pam_unix(sudo:session): session closed for user root Aug 05 06:30:14 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-9eeffcc0-46e2-4376-9f2e-6bfec29eb8fc tempest-VolumeImageDependencyTests-203370525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dfa1d9e4-562e-4b94-bc48-0e76f7f49094_42pz62ma" returned: 1 in 0.342s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:30:14 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-9eeffcc0-46e2-4376-9f2e-6bfec29eb8fc tempest-VolumeImageDependencyTests-203370525 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dfa1d9e4-562e-4b94-bc48-0e76f7f49094_42pz62ma' failed. Not Retrying. {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 05 06:30:14 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc5d1b56-ed1f-4330-9a10-e9d60ff7e898]: (4, 'raw') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:30:14 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-9eeffcc0-46e2-4376-9f2e-6bfec29eb8fc tempest-VolumeImageDependencyTests-203370525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dfa1d9e4-562e-4b94-bc48-0e76f7f49094_lrmx4pyrdevstack@QuobyteHD {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:30:14 devstack sudo[108161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dfa1d9e4-562e-4b94-bc48-0e76f7f49094_lrmx4pyrdevstack@QuobyteHD Aug 05 06:30:14 devstack sudo[108161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:30:15 devstack sudo[108161]: pam_unix(sudo:session): session closed for user root Aug 05 06:30:15 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-9eeffcc0-46e2-4376-9f2e-6bfec29eb8fc tempest-VolumeImageDependencyTests-203370525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dfa1d9e4-562e-4b94-bc48-0e76f7f49094_lrmx4pyrdevstack@QuobyteHD" returned: 0 in 0.349s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:30:15 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-9eeffcc0-46e2-4376-9f2e-6bfec29eb8fc tempest-VolumeImageDependencyTests-203370525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dfa1d9e4-562e-4b94-bc48-0e76f7f49094_lrmx4pyrdevstack@QuobyteHD {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:30:15 devstack sudo[108165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dfa1d9e4-562e-4b94-bc48-0e76f7f49094_lrmx4pyrdevstack@QuobyteHD Aug 05 06:30:15 devstack sudo[108165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:30:15 devstack sudo[108165]: pam_unix(sudo:session): session closed for user root Aug 05 06:30:15 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-9eeffcc0-46e2-4376-9f2e-6bfec29eb8fc tempest-VolumeImageDependencyTests-203370525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dfa1d9e4-562e-4b94-bc48-0e76f7f49094_lrmx4pyrdevstack@QuobyteHD" returned: 1 in 0.342s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:30:15 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-9eeffcc0-46e2-4376-9f2e-6bfec29eb8fc tempest-VolumeImageDependencyTests-203370525 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dfa1d9e4-562e-4b94-bc48-0e76f7f49094_lrmx4pyrdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 05 06:30:15 devstack cinder-volume[88695]: DEBUG cinder.image.image_utils [None req-9eeffcc0-46e2-4376-9f2e-6bfec29eb8fc tempest-VolumeImageDependencyTests-203370525 None] dfa1d9e4-562e-4b94-bc48-0e76f7f49094 was raw, converting to qcow2 {{(pid=88695) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 05 06:30:15 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-9eeffcc0-46e2-4376-9f2e-6bfec29eb8fc tempest-VolumeImageDependencyTests-203370525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_dfa1d9e4-562e-4b94-bc48-0e76f7f49094_lrmx4pyrdevstack@QuobyteHD /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a6cf3b2b-704b-4cd8-9694-098e29a53944 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:30:15 devstack sudo[108171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_dfa1d9e4-562e-4b94-bc48-0e76f7f49094_lrmx4pyrdevstack@QuobyteHD /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a6cf3b2b-704b-4cd8-9694-098e29a53944 Aug 05 06:30:15 devstack sudo[108171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:30:15 devstack sudo[108171]: pam_unix(sudo:session): session closed for user root Aug 05 06:30:15 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-9eeffcc0-46e2-4376-9f2e-6bfec29eb8fc tempest-VolumeImageDependencyTests-203370525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_dfa1d9e4-562e-4b94-bc48-0e76f7f49094_lrmx4pyrdevstack@QuobyteHD /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a6cf3b2b-704b-4cd8-9694-098e29a53944" returned: 0 in 0.468s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:30:15 devstack cinder-volume[88695]: DEBUG cinder.image.image_utils [None req-9eeffcc0-46e2-4376-9f2e-6bfec29eb8fc tempest-VolumeImageDependencyTests-203370525 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_dfa1d9e4-562e-4b94-bc48-0e76f7f49094_lrmx4pyrdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a6cf3b2b-704b-4cd8-9694-098e29a53944 {{(pid=88695) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 05 06:30:15 devstack cinder-volume[88695]: INFO cinder.image.image_utils [None req-9eeffcc0-46e2-4376-9f2e-6bfec29eb8fc tempest-VolumeImageDependencyTests-203370525 None] Converted 0.00 MB image at 0.00 MB/s Aug 05 06:30:15 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-9eeffcc0-46e2-4376-9f2e-6bfec29eb8fc tempest-VolumeImageDependencyTests-203370525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a6cf3b2b-704b-4cd8-9694-098e29a53944 1G {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:30:15 devstack sudo[108177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a6cf3b2b-704b-4cd8-9694-098e29a53944 1G Aug 05 06:30:15 devstack sudo[108177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:30:16 devstack sudo[108177]: pam_unix(sudo:session): session closed for user root Aug 05 06:30:16 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-9eeffcc0-46e2-4376-9f2e-6bfec29eb8fc tempest-VolumeImageDependencyTests-203370525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a6cf3b2b-704b-4cd8-9694-098e29a53944 1G" returned: 0 in 0.302s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:30:16 devstack cinder-volume[88695]: DEBUG cinder.volume.volume_utils [None req-9eeffcc0-46e2-4376-9f2e-6bfec29eb8fc tempest-VolumeImageDependencyTests-203370525 None] Downloaded image dfa1d9e4-562e-4b94-bc48-0e76f7f49094 ((None, [{'url': 'file:///opt/stack/data/glance/images/dfa1d9e4-562e-4b94-bc48-0e76f7f49094', 'metadata': {}}])) to volume a6cf3b2b-704b-4cd8-9694-098e29a53944 successfully. {{(pid=88695) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 05 06:30:16 devstack cinder-volume[88695]: DEBUG cinder.image.image_utils [None req-9eeffcc0-46e2-4376-9f2e-6bfec29eb8fc tempest-VolumeImageDependencyTests-203370525 None] Temporary image dfa1d9e4-562e-4b94-bc48-0e76f7f49094 for user c47bd3dce35e460b845d1c16bc0d63f6 is deleted. {{(pid=88695) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 05 06:30:16 devstack cinder-volume[88695]: DEBUG cinder.volume.volume_utils [None req-9eeffcc0-46e2-4376-9f2e-6bfec29eb8fc tempest-VolumeImageDependencyTests-203370525 None] Marking volume a6cf3b2b-704b-4cd8-9694-098e29a53944 as bootable. {{(pid=88695) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 05 06:30:16 devstack cinder-volume[88695]: DEBUG cinder.volume.flows.manager.create_volume [None req-9eeffcc0-46e2-4376-9f2e-6bfec29eb8fc tempest-VolumeImageDependencyTests-203370525 None] Copying metadata from image dfa1d9e4-562e-4b94-bc48-0e76f7f49094 to a6cf3b2b-704b-4cd8-9694-098e29a53944. {{(pid=88695) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 05 06:30:16 devstack cinder-volume[88695]: DEBUG cinder.volume.flows.manager.create_volume [None req-9eeffcc0-46e2-4376-9f2e-6bfec29eb8fc tempest-VolumeImageDependencyTests-203370525 None] Creating volume glance metadata for volume a6cf3b2b-704b-4cd8-9694-098e29a53944 backed by image dfa1d9e4-562e-4b94-bc48-0e76f7f49094 with: {'image_id': 'dfa1d9e4-562e-4b94-bc48-0e76f7f49094', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'ccd9badab4fd55612d6c12ff0586dd0f', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=88695) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 05 06:30:16 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-9eeffcc0-46e2-4376-9f2e-6bfec29eb8fc tempest-VolumeImageDependencyTests-203370525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1cd005a-ac74-47fd-b0d4-a2d3f563273c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6cf3b2b-704b-4cd8-9694-098e29a53944', 'volume_size': 1, 'image_id': 'dfa1d9e4-562e-4b94-bc48-0e76f7f49094', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/dfa1d9e4-562e-4b94-bc48-0e76f7f49094', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ccd9badab4fd55612d6c12ff0586dd0f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'ee9725e494ec4a4cbc5e496c8b281372', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'c00944ded54ced7db8fac7e0915a1de0e35e2e894b0db3e6bfaa0b766c64976d1e670926ca9f40e6652d379066a60593535f2b39f2955f31d575fcb7e04045e6', 'id': 'dfa1d9e4-562e-4b94-bc48-0e76f7f49094', 'created_at': datetime.datetime(2026, 8, 5, 4, 30, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 5, 4, 30, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dfa1d9e4-562e-4b94-bc48-0e76f7f49094/file', 'properties': {}}, 'image_service': }' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:30:16 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-9eeffcc0-46e2-4376-9f2e-6bfec29eb8fc tempest-VolumeImageDependencyTests-203370525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (653b4f3d-d8ef-40b5-8ea3-0cd0907f5329) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:30:16 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-9eeffcc0-46e2-4376-9f2e-6bfec29eb8fc tempest-VolumeImageDependencyTests-203370525 None] Volume volume-a6cf3b2b-704b-4cd8-9694-098e29a53944 (a6cf3b2b-704b-4cd8-9694-098e29a53944): created successfully Aug 05 06:30:16 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-9eeffcc0-46e2-4376-9f2e-6bfec29eb8fc tempest-VolumeImageDependencyTests-203370525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (653b4f3d-d8ef-40b5-8ea3-0cd0907f5329) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:30:16 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-9eeffcc0-46e2-4376-9f2e-6bfec29eb8fc tempest-VolumeImageDependencyTests-203370525 None] Flow 'volume_create_manager' (1eede916-0166-4e64-b2a5-5a4266a6297d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:30:16 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-9eeffcc0-46e2-4376-9f2e-6bfec29eb8fc tempest-VolumeImageDependencyTests-203370525 None] Created volume successfully. Aug 05 06:30:17 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-d097fc88-65d0-4c77-9a9a-154fe05659d9 tempest-VolumeImageDependencyTests-203370525 None] Acquiring lock "cinder-a6cf3b2b-704b-4cd8-9694-098e29a53944-delete_volume" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:30:17 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-d097fc88-65d0-4c77-9a9a-154fe05659d9 tempest-VolumeImageDependencyTests-203370525 None] Lock "cinder-a6cf3b2b-704b-4cd8-9694-098e29a53944-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:30:17 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-d097fc88-65d0-4c77-9a9a-154fe05659d9 tempest-VolumeImageDependencyTests-203370525 None] Acquiring lock "cinder-quobyte-a6cf3b2b-704b-4cd8-9694-098e29a53944" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:30:17 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-d097fc88-65d0-4c77-9a9a-154fe05659d9 tempest-VolumeImageDependencyTests-203370525 None] Lock "cinder-quobyte-a6cf3b2b-704b-4cd8-9694-098e29a53944" acquired by "delete_volume" :: waited 0.016s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:30:17 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[65c3ca5f-3d3f-4328-a1f8-647431378f6f]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:30:17 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-d097fc88-65d0-4c77-9a9a-154fe05659d9 tempest-VolumeImageDependencyTests-203370525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a6cf3b2b-704b-4cd8-9694-098e29a53944 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:30:17 devstack sudo[108182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a6cf3b2b-704b-4cd8-9694-098e29a53944 Aug 05 06:30:17 devstack sudo[108182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:30:17 devstack sudo[108182]: pam_unix(sudo:session): session closed for user root Aug 05 06:30:17 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-d097fc88-65d0-4c77-9a9a-154fe05659d9 tempest-VolumeImageDependencyTests-203370525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a6cf3b2b-704b-4cd8-9694-098e29a53944" returned: 0 in 0.361s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:30:17 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-d097fc88-65d0-4c77-9a9a-154fe05659d9 tempest-VolumeImageDependencyTests-203370525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a6cf3b2b-704b-4cd8-9694-098e29a53944 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:30:17 devstack sudo[108187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a6cf3b2b-704b-4cd8-9694-098e29a53944 Aug 05 06:30:17 devstack sudo[108187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:30:18 devstack sudo[108187]: pam_unix(sudo:session): session closed for user root Aug 05 06:30:18 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-d097fc88-65d0-4c77-9a9a-154fe05659d9 tempest-VolumeImageDependencyTests-203370525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a6cf3b2b-704b-4cd8-9694-098e29a53944" returned: 0 in 0.234s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:30:18 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-d097fc88-65d0-4c77-9a9a-154fe05659d9 tempest-VolumeImageDependencyTests-203370525 None] Lock "cinder-quobyte-a6cf3b2b-704b-4cd8-9694-098e29a53944" released by "delete_volume" :: held 0.634s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:30:18 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-d097fc88-65d0-4c77-9a9a-154fe05659d9 tempest-VolumeImageDependencyTests-203370525 None] Created reservations ['0038a3e5-3e4b-4f72-abe3-2bdc0a5ca98b', '3c98ca91-d2cb-4370-8e54-772e9fae1201', 'e0046c4b-fad9-4233-b0fa-d8dbbf9256d6', '033db229-ddf2-43e8-a895-24fc2bde46b0'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:30:18 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-d097fc88-65d0-4c77-9a9a-154fe05659d9 tempest-VolumeImageDependencyTests-203370525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:30:18 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-d097fc88-65d0-4c77-9a9a-154fe05659d9 tempest-VolumeImageDependencyTests-203370525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:30:18 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-d097fc88-65d0-4c77-9a9a-154fe05659d9 tempest-VolumeImageDependencyTests-203370525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:30:18 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-d097fc88-65d0-4c77-9a9a-154fe05659d9 tempest-VolumeImageDependencyTests-203370525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:30:18 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-d097fc88-65d0-4c77-9a9a-154fe05659d9 tempest-VolumeImageDependencyTests-203370525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:30:18 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-d097fc88-65d0-4c77-9a9a-154fe05659d9 tempest-VolumeImageDependencyTests-203370525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:30:18 devstack sudo[108190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce Aug 05 06:30:18 devstack sudo[108190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:30:18 devstack sudo[108190]: pam_unix(sudo:session): session closed for user root Aug 05 06:30:18 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-d097fc88-65d0-4c77-9a9a-154fe05659d9 tempest-VolumeImageDependencyTests-203370525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce" returned: 0 in 0.248s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:30:18 devstack cinder-volume[88695]: DEBUG cinder.manager [None req-d097fc88-65d0-4c77-9a9a-154fe05659d9 tempest-VolumeImageDependencyTests-203370525 None] Notifying Schedulers of capabilities ... {{(pid=88695) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 06:30:18 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-d097fc88-65d0-4c77-9a9a-154fe05659d9 tempest-VolumeImageDependencyTests-203370525 None] Deleted volume successfully. Aug 05 06:30:18 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-d097fc88-65d0-4c77-9a9a-154fe05659d9 tempest-VolumeImageDependencyTests-203370525 None] Lock "cinder-a6cf3b2b-704b-4cd8-9694-098e29a53944-delete_volume" released by "delete_volume" :: held 1.084s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:30:28 devstack cinder-volume[88695]: DEBUG dbcounter [-] [88695] Writing DB stats cinder:SELECT=46,cinder:UPDATE=53,cinder:INSERT=25,cinder:DELETE=4 {{(pid=88695) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 06:30:28 devstack cinder-volume[88695]: DEBUG dbcounter [-] [88695] Writing DB stats cinder:UPDATE=56,cinder:SELECT=55,cinder:INSERT=19,cinder:DELETE=5 {{(pid=88695) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 06:30:39 devstack cinder-volume[88695]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e5da8d9-3c7e-4c24-9525-f5bda6c7047b tempest-CreateVolumesFromSnapshotTest-2119669264 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88695) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 06:30:39 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-2e5da8d9-3c7e-4c24-9525-f5bda6c7047b tempest-CreateVolumesFromSnapshotTest-2119669264 None] Flow 'volume_create_manager' (b8112bd4-ffb8-4ac3-b454-0fb36f751463) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:30:39 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-2e5da8d9-3c7e-4c24-9525-f5bda6c7047b tempest-CreateVolumesFromSnapshotTest-2119669264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae970f3e-b916-48fb-b5cd-f3bb44be9908) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:30:39 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-2e5da8d9-3c7e-4c24-9525-f5bda6c7047b tempest-CreateVolumesFromSnapshotTest-2119669264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae970f3e-b916-48fb-b5cd-f3bb44be9908) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:30:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1504458207',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f20ffa7-b1ae-44bc-840b-e69aad0b54f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ed354397e4746949a3143134c0f9610',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:30:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:30:40Z,use_quota=True,user_id='3f4a957b9fec41f2a34ccfbae96acc10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:30:39 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-2e5da8d9-3c7e-4c24-9525-f5bda6c7047b tempest-CreateVolumesFromSnapshotTest-2119669264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c64cee80-e0a3-49f3-b317-9656a21afe34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:30:39 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-2e5da8d9-3c7e-4c24-9525-f5bda6c7047b tempest-CreateVolumesFromSnapshotTest-2119669264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c64cee80-e0a3-49f3-b317-9656a21afe34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:30:39 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-2e5da8d9-3c7e-4c24-9525-f5bda6c7047b tempest-CreateVolumesFromSnapshotTest-2119669264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9246f140-9097-43fc-9e7a-a89e2382f103) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:30:39 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-2e5da8d9-3c7e-4c24-9525-f5bda6c7047b tempest-CreateVolumesFromSnapshotTest-2119669264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9246f140-9097-43fc-9e7a-a89e2382f103) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8f20ffa7-b1ae-44bc-840b-e69aad0b54f7', 'volume_name': 'volume-8f20ffa7-b1ae-44bc-840b-e69aad0b54f7', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:30:39 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-2e5da8d9-3c7e-4c24-9525-f5bda6c7047b tempest-CreateVolumesFromSnapshotTest-2119669264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04730fc0-7711-4bde-a22b-d4d729fd6ee3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:30:39 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-2e5da8d9-3c7e-4c24-9525-f5bda6c7047b tempest-CreateVolumesFromSnapshotTest-2119669264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04730fc0-7711-4bde-a22b-d4d729fd6ee3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:30:39 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-2e5da8d9-3c7e-4c24-9525-f5bda6c7047b tempest-CreateVolumesFromSnapshotTest-2119669264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11d1d25b-7b36-40e2-a616-2aa0bf631284) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:30:39 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-2e5da8d9-3c7e-4c24-9525-f5bda6c7047b tempest-CreateVolumesFromSnapshotTest-2119669264 None] Volume 8f20ffa7-b1ae-44bc-840b-e69aad0b54f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8f20ffa7-b1ae-44bc-840b-e69aad0b54f7', 'volume_size': 1} Aug 05 06:30:39 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-2e5da8d9-3c7e-4c24-9525-f5bda6c7047b tempest-CreateVolumesFromSnapshotTest-2119669264 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:30:39 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-2e5da8d9-3c7e-4c24-9525-f5bda6c7047b tempest-CreateVolumesFromSnapshotTest-2119669264 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:30:39 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-2e5da8d9-3c7e-4c24-9525-f5bda6c7047b tempest-CreateVolumesFromSnapshotTest-2119669264 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:30:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1504458207',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f20ffa7-b1ae-44bc-840b-e69aad0b54f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ed354397e4746949a3143134c0f9610',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:30:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:30:40Z,use_quota=True,user_id='3f4a957b9fec41f2a34ccfbae96acc10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)}" {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 06:30:39 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-2e5da8d9-3c7e-4c24-9525-f5bda6c7047b tempest-CreateVolumesFromSnapshotTest-2119669264 None] Creating volume 8f20ffa7-b1ae-44bc-840b-e69aad0b54f7 {{(pid=88695) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 06:30:39 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-2e5da8d9-3c7e-4c24-9525-f5bda6c7047b tempest-CreateVolumesFromSnapshotTest-2119669264 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:30:39 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-2e5da8d9-3c7e-4c24-9525-f5bda6c7047b tempest-CreateVolumesFromSnapshotTest-2119669264 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:30:39 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-2e5da8d9-3c7e-4c24-9525-f5bda6c7047b tempest-CreateVolumesFromSnapshotTest-2119669264 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:30:39 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-2e5da8d9-3c7e-4c24-9525-f5bda6c7047b tempest-CreateVolumesFromSnapshotTest-2119669264 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:30:39 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-2e5da8d9-3c7e-4c24-9525-f5bda6c7047b tempest-CreateVolumesFromSnapshotTest-2119669264 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:30:39 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-2e5da8d9-3c7e-4c24-9525-f5bda6c7047b tempest-CreateVolumesFromSnapshotTest-2119669264 None] Selected osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 as target Quobyte volume. {{(pid=88695) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 06:30:39 devstack cinder-volume[88695]: INFO cinder.volume.drivers.remotefs [None req-2e5da8d9-3c7e-4c24-9525-f5bda6c7047b tempest-CreateVolumesFromSnapshotTest-2119669264 None] casted to osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 Aug 05 06:30:39 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-2e5da8d9-3c7e-4c24-9525-f5bda6c7047b tempest-CreateVolumesFromSnapshotTest-2119669264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8f20ffa7-b1ae-44bc-840b-e69aad0b54f7 1073741824 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:30:39 devstack sudo[108234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8f20ffa7-b1ae-44bc-840b-e69aad0b54f7 1073741824 Aug 05 06:30:39 devstack sudo[108234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:30:40 devstack sudo[108234]: pam_unix(sudo:session): session closed for user root Aug 05 06:30:40 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-2e5da8d9-3c7e-4c24-9525-f5bda6c7047b tempest-CreateVolumesFromSnapshotTest-2119669264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8f20ffa7-b1ae-44bc-840b-e69aad0b54f7 1073741824" returned: 0 in 0.628s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:30:40 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-2e5da8d9-3c7e-4c24-9525-f5bda6c7047b tempest-CreateVolumesFromSnapshotTest-2119669264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8f20ffa7-b1ae-44bc-840b-e69aad0b54f7 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:30:40 devstack sudo[108242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8f20ffa7-b1ae-44bc-840b-e69aad0b54f7 Aug 05 06:30:40 devstack sudo[108242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:30:40 devstack cinder-volume[88695]: DEBUG cinder.volume.flows.manager.create_volume [None req-66241179-b497-47e0-882f-0ad1126540ce tempest-CreateVolumesFromImageTest-1660354549 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88695) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 06:30:40 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-66241179-b497-47e0-882f-0ad1126540ce tempest-CreateVolumesFromImageTest-1660354549 None] Flow 'volume_create_manager' (69377a23-3874-45af-a97e-aa7e7f5b2e7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:30:40 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-66241179-b497-47e0-882f-0ad1126540ce tempest-CreateVolumesFromImageTest-1660354549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (078b769c-8ab1-4ed1-a5ed-e3c2353e87b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:30:40 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-66241179-b497-47e0-882f-0ad1126540ce tempest-CreateVolumesFromImageTest-1660354549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (078b769c-8ab1-4ed1-a5ed-e3c2353e87b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:30:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1174862230',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e70f9afb-ce5b-4c1a-b58d-62f5d72d2a6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfbd90e005004d19acde625aad4388ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:30:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:30:41Z,use_quota=True,user_id='614c086a634842d0a936701bac2b12b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:30:40 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-66241179-b497-47e0-882f-0ad1126540ce tempest-CreateVolumesFromImageTest-1660354549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8306387-4287-49de-abd4-40860da5801a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:30:40 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-66241179-b497-47e0-882f-0ad1126540ce tempest-CreateVolumesFromImageTest-1660354549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8306387-4287-49de-abd4-40860da5801a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:30:40 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-66241179-b497-47e0-882f-0ad1126540ce tempest-CreateVolumesFromImageTest-1660354549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed3c64e1-119b-498a-b361-c9991d5671c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:30:40 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-66241179-b497-47e0-882f-0ad1126540ce tempest-CreateVolumesFromImageTest-1660354549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed3c64e1-119b-498a-b361-c9991d5671c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e70f9afb-ce5b-4c1a-b58d-62f5d72d2a6b', 'volume_name': 'volume-e70f9afb-ce5b-4c1a-b58d-62f5d72d2a6b', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:30:40 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-66241179-b497-47e0-882f-0ad1126540ce tempest-CreateVolumesFromImageTest-1660354549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8398bc76-e3e6-4bb1-942e-cf9736e0a201) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:30:40 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-66241179-b497-47e0-882f-0ad1126540ce tempest-CreateVolumesFromImageTest-1660354549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8398bc76-e3e6-4bb1-942e-cf9736e0a201) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:30:40 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-66241179-b497-47e0-882f-0ad1126540ce tempest-CreateVolumesFromImageTest-1660354549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb8cf745-781b-4ea1-b299-c09b5767f25c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:30:40 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-66241179-b497-47e0-882f-0ad1126540ce tempest-CreateVolumesFromImageTest-1660354549 None] Volume e70f9afb-ce5b-4c1a-b58d-62f5d72d2a6b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e70f9afb-ce5b-4c1a-b58d-62f5d72d2a6b', 'volume_size': 1} Aug 05 06:30:40 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-66241179-b497-47e0-882f-0ad1126540ce tempest-CreateVolumesFromImageTest-1660354549 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:30:41 devstack sudo[108242]: pam_unix(sudo:session): session closed for user root Aug 05 06:30:41 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-2e5da8d9-3c7e-4c24-9525-f5bda6c7047b tempest-CreateVolumesFromSnapshotTest-2119669264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8f20ffa7-b1ae-44bc-840b-e69aad0b54f7" returned: 0 in 0.444s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:30:41 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-2e5da8d9-3c7e-4c24-9525-f5bda6c7047b tempest-CreateVolumesFromSnapshotTest-2119669264 None] <== create_volume: return (1143ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'} {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 06:30:41 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-2e5da8d9-3c7e-4c24-9525-f5bda6c7047b tempest-CreateVolumesFromSnapshotTest-2119669264 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.146s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:30:41 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-66241179-b497-47e0-882f-0ad1126540ce tempest-CreateVolumesFromImageTest-1660354549 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.145s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:30:41 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-66241179-b497-47e0-882f-0ad1126540ce tempest-CreateVolumesFromImageTest-1660354549 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:30:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1174862230',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e70f9afb-ce5b-4c1a-b58d-62f5d72d2a6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfbd90e005004d19acde625aad4388ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:30:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:30:41Z,use_quota=True,user_id='614c086a634842d0a936701bac2b12b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)}" {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 06:30:41 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-66241179-b497-47e0-882f-0ad1126540ce tempest-CreateVolumesFromImageTest-1660354549 None] Creating volume e70f9afb-ce5b-4c1a-b58d-62f5d72d2a6b {{(pid=88695) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 06:30:41 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-66241179-b497-47e0-882f-0ad1126540ce tempest-CreateVolumesFromImageTest-1660354549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:30:41 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-66241179-b497-47e0-882f-0ad1126540ce tempest-CreateVolumesFromImageTest-1660354549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:30:41 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-66241179-b497-47e0-882f-0ad1126540ce tempest-CreateVolumesFromImageTest-1660354549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:30:41 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-66241179-b497-47e0-882f-0ad1126540ce tempest-CreateVolumesFromImageTest-1660354549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:30:41 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-66241179-b497-47e0-882f-0ad1126540ce tempest-CreateVolumesFromImageTest-1660354549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:30:41 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-66241179-b497-47e0-882f-0ad1126540ce tempest-CreateVolumesFromImageTest-1660354549 None] Selected osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 as target Quobyte volume. {{(pid=88695) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 06:30:41 devstack cinder-volume[88695]: INFO cinder.volume.drivers.remotefs [None req-66241179-b497-47e0-882f-0ad1126540ce tempest-CreateVolumesFromImageTest-1660354549 None] casted to osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 Aug 05 06:30:41 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-66241179-b497-47e0-882f-0ad1126540ce tempest-CreateVolumesFromImageTest-1660354549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-e70f9afb-ce5b-4c1a-b58d-62f5d72d2a6b 1073741824 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:30:41 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-2e5da8d9-3c7e-4c24-9525-f5bda6c7047b tempest-CreateVolumesFromSnapshotTest-2119669264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11d1d25b-7b36-40e2-a616-2aa0bf631284) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f20ffa7-b1ae-44bc-840b-e69aad0b54f7', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:30:41 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-2e5da8d9-3c7e-4c24-9525-f5bda6c7047b tempest-CreateVolumesFromSnapshotTest-2119669264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75163fcb-0f87-4cf3-8469-a854cebd2ae7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:30:41 devstack sudo[108245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-e70f9afb-ce5b-4c1a-b58d-62f5d72d2a6b 1073741824 Aug 05 06:30:41 devstack sudo[108245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:30:41 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-2e5da8d9-3c7e-4c24-9525-f5bda6c7047b tempest-CreateVolumesFromSnapshotTest-2119669264 None] Volume volume-8f20ffa7-b1ae-44bc-840b-e69aad0b54f7 (8f20ffa7-b1ae-44bc-840b-e69aad0b54f7): created successfully Aug 05 06:30:41 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-2e5da8d9-3c7e-4c24-9525-f5bda6c7047b tempest-CreateVolumesFromSnapshotTest-2119669264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75163fcb-0f87-4cf3-8469-a854cebd2ae7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:30:41 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-2e5da8d9-3c7e-4c24-9525-f5bda6c7047b tempest-CreateVolumesFromSnapshotTest-2119669264 None] Flow 'volume_create_manager' (b8112bd4-ffb8-4ac3-b454-0fb36f751463) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:30:41 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-2e5da8d9-3c7e-4c24-9525-f5bda6c7047b tempest-CreateVolumesFromSnapshotTest-2119669264 None] Created volume successfully. Aug 05 06:30:41 devstack cinder-volume[88695]: DEBUG cinder.volume.flows.manager.create_volume [None req-0aea84de-0d83-43c8-86e8-f5e6ed8c48ab tempest-CreateVolumesFromImageTest-1660354549 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88695) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 06:30:41 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-0aea84de-0d83-43c8-86e8-f5e6ed8c48ab tempest-CreateVolumesFromImageTest-1660354549 None] Flow 'volume_create_manager' (40912308-f2a1-403d-aaf3-6ce8da2bc82d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:30:41 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-0aea84de-0d83-43c8-86e8-f5e6ed8c48ab tempest-CreateVolumesFromImageTest-1660354549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e58481c-6b1f-4463-afe3-8a1ec71c2d88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:30:41 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-0aea84de-0d83-43c8-86e8-f5e6ed8c48ab tempest-CreateVolumesFromImageTest-1660354549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e58481c-6b1f-4463-afe3-8a1ec71c2d88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:30:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-851787373',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b785db54-adc6-4228-9b29-855281f55a92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfbd90e005004d19acde625aad4388ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:30:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:30:41Z,use_quota=True,user_id='614c086a634842d0a936701bac2b12b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:30:41 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-0aea84de-0d83-43c8-86e8-f5e6ed8c48ab tempest-CreateVolumesFromImageTest-1660354549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e272c4ab-6a09-4132-985e-fa5a6662301e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:30:41 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-0aea84de-0d83-43c8-86e8-f5e6ed8c48ab tempest-CreateVolumesFromImageTest-1660354549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e272c4ab-6a09-4132-985e-fa5a6662301e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:30:41 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-0aea84de-0d83-43c8-86e8-f5e6ed8c48ab tempest-CreateVolumesFromImageTest-1660354549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa91b316-c7b3-4c95-bb24-a9396f3e7e65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:30:41 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-0aea84de-0d83-43c8-86e8-f5e6ed8c48ab tempest-CreateVolumesFromImageTest-1660354549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa91b316-c7b3-4c95-bb24-a9396f3e7e65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b785db54-adc6-4228-9b29-855281f55a92', 'volume_name': 'volume-b785db54-adc6-4228-9b29-855281f55a92', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:30:41 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-0aea84de-0d83-43c8-86e8-f5e6ed8c48ab tempest-CreateVolumesFromImageTest-1660354549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f90dbf7-7607-40c4-8565-5c39b31ad89b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:30:41 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-0aea84de-0d83-43c8-86e8-f5e6ed8c48ab tempest-CreateVolumesFromImageTest-1660354549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f90dbf7-7607-40c4-8565-5c39b31ad89b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:30:41 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-0aea84de-0d83-43c8-86e8-f5e6ed8c48ab tempest-CreateVolumesFromImageTest-1660354549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98414b8f-78a2-4b5a-b29b-f366883c4ba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:30:41 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-0aea84de-0d83-43c8-86e8-f5e6ed8c48ab tempest-CreateVolumesFromImageTest-1660354549 None] Volume b785db54-adc6-4228-9b29-855281f55a92: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b785db54-adc6-4228-9b29-855281f55a92', 'volume_size': 1} Aug 05 06:30:41 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-0aea84de-0d83-43c8-86e8-f5e6ed8c48ab tempest-CreateVolumesFromImageTest-1660354549 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:30:41 devstack cinder-volume[88695]: DEBUG cinder.volume.flows.manager.create_volume [None req-02978846-d748-4c33-be6c-859adfa83958 tempest-CreateVolumesFromImageTest-1660354549 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88695) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 06:30:41 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-02978846-d748-4c33-be6c-859adfa83958 tempest-CreateVolumesFromImageTest-1660354549 None] Flow 'volume_create_manager' (a77564a1-a7e2-44c8-a186-4b904f0206af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:30:41 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-02978846-d748-4c33-be6c-859adfa83958 tempest-CreateVolumesFromImageTest-1660354549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c2d02fd-d88a-4276-a5c8-62ff8ba70dad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:30:41 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-02978846-d748-4c33-be6c-859adfa83958 tempest-CreateVolumesFromImageTest-1660354549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c2d02fd-d88a-4276-a5c8-62ff8ba70dad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:30:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2028819547',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ba13aa8-65cb-4089-8460-bfd804673440,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfbd90e005004d19acde625aad4388ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:30:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:30:42Z,use_quota=True,user_id='614c086a634842d0a936701bac2b12b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:30:41 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-02978846-d748-4c33-be6c-859adfa83958 tempest-CreateVolumesFromImageTest-1660354549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (921a2870-f4c1-4b3e-a401-cebb82b0d8f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:30:41 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-02978846-d748-4c33-be6c-859adfa83958 tempest-CreateVolumesFromImageTest-1660354549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (921a2870-f4c1-4b3e-a401-cebb82b0d8f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:30:41 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-02978846-d748-4c33-be6c-859adfa83958 tempest-CreateVolumesFromImageTest-1660354549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7d841ee-f442-416e-8b73-9a41c30af66f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:30:41 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-02978846-d748-4c33-be6c-859adfa83958 tempest-CreateVolumesFromImageTest-1660354549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7d841ee-f442-416e-8b73-9a41c30af66f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ba13aa8-65cb-4089-8460-bfd804673440', 'volume_name': 'volume-6ba13aa8-65cb-4089-8460-bfd804673440', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:30:41 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-02978846-d748-4c33-be6c-859adfa83958 tempest-CreateVolumesFromImageTest-1660354549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05095339-a2a5-49f7-96a8-7edaa5bc3212) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:30:41 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-02978846-d748-4c33-be6c-859adfa83958 tempest-CreateVolumesFromImageTest-1660354549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05095339-a2a5-49f7-96a8-7edaa5bc3212) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:30:41 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-02978846-d748-4c33-be6c-859adfa83958 tempest-CreateVolumesFromImageTest-1660354549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8ce6189-cfc4-421c-b89e-a30af4b0ca49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:30:41 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-02978846-d748-4c33-be6c-859adfa83958 tempest-CreateVolumesFromImageTest-1660354549 None] Volume 6ba13aa8-65cb-4089-8460-bfd804673440: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ba13aa8-65cb-4089-8460-bfd804673440', 'volume_size': 1} Aug 05 06:30:41 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-02978846-d748-4c33-be6c-859adfa83958 tempest-CreateVolumesFromImageTest-1660354549 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:30:42 devstack sudo[108245]: pam_unix(sudo:session): session closed for user root Aug 05 06:30:42 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-66241179-b497-47e0-882f-0ad1126540ce tempest-CreateVolumesFromImageTest-1660354549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-e70f9afb-ce5b-4c1a-b58d-62f5d72d2a6b 1073741824" returned: 0 in 0.908s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:30:42 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-66241179-b497-47e0-882f-0ad1126540ce tempest-CreateVolumesFromImageTest-1660354549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-e70f9afb-ce5b-4c1a-b58d-62f5d72d2a6b {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:30:42 devstack sudo[108251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-e70f9afb-ce5b-4c1a-b58d-62f5d72d2a6b Aug 05 06:30:42 devstack sudo[108251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:30:42 devstack cinder-volume[88695]: DEBUG cinder.volume.flows.manager.create_volume [None req-29091ef0-840c-452e-91a2-aefdbd1338dd tempest-CreateVolumesFromImageTest-1660354549 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88695) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 06:30:42 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-29091ef0-840c-452e-91a2-aefdbd1338dd tempest-CreateVolumesFromImageTest-1660354549 None] Flow 'volume_create_manager' (1f2edd44-105e-4c20-8783-1e720e4b990e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:30:42 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-29091ef0-840c-452e-91a2-aefdbd1338dd tempest-CreateVolumesFromImageTest-1660354549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (257bf634-361b-4f64-9999-5f6225fa3e3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:30:42 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-29091ef0-840c-452e-91a2-aefdbd1338dd tempest-CreateVolumesFromImageTest-1660354549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (257bf634-361b-4f64-9999-5f6225fa3e3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:30:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1006758405',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0f8f15c-516d-4ca3-b7f4-6a69e79f0409,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfbd90e005004d19acde625aad4388ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:30:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:30:42Z,use_quota=True,user_id='614c086a634842d0a936701bac2b12b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:30:42 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-29091ef0-840c-452e-91a2-aefdbd1338dd tempest-CreateVolumesFromImageTest-1660354549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (712dc2ed-256c-4440-b0aa-60bca1fb47ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:30:42 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-29091ef0-840c-452e-91a2-aefdbd1338dd tempest-CreateVolumesFromImageTest-1660354549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (712dc2ed-256c-4440-b0aa-60bca1fb47ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:30:42 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-29091ef0-840c-452e-91a2-aefdbd1338dd tempest-CreateVolumesFromImageTest-1660354549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bae3eb6-c04c-43f3-901c-02394a9d42b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:30:42 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-29091ef0-840c-452e-91a2-aefdbd1338dd tempest-CreateVolumesFromImageTest-1660354549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bae3eb6-c04c-43f3-901c-02394a9d42b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f0f8f15c-516d-4ca3-b7f4-6a69e79f0409', 'volume_name': 'volume-f0f8f15c-516d-4ca3-b7f4-6a69e79f0409', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:30:42 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-29091ef0-840c-452e-91a2-aefdbd1338dd tempest-CreateVolumesFromImageTest-1660354549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7ea9d8a-886d-48ef-bd43-cbfcef012a0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:30:42 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-29091ef0-840c-452e-91a2-aefdbd1338dd tempest-CreateVolumesFromImageTest-1660354549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7ea9d8a-886d-48ef-bd43-cbfcef012a0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:30:42 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-29091ef0-840c-452e-91a2-aefdbd1338dd tempest-CreateVolumesFromImageTest-1660354549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0227da2-1598-4cee-8c63-f499a652e878) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:30:42 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-29091ef0-840c-452e-91a2-aefdbd1338dd tempest-CreateVolumesFromImageTest-1660354549 None] Volume f0f8f15c-516d-4ca3-b7f4-6a69e79f0409: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f0f8f15c-516d-4ca3-b7f4-6a69e79f0409', 'volume_size': 1} Aug 05 06:30:42 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-29091ef0-840c-452e-91a2-aefdbd1338dd tempest-CreateVolumesFromImageTest-1660354549 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:30:42 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-b9f1c32e-b7bb-4d05-b010-0837ab2c0841 tempest-CreateVolumesFromSnapshotTest-2119669264 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:30:42 devstack sudo[108251]: pam_unix(sudo:session): session closed for user root Aug 05 06:30:42 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-66241179-b497-47e0-882f-0ad1126540ce tempest-CreateVolumesFromImageTest-1660354549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-e70f9afb-ce5b-4c1a-b58d-62f5d72d2a6b" returned: 0 in 0.444s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:30:42 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-66241179-b497-47e0-882f-0ad1126540ce tempest-CreateVolumesFromImageTest-1660354549 None] <== create_volume: return (1419ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'} {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 06:30:42 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-66241179-b497-47e0-882f-0ad1126540ce tempest-CreateVolumesFromImageTest-1660354549 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.422s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:30:42 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-0aea84de-0d83-43c8-86e8-f5e6ed8c48ab tempest-CreateVolumesFromImageTest-1660354549 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.911s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:30:42 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-0aea84de-0d83-43c8-86e8-f5e6ed8c48ab tempest-CreateVolumesFromImageTest-1660354549 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:30:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-851787373',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b785db54-adc6-4228-9b29-855281f55a92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfbd90e005004d19acde625aad4388ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:30:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:30:41Z,use_quota=True,user_id='614c086a634842d0a936701bac2b12b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)}" {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 06:30:42 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-0aea84de-0d83-43c8-86e8-f5e6ed8c48ab tempest-CreateVolumesFromImageTest-1660354549 None] Creating volume b785db54-adc6-4228-9b29-855281f55a92 {{(pid=88695) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 06:30:42 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-0aea84de-0d83-43c8-86e8-f5e6ed8c48ab tempest-CreateVolumesFromImageTest-1660354549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:30:42 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-0aea84de-0d83-43c8-86e8-f5e6ed8c48ab tempest-CreateVolumesFromImageTest-1660354549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:30:42 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-0aea84de-0d83-43c8-86e8-f5e6ed8c48ab tempest-CreateVolumesFromImageTest-1660354549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:30:42 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-0aea84de-0d83-43c8-86e8-f5e6ed8c48ab tempest-CreateVolumesFromImageTest-1660354549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:30:42 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-0aea84de-0d83-43c8-86e8-f5e6ed8c48ab tempest-CreateVolumesFromImageTest-1660354549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:30:42 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-0aea84de-0d83-43c8-86e8-f5e6ed8c48ab tempest-CreateVolumesFromImageTest-1660354549 None] Selected osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 as target Quobyte volume. {{(pid=88695) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 06:30:42 devstack cinder-volume[88695]: INFO cinder.volume.drivers.remotefs [None req-0aea84de-0d83-43c8-86e8-f5e6ed8c48ab tempest-CreateVolumesFromImageTest-1660354549 None] casted to osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 Aug 05 06:30:42 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-0aea84de-0d83-43c8-86e8-f5e6ed8c48ab tempest-CreateVolumesFromImageTest-1660354549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-b785db54-adc6-4228-9b29-855281f55a92 1073741824 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:30:42 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-66241179-b497-47e0-882f-0ad1126540ce tempest-CreateVolumesFromImageTest-1660354549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb8cf745-781b-4ea1-b299-c09b5767f25c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e70f9afb-ce5b-4c1a-b58d-62f5d72d2a6b', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:30:42 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-66241179-b497-47e0-882f-0ad1126540ce tempest-CreateVolumesFromImageTest-1660354549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (473f4c30-7d59-4345-8909-9c1d2dcfcda3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:30:42 devstack sudo[108254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-b785db54-adc6-4228-9b29-855281f55a92 1073741824 Aug 05 06:30:42 devstack sudo[108254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:30:42 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-66241179-b497-47e0-882f-0ad1126540ce tempest-CreateVolumesFromImageTest-1660354549 None] Volume volume-e70f9afb-ce5b-4c1a-b58d-62f5d72d2a6b (e70f9afb-ce5b-4c1a-b58d-62f5d72d2a6b): created successfully Aug 05 06:30:42 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-66241179-b497-47e0-882f-0ad1126540ce tempest-CreateVolumesFromImageTest-1660354549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (473f4c30-7d59-4345-8909-9c1d2dcfcda3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:30:42 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-66241179-b497-47e0-882f-0ad1126540ce tempest-CreateVolumesFromImageTest-1660354549 None] Flow 'volume_create_manager' (69377a23-3874-45af-a97e-aa7e7f5b2e7a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:30:42 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-66241179-b497-47e0-882f-0ad1126540ce tempest-CreateVolumesFromImageTest-1660354549 None] Created volume successfully. Aug 05 06:30:43 devstack cinder-volume[88695]: DEBUG cinder.volume.flows.manager.create_volume [None req-32b1c456-f8d2-40d9-be61-9327b70a6815 tempest-CreateVolumesFromImageTest-1660354549 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88695) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 06:30:43 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-32b1c456-f8d2-40d9-be61-9327b70a6815 tempest-CreateVolumesFromImageTest-1660354549 None] Flow 'volume_create_manager' (b34288a0-26f7-4357-8d6c-5e38b75fb089) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:30:43 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-32b1c456-f8d2-40d9-be61-9327b70a6815 tempest-CreateVolumesFromImageTest-1660354549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73232ddd-9acf-4616-a19d-e8ee77709a9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:30:43 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-32b1c456-f8d2-40d9-be61-9327b70a6815 tempest-CreateVolumesFromImageTest-1660354549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73232ddd-9acf-4616-a19d-e8ee77709a9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:30:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1235634212',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=beba6f32-c79c-4797-969a-46016e63a73e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfbd90e005004d19acde625aad4388ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:30:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:30:43Z,use_quota=True,user_id='614c086a634842d0a936701bac2b12b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:30:43 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-32b1c456-f8d2-40d9-be61-9327b70a6815 tempest-CreateVolumesFromImageTest-1660354549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4801da6-fea9-49c0-b984-45e8a4c3bf2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:30:43 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-32b1c456-f8d2-40d9-be61-9327b70a6815 tempest-CreateVolumesFromImageTest-1660354549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4801da6-fea9-49c0-b984-45e8a4c3bf2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:30:43 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-32b1c456-f8d2-40d9-be61-9327b70a6815 tempest-CreateVolumesFromImageTest-1660354549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a811ed9-5d8a-42f3-ad79-4a161da06c0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:30:43 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-32b1c456-f8d2-40d9-be61-9327b70a6815 tempest-CreateVolumesFromImageTest-1660354549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a811ed9-5d8a-42f3-ad79-4a161da06c0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'beba6f32-c79c-4797-969a-46016e63a73e', 'volume_name': 'volume-beba6f32-c79c-4797-969a-46016e63a73e', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:30:43 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-32b1c456-f8d2-40d9-be61-9327b70a6815 tempest-CreateVolumesFromImageTest-1660354549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8f085c9-b318-42ac-99f7-0492390ef599) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:30:43 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-32b1c456-f8d2-40d9-be61-9327b70a6815 tempest-CreateVolumesFromImageTest-1660354549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8f085c9-b318-42ac-99f7-0492390ef599) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:30:43 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-32b1c456-f8d2-40d9-be61-9327b70a6815 tempest-CreateVolumesFromImageTest-1660354549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63a40bfd-677f-4ff1-bdfe-81c622131859) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:30:43 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-32b1c456-f8d2-40d9-be61-9327b70a6815 tempest-CreateVolumesFromImageTest-1660354549 None] Volume beba6f32-c79c-4797-969a-46016e63a73e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-beba6f32-c79c-4797-969a-46016e63a73e', 'volume_size': 1} Aug 05 06:30:43 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-32b1c456-f8d2-40d9-be61-9327b70a6815 tempest-CreateVolumesFromImageTest-1660354549 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:30:43 devstack sudo[108254]: pam_unix(sudo:session): session closed for user root Aug 05 06:30:43 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-0aea84de-0d83-43c8-86e8-f5e6ed8c48ab tempest-CreateVolumesFromImageTest-1660354549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-b785db54-adc6-4228-9b29-855281f55a92 1073741824" returned: 0 in 0.721s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:30:43 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-0aea84de-0d83-43c8-86e8-f5e6ed8c48ab tempest-CreateVolumesFromImageTest-1660354549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-b785db54-adc6-4228-9b29-855281f55a92 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:30:43 devstack sudo[108295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-b785db54-adc6-4228-9b29-855281f55a92 Aug 05 06:30:43 devstack sudo[108295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:30:43 devstack sudo[108295]: pam_unix(sudo:session): session closed for user root Aug 05 06:30:43 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-0aea84de-0d83-43c8-86e8-f5e6ed8c48ab tempest-CreateVolumesFromImageTest-1660354549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-b785db54-adc6-4228-9b29-855281f55a92" returned: 0 in 0.332s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:30:43 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-0aea84de-0d83-43c8-86e8-f5e6ed8c48ab tempest-CreateVolumesFromImageTest-1660354549 None] <== create_volume: return (1125ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'} {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 06:30:43 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-0aea84de-0d83-43c8-86e8-f5e6ed8c48ab tempest-CreateVolumesFromImageTest-1660354549 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.128s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:30:43 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-02978846-d748-4c33-be6c-859adfa83958 tempest-CreateVolumesFromImageTest-1660354549 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.708s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:30:43 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-02978846-d748-4c33-be6c-859adfa83958 tempest-CreateVolumesFromImageTest-1660354549 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:30:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2028819547',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ba13aa8-65cb-4089-8460-bfd804673440,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfbd90e005004d19acde625aad4388ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:30:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:30:42Z,use_quota=True,user_id='614c086a634842d0a936701bac2b12b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)}" {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 06:30:43 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-02978846-d748-4c33-be6c-859adfa83958 tempest-CreateVolumesFromImageTest-1660354549 None] Creating volume 6ba13aa8-65cb-4089-8460-bfd804673440 {{(pid=88695) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 06:30:43 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-02978846-d748-4c33-be6c-859adfa83958 tempest-CreateVolumesFromImageTest-1660354549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:30:43 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-02978846-d748-4c33-be6c-859adfa83958 tempest-CreateVolumesFromImageTest-1660354549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:30:43 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-02978846-d748-4c33-be6c-859adfa83958 tempest-CreateVolumesFromImageTest-1660354549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:30:43 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-02978846-d748-4c33-be6c-859adfa83958 tempest-CreateVolumesFromImageTest-1660354549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:30:43 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-02978846-d748-4c33-be6c-859adfa83958 tempest-CreateVolumesFromImageTest-1660354549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:30:43 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-02978846-d748-4c33-be6c-859adfa83958 tempest-CreateVolumesFromImageTest-1660354549 None] Selected osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 as target Quobyte volume. {{(pid=88695) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 06:30:43 devstack cinder-volume[88695]: INFO cinder.volume.drivers.remotefs [None req-02978846-d748-4c33-be6c-859adfa83958 tempest-CreateVolumesFromImageTest-1660354549 None] casted to osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 Aug 05 06:30:43 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-02978846-d748-4c33-be6c-859adfa83958 tempest-CreateVolumesFromImageTest-1660354549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-6ba13aa8-65cb-4089-8460-bfd804673440 1073741824 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:30:43 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-0aea84de-0d83-43c8-86e8-f5e6ed8c48ab tempest-CreateVolumesFromImageTest-1660354549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98414b8f-78a2-4b5a-b29b-f366883c4ba5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b785db54-adc6-4228-9b29-855281f55a92', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:30:43 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-0aea84de-0d83-43c8-86e8-f5e6ed8c48ab tempest-CreateVolumesFromImageTest-1660354549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e18e14a6-6cd7-49f0-b3c9-fe140a42c3fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:30:43 devstack sudo[108298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-6ba13aa8-65cb-4089-8460-bfd804673440 1073741824 Aug 05 06:30:43 devstack sudo[108298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:30:43 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-0aea84de-0d83-43c8-86e8-f5e6ed8c48ab tempest-CreateVolumesFromImageTest-1660354549 None] Volume volume-b785db54-adc6-4228-9b29-855281f55a92 (b785db54-adc6-4228-9b29-855281f55a92): created successfully Aug 05 06:30:43 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-0aea84de-0d83-43c8-86e8-f5e6ed8c48ab tempest-CreateVolumesFromImageTest-1660354549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e18e14a6-6cd7-49f0-b3c9-fe140a42c3fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:30:43 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-0aea84de-0d83-43c8-86e8-f5e6ed8c48ab tempest-CreateVolumesFromImageTest-1660354549 None] Flow 'volume_create_manager' (40912308-f2a1-403d-aaf3-6ce8da2bc82d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:30:43 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-0aea84de-0d83-43c8-86e8-f5e6ed8c48ab tempest-CreateVolumesFromImageTest-1660354549 None] Created volume successfully. Aug 05 06:30:44 devstack cinder-volume[88695]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a1fe141-b8c4-440d-b9f7-0cb528ded302 tempest-VolumeImageDependencyTests-768896694 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88695) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 06:30:44 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-8a1fe141-b8c4-440d-b9f7-0cb528ded302 tempest-VolumeImageDependencyTests-768896694 None] Flow 'volume_create_manager' (6b70d5c9-3d49-4972-9adc-9db833bd56ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:30:44 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-8a1fe141-b8c4-440d-b9f7-0cb528ded302 tempest-VolumeImageDependencyTests-768896694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f6cbe14-1304-4b1b-b9c0-321e6cb54e27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:30:44 devstack sudo[108298]: pam_unix(sudo:session): session closed for user root Aug 05 06:30:44 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-02978846-d748-4c33-be6c-859adfa83958 tempest-CreateVolumesFromImageTest-1660354549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-6ba13aa8-65cb-4089-8460-bfd804673440 1073741824" returned: 0 in 0.580s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:30:44 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-8a1fe141-b8c4-440d-b9f7-0cb528ded302 tempest-VolumeImageDependencyTests-768896694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f6cbe14-1304-4b1b-b9c0-321e6cb54e27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:30:44Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a48e355-7f38-41fc-8930-a87861389946,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1362d38ef5545ecad2e547c10164bf8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:30:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:30:44Z,use_quota=True,user_id='affc9b971e604423a363b3a1691e85ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:30:44 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-8a1fe141-b8c4-440d-b9f7-0cb528ded302 tempest-VolumeImageDependencyTests-768896694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bba477c-6f60-4041-b7f3-bcda59cd0d0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:30:44 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-8a1fe141-b8c4-440d-b9f7-0cb528ded302 tempest-VolumeImageDependencyTests-768896694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bba477c-6f60-4041-b7f3-bcda59cd0d0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:30:44 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-8a1fe141-b8c4-440d-b9f7-0cb528ded302 tempest-VolumeImageDependencyTests-768896694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4af78cfd-c112-4c53-808f-5a7b50e9d9b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:30:44 devstack cinder-volume[88695]: DEBUG cinder.image.glance [None req-8a1fe141-b8c4-440d-b9f7-0cb528ded302 tempest-VolumeImageDependencyTests-768896694 None] Creating Keystone auth plugin from conf {{(pid=88695) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 05 06:30:44 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-02978846-d748-4c33-be6c-859adfa83958 tempest-CreateVolumesFromImageTest-1660354549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-6ba13aa8-65cb-4089-8460-bfd804673440 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:30:44 devstack sudo[108304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-6ba13aa8-65cb-4089-8460-bfd804673440 Aug 05 06:30:44 devstack sudo[108304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:30:44 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-8a1fe141-b8c4-440d-b9f7-0cb528ded302 tempest-VolumeImageDependencyTests-768896694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4af78cfd-c112-4c53-808f-5a7b50e9d9b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '1a48e355-7f38-41fc-8930-a87861389946', 'volume_name': 'volume-1a48e355-7f38-41fc-8930-a87861389946', 'volume_size': 1, 'image_id': 'e170712c-b7ea-4f8f-97b5-9b7c6f07a51d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e170712c-b7ea-4f8f-97b5-9b7c6f07a51d', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'fb95018c90a23898ef105145ada786a7', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b1362d38ef5545ecad2e547c10164bf8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e1814052b725653ce97c3d3df6f73d1c34a2fa615e765f590e118d2d602c22e8b330f352c5fc893eba8efff2459caeb7c2c2a583c841e94902bdb76eeb268314', 'id': 'e170712c-b7ea-4f8f-97b5-9b7c6f07a51d', 'created_at': datetime.datetime(2026, 8, 5, 4, 30, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 5, 4, 30, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e170712c-b7ea-4f8f-97b5-9b7c6f07a51d/file', 'properties': {}}, 'image_service': }' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:30:44 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-8a1fe141-b8c4-440d-b9f7-0cb528ded302 tempest-VolumeImageDependencyTests-768896694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a557d03-caa4-4510-a785-d1e016f3735b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:30:44 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-8a1fe141-b8c4-440d-b9f7-0cb528ded302 tempest-VolumeImageDependencyTests-768896694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a557d03-caa4-4510-a785-d1e016f3735b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:30:44 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-8a1fe141-b8c4-440d-b9f7-0cb528ded302 tempest-VolumeImageDependencyTests-768896694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87210d5d-b828-48cd-9233-c75c78f04a71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:30:44 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-8a1fe141-b8c4-440d-b9f7-0cb528ded302 tempest-VolumeImageDependencyTests-768896694 None] Volume 1a48e355-7f38-41fc-8930-a87861389946: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-1a48e355-7f38-41fc-8930-a87861389946', 'volume_size': 1, 'image_id': 'e170712c-b7ea-4f8f-97b5-9b7c6f07a51d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e170712c-b7ea-4f8f-97b5-9b7c6f07a51d', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'fb95018c90a23898ef105145ada786a7', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b1362d38ef5545ecad2e547c10164bf8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e1814052b725653ce97c3d3df6f73d1c34a2fa615e765f590e118d2d602c22e8b330f352c5fc893eba8efff2459caeb7c2c2a583c841e94902bdb76eeb268314', 'id': 'e170712c-b7ea-4f8f-97b5-9b7c6f07a51d', 'created_at': datetime.datetime(2026, 8, 5, 4, 30, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 5, 4, 30, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e170712c-b7ea-4f8f-97b5-9b7c6f07a51d/file', 'properties': {}}, 'image_service': } Aug 05 06:30:44 devstack cinder-volume[88695]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a1fe141-b8c4-440d-b9f7-0cb528ded302 tempest-VolumeImageDependencyTests-768896694 None] Trying to clone 1a48e355-7f38-41fc-8930-a87861389946 from image e170712c-b7ea-4f8f-97b5-9b7c6f07a51d at location (None, [{'url': 'file:///opt/stack/data/glance/images/e170712c-b7ea-4f8f-97b5-9b7c6f07a51d', 'metadata': {}}]). {{(pid=88695) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 05 06:30:44 devstack sudo[108304]: pam_unix(sudo:session): session closed for user root Aug 05 06:30:44 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-02978846-d748-4c33-be6c-859adfa83958 tempest-CreateVolumesFromImageTest-1660354549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-6ba13aa8-65cb-4089-8460-bfd804673440" returned: 0 in 0.284s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:30:44 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-02978846-d748-4c33-be6c-859adfa83958 tempest-CreateVolumesFromImageTest-1660354549 None] <== create_volume: return (954ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'} {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 06:30:44 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-02978846-d748-4c33-be6c-859adfa83958 tempest-CreateVolumesFromImageTest-1660354549 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.958s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:30:44 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-29091ef0-840c-452e-91a2-aefdbd1338dd tempest-CreateVolumesFromImageTest-1660354549 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.147s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:30:44 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-29091ef0-840c-452e-91a2-aefdbd1338dd tempest-CreateVolumesFromImageTest-1660354549 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:30:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1006758405',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0f8f15c-516d-4ca3-b7f4-6a69e79f0409,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfbd90e005004d19acde625aad4388ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:30:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:30:42Z,use_quota=True,user_id='614c086a634842d0a936701bac2b12b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)}" {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 06:30:44 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-29091ef0-840c-452e-91a2-aefdbd1338dd tempest-CreateVolumesFromImageTest-1660354549 None] Creating volume f0f8f15c-516d-4ca3-b7f4-6a69e79f0409 {{(pid=88695) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 06:30:44 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-29091ef0-840c-452e-91a2-aefdbd1338dd tempest-CreateVolumesFromImageTest-1660354549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:30:44 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-29091ef0-840c-452e-91a2-aefdbd1338dd tempest-CreateVolumesFromImageTest-1660354549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:30:44 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-29091ef0-840c-452e-91a2-aefdbd1338dd tempest-CreateVolumesFromImageTest-1660354549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:30:44 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-29091ef0-840c-452e-91a2-aefdbd1338dd tempest-CreateVolumesFromImageTest-1660354549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:30:44 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-29091ef0-840c-452e-91a2-aefdbd1338dd tempest-CreateVolumesFromImageTest-1660354549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:30:44 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-29091ef0-840c-452e-91a2-aefdbd1338dd tempest-CreateVolumesFromImageTest-1660354549 None] Selected osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 as target Quobyte volume. {{(pid=88695) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 06:30:44 devstack cinder-volume[88695]: INFO cinder.volume.drivers.remotefs [None req-29091ef0-840c-452e-91a2-aefdbd1338dd tempest-CreateVolumesFromImageTest-1660354549 None] casted to osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 Aug 05 06:30:44 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-29091ef0-840c-452e-91a2-aefdbd1338dd tempest-CreateVolumesFromImageTest-1660354549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-f0f8f15c-516d-4ca3-b7f4-6a69e79f0409 1073741824 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:30:44 devstack sudo[108307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-f0f8f15c-516d-4ca3-b7f4-6a69e79f0409 1073741824 Aug 05 06:30:44 devstack sudo[108307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:30:44 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-02978846-d748-4c33-be6c-859adfa83958 tempest-CreateVolumesFromImageTest-1660354549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8ce6189-cfc4-421c-b89e-a30af4b0ca49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ba13aa8-65cb-4089-8460-bfd804673440', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:30:44 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-02978846-d748-4c33-be6c-859adfa83958 tempest-CreateVolumesFromImageTest-1660354549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7582117e-fb7a-44ab-8dc7-db727d87ec35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:30:44 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-02978846-d748-4c33-be6c-859adfa83958 tempest-CreateVolumesFromImageTest-1660354549 None] Volume volume-6ba13aa8-65cb-4089-8460-bfd804673440 (6ba13aa8-65cb-4089-8460-bfd804673440): created successfully Aug 05 06:30:44 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-02978846-d748-4c33-be6c-859adfa83958 tempest-CreateVolumesFromImageTest-1660354549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7582117e-fb7a-44ab-8dc7-db727d87ec35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:30:44 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-02978846-d748-4c33-be6c-859adfa83958 tempest-CreateVolumesFromImageTest-1660354549 None] Flow 'volume_create_manager' (a77564a1-a7e2-44c8-a186-4b904f0206af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:30:44 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-02978846-d748-4c33-be6c-859adfa83958 tempest-CreateVolumesFromImageTest-1660354549 None] Created volume successfully. Aug 05 06:30:44 devstack cinder-volume[88695]: DEBUG cinder.image.image_utils [None req-8a1fe141-b8c4-440d-b9f7-0cb528ded302 tempest-VolumeImageDependencyTests-768896694 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_e170712c-b7ea-4f8f-97b5-9b7c6f07a51d_jphm987ndevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=88695) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 05 06:30:44 devstack cinder-volume[88695]: INFO cinder.image.image_utils [None req-8a1fe141-b8c4-440d-b9f7-0cb528ded302 tempest-VolumeImageDependencyTests-768896694 None] Image download 0.00 MB at 0.00 MB/s Aug 05 06:30:44 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[692825f9-e443-4a95-a495-7c469e15e6b0]: (4, 'raw') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:30:44 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-8a1fe141-b8c4-440d-b9f7-0cb528ded302 tempest-VolumeImageDependencyTests-768896694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e170712c-b7ea-4f8f-97b5-9b7c6f07a51d_jphm987ndevstack@QuobyteHD {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:30:44 devstack sudo[108309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e170712c-b7ea-4f8f-97b5-9b7c6f07a51d_jphm987ndevstack@QuobyteHD Aug 05 06:30:44 devstack sudo[108309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:30:45 devstack cinder-volume[88695]: DEBUG cinder.volume.flows.manager.create_volume [None req-513b4728-2fea-415b-92fe-8340ecd94ebc tempest-VolumeAndVolumeTypeFromImageTest-719304038 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88695) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 06:30:45 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-513b4728-2fea-415b-92fe-8340ecd94ebc tempest-VolumeAndVolumeTypeFromImageTest-719304038 None] Flow 'volume_create_manager' (9c10184e-cbef-40e8-8dfa-36397ede13db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:30:45 devstack sudo[108307]: pam_unix(sudo:session): session closed for user root Aug 05 06:30:45 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-513b4728-2fea-415b-92fe-8340ecd94ebc tempest-VolumeAndVolumeTypeFromImageTest-719304038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6217998e-e88a-45d1-8208-c39ae90fdbe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:30:45 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-29091ef0-840c-452e-91a2-aefdbd1338dd tempest-CreateVolumesFromImageTest-1660354549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-f0f8f15c-516d-4ca3-b7f4-6a69e79f0409 1073741824" returned: 0 in 0.604s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:30:45 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-513b4728-2fea-415b-92fe-8340ecd94ebc tempest-VolumeAndVolumeTypeFromImageTest-719304038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6217998e-e88a-45d1-8208-c39ae90fdbe6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:30:45Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bb219fc-af1f-4eec-b3dc-517d57498a94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8fe921f2e49452b9d0d288e7b5d625e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:30:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:30:45Z,use_quota=True,user_id='0e2ce0fc11f54a20aae5af42617cbe1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e7b9d46f-f815-4f95-8fa5-7e73f338f8ee),volume_type_id=e7b9d46f-f815-4f95-8fa5-7e73f338f8ee)' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:30:45 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-513b4728-2fea-415b-92fe-8340ecd94ebc tempest-VolumeAndVolumeTypeFromImageTest-719304038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25169d43-5cd7-43f9-80b4-95d04aa3f9fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:30:45 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-513b4728-2fea-415b-92fe-8340ecd94ebc tempest-VolumeAndVolumeTypeFromImageTest-719304038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25169d43-5cd7-43f9-80b4-95d04aa3f9fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:30:45 devstack sudo[108309]: pam_unix(sudo:session): session closed for user root Aug 05 06:30:45 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-513b4728-2fea-415b-92fe-8340ecd94ebc tempest-VolumeAndVolumeTypeFromImageTest-719304038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc289d59-700e-4b90-9835-5ba1e5235f4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:30:45 devstack cinder-volume[88695]: DEBUG cinder.image.glance [None req-513b4728-2fea-415b-92fe-8340ecd94ebc tempest-VolumeAndVolumeTypeFromImageTest-719304038 None] Creating Keystone auth plugin from conf {{(pid=88695) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 05 06:30:45 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-8a1fe141-b8c4-440d-b9f7-0cb528ded302 tempest-VolumeImageDependencyTests-768896694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e170712c-b7ea-4f8f-97b5-9b7c6f07a51d_jphm987ndevstack@QuobyteHD" returned: 0 in 0.464s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:30:45 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-8a1fe141-b8c4-440d-b9f7-0cb528ded302 tempest-VolumeImageDependencyTests-768896694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e170712c-b7ea-4f8f-97b5-9b7c6f07a51d_jphm987ndevstack@QuobyteHD {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:30:45 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-29091ef0-840c-452e-91a2-aefdbd1338dd tempest-CreateVolumesFromImageTest-1660354549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-f0f8f15c-516d-4ca3-b7f4-6a69e79f0409 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:30:45 devstack sudo[108317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-f0f8f15c-516d-4ca3-b7f4-6a69e79f0409 Aug 05 06:30:45 devstack sudo[108317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:30:45 devstack sudo[108316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e170712c-b7ea-4f8f-97b5-9b7c6f07a51d_jphm987ndevstack@QuobyteHD Aug 05 06:30:45 devstack sudo[108316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:30:45 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-513b4728-2fea-415b-92fe-8340ecd94ebc tempest-VolumeAndVolumeTypeFromImageTest-719304038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc289d59-700e-4b90-9835-5ba1e5235f4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '9bb219fc-af1f-4eec-b3dc-517d57498a94', 'volume_name': 'volume-9bb219fc-af1f-4eec-b3dc-517d57498a94', 'volume_size': 1, 'image_id': '0070e005-4c44-478a-aa34-8f6476690d5f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0070e005-4c44-478a-aa34-8f6476690d5f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '07633c6825fa1909531552b37b5b8c5e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'f8fe921f2e49452b9d0d288e7b5d625e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6330ee369bb2c3753911b33e2cc228d401b695a725391b7ef6a350c18c20836442e86c8976af0bc8aab7ce114f23f80c8b35d463558d24dc2280fb18c8c004c9', 'id': '0070e005-4c44-478a-aa34-8f6476690d5f', 'created_at': datetime.datetime(2026, 8, 5, 4, 30, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 5, 4, 30, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0070e005-4c44-478a-aa34-8f6476690d5f/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:30:45 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-513b4728-2fea-415b-92fe-8340ecd94ebc tempest-VolumeAndVolumeTypeFromImageTest-719304038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0e96af9-51c2-4a65-bcd0-1a3b28b258d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:30:45 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-513b4728-2fea-415b-92fe-8340ecd94ebc tempest-VolumeAndVolumeTypeFromImageTest-719304038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0e96af9-51c2-4a65-bcd0-1a3b28b258d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:30:45 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-513b4728-2fea-415b-92fe-8340ecd94ebc tempest-VolumeAndVolumeTypeFromImageTest-719304038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fec5fea-f71d-4567-9462-22efbedd415d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:30:45 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-513b4728-2fea-415b-92fe-8340ecd94ebc tempest-VolumeAndVolumeTypeFromImageTest-719304038 None] Volume 9bb219fc-af1f-4eec-b3dc-517d57498a94: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-9bb219fc-af1f-4eec-b3dc-517d57498a94', 'volume_size': 1, 'image_id': '0070e005-4c44-478a-aa34-8f6476690d5f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0070e005-4c44-478a-aa34-8f6476690d5f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '07633c6825fa1909531552b37b5b8c5e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'f8fe921f2e49452b9d0d288e7b5d625e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6330ee369bb2c3753911b33e2cc228d401b695a725391b7ef6a350c18c20836442e86c8976af0bc8aab7ce114f23f80c8b35d463558d24dc2280fb18c8c004c9', 'id': '0070e005-4c44-478a-aa34-8f6476690d5f', 'created_at': datetime.datetime(2026, 8, 5, 4, 30, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 5, 4, 30, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0070e005-4c44-478a-aa34-8f6476690d5f/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Aug 05 06:30:45 devstack cinder-volume[88695]: DEBUG cinder.volume.flows.manager.create_volume [None req-513b4728-2fea-415b-92fe-8340ecd94ebc tempest-VolumeAndVolumeTypeFromImageTest-719304038 None] Trying to clone 9bb219fc-af1f-4eec-b3dc-517d57498a94 from image 0070e005-4c44-478a-aa34-8f6476690d5f at location (None, [{'url': 'file:///opt/stack/data/glance/images/0070e005-4c44-478a-aa34-8f6476690d5f', 'metadata': {}}]). {{(pid=88695) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 05 06:30:45 devstack sudo[108317]: pam_unix(sudo:session): session closed for user root Aug 05 06:30:45 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-29091ef0-840c-452e-91a2-aefdbd1338dd tempest-CreateVolumesFromImageTest-1660354549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-f0f8f15c-516d-4ca3-b7f4-6a69e79f0409" returned: 0 in 0.315s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:30:45 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-29091ef0-840c-452e-91a2-aefdbd1338dd tempest-CreateVolumesFromImageTest-1660354549 None] <== create_volume: return (1034ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'} {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 06:30:45 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-29091ef0-840c-452e-91a2-aefdbd1338dd tempest-CreateVolumesFromImageTest-1660354549 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.037s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:30:45 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-b9f1c32e-b7bb-4d05-b010-0837ab2c0841 tempest-CreateVolumesFromSnapshotTest-2119669264 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.184s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:30:45 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-b9f1c32e-b7bb-4d05-b010-0837ab2c0841 tempest-CreateVolumesFromSnapshotTest-2119669264 None] Creating offline snapshot 37e0b55e-543f-45ce-b8d6-278051035468 of volume 8f20ffa7-b1ae-44bc-840b-e69aad0b54f7 {{(pid=88695) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 06:30:45 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-29091ef0-840c-452e-91a2-aefdbd1338dd tempest-CreateVolumesFromImageTest-1660354549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0227da2-1598-4cee-8c63-f499a652e878) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f0f8f15c-516d-4ca3-b7f4-6a69e79f0409', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:30:45 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-29091ef0-840c-452e-91a2-aefdbd1338dd tempest-CreateVolumesFromImageTest-1660354549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7b9e99c-be97-4d4c-b7d8-7071b216dc43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:30:45 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[24c59f2e-5b07-49be-be4d-3cced4e8a0b9]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:30:45 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-b9f1c32e-b7bb-4d05-b010-0837ab2c0841 tempest-CreateVolumesFromSnapshotTest-2119669264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8f20ffa7-b1ae-44bc-840b-e69aad0b54f7 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:30:45 devstack sudo[108316]: pam_unix(sudo:session): session closed for user root Aug 05 06:30:45 devstack cinder-volume[88695]: DEBUG cinder.image.image_utils [None req-513b4728-2fea-415b-92fe-8340ecd94ebc tempest-VolumeAndVolumeTypeFromImageTest-719304038 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_0070e005-4c44-478a-aa34-8f6476690d5f_ixtyqf7idevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=88695) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 05 06:30:45 devstack cinder-volume[88695]: INFO cinder.image.image_utils [None req-513b4728-2fea-415b-92fe-8340ecd94ebc tempest-VolumeAndVolumeTypeFromImageTest-719304038 None] Image download 0.00 MB at 0.00 MB/s Aug 05 06:30:45 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-29091ef0-840c-452e-91a2-aefdbd1338dd tempest-CreateVolumesFromImageTest-1660354549 None] Volume volume-f0f8f15c-516d-4ca3-b7f4-6a69e79f0409 (f0f8f15c-516d-4ca3-b7f4-6a69e79f0409): created successfully Aug 05 06:30:45 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-29091ef0-840c-452e-91a2-aefdbd1338dd tempest-CreateVolumesFromImageTest-1660354549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7b9e99c-be97-4d4c-b7d8-7071b216dc43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:30:45 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-29091ef0-840c-452e-91a2-aefdbd1338dd tempest-CreateVolumesFromImageTest-1660354549 None] Flow 'volume_create_manager' (1f2edd44-105e-4c20-8783-1e720e4b990e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:30:45 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-8a1fe141-b8c4-440d-b9f7-0cb528ded302 tempest-VolumeImageDependencyTests-768896694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e170712c-b7ea-4f8f-97b5-9b7c6f07a51d_jphm987ndevstack@QuobyteHD" returned: 1 in 0.467s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:30:45 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-8a1fe141-b8c4-440d-b9f7-0cb528ded302 tempest-VolumeImageDependencyTests-768896694 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e170712c-b7ea-4f8f-97b5-9b7c6f07a51d_jphm987ndevstack@QuobyteHD' failed. Not Retrying. {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 05 06:30:45 devstack cinder-volume[88695]: DEBUG cinder.image.image_utils [None req-8a1fe141-b8c4-440d-b9f7-0cb528ded302 tempest-VolumeImageDependencyTests-768896694 None] Temporary image e170712c-b7ea-4f8f-97b5-9b7c6f07a51d is fetched for user affc9b971e604423a363b3a1691e85ec. {{(pid=88695) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 05 06:30:45 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-29091ef0-840c-452e-91a2-aefdbd1338dd tempest-CreateVolumesFromImageTest-1660354549 None] Created volume successfully. Aug 05 06:30:45 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee2f6984-4e6d-4e50-8c37-7ac5cd40bf65]: (4, 'raw') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:30:45 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-513b4728-2fea-415b-92fe-8340ecd94ebc tempest-VolumeAndVolumeTypeFromImageTest-719304038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0070e005-4c44-478a-aa34-8f6476690d5f_ixtyqf7idevstack@QuobyteHD {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:30:45 devstack sudo[108324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8f20ffa7-b1ae-44bc-840b-e69aad0b54f7 Aug 05 06:30:45 devstack sudo[108324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:30:45 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8071458-d1c8-4283-b044-3510c2d73730]: (4, 'raw') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:30:45 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-8a1fe141-b8c4-440d-b9f7-0cb528ded302 tempest-VolumeImageDependencyTests-768896694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e170712c-b7ea-4f8f-97b5-9b7c6f07a51d_jphm987ndevstack@QuobyteHD {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:30:45 devstack sudo[108325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0070e005-4c44-478a-aa34-8f6476690d5f_ixtyqf7idevstack@QuobyteHD Aug 05 06:30:45 devstack sudo[108325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:30:45 devstack sudo[108327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e170712c-b7ea-4f8f-97b5-9b7c6f07a51d_jphm987ndevstack@QuobyteHD Aug 05 06:30:45 devstack sudo[108327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:30:46 devstack sudo[108324]: pam_unix(sudo:session): session closed for user root Aug 05 06:30:46 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-b9f1c32e-b7bb-4d05-b010-0837ab2c0841 tempest-CreateVolumesFromSnapshotTest-2119669264 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8f20ffa7-b1ae-44bc-840b-e69aad0b54f7" returned: 0 in 0.437s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:30:46 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-b9f1c32e-b7bb-4d05-b010-0837ab2c0841 tempest-CreateVolumesFromSnapshotTest-2119669264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8f20ffa7-b1ae-44bc-840b-e69aad0b54f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8f20ffa7-b1ae-44bc-840b-e69aad0b54f7.37e0b55e-543f-45ce-b8d6-278051035468 1G {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:30:46 devstack sudo[108335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8f20ffa7-b1ae-44bc-840b-e69aad0b54f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8f20ffa7-b1ae-44bc-840b-e69aad0b54f7.37e0b55e-543f-45ce-b8d6-278051035468 1G Aug 05 06:30:46 devstack sudo[108335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:30:46 devstack sudo[108325]: pam_unix(sudo:session): session closed for user root Aug 05 06:30:46 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-513b4728-2fea-415b-92fe-8340ecd94ebc tempest-VolumeAndVolumeTypeFromImageTest-719304038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0070e005-4c44-478a-aa34-8f6476690d5f_ixtyqf7idevstack@QuobyteHD" returned: 0 in 0.406s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:30:46 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-513b4728-2fea-415b-92fe-8340ecd94ebc tempest-VolumeAndVolumeTypeFromImageTest-719304038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0070e005-4c44-478a-aa34-8f6476690d5f_ixtyqf7idevstack@QuobyteHD {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:30:46 devstack sudo[108327]: pam_unix(sudo:session): session closed for user root Aug 05 06:30:46 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-8a1fe141-b8c4-440d-b9f7-0cb528ded302 tempest-VolumeImageDependencyTests-768896694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e170712c-b7ea-4f8f-97b5-9b7c6f07a51d_jphm987ndevstack@QuobyteHD" returned: 0 in 0.376s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:30:46 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-8a1fe141-b8c4-440d-b9f7-0cb528ded302 tempest-VolumeImageDependencyTests-768896694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e170712c-b7ea-4f8f-97b5-9b7c6f07a51d_jphm987ndevstack@QuobyteHD {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:30:46 devstack sudo[108339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0070e005-4c44-478a-aa34-8f6476690d5f_ixtyqf7idevstack@QuobyteHD Aug 05 06:30:46 devstack sudo[108339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:30:46 devstack sudo[108340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e170712c-b7ea-4f8f-97b5-9b7c6f07a51d_jphm987ndevstack@QuobyteHD Aug 05 06:30:46 devstack sudo[108340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:30:46 devstack sudo[108339]: pam_unix(sudo:session): session closed for user root Aug 05 06:30:46 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-513b4728-2fea-415b-92fe-8340ecd94ebc tempest-VolumeAndVolumeTypeFromImageTest-719304038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0070e005-4c44-478a-aa34-8f6476690d5f_ixtyqf7idevstack@QuobyteHD" returned: 1 in 0.382s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:30:46 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-513b4728-2fea-415b-92fe-8340ecd94ebc tempest-VolumeAndVolumeTypeFromImageTest-719304038 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0070e005-4c44-478a-aa34-8f6476690d5f_ixtyqf7idevstack@QuobyteHD' failed. Not Retrying. {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 05 06:30:46 devstack cinder-volume[88695]: DEBUG cinder.image.image_utils [None req-513b4728-2fea-415b-92fe-8340ecd94ebc tempest-VolumeAndVolumeTypeFromImageTest-719304038 None] Temporary image 0070e005-4c44-478a-aa34-8f6476690d5f is fetched for user 0e2ce0fc11f54a20aae5af42617cbe1a. {{(pid=88695) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 05 06:30:46 devstack sudo[108340]: pam_unix(sudo:session): session closed for user root Aug 05 06:30:46 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-8a1fe141-b8c4-440d-b9f7-0cb528ded302 tempest-VolumeImageDependencyTests-768896694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e170712c-b7ea-4f8f-97b5-9b7c6f07a51d_jphm987ndevstack@QuobyteHD" returned: 1 in 0.375s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:30:46 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-8a1fe141-b8c4-440d-b9f7-0cb528ded302 tempest-VolumeImageDependencyTests-768896694 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e170712c-b7ea-4f8f-97b5-9b7c6f07a51d_jphm987ndevstack@QuobyteHD' failed. Not Retrying. {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 05 06:30:46 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-8a1fe141-b8c4-440d-b9f7-0cb528ded302 tempest-VolumeImageDependencyTests-768896694 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:30:46 devstack sudo[108335]: pam_unix(sudo:session): session closed for user root Aug 05 06:30:46 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-b9f1c32e-b7bb-4d05-b010-0837ab2c0841 tempest-CreateVolumesFromSnapshotTest-2119669264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8f20ffa7-b1ae-44bc-840b-e69aad0b54f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8f20ffa7-b1ae-44bc-840b-e69aad0b54f7.37e0b55e-543f-45ce-b8d6-278051035468 1G" returned: 0 in 0.478s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:30:46 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-b9f1c32e-b7bb-4d05-b010-0837ab2c0841 tempest-CreateVolumesFromSnapshotTest-2119669264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8f20ffa7-b1ae-44bc-840b-e69aad0b54f7 -F qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8f20ffa7-b1ae-44bc-840b-e69aad0b54f7.37e0b55e-543f-45ce-b8d6-278051035468 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:30:46 devstack sudo[108353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8f20ffa7-b1ae-44bc-840b-e69aad0b54f7 -F qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8f20ffa7-b1ae-44bc-840b-e69aad0b54f7.37e0b55e-543f-45ce-b8d6-278051035468 Aug 05 06:30:46 devstack sudo[108353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:30:46 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e950d4b-8a2d-4c63-bef4-2a38fb5e118e]: (4, 'raw') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:30:46 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-513b4728-2fea-415b-92fe-8340ecd94ebc tempest-VolumeAndVolumeTypeFromImageTest-719304038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0070e005-4c44-478a-aa34-8f6476690d5f_ixtyqf7idevstack@QuobyteHD {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:30:46 devstack sudo[108355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0070e005-4c44-478a-aa34-8f6476690d5f_ixtyqf7idevstack@QuobyteHD Aug 05 06:30:46 devstack sudo[108355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:30:46 devstack sudo[108353]: pam_unix(sudo:session): session closed for user root Aug 05 06:30:46 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-b9f1c32e-b7bb-4d05-b010-0837ab2c0841 tempest-CreateVolumesFromSnapshotTest-2119669264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8f20ffa7-b1ae-44bc-840b-e69aad0b54f7 -F qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8f20ffa7-b1ae-44bc-840b-e69aad0b54f7.37e0b55e-543f-45ce-b8d6-278051035468" returned: 0 in 0.319s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:30:46 devstack cinder-volume[88695]: WARNING cinder.volume.drivers.remotefs [None req-b9f1c32e-b7bb-4d05-b010-0837ab2c0841 tempest-CreateVolumesFromSnapshotTest-2119669264 None] /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8f20ffa7-b1ae-44bc-840b-e69aad0b54f7.37e0b55e-543f-45ce-b8d6-278051035468 is being set with open permissions: ugo+rw Aug 05 06:30:46 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-b9f1c32e-b7bb-4d05-b010-0837ab2c0841 tempest-CreateVolumesFromSnapshotTest-2119669264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8f20ffa7-b1ae-44bc-840b-e69aad0b54f7.37e0b55e-543f-45ce-b8d6-278051035468 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:30:46 devstack sudo[108360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8f20ffa7-b1ae-44bc-840b-e69aad0b54f7.37e0b55e-543f-45ce-b8d6-278051035468 Aug 05 06:30:46 devstack sudo[108360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:30:47 devstack sudo[108355]: pam_unix(sudo:session): session closed for user root Aug 05 06:30:47 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-513b4728-2fea-415b-92fe-8340ecd94ebc tempest-VolumeAndVolumeTypeFromImageTest-719304038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0070e005-4c44-478a-aa34-8f6476690d5f_ixtyqf7idevstack@QuobyteHD" returned: 0 in 0.367s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:30:47 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-513b4728-2fea-415b-92fe-8340ecd94ebc tempest-VolumeAndVolumeTypeFromImageTest-719304038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0070e005-4c44-478a-aa34-8f6476690d5f_ixtyqf7idevstack@QuobyteHD {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:30:47 devstack sudo[108364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0070e005-4c44-478a-aa34-8f6476690d5f_ixtyqf7idevstack@QuobyteHD Aug 05 06:30:47 devstack sudo[108364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:30:47 devstack sudo[108360]: pam_unix(sudo:session): session closed for user root Aug 05 06:30:47 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-b9f1c32e-b7bb-4d05-b010-0837ab2c0841 tempest-CreateVolumesFromSnapshotTest-2119669264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8f20ffa7-b1ae-44bc-840b-e69aad0b54f7.37e0b55e-543f-45ce-b8d6-278051035468" returned: 0 in 0.249s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:30:47 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-b9f1c32e-b7bb-4d05-b010-0837ab2c0841 tempest-CreateVolumesFromSnapshotTest-2119669264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8f20ffa7-b1ae-44bc-840b-e69aad0b54f7.info {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:30:47 devstack sudo[108367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8f20ffa7-b1ae-44bc-840b-e69aad0b54f7.info Aug 05 06:30:47 devstack sudo[108367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:30:47 devstack sudo[108364]: pam_unix(sudo:session): session closed for user root Aug 05 06:30:47 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-513b4728-2fea-415b-92fe-8340ecd94ebc tempest-VolumeAndVolumeTypeFromImageTest-719304038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0070e005-4c44-478a-aa34-8f6476690d5f_ixtyqf7idevstack@QuobyteHD" returned: 1 in 0.370s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:30:47 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-513b4728-2fea-415b-92fe-8340ecd94ebc tempest-VolumeAndVolumeTypeFromImageTest-719304038 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0070e005-4c44-478a-aa34-8f6476690d5f_ixtyqf7idevstack@QuobyteHD' failed. Not Retrying. {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 05 06:30:47 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-513b4728-2fea-415b-92fe-8340ecd94ebc tempest-VolumeAndVolumeTypeFromImageTest-719304038 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:30:47 devstack sudo[108367]: pam_unix(sudo:session): session closed for user root Aug 05 06:30:47 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-b9f1c32e-b7bb-4d05-b010-0837ab2c0841 tempest-CreateVolumesFromSnapshotTest-2119669264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8f20ffa7-b1ae-44bc-840b-e69aad0b54f7.info" returned: 0 in 0.273s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:30:47 devstack cinder-volume[88695]: WARNING cinder.volume.drivers.remotefs [None req-b9f1c32e-b7bb-4d05-b010-0837ab2c0841 tempest-CreateVolumesFromSnapshotTest-2119669264 None] /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8f20ffa7-b1ae-44bc-840b-e69aad0b54f7.info is being set with open permissions: ugo+rw Aug 05 06:30:47 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-b9f1c32e-b7bb-4d05-b010-0837ab2c0841 tempest-CreateVolumesFromSnapshotTest-2119669264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8f20ffa7-b1ae-44bc-840b-e69aad0b54f7.info {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:30:47 devstack sudo[108373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8f20ffa7-b1ae-44bc-840b-e69aad0b54f7.info Aug 05 06:30:47 devstack sudo[108373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:30:47 devstack sudo[108373]: pam_unix(sudo:session): session closed for user root Aug 05 06:30:47 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-b9f1c32e-b7bb-4d05-b010-0837ab2c0841 tempest-CreateVolumesFromSnapshotTest-2119669264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8f20ffa7-b1ae-44bc-840b-e69aad0b54f7.info" returned: 0 in 0.246s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:30:47 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-b9f1c32e-b7bb-4d05-b010-0837ab2c0841 tempest-CreateVolumesFromSnapshotTest-2119669264 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.125s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:30:47 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-32b1c456-f8d2-40d9-be61-9327b70a6815 tempest-CreateVolumesFromImageTest-1660354549 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.584s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:30:47 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-32b1c456-f8d2-40d9-be61-9327b70a6815 tempest-CreateVolumesFromImageTest-1660354549 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:30:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1235634212',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=beba6f32-c79c-4797-969a-46016e63a73e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfbd90e005004d19acde625aad4388ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:30:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:30:43Z,use_quota=True,user_id='614c086a634842d0a936701bac2b12b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)}" {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 06:30:47 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-32b1c456-f8d2-40d9-be61-9327b70a6815 tempest-CreateVolumesFromImageTest-1660354549 None] Creating volume beba6f32-c79c-4797-969a-46016e63a73e {{(pid=88695) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 06:30:47 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-32b1c456-f8d2-40d9-be61-9327b70a6815 tempest-CreateVolumesFromImageTest-1660354549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:30:47 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-32b1c456-f8d2-40d9-be61-9327b70a6815 tempest-CreateVolumesFromImageTest-1660354549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:30:47 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-32b1c456-f8d2-40d9-be61-9327b70a6815 tempest-CreateVolumesFromImageTest-1660354549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:30:47 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-32b1c456-f8d2-40d9-be61-9327b70a6815 tempest-CreateVolumesFromImageTest-1660354549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:30:47 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-32b1c456-f8d2-40d9-be61-9327b70a6815 tempest-CreateVolumesFromImageTest-1660354549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:30:47 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-32b1c456-f8d2-40d9-be61-9327b70a6815 tempest-CreateVolumesFromImageTest-1660354549 None] Selected osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 as target Quobyte volume. {{(pid=88695) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 06:30:47 devstack cinder-volume[88695]: INFO cinder.volume.drivers.remotefs [None req-32b1c456-f8d2-40d9-be61-9327b70a6815 tempest-CreateVolumesFromImageTest-1660354549 None] casted to osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 Aug 05 06:30:47 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-32b1c456-f8d2-40d9-be61-9327b70a6815 tempest-CreateVolumesFromImageTest-1660354549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-beba6f32-c79c-4797-969a-46016e63a73e 1073741824 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:30:47 devstack sudo[108376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-beba6f32-c79c-4797-969a-46016e63a73e 1073741824 Aug 05 06:30:47 devstack sudo[108376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:30:47 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-b9f1c32e-b7bb-4d05-b010-0837ab2c0841 tempest-CreateVolumesFromSnapshotTest-2119669264 None] Create snapshot completed successfully Aug 05 06:30:48 devstack sudo[108376]: pam_unix(sudo:session): session closed for user root Aug 05 06:30:48 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-32b1c456-f8d2-40d9-be61-9327b70a6815 tempest-CreateVolumesFromImageTest-1660354549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-beba6f32-c79c-4797-969a-46016e63a73e 1073741824" returned: 0 in 0.406s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:30:48 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-32b1c456-f8d2-40d9-be61-9327b70a6815 tempest-CreateVolumesFromImageTest-1660354549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-beba6f32-c79c-4797-969a-46016e63a73e {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:30:48 devstack sudo[108382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-beba6f32-c79c-4797-969a-46016e63a73e Aug 05 06:30:48 devstack sudo[108382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:30:48 devstack sudo[108382]: pam_unix(sudo:session): session closed for user root Aug 05 06:30:48 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-32b1c456-f8d2-40d9-be61-9327b70a6815 tempest-CreateVolumesFromImageTest-1660354549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-beba6f32-c79c-4797-969a-46016e63a73e" returned: 0 in 0.269s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:30:48 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-32b1c456-f8d2-40d9-be61-9327b70a6815 tempest-CreateVolumesFromImageTest-1660354549 None] <== create_volume: return (714ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'} {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 06:30:48 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-32b1c456-f8d2-40d9-be61-9327b70a6815 tempest-CreateVolumesFromImageTest-1660354549 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.717s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:30:48 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-8a1fe141-b8c4-440d-b9f7-0cb528ded302 tempest-VolumeImageDependencyTests-768896694 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.892s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:30:48 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-8a1fe141-b8c4-440d-b9f7-0cb528ded302 tempest-VolumeImageDependencyTests-768896694 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:30:44Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a48e355-7f38-41fc-8930-a87861389946,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1362d38ef5545ecad2e547c10164bf8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:30:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:30:44Z,use_quota=True,user_id='affc9b971e604423a363b3a1691e85ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)}" {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 06:30:48 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-8a1fe141-b8c4-440d-b9f7-0cb528ded302 tempest-VolumeImageDependencyTests-768896694 None] Creating volume 1a48e355-7f38-41fc-8930-a87861389946 {{(pid=88695) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 06:30:48 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-8a1fe141-b8c4-440d-b9f7-0cb528ded302 tempest-VolumeImageDependencyTests-768896694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:30:48 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-8a1fe141-b8c4-440d-b9f7-0cb528ded302 tempest-VolumeImageDependencyTests-768896694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:30:48 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-8a1fe141-b8c4-440d-b9f7-0cb528ded302 tempest-VolumeImageDependencyTests-768896694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:30:48 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-8a1fe141-b8c4-440d-b9f7-0cb528ded302 tempest-VolumeImageDependencyTests-768896694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:30:48 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-8a1fe141-b8c4-440d-b9f7-0cb528ded302 tempest-VolumeImageDependencyTests-768896694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:30:48 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-8a1fe141-b8c4-440d-b9f7-0cb528ded302 tempest-VolumeImageDependencyTests-768896694 None] Selected osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 as target Quobyte volume. {{(pid=88695) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 06:30:48 devstack cinder-volume[88695]: INFO cinder.volume.drivers.remotefs [None req-8a1fe141-b8c4-440d-b9f7-0cb528ded302 tempest-VolumeImageDependencyTests-768896694 None] casted to osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 Aug 05 06:30:48 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-8a1fe141-b8c4-440d-b9f7-0cb528ded302 tempest-VolumeImageDependencyTests-768896694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-1a48e355-7f38-41fc-8930-a87861389946 1073741824 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:30:48 devstack sudo[108386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-1a48e355-7f38-41fc-8930-a87861389946 1073741824 Aug 05 06:30:48 devstack sudo[108386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:30:48 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-32b1c456-f8d2-40d9-be61-9327b70a6815 tempest-CreateVolumesFromImageTest-1660354549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63a40bfd-677f-4ff1-bdfe-81c622131859) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-beba6f32-c79c-4797-969a-46016e63a73e', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:30:48 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-32b1c456-f8d2-40d9-be61-9327b70a6815 tempest-CreateVolumesFromImageTest-1660354549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d571d963-fea9-495e-903e-eb0ac54bd68a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:30:48 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-32b1c456-f8d2-40d9-be61-9327b70a6815 tempest-CreateVolumesFromImageTest-1660354549 None] Volume volume-beba6f32-c79c-4797-969a-46016e63a73e (beba6f32-c79c-4797-969a-46016e63a73e): created successfully Aug 05 06:30:48 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-32b1c456-f8d2-40d9-be61-9327b70a6815 tempest-CreateVolumesFromImageTest-1660354549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d571d963-fea9-495e-903e-eb0ac54bd68a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:30:48 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-32b1c456-f8d2-40d9-be61-9327b70a6815 tempest-CreateVolumesFromImageTest-1660354549 None] Flow 'volume_create_manager' (b34288a0-26f7-4357-8d6c-5e38b75fb089) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:30:48 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-32b1c456-f8d2-40d9-be61-9327b70a6815 tempest-CreateVolumesFromImageTest-1660354549 None] Created volume successfully. Aug 05 06:30:48 devstack sudo[108386]: pam_unix(sudo:session): session closed for user root Aug 05 06:30:48 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-8a1fe141-b8c4-440d-b9f7-0cb528ded302 tempest-VolumeImageDependencyTests-768896694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-1a48e355-7f38-41fc-8930-a87861389946 1073741824" returned: 0 in 0.453s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:30:49 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-8a1fe141-b8c4-440d-b9f7-0cb528ded302 tempest-VolumeImageDependencyTests-768896694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-1a48e355-7f38-41fc-8930-a87861389946 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:30:49 devstack sudo[108392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-1a48e355-7f38-41fc-8930-a87861389946 Aug 05 06:30:49 devstack sudo[108392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:30:49 devstack cinder-volume[88695]: DEBUG cinder.volume.flows.manager.create_volume [None req-15dc1360-a27b-4e92-8c0e-6a0a6f7711da tempest-CreateVolumesFromSnapshotTest-2119669264 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88695) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 06:30:49 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-15dc1360-a27b-4e92-8c0e-6a0a6f7711da tempest-CreateVolumesFromSnapshotTest-2119669264 None] Flow 'volume_create_manager' (e4b346eb-20c2-43fa-88e7-819adbe42b08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:30:49 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-15dc1360-a27b-4e92-8c0e-6a0a6f7711da tempest-CreateVolumesFromSnapshotTest-2119669264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ece9d80-4f2c-4afe-8269-83242aa52431) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:30:49 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-15dc1360-a27b-4e92-8c0e-6a0a6f7711da tempest-CreateVolumesFromSnapshotTest-2119669264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ece9d80-4f2c-4afe-8269-83242aa52431) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:30:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-968016741',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6a1f0a3-9533-4004-a009-213a3e8c4b2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ed354397e4746949a3143134c0f9610',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:30:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:30:49Z,use_quota=True,user_id='3f4a957b9fec41f2a34ccfbae96acc10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:30:49 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-15dc1360-a27b-4e92-8c0e-6a0a6f7711da tempest-CreateVolumesFromSnapshotTest-2119669264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfad4f5a-564c-43e8-8f1c-99dcb419de5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:30:49 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-15dc1360-a27b-4e92-8c0e-6a0a6f7711da tempest-CreateVolumesFromSnapshotTest-2119669264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfad4f5a-564c-43e8-8f1c-99dcb419de5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:30:49 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-15dc1360-a27b-4e92-8c0e-6a0a6f7711da tempest-CreateVolumesFromSnapshotTest-2119669264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32a67259-fa6f-445b-b2ff-7904d934a802) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:30:49 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-15dc1360-a27b-4e92-8c0e-6a0a6f7711da tempest-CreateVolumesFromSnapshotTest-2119669264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32a67259-fa6f-445b-b2ff-7904d934a802) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e6a1f0a3-9533-4004-a009-213a3e8c4b2e', 'volume_name': 'volume-e6a1f0a3-9533-4004-a009-213a3e8c4b2e', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:30:49 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-15dc1360-a27b-4e92-8c0e-6a0a6f7711da tempest-CreateVolumesFromSnapshotTest-2119669264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d77e97db-96b9-499e-98ee-9d474ccf491a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:30:49 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-15dc1360-a27b-4e92-8c0e-6a0a6f7711da tempest-CreateVolumesFromSnapshotTest-2119669264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d77e97db-96b9-499e-98ee-9d474ccf491a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:30:49 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-15dc1360-a27b-4e92-8c0e-6a0a6f7711da tempest-CreateVolumesFromSnapshotTest-2119669264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e09cf280-fbc3-47a9-8d66-5265954fadd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:30:49 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-15dc1360-a27b-4e92-8c0e-6a0a6f7711da tempest-CreateVolumesFromSnapshotTest-2119669264 None] Volume e6a1f0a3-9533-4004-a009-213a3e8c4b2e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e6a1f0a3-9533-4004-a009-213a3e8c4b2e', 'volume_size': 1} Aug 05 06:30:49 devstack sudo[108392]: pam_unix(sudo:session): session closed for user root Aug 05 06:30:49 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-15dc1360-a27b-4e92-8c0e-6a0a6f7711da tempest-CreateVolumesFromSnapshotTest-2119669264 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:30:49 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-8a1fe141-b8c4-440d-b9f7-0cb528ded302 tempest-VolumeImageDependencyTests-768896694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-1a48e355-7f38-41fc-8930-a87861389946" returned: 0 in 0.301s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:30:49 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-8a1fe141-b8c4-440d-b9f7-0cb528ded302 tempest-VolumeImageDependencyTests-768896694 None] <== create_volume: return (803ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'} {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 06:30:49 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-8a1fe141-b8c4-440d-b9f7-0cb528ded302 tempest-VolumeImageDependencyTests-768896694 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.806s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:30:49 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-513b4728-2fea-415b-92fe-8340ecd94ebc tempest-VolumeAndVolumeTypeFromImageTest-719304038 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.895s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:30:49 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-513b4728-2fea-415b-92fe-8340ecd94ebc tempest-VolumeAndVolumeTypeFromImageTest-719304038 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:30:45Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bb219fc-af1f-4eec-b3dc-517d57498a94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8fe921f2e49452b9d0d288e7b5d625e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:30:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:30:45Z,use_quota=True,user_id='0e2ce0fc11f54a20aae5af42617cbe1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e7b9d46f-f815-4f95-8fa5-7e73f338f8ee),volume_type_id=e7b9d46f-f815-4f95-8fa5-7e73f338f8ee)}" {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 06:30:49 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-513b4728-2fea-415b-92fe-8340ecd94ebc tempest-VolumeAndVolumeTypeFromImageTest-719304038 None] Creating volume 9bb219fc-af1f-4eec-b3dc-517d57498a94 {{(pid=88695) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 06:30:49 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-513b4728-2fea-415b-92fe-8340ecd94ebc tempest-VolumeAndVolumeTypeFromImageTest-719304038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:30:49 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-513b4728-2fea-415b-92fe-8340ecd94ebc tempest-VolumeAndVolumeTypeFromImageTest-719304038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:30:49 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-513b4728-2fea-415b-92fe-8340ecd94ebc tempest-VolumeAndVolumeTypeFromImageTest-719304038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:30:49 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-513b4728-2fea-415b-92fe-8340ecd94ebc tempest-VolumeAndVolumeTypeFromImageTest-719304038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:30:49 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-513b4728-2fea-415b-92fe-8340ecd94ebc tempest-VolumeAndVolumeTypeFromImageTest-719304038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:30:49 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-513b4728-2fea-415b-92fe-8340ecd94ebc tempest-VolumeAndVolumeTypeFromImageTest-719304038 None] Selected osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 as target Quobyte volume. {{(pid=88695) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 06:30:49 devstack cinder-volume[88695]: INFO cinder.volume.drivers.remotefs [None req-513b4728-2fea-415b-92fe-8340ecd94ebc tempest-VolumeAndVolumeTypeFromImageTest-719304038 None] casted to osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 Aug 05 06:30:49 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-513b4728-2fea-415b-92fe-8340ecd94ebc tempest-VolumeAndVolumeTypeFromImageTest-719304038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9bb219fc-af1f-4eec-b3dc-517d57498a94 1073741824 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:30:49 devstack sudo[108395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9bb219fc-af1f-4eec-b3dc-517d57498a94 1073741824 Aug 05 06:30:49 devstack sudo[108395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:30:49 devstack cinder-volume[88695]: DEBUG cinder.volume.volume_utils [None req-8a1fe141-b8c4-440d-b9f7-0cb528ded302 tempest-VolumeImageDependencyTests-768896694 None] Attempting download of e170712c-b7ea-4f8f-97b5-9b7c6f07a51d ((None, [{'url': 'file:///opt/stack/data/glance/images/e170712c-b7ea-4f8f-97b5-9b7c6f07a51d', 'metadata': {}}])) to volume 1a48e355-7f38-41fc-8930-a87861389946. {{(pid=88695) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 05 06:30:49 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[a62efb49-a449-4149-a54c-6149f4d0e21d]: (4, 'raw') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:30:49 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-8a1fe141-b8c4-440d-b9f7-0cb528ded302 tempest-VolumeImageDependencyTests-768896694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e170712c-b7ea-4f8f-97b5-9b7c6f07a51d_u3wwa00e {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:30:49 devstack sudo[108397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e170712c-b7ea-4f8f-97b5-9b7c6f07a51d_u3wwa00e Aug 05 06:30:49 devstack sudo[108397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:30:49 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-6dd27d5e-7df9-4e4b-86e7-ef180ef5a94f tempest-CreateVolumesFromImageTest-1660354549 None] Acquiring lock "cinder-beba6f32-c79c-4797-969a-46016e63a73e-delete_volume" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:30:49 devstack cinder-volume[88695]: DEBUG cinder.volume.flows.manager.create_volume [None req-57d9e710-1f15-46cb-a702-a24ba21e7ca2 tempest-CreateVolumesFromSnapshotTest-2119669264 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88695) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 06:30:49 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-57d9e710-1f15-46cb-a702-a24ba21e7ca2 tempest-CreateVolumesFromSnapshotTest-2119669264 None] Flow 'volume_create_manager' (c8894459-c457-4572-9653-5cf5445a5b8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:30:49 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-57d9e710-1f15-46cb-a702-a24ba21e7ca2 tempest-CreateVolumesFromSnapshotTest-2119669264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e440d94-d376-46d4-98fc-21ebc9933e76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:30:49 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-6dd27d5e-7df9-4e4b-86e7-ef180ef5a94f tempest-CreateVolumesFromImageTest-1660354549 None] Lock "cinder-beba6f32-c79c-4797-969a-46016e63a73e-delete_volume" acquired by "delete_volume" :: waited 0.111s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:30:49 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-57d9e710-1f15-46cb-a702-a24ba21e7ca2 tempest-CreateVolumesFromSnapshotTest-2119669264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e440d94-d376-46d4-98fc-21ebc9933e76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:30:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1028110024',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03d7382d-6a9f-428c-9c20-ce26215b4baa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ed354397e4746949a3143134c0f9610',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:30:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:30:50Z,use_quota=True,user_id='3f4a957b9fec41f2a34ccfbae96acc10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:30:49 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-57d9e710-1f15-46cb-a702-a24ba21e7ca2 tempest-CreateVolumesFromSnapshotTest-2119669264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (283fd7d5-75ee-41b4-94c3-d8f1808745c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:30:49 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-57d9e710-1f15-46cb-a702-a24ba21e7ca2 tempest-CreateVolumesFromSnapshotTest-2119669264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (283fd7d5-75ee-41b4-94c3-d8f1808745c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:30:49 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-57d9e710-1f15-46cb-a702-a24ba21e7ca2 tempest-CreateVolumesFromSnapshotTest-2119669264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8be56e65-7481-4290-8758-c6ec1bfd9914) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:30:49 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-57d9e710-1f15-46cb-a702-a24ba21e7ca2 tempest-CreateVolumesFromSnapshotTest-2119669264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8be56e65-7481-4290-8758-c6ec1bfd9914) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '03d7382d-6a9f-428c-9c20-ce26215b4baa', 'volume_name': 'volume-03d7382d-6a9f-428c-9c20-ce26215b4baa', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:30:49 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-57d9e710-1f15-46cb-a702-a24ba21e7ca2 tempest-CreateVolumesFromSnapshotTest-2119669264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25d712ad-2acc-44b8-a8bc-7f817a4a975e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:30:49 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-57d9e710-1f15-46cb-a702-a24ba21e7ca2 tempest-CreateVolumesFromSnapshotTest-2119669264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25d712ad-2acc-44b8-a8bc-7f817a4a975e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:30:49 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-57d9e710-1f15-46cb-a702-a24ba21e7ca2 tempest-CreateVolumesFromSnapshotTest-2119669264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6609e0af-cf9b-4151-b88e-3156ec1af171) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:30:49 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-57d9e710-1f15-46cb-a702-a24ba21e7ca2 tempest-CreateVolumesFromSnapshotTest-2119669264 None] Volume 03d7382d-6a9f-428c-9c20-ce26215b4baa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-03d7382d-6a9f-428c-9c20-ce26215b4baa', 'volume_size': 1} Aug 05 06:30:49 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-57d9e710-1f15-46cb-a702-a24ba21e7ca2 tempest-CreateVolumesFromSnapshotTest-2119669264 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:30:49 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-6dd27d5e-7df9-4e4b-86e7-ef180ef5a94f tempest-CreateVolumesFromImageTest-1660354549 None] Acquiring lock "cinder-quobyte-beba6f32-c79c-4797-969a-46016e63a73e" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:30:49 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-6dd27d5e-7df9-4e4b-86e7-ef180ef5a94f tempest-CreateVolumesFromImageTest-1660354549 None] Lock "cinder-quobyte-beba6f32-c79c-4797-969a-46016e63a73e" acquired by "delete_volume" :: waited 0.019s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:30:49 devstack sudo[108397]: pam_unix(sudo:session): session closed for user root Aug 05 06:30:49 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-8a1fe141-b8c4-440d-b9f7-0cb528ded302 tempest-VolumeImageDependencyTests-768896694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e170712c-b7ea-4f8f-97b5-9b7c6f07a51d_u3wwa00e" returned: 0 in 0.464s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:30:49 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-8a1fe141-b8c4-440d-b9f7-0cb528ded302 tempest-VolumeImageDependencyTests-768896694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e170712c-b7ea-4f8f-97b5-9b7c6f07a51d_u3wwa00e {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:30:49 devstack sudo[108395]: pam_unix(sudo:session): session closed for user root Aug 05 06:30:49 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ff8ba8e-f802-40d2-b2c5-b91eb87eb515]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:30:49 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-6dd27d5e-7df9-4e4b-86e7-ef180ef5a94f tempest-CreateVolumesFromImageTest-1660354549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-beba6f32-c79c-4797-969a-46016e63a73e {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:30:49 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-513b4728-2fea-415b-92fe-8340ecd94ebc tempest-VolumeAndVolumeTypeFromImageTest-719304038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9bb219fc-af1f-4eec-b3dc-517d57498a94 1073741824" returned: 0 in 0.636s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:30:50 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-513b4728-2fea-415b-92fe-8340ecd94ebc tempest-VolumeAndVolumeTypeFromImageTest-719304038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9bb219fc-af1f-4eec-b3dc-517d57498a94 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:30:50 devstack sudo[108407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9bb219fc-af1f-4eec-b3dc-517d57498a94 Aug 05 06:30:50 devstack sudo[108407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:30:50 devstack sudo[108405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e170712c-b7ea-4f8f-97b5-9b7c6f07a51d_u3wwa00e Aug 05 06:30:50 devstack sudo[108405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:30:50 devstack sudo[108406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-beba6f32-c79c-4797-969a-46016e63a73e Aug 05 06:30:50 devstack sudo[108406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:30:50 devstack cinder-volume[88695]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b826ef7-9ae6-4e15-a581-d3396ce92e03 tempest-CreateVolumesFromSnapshotTest-2119669264 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88695) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 06:30:50 devstack sudo[108405]: pam_unix(sudo:session): session closed for user root Aug 05 06:30:50 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-3b826ef7-9ae6-4e15-a581-d3396ce92e03 tempest-CreateVolumesFromSnapshotTest-2119669264 None] Flow 'volume_create_manager' (dca8b236-7e02-4434-b7d1-cf95d950a1a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:30:50 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-3b826ef7-9ae6-4e15-a581-d3396ce92e03 tempest-CreateVolumesFromSnapshotTest-2119669264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8b37cde-2845-4c23-b5a5-6e9f8fee9e00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:30:50 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-8a1fe141-b8c4-440d-b9f7-0cb528ded302 tempest-VolumeImageDependencyTests-768896694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e170712c-b7ea-4f8f-97b5-9b7c6f07a51d_u3wwa00e" returned: 1 in 0.435s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:30:50 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-8a1fe141-b8c4-440d-b9f7-0cb528ded302 tempest-VolumeImageDependencyTests-768896694 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e170712c-b7ea-4f8f-97b5-9b7c6f07a51d_u3wwa00e' failed. Not Retrying. {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 05 06:30:50 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[220e7ccc-a15e-4b4d-bf36-7263b1ff101a]: (4, 'raw') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:30:50 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-8a1fe141-b8c4-440d-b9f7-0cb528ded302 tempest-VolumeImageDependencyTests-768896694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e170712c-b7ea-4f8f-97b5-9b7c6f07a51d_jphm987ndevstack@QuobyteHD {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:30:50 devstack sudo[108407]: pam_unix(sudo:session): session closed for user root Aug 05 06:30:50 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-3b826ef7-9ae6-4e15-a581-d3396ce92e03 tempest-CreateVolumesFromSnapshotTest-2119669264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8b37cde-2845-4c23-b5a5-6e9f8fee9e00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:30:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-461866323',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a095fb1-8ad2-4938-8598-8d3af510338a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ed354397e4746949a3143134c0f9610',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:30:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:30:50Z,use_quota=True,user_id='3f4a957b9fec41f2a34ccfbae96acc10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:30:50 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-3b826ef7-9ae6-4e15-a581-d3396ce92e03 tempest-CreateVolumesFromSnapshotTest-2119669264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d44b956c-cc69-43b4-8a77-779647011acc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:30:50 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-3b826ef7-9ae6-4e15-a581-d3396ce92e03 tempest-CreateVolumesFromSnapshotTest-2119669264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d44b956c-cc69-43b4-8a77-779647011acc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:30:50 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-3b826ef7-9ae6-4e15-a581-d3396ce92e03 tempest-CreateVolumesFromSnapshotTest-2119669264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7740a5d1-e3d4-4639-a726-904a53d823f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:30:50 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-3b826ef7-9ae6-4e15-a581-d3396ce92e03 tempest-CreateVolumesFromSnapshotTest-2119669264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7740a5d1-e3d4-4639-a726-904a53d823f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a095fb1-8ad2-4938-8598-8d3af510338a', 'volume_name': 'volume-1a095fb1-8ad2-4938-8598-8d3af510338a', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:30:50 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-3b826ef7-9ae6-4e15-a581-d3396ce92e03 tempest-CreateVolumesFromSnapshotTest-2119669264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b3f2882-4aac-4fa7-9e40-aa702a813e16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:30:50 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-3b826ef7-9ae6-4e15-a581-d3396ce92e03 tempest-CreateVolumesFromSnapshotTest-2119669264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b3f2882-4aac-4fa7-9e40-aa702a813e16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:30:50 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-3b826ef7-9ae6-4e15-a581-d3396ce92e03 tempest-CreateVolumesFromSnapshotTest-2119669264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0411630-97b6-4416-83fb-206545ee67a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:30:50 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-3b826ef7-9ae6-4e15-a581-d3396ce92e03 tempest-CreateVolumesFromSnapshotTest-2119669264 None] Volume 1a095fb1-8ad2-4938-8598-8d3af510338a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a095fb1-8ad2-4938-8598-8d3af510338a', 'volume_size': 1} Aug 05 06:30:50 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-3b826ef7-9ae6-4e15-a581-d3396ce92e03 tempest-CreateVolumesFromSnapshotTest-2119669264 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:30:50 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-513b4728-2fea-415b-92fe-8340ecd94ebc tempest-VolumeAndVolumeTypeFromImageTest-719304038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9bb219fc-af1f-4eec-b3dc-517d57498a94" returned: 0 in 0.435s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:30:50 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-513b4728-2fea-415b-92fe-8340ecd94ebc tempest-VolumeAndVolumeTypeFromImageTest-719304038 None] <== create_volume: return (1137ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'} {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 06:30:50 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-513b4728-2fea-415b-92fe-8340ecd94ebc tempest-VolumeAndVolumeTypeFromImageTest-719304038 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.143s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:30:50 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-15dc1360-a27b-4e92-8c0e-6a0a6f7711da tempest-CreateVolumesFromSnapshotTest-2119669264 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.159s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:30:50 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-15dc1360-a27b-4e92-8c0e-6a0a6f7711da tempest-CreateVolumesFromSnapshotTest-2119669264 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:30:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-968016741',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6a1f0a3-9533-4004-a009-213a3e8c4b2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ed354397e4746949a3143134c0f9610',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:30:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:30:49Z,use_quota=True,user_id='3f4a957b9fec41f2a34ccfbae96acc10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)}" {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 06:30:50 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-15dc1360-a27b-4e92-8c0e-6a0a6f7711da tempest-CreateVolumesFromSnapshotTest-2119669264 None] Creating volume e6a1f0a3-9533-4004-a009-213a3e8c4b2e {{(pid=88695) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 06:30:50 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-15dc1360-a27b-4e92-8c0e-6a0a6f7711da tempest-CreateVolumesFromSnapshotTest-2119669264 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:30:50 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-15dc1360-a27b-4e92-8c0e-6a0a6f7711da tempest-CreateVolumesFromSnapshotTest-2119669264 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:30:50 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-15dc1360-a27b-4e92-8c0e-6a0a6f7711da tempest-CreateVolumesFromSnapshotTest-2119669264 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:30:50 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-15dc1360-a27b-4e92-8c0e-6a0a6f7711da tempest-CreateVolumesFromSnapshotTest-2119669264 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:30:50 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-15dc1360-a27b-4e92-8c0e-6a0a6f7711da tempest-CreateVolumesFromSnapshotTest-2119669264 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:30:50 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-15dc1360-a27b-4e92-8c0e-6a0a6f7711da tempest-CreateVolumesFromSnapshotTest-2119669264 None] Selected osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 as target Quobyte volume. {{(pid=88695) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 06:30:50 devstack cinder-volume[88695]: INFO cinder.volume.drivers.remotefs [None req-15dc1360-a27b-4e92-8c0e-6a0a6f7711da tempest-CreateVolumesFromSnapshotTest-2119669264 None] casted to osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 Aug 05 06:30:50 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-15dc1360-a27b-4e92-8c0e-6a0a6f7711da tempest-CreateVolumesFromSnapshotTest-2119669264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-e6a1f0a3-9533-4004-a009-213a3e8c4b2e 1073741824 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:30:50 devstack sudo[108415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-e6a1f0a3-9533-4004-a009-213a3e8c4b2e 1073741824 Aug 05 06:30:50 devstack sudo[108415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:30:50 devstack cinder-volume[88695]: DEBUG cinder.volume.volume_utils [None req-513b4728-2fea-415b-92fe-8340ecd94ebc tempest-VolumeAndVolumeTypeFromImageTest-719304038 None] Attempting download of 0070e005-4c44-478a-aa34-8f6476690d5f ((None, [{'url': 'file:///opt/stack/data/glance/images/0070e005-4c44-478a-aa34-8f6476690d5f', 'metadata': {}}])) to volume 9bb219fc-af1f-4eec-b3dc-517d57498a94. {{(pid=88695) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 05 06:30:50 devstack sudo[108414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e170712c-b7ea-4f8f-97b5-9b7c6f07a51d_jphm987ndevstack@QuobyteHD Aug 05 06:30:50 devstack sudo[108414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:30:50 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[61e5b919-3f79-45fd-9c67-8ce261c8582d]: (4, 'raw') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:30:50 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-513b4728-2fea-415b-92fe-8340ecd94ebc tempest-VolumeAndVolumeTypeFromImageTest-719304038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0070e005-4c44-478a-aa34-8f6476690d5f_6_3w8xpt {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:30:50 devstack sudo[108406]: pam_unix(sudo:session): session closed for user root Aug 05 06:30:50 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-6dd27d5e-7df9-4e4b-86e7-ef180ef5a94f tempest-CreateVolumesFromImageTest-1660354549 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-beba6f32-c79c-4797-969a-46016e63a73e" returned: 0 in 0.865s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:30:50 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-6dd27d5e-7df9-4e4b-86e7-ef180ef5a94f tempest-CreateVolumesFromImageTest-1660354549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-beba6f32-c79c-4797-969a-46016e63a73e {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:30:50 devstack sudo[108420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0070e005-4c44-478a-aa34-8f6476690d5f_6_3w8xpt Aug 05 06:30:50 devstack sudo[108420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:30:50 devstack sudo[108422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-beba6f32-c79c-4797-969a-46016e63a73e Aug 05 06:30:50 devstack sudo[108422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:30:50 devstack sudo[108414]: pam_unix(sudo:session): session closed for user root Aug 05 06:30:50 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-8a1fe141-b8c4-440d-b9f7-0cb528ded302 tempest-VolumeImageDependencyTests-768896694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e170712c-b7ea-4f8f-97b5-9b7c6f07a51d_jphm987ndevstack@QuobyteHD" returned: 0 in 0.560s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:30:50 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-8a1fe141-b8c4-440d-b9f7-0cb528ded302 tempest-VolumeImageDependencyTests-768896694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e170712c-b7ea-4f8f-97b5-9b7c6f07a51d_jphm987ndevstack@QuobyteHD {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:30:50 devstack cinder-volume[88695]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1eadc83-acc0-4bbc-9f1f-61e5ee7f18ed tempest-CreateVolumesFromSnapshotTest-2119669264 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88695) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 06:30:51 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-e1eadc83-acc0-4bbc-9f1f-61e5ee7f18ed tempest-CreateVolumesFromSnapshotTest-2119669264 None] Flow 'volume_create_manager' (13235d0d-9528-491e-9679-affaa802ef28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:30:51 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-e1eadc83-acc0-4bbc-9f1f-61e5ee7f18ed tempest-CreateVolumesFromSnapshotTest-2119669264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8fcc11f-bc6a-4add-86c5-e2ffe98e853f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:30:51 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-e1eadc83-acc0-4bbc-9f1f-61e5ee7f18ed tempest-CreateVolumesFromSnapshotTest-2119669264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8fcc11f-bc6a-4add-86c5-e2ffe98e853f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:30:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-418152216',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83e37e8c-7c78-4854-a900-3a3c33219c88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ed354397e4746949a3143134c0f9610',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:30:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:30:51Z,use_quota=True,user_id='3f4a957b9fec41f2a34ccfbae96acc10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:30:51 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-e1eadc83-acc0-4bbc-9f1f-61e5ee7f18ed tempest-CreateVolumesFromSnapshotTest-2119669264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1859c4d1-820c-4ae8-b491-635746c863bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:30:51 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-e1eadc83-acc0-4bbc-9f1f-61e5ee7f18ed tempest-CreateVolumesFromSnapshotTest-2119669264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1859c4d1-820c-4ae8-b491-635746c863bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:30:51 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-e1eadc83-acc0-4bbc-9f1f-61e5ee7f18ed tempest-CreateVolumesFromSnapshotTest-2119669264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6c0f29f-8264-4f6d-ab11-be3108315874) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:30:51 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-e1eadc83-acc0-4bbc-9f1f-61e5ee7f18ed tempest-CreateVolumesFromSnapshotTest-2119669264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6c0f29f-8264-4f6d-ab11-be3108315874) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '83e37e8c-7c78-4854-a900-3a3c33219c88', 'volume_name': 'volume-83e37e8c-7c78-4854-a900-3a3c33219c88', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:30:51 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-e1eadc83-acc0-4bbc-9f1f-61e5ee7f18ed tempest-CreateVolumesFromSnapshotTest-2119669264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0935a48b-9342-4263-a648-81b7629cb2a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:30:51 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-e1eadc83-acc0-4bbc-9f1f-61e5ee7f18ed tempest-CreateVolumesFromSnapshotTest-2119669264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0935a48b-9342-4263-a648-81b7629cb2a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:30:51 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-e1eadc83-acc0-4bbc-9f1f-61e5ee7f18ed tempest-CreateVolumesFromSnapshotTest-2119669264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c790a06b-e77e-4207-852e-940e0a757598) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:30:51 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-e1eadc83-acc0-4bbc-9f1f-61e5ee7f18ed tempest-CreateVolumesFromSnapshotTest-2119669264 None] Volume 83e37e8c-7c78-4854-a900-3a3c33219c88: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-83e37e8c-7c78-4854-a900-3a3c33219c88', 'volume_size': 1} Aug 05 06:30:51 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-e1eadc83-acc0-4bbc-9f1f-61e5ee7f18ed tempest-CreateVolumesFromSnapshotTest-2119669264 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:30:51 devstack sudo[108429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e170712c-b7ea-4f8f-97b5-9b7c6f07a51d_jphm987ndevstack@QuobyteHD Aug 05 06:30:51 devstack sudo[108429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:30:51 devstack sudo[108422]: pam_unix(sudo:session): session closed for user root Aug 05 06:30:51 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-6dd27d5e-7df9-4e4b-86e7-ef180ef5a94f tempest-CreateVolumesFromImageTest-1660354549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-beba6f32-c79c-4797-969a-46016e63a73e" returned: 0 in 0.382s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:30:51 devstack sudo[108420]: pam_unix(sudo:session): session closed for user root Aug 05 06:30:51 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-513b4728-2fea-415b-92fe-8340ecd94ebc tempest-VolumeAndVolumeTypeFromImageTest-719304038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0070e005-4c44-478a-aa34-8f6476690d5f_6_3w8xpt" returned: 0 in 0.580s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:30:51 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-513b4728-2fea-415b-92fe-8340ecd94ebc tempest-VolumeAndVolumeTypeFromImageTest-719304038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0070e005-4c44-478a-aa34-8f6476690d5f_6_3w8xpt {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:30:51 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-6dd27d5e-7df9-4e4b-86e7-ef180ef5a94f tempest-CreateVolumesFromImageTest-1660354549 None] Lock "cinder-quobyte-beba6f32-c79c-4797-969a-46016e63a73e" released by "delete_volume" :: held 1.341s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:30:51 devstack sudo[108415]: pam_unix(sudo:session): session closed for user root Aug 05 06:30:51 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-15dc1360-a27b-4e92-8c0e-6a0a6f7711da tempest-CreateVolumesFromSnapshotTest-2119669264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-e6a1f0a3-9533-4004-a009-213a3e8c4b2e 1073741824" returned: 0 in 0.828s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:30:51 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-6dd27d5e-7df9-4e4b-86e7-ef180ef5a94f tempest-CreateVolumesFromImageTest-1660354549 None] Created reservations ['e5dcd856-07bf-4b5a-a803-f13c77ecee3a', '06f40a63-d482-48d8-8cb9-7f963f7b9dc2', '3f1679c7-3fcf-437e-a387-d4958ad49425', '3454a292-dedb-4d4d-9763-407d841d645a'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:30:51 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-15dc1360-a27b-4e92-8c0e-6a0a6f7711da tempest-CreateVolumesFromSnapshotTest-2119669264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-e6a1f0a3-9533-4004-a009-213a3e8c4b2e {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:30:51 devstack sudo[108435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0070e005-4c44-478a-aa34-8f6476690d5f_6_3w8xpt Aug 05 06:30:51 devstack sudo[108435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:30:51 devstack sudo[108436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-e6a1f0a3-9533-4004-a009-213a3e8c4b2e Aug 05 06:30:51 devstack sudo[108436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:30:51 devstack sudo[108429]: pam_unix(sudo:session): session closed for user root Aug 05 06:30:51 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-6dd27d5e-7df9-4e4b-86e7-ef180ef5a94f tempest-CreateVolumesFromImageTest-1660354549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:30:51 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-6dd27d5e-7df9-4e4b-86e7-ef180ef5a94f tempest-CreateVolumesFromImageTest-1660354549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:30:51 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-6dd27d5e-7df9-4e4b-86e7-ef180ef5a94f tempest-CreateVolumesFromImageTest-1660354549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:30:51 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-6dd27d5e-7df9-4e4b-86e7-ef180ef5a94f tempest-CreateVolumesFromImageTest-1660354549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:30:51 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-6dd27d5e-7df9-4e4b-86e7-ef180ef5a94f tempest-CreateVolumesFromImageTest-1660354549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:30:51 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-6dd27d5e-7df9-4e4b-86e7-ef180ef5a94f tempest-CreateVolumesFromImageTest-1660354549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:30:51 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-8a1fe141-b8c4-440d-b9f7-0cb528ded302 tempest-VolumeImageDependencyTests-768896694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e170712c-b7ea-4f8f-97b5-9b7c6f07a51d_jphm987ndevstack@QuobyteHD" returned: 1 in 0.640s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:30:51 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-8a1fe141-b8c4-440d-b9f7-0cb528ded302 tempest-VolumeImageDependencyTests-768896694 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e170712c-b7ea-4f8f-97b5-9b7c6f07a51d_jphm987ndevstack@QuobyteHD' failed. Not Retrying. {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 05 06:30:51 devstack cinder-volume[88695]: DEBUG cinder.image.image_utils [None req-8a1fe141-b8c4-440d-b9f7-0cb528ded302 tempest-VolumeImageDependencyTests-768896694 None] e170712c-b7ea-4f8f-97b5-9b7c6f07a51d was raw, converting to qcow2 {{(pid=88695) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 05 06:30:51 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-8a1fe141-b8c4-440d-b9f7-0cb528ded302 tempest-VolumeImageDependencyTests-768896694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_e170712c-b7ea-4f8f-97b5-9b7c6f07a51d_jphm987ndevstack@QuobyteHD /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-1a48e355-7f38-41fc-8930-a87861389946 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:30:51 devstack sudo[108445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce Aug 05 06:30:51 devstack sudo[108445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:30:51 devstack sudo[108446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_e170712c-b7ea-4f8f-97b5-9b7c6f07a51d_jphm987ndevstack@QuobyteHD /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-1a48e355-7f38-41fc-8930-a87861389946 Aug 05 06:30:51 devstack sudo[108446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:30:51 devstack cinder-volume[88695]: DEBUG cinder.volume.flows.manager.create_volume [None req-1741ab19-c03a-4990-975d-70e2d8a8bacc tempest-CreateVolumesFromSnapshotTest-2119669264 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88695) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 06:30:51 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-1741ab19-c03a-4990-975d-70e2d8a8bacc tempest-CreateVolumesFromSnapshotTest-2119669264 None] Flow 'volume_create_manager' (8cb1bd08-73de-4cf0-b5af-1c6627a8e924) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:30:51 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-1741ab19-c03a-4990-975d-70e2d8a8bacc tempest-CreateVolumesFromSnapshotTest-2119669264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4cb0e66-cf81-41d3-b23a-e2cbbe38ff7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:30:51 devstack sudo[108435]: pam_unix(sudo:session): session closed for user root Aug 05 06:30:51 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-1741ab19-c03a-4990-975d-70e2d8a8bacc tempest-CreateVolumesFromSnapshotTest-2119669264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4cb0e66-cf81-41d3-b23a-e2cbbe38ff7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:30:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1523972696',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f70e629-3f42-4408-aa3c-e1d04d4121ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ed354397e4746949a3143134c0f9610',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:30:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:30:52Z,use_quota=True,user_id='3f4a957b9fec41f2a34ccfbae96acc10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:30:51 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-1741ab19-c03a-4990-975d-70e2d8a8bacc tempest-CreateVolumesFromSnapshotTest-2119669264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f496405-84ef-4b05-8cb0-49b2b35d1073) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:30:51 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-1741ab19-c03a-4990-975d-70e2d8a8bacc tempest-CreateVolumesFromSnapshotTest-2119669264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f496405-84ef-4b05-8cb0-49b2b35d1073) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:30:51 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-1741ab19-c03a-4990-975d-70e2d8a8bacc tempest-CreateVolumesFromSnapshotTest-2119669264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9828dbe5-c99c-4e09-bfb8-6d4c75ff14e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:30:51 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-1741ab19-c03a-4990-975d-70e2d8a8bacc tempest-CreateVolumesFromSnapshotTest-2119669264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9828dbe5-c99c-4e09-bfb8-6d4c75ff14e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f70e629-3f42-4408-aa3c-e1d04d4121ad', 'volume_name': 'volume-9f70e629-3f42-4408-aa3c-e1d04d4121ad', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:30:51 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-1741ab19-c03a-4990-975d-70e2d8a8bacc tempest-CreateVolumesFromSnapshotTest-2119669264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec11b26b-94fd-4bbf-9b8a-4fdad555ac1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:30:51 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-1741ab19-c03a-4990-975d-70e2d8a8bacc tempest-CreateVolumesFromSnapshotTest-2119669264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec11b26b-94fd-4bbf-9b8a-4fdad555ac1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:30:51 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-1741ab19-c03a-4990-975d-70e2d8a8bacc tempest-CreateVolumesFromSnapshotTest-2119669264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc620112-4816-4384-a7d9-0002180d4838) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:30:51 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-1741ab19-c03a-4990-975d-70e2d8a8bacc tempest-CreateVolumesFromSnapshotTest-2119669264 None] Volume 9f70e629-3f42-4408-aa3c-e1d04d4121ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f70e629-3f42-4408-aa3c-e1d04d4121ad', 'volume_size': 1} Aug 05 06:30:51 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-1741ab19-c03a-4990-975d-70e2d8a8bacc tempest-CreateVolumesFromSnapshotTest-2119669264 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:30:51 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-513b4728-2fea-415b-92fe-8340ecd94ebc tempest-VolumeAndVolumeTypeFromImageTest-719304038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0070e005-4c44-478a-aa34-8f6476690d5f_6_3w8xpt" returned: 1 in 0.615s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:30:51 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-513b4728-2fea-415b-92fe-8340ecd94ebc tempest-VolumeAndVolumeTypeFromImageTest-719304038 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0070e005-4c44-478a-aa34-8f6476690d5f_6_3w8xpt' failed. Not Retrying. {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 05 06:30:51 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[e04c0c90-3e1d-4670-8cac-1676882abe9a]: (4, 'raw') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:30:51 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-513b4728-2fea-415b-92fe-8340ecd94ebc tempest-VolumeAndVolumeTypeFromImageTest-719304038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0070e005-4c44-478a-aa34-8f6476690d5f_ixtyqf7idevstack@QuobyteHD {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:30:51 devstack sudo[108436]: pam_unix(sudo:session): session closed for user root Aug 05 06:30:51 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-15dc1360-a27b-4e92-8c0e-6a0a6f7711da tempest-CreateVolumesFromSnapshotTest-2119669264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-e6a1f0a3-9533-4004-a009-213a3e8c4b2e" returned: 0 in 0.456s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:30:51 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-15dc1360-a27b-4e92-8c0e-6a0a6f7711da tempest-CreateVolumesFromSnapshotTest-2119669264 None] <== create_volume: return (1387ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'} {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 06:30:51 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-15dc1360-a27b-4e92-8c0e-6a0a6f7711da tempest-CreateVolumesFromSnapshotTest-2119669264 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.391s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:30:51 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-57d9e710-1f15-46cb-a702-a24ba21e7ca2 tempest-CreateVolumesFromSnapshotTest-2119669264 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.000s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:30:51 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-57d9e710-1f15-46cb-a702-a24ba21e7ca2 tempest-CreateVolumesFromSnapshotTest-2119669264 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:30:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1028110024',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03d7382d-6a9f-428c-9c20-ce26215b4baa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ed354397e4746949a3143134c0f9610',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:30:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:30:50Z,use_quota=True,user_id='3f4a957b9fec41f2a34ccfbae96acc10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)}" {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 06:30:51 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-57d9e710-1f15-46cb-a702-a24ba21e7ca2 tempest-CreateVolumesFromSnapshotTest-2119669264 None] Creating volume 03d7382d-6a9f-428c-9c20-ce26215b4baa {{(pid=88695) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 06:30:51 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-57d9e710-1f15-46cb-a702-a24ba21e7ca2 tempest-CreateVolumesFromSnapshotTest-2119669264 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:30:51 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-57d9e710-1f15-46cb-a702-a24ba21e7ca2 tempest-CreateVolumesFromSnapshotTest-2119669264 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:30:51 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-57d9e710-1f15-46cb-a702-a24ba21e7ca2 tempest-CreateVolumesFromSnapshotTest-2119669264 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:30:51 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-57d9e710-1f15-46cb-a702-a24ba21e7ca2 tempest-CreateVolumesFromSnapshotTest-2119669264 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:30:51 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-57d9e710-1f15-46cb-a702-a24ba21e7ca2 tempest-CreateVolumesFromSnapshotTest-2119669264 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:30:51 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-57d9e710-1f15-46cb-a702-a24ba21e7ca2 tempest-CreateVolumesFromSnapshotTest-2119669264 None] Selected osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 as target Quobyte volume. {{(pid=88695) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 06:30:51 devstack cinder-volume[88695]: INFO cinder.volume.drivers.remotefs [None req-57d9e710-1f15-46cb-a702-a24ba21e7ca2 tempest-CreateVolumesFromSnapshotTest-2119669264 None] casted to osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 Aug 05 06:30:51 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-57d9e710-1f15-46cb-a702-a24ba21e7ca2 tempest-CreateVolumesFromSnapshotTest-2119669264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-03d7382d-6a9f-428c-9c20-ce26215b4baa 1073741824 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:30:51 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-15dc1360-a27b-4e92-8c0e-6a0a6f7711da tempest-CreateVolumesFromSnapshotTest-2119669264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e09cf280-fbc3-47a9-8d66-5265954fadd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e6a1f0a3-9533-4004-a009-213a3e8c4b2e', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:30:51 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-15dc1360-a27b-4e92-8c0e-6a0a6f7711da tempest-CreateVolumesFromSnapshotTest-2119669264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4877e969-f178-4124-81ef-242802c8b498) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:30:51 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-15dc1360-a27b-4e92-8c0e-6a0a6f7711da tempest-CreateVolumesFromSnapshotTest-2119669264 None] Volume volume-e6a1f0a3-9533-4004-a009-213a3e8c4b2e (e6a1f0a3-9533-4004-a009-213a3e8c4b2e): created successfully Aug 05 06:30:51 devstack sudo[108457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-03d7382d-6a9f-428c-9c20-ce26215b4baa 1073741824 Aug 05 06:30:51 devstack sudo[108457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:30:51 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-15dc1360-a27b-4e92-8c0e-6a0a6f7711da tempest-CreateVolumesFromSnapshotTest-2119669264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4877e969-f178-4124-81ef-242802c8b498) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:30:51 devstack sudo[108445]: pam_unix(sudo:session): session closed for user root Aug 05 06:30:51 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-15dc1360-a27b-4e92-8c0e-6a0a6f7711da tempest-CreateVolumesFromSnapshotTest-2119669264 None] Flow 'volume_create_manager' (e4b346eb-20c2-43fa-88e7-819adbe42b08) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:30:51 devstack sudo[108455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0070e005-4c44-478a-aa34-8f6476690d5f_ixtyqf7idevstack@QuobyteHD Aug 05 06:30:51 devstack sudo[108455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:30:51 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-6dd27d5e-7df9-4e4b-86e7-ef180ef5a94f tempest-CreateVolumesFromImageTest-1660354549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce" returned: 0 in 0.419s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:30:51 devstack cinder-volume[88695]: DEBUG cinder.manager [None req-6dd27d5e-7df9-4e4b-86e7-ef180ef5a94f tempest-CreateVolumesFromImageTest-1660354549 None] Notifying Schedulers of capabilities ... {{(pid=88695) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 06:30:51 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-6dd27d5e-7df9-4e4b-86e7-ef180ef5a94f tempest-CreateVolumesFromImageTest-1660354549 None] Deleted volume successfully. Aug 05 06:30:52 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-15dc1360-a27b-4e92-8c0e-6a0a6f7711da tempest-CreateVolumesFromSnapshotTest-2119669264 None] Created volume successfully. Aug 05 06:30:52 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-6dd27d5e-7df9-4e4b-86e7-ef180ef5a94f tempest-CreateVolumesFromImageTest-1660354549 None] Lock "cinder-beba6f32-c79c-4797-969a-46016e63a73e-delete_volume" released by "delete_volume" :: held 2.258s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:30:52 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-126f794f-c633-4192-9236-1d2e372ff136 tempest-CreateVolumesFromImageTest-1660354549 None] Acquiring lock "cinder-f0f8f15c-516d-4ca3-b7f4-6a69e79f0409-delete_volume" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:30:52 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-126f794f-c633-4192-9236-1d2e372ff136 tempest-CreateVolumesFromImageTest-1660354549 None] Lock "cinder-f0f8f15c-516d-4ca3-b7f4-6a69e79f0409-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:30:52 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-126f794f-c633-4192-9236-1d2e372ff136 tempest-CreateVolumesFromImageTest-1660354549 None] Acquiring lock "cinder-quobyte-f0f8f15c-516d-4ca3-b7f4-6a69e79f0409" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:30:52 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-126f794f-c633-4192-9236-1d2e372ff136 tempest-CreateVolumesFromImageTest-1660354549 None] Lock "cinder-quobyte-f0f8f15c-516d-4ca3-b7f4-6a69e79f0409" acquired by "delete_volume" :: waited 0.031s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:30:52 devstack sudo[108455]: pam_unix(sudo:session): session closed for user root Aug 05 06:30:52 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-513b4728-2fea-415b-92fe-8340ecd94ebc tempest-VolumeAndVolumeTypeFromImageTest-719304038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0070e005-4c44-478a-aa34-8f6476690d5f_ixtyqf7idevstack@QuobyteHD" returned: 0 in 0.482s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:30:52 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-513b4728-2fea-415b-92fe-8340ecd94ebc tempest-VolumeAndVolumeTypeFromImageTest-719304038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0070e005-4c44-478a-aa34-8f6476690d5f_ixtyqf7idevstack@QuobyteHD {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:30:52 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[706edc77-c207-4d0e-af44-252ba164cb70]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:30:52 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-126f794f-c633-4192-9236-1d2e372ff136 tempest-CreateVolumesFromImageTest-1660354549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-f0f8f15c-516d-4ca3-b7f4-6a69e79f0409 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:30:52 devstack sudo[108446]: pam_unix(sudo:session): session closed for user root Aug 05 06:30:52 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-8a1fe141-b8c4-440d-b9f7-0cb528ded302 tempest-VolumeImageDependencyTests-768896694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_e170712c-b7ea-4f8f-97b5-9b7c6f07a51d_jphm987ndevstack@QuobyteHD /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-1a48e355-7f38-41fc-8930-a87861389946" returned: 0 in 0.762s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:30:52 devstack cinder-volume[88695]: DEBUG cinder.image.image_utils [None req-8a1fe141-b8c4-440d-b9f7-0cb528ded302 tempest-VolumeImageDependencyTests-768896694 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_e170712c-b7ea-4f8f-97b5-9b7c6f07a51d_jphm987ndevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-1a48e355-7f38-41fc-8930-a87861389946 {{(pid=88695) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 05 06:30:52 devstack cinder-volume[88695]: INFO cinder.image.image_utils [None req-8a1fe141-b8c4-440d-b9f7-0cb528ded302 tempest-VolumeImageDependencyTests-768896694 None] Converted 0.00 MB image at 0.00 MB/s Aug 05 06:30:52 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-8a1fe141-b8c4-440d-b9f7-0cb528ded302 tempest-VolumeImageDependencyTests-768896694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-1a48e355-7f38-41fc-8930-a87861389946 1G {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:30:52 devstack sudo[108472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-1a48e355-7f38-41fc-8930-a87861389946 1G Aug 05 06:30:52 devstack sudo[108472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:30:52 devstack sudo[108471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-f0f8f15c-516d-4ca3-b7f4-6a69e79f0409 Aug 05 06:30:52 devstack sudo[108471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:30:52 devstack sudo[108469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0070e005-4c44-478a-aa34-8f6476690d5f_ixtyqf7idevstack@QuobyteHD Aug 05 06:30:52 devstack sudo[108469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:30:52 devstack sudo[108457]: pam_unix(sudo:session): session closed for user root Aug 05 06:30:52 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-57d9e710-1f15-46cb-a702-a24ba21e7ca2 tempest-CreateVolumesFromSnapshotTest-2119669264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-03d7382d-6a9f-428c-9c20-ce26215b4baa 1073741824" returned: 0 in 0.656s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:30:52 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-57d9e710-1f15-46cb-a702-a24ba21e7ca2 tempest-CreateVolumesFromSnapshotTest-2119669264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-03d7382d-6a9f-428c-9c20-ce26215b4baa {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:30:52 devstack sudo[108477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-03d7382d-6a9f-428c-9c20-ce26215b4baa Aug 05 06:30:52 devstack sudo[108477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:30:52 devstack sudo[108472]: pam_unix(sudo:session): session closed for user root Aug 05 06:30:52 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-8a1fe141-b8c4-440d-b9f7-0cb528ded302 tempest-VolumeImageDependencyTests-768896694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-1a48e355-7f38-41fc-8930-a87861389946 1G" returned: 0 in 0.433s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:30:52 devstack cinder-volume[88695]: DEBUG cinder.volume.volume_utils [None req-8a1fe141-b8c4-440d-b9f7-0cb528ded302 tempest-VolumeImageDependencyTests-768896694 None] Downloaded image e170712c-b7ea-4f8f-97b5-9b7c6f07a51d ((None, [{'url': 'file:///opt/stack/data/glance/images/e170712c-b7ea-4f8f-97b5-9b7c6f07a51d', 'metadata': {}}])) to volume 1a48e355-7f38-41fc-8930-a87861389946 successfully. {{(pid=88695) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 05 06:30:52 devstack cinder-volume[88695]: DEBUG cinder.image.image_utils [None req-8a1fe141-b8c4-440d-b9f7-0cb528ded302 tempest-VolumeImageDependencyTests-768896694 None] Temporary image e170712c-b7ea-4f8f-97b5-9b7c6f07a51d for user affc9b971e604423a363b3a1691e85ec is deleted. {{(pid=88695) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 05 06:30:52 devstack cinder-volume[88695]: DEBUG cinder.volume.volume_utils [None req-8a1fe141-b8c4-440d-b9f7-0cb528ded302 tempest-VolumeImageDependencyTests-768896694 None] Marking volume 1a48e355-7f38-41fc-8930-a87861389946 as bootable. {{(pid=88695) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 05 06:30:52 devstack cinder-volume[88695]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a1fe141-b8c4-440d-b9f7-0cb528ded302 tempest-VolumeImageDependencyTests-768896694 None] Copying metadata from image e170712c-b7ea-4f8f-97b5-9b7c6f07a51d to 1a48e355-7f38-41fc-8930-a87861389946. {{(pid=88695) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 05 06:30:52 devstack cinder-volume[88695]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a1fe141-b8c4-440d-b9f7-0cb528ded302 tempest-VolumeImageDependencyTests-768896694 None] Creating volume glance metadata for volume 1a48e355-7f38-41fc-8930-a87861389946 backed by image e170712c-b7ea-4f8f-97b5-9b7c6f07a51d with: {'image_id': 'e170712c-b7ea-4f8f-97b5-9b7c6f07a51d', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'fb95018c90a23898ef105145ada786a7', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=88695) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 05 06:30:52 devstack sudo[108469]: pam_unix(sudo:session): session closed for user root Aug 05 06:30:52 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-513b4728-2fea-415b-92fe-8340ecd94ebc tempest-VolumeAndVolumeTypeFromImageTest-719304038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0070e005-4c44-478a-aa34-8f6476690d5f_ixtyqf7idevstack@QuobyteHD" returned: 1 in 0.525s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:30:52 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-513b4728-2fea-415b-92fe-8340ecd94ebc tempest-VolumeAndVolumeTypeFromImageTest-719304038 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0070e005-4c44-478a-aa34-8f6476690d5f_ixtyqf7idevstack@QuobyteHD' failed. Not Retrying. {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 05 06:30:52 devstack cinder-volume[88695]: DEBUG cinder.image.image_utils [None req-513b4728-2fea-415b-92fe-8340ecd94ebc tempest-VolumeAndVolumeTypeFromImageTest-719304038 None] 0070e005-4c44-478a-aa34-8f6476690d5f was raw, converting to qcow2 {{(pid=88695) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 05 06:30:52 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-513b4728-2fea-415b-92fe-8340ecd94ebc tempest-VolumeAndVolumeTypeFromImageTest-719304038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_0070e005-4c44-478a-aa34-8f6476690d5f_ixtyqf7idevstack@QuobyteHD /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9bb219fc-af1f-4eec-b3dc-517d57498a94 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:30:52 devstack sudo[108489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_0070e005-4c44-478a-aa34-8f6476690d5f_ixtyqf7idevstack@QuobyteHD /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9bb219fc-af1f-4eec-b3dc-517d57498a94 Aug 05 06:30:52 devstack sudo[108489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:30:52 devstack sudo[108471]: pam_unix(sudo:session): session closed for user root Aug 05 06:30:52 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-126f794f-c633-4192-9236-1d2e372ff136 tempest-CreateVolumesFromImageTest-1660354549 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-f0f8f15c-516d-4ca3-b7f4-6a69e79f0409" returned: 0 in 0.568s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:30:52 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-126f794f-c633-4192-9236-1d2e372ff136 tempest-CreateVolumesFromImageTest-1660354549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-f0f8f15c-516d-4ca3-b7f4-6a69e79f0409 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:30:52 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-8a1fe141-b8c4-440d-b9f7-0cb528ded302 tempest-VolumeImageDependencyTests-768896694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87210d5d-b828-48cd-9233-c75c78f04a71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a48e355-7f38-41fc-8930-a87861389946', 'volume_size': 1, 'image_id': 'e170712c-b7ea-4f8f-97b5-9b7c6f07a51d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e170712c-b7ea-4f8f-97b5-9b7c6f07a51d', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'fb95018c90a23898ef105145ada786a7', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b1362d38ef5545ecad2e547c10164bf8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e1814052b725653ce97c3d3df6f73d1c34a2fa615e765f590e118d2d602c22e8b330f352c5fc893eba8efff2459caeb7c2c2a583c841e94902bdb76eeb268314', 'id': 'e170712c-b7ea-4f8f-97b5-9b7c6f07a51d', 'created_at': datetime.datetime(2026, 8, 5, 4, 30, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 5, 4, 30, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e170712c-b7ea-4f8f-97b5-9b7c6f07a51d/file', 'properties': {}}, 'image_service': }' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:30:52 devstack sudo[108492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-f0f8f15c-516d-4ca3-b7f4-6a69e79f0409 Aug 05 06:30:52 devstack sudo[108492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:30:52 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-8a1fe141-b8c4-440d-b9f7-0cb528ded302 tempest-VolumeImageDependencyTests-768896694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcdc1b8e-900d-4c43-9e29-f0a38c2afce1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:30:52 devstack sudo[108477]: pam_unix(sudo:session): session closed for user root Aug 05 06:30:52 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-57d9e710-1f15-46cb-a702-a24ba21e7ca2 tempest-CreateVolumesFromSnapshotTest-2119669264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-03d7382d-6a9f-428c-9c20-ce26215b4baa" returned: 0 in 0.339s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:30:52 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-57d9e710-1f15-46cb-a702-a24ba21e7ca2 tempest-CreateVolumesFromSnapshotTest-2119669264 None] <== create_volume: return (1095ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'} {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 06:30:52 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-57d9e710-1f15-46cb-a702-a24ba21e7ca2 tempest-CreateVolumesFromSnapshotTest-2119669264 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.099s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:30:52 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-3b826ef7-9ae6-4e15-a581-d3396ce92e03 tempest-CreateVolumesFromSnapshotTest-2119669264 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.515s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:30:52 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-3b826ef7-9ae6-4e15-a581-d3396ce92e03 tempest-CreateVolumesFromSnapshotTest-2119669264 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:30:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-461866323',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a095fb1-8ad2-4938-8598-8d3af510338a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ed354397e4746949a3143134c0f9610',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:30:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:30:50Z,use_quota=True,user_id='3f4a957b9fec41f2a34ccfbae96acc10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)}" {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 06:30:52 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-3b826ef7-9ae6-4e15-a581-d3396ce92e03 tempest-CreateVolumesFromSnapshotTest-2119669264 None] Creating volume 1a095fb1-8ad2-4938-8598-8d3af510338a {{(pid=88695) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 06:30:52 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-3b826ef7-9ae6-4e15-a581-d3396ce92e03 tempest-CreateVolumesFromSnapshotTest-2119669264 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:30:52 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-3b826ef7-9ae6-4e15-a581-d3396ce92e03 tempest-CreateVolumesFromSnapshotTest-2119669264 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:30:52 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-3b826ef7-9ae6-4e15-a581-d3396ce92e03 tempest-CreateVolumesFromSnapshotTest-2119669264 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:30:52 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-3b826ef7-9ae6-4e15-a581-d3396ce92e03 tempest-CreateVolumesFromSnapshotTest-2119669264 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:30:52 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-3b826ef7-9ae6-4e15-a581-d3396ce92e03 tempest-CreateVolumesFromSnapshotTest-2119669264 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:30:52 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-3b826ef7-9ae6-4e15-a581-d3396ce92e03 tempest-CreateVolumesFromSnapshotTest-2119669264 None] Selected osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 as target Quobyte volume. {{(pid=88695) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 06:30:52 devstack cinder-volume[88695]: INFO cinder.volume.drivers.remotefs [None req-3b826ef7-9ae6-4e15-a581-d3396ce92e03 tempest-CreateVolumesFromSnapshotTest-2119669264 None] casted to osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 Aug 05 06:30:52 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-3b826ef7-9ae6-4e15-a581-d3396ce92e03 tempest-CreateVolumesFromSnapshotTest-2119669264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-1a095fb1-8ad2-4938-8598-8d3af510338a 1073741824 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:30:52 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-8a1fe141-b8c4-440d-b9f7-0cb528ded302 tempest-VolumeImageDependencyTests-768896694 None] Volume volume-1a48e355-7f38-41fc-8930-a87861389946 (1a48e355-7f38-41fc-8930-a87861389946): created successfully Aug 05 06:30:52 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-8a1fe141-b8c4-440d-b9f7-0cb528ded302 tempest-VolumeImageDependencyTests-768896694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcdc1b8e-900d-4c43-9e29-f0a38c2afce1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:30:53 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-8a1fe141-b8c4-440d-b9f7-0cb528ded302 tempest-VolumeImageDependencyTests-768896694 None] Flow 'volume_create_manager' (6b70d5c9-3d49-4972-9adc-9db833bd56ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:30:53 devstack sudo[108494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-1a095fb1-8ad2-4938-8598-8d3af510338a 1073741824 Aug 05 06:30:53 devstack sudo[108494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:30:53 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-57d9e710-1f15-46cb-a702-a24ba21e7ca2 tempest-CreateVolumesFromSnapshotTest-2119669264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6609e0af-cf9b-4151-b88e-3156ec1af171) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03d7382d-6a9f-428c-9c20-ce26215b4baa', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:30:53 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-57d9e710-1f15-46cb-a702-a24ba21e7ca2 tempest-CreateVolumesFromSnapshotTest-2119669264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bca3aa0a-5abd-42b0-891e-f37532b5df9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:30:53 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-8a1fe141-b8c4-440d-b9f7-0cb528ded302 tempest-VolumeImageDependencyTests-768896694 None] Created volume successfully. Aug 05 06:30:53 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-57d9e710-1f15-46cb-a702-a24ba21e7ca2 tempest-CreateVolumesFromSnapshotTest-2119669264 None] Volume volume-03d7382d-6a9f-428c-9c20-ce26215b4baa (03d7382d-6a9f-428c-9c20-ce26215b4baa): created successfully Aug 05 06:30:53 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-57d9e710-1f15-46cb-a702-a24ba21e7ca2 tempest-CreateVolumesFromSnapshotTest-2119669264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bca3aa0a-5abd-42b0-891e-f37532b5df9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:30:53 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-57d9e710-1f15-46cb-a702-a24ba21e7ca2 tempest-CreateVolumesFromSnapshotTest-2119669264 None] Flow 'volume_create_manager' (c8894459-c457-4572-9653-5cf5445a5b8e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:30:53 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-57d9e710-1f15-46cb-a702-a24ba21e7ca2 tempest-CreateVolumesFromSnapshotTest-2119669264 None] Created volume successfully. Aug 05 06:30:53 devstack sudo[108492]: pam_unix(sudo:session): session closed for user root Aug 05 06:30:53 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-126f794f-c633-4192-9236-1d2e372ff136 tempest-CreateVolumesFromImageTest-1660354549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-f0f8f15c-516d-4ca3-b7f4-6a69e79f0409" returned: 0 in 0.288s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:30:53 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-126f794f-c633-4192-9236-1d2e372ff136 tempest-CreateVolumesFromImageTest-1660354549 None] Lock "cinder-quobyte-f0f8f15c-516d-4ca3-b7f4-6a69e79f0409" released by "delete_volume" :: held 0.946s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:30:53 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-126f794f-c633-4192-9236-1d2e372ff136 tempest-CreateVolumesFromImageTest-1660354549 None] Created reservations ['725df417-5a5b-46e7-af31-5062fbeb3d99', '5e8bf464-140a-4a26-925a-3bee99456588', '9f8248f3-5f25-40f4-9f16-ecd55418b87d', '7bc36441-5edd-43a4-b358-6bf651b66fc5'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:30:53 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-126f794f-c633-4192-9236-1d2e372ff136 tempest-CreateVolumesFromImageTest-1660354549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:30:53 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-126f794f-c633-4192-9236-1d2e372ff136 tempest-CreateVolumesFromImageTest-1660354549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:30:53 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-126f794f-c633-4192-9236-1d2e372ff136 tempest-CreateVolumesFromImageTest-1660354549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:30:53 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-126f794f-c633-4192-9236-1d2e372ff136 tempest-CreateVolumesFromImageTest-1660354549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:30:53 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-126f794f-c633-4192-9236-1d2e372ff136 tempest-CreateVolumesFromImageTest-1660354549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:30:53 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-126f794f-c633-4192-9236-1d2e372ff136 tempest-CreateVolumesFromImageTest-1660354549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:30:53 devstack sudo[108489]: pam_unix(sudo:session): session closed for user root Aug 05 06:30:53 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-513b4728-2fea-415b-92fe-8340ecd94ebc tempest-VolumeAndVolumeTypeFromImageTest-719304038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_0070e005-4c44-478a-aa34-8f6476690d5f_ixtyqf7idevstack@QuobyteHD /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9bb219fc-af1f-4eec-b3dc-517d57498a94" returned: 0 in 0.578s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:30:53 devstack cinder-volume[88695]: DEBUG cinder.image.image_utils [None req-513b4728-2fea-415b-92fe-8340ecd94ebc tempest-VolumeAndVolumeTypeFromImageTest-719304038 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_0070e005-4c44-478a-aa34-8f6476690d5f_ixtyqf7idevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9bb219fc-af1f-4eec-b3dc-517d57498a94 {{(pid=88695) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 05 06:30:53 devstack cinder-volume[88695]: INFO cinder.image.image_utils [None req-513b4728-2fea-415b-92fe-8340ecd94ebc tempest-VolumeAndVolumeTypeFromImageTest-719304038 None] Converted 0.00 MB image at 0.00 MB/s Aug 05 06:30:53 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-513b4728-2fea-415b-92fe-8340ecd94ebc tempest-VolumeAndVolumeTypeFromImageTest-719304038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9bb219fc-af1f-4eec-b3dc-517d57498a94 1G {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:30:53 devstack sudo[108505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce Aug 05 06:30:53 devstack sudo[108505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:30:53 devstack sudo[108506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9bb219fc-af1f-4eec-b3dc-517d57498a94 1G Aug 05 06:30:53 devstack sudo[108506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:30:53 devstack sudo[108494]: pam_unix(sudo:session): session closed for user root Aug 05 06:30:53 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-3b826ef7-9ae6-4e15-a581-d3396ce92e03 tempest-CreateVolumesFromSnapshotTest-2119669264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-1a095fb1-8ad2-4938-8598-8d3af510338a 1073741824" returned: 0 in 0.548s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:30:53 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-3b826ef7-9ae6-4e15-a581-d3396ce92e03 tempest-CreateVolumesFromSnapshotTest-2119669264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-1a095fb1-8ad2-4938-8598-8d3af510338a {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:30:53 devstack sudo[108509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-1a095fb1-8ad2-4938-8598-8d3af510338a Aug 05 06:30:53 devstack sudo[108509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:30:53 devstack sudo[108505]: pam_unix(sudo:session): session closed for user root Aug 05 06:30:53 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-126f794f-c633-4192-9236-1d2e372ff136 tempest-CreateVolumesFromImageTest-1660354549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce" returned: 0 in 0.351s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:30:53 devstack cinder-volume[88695]: DEBUG cinder.manager [None req-126f794f-c633-4192-9236-1d2e372ff136 tempest-CreateVolumesFromImageTest-1660354549 None] Notifying Schedulers of capabilities ... {{(pid=88695) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 06:30:53 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-126f794f-c633-4192-9236-1d2e372ff136 tempest-CreateVolumesFromImageTest-1660354549 None] Deleted volume successfully. Aug 05 06:30:53 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-126f794f-c633-4192-9236-1d2e372ff136 tempest-CreateVolumesFromImageTest-1660354549 None] Lock "cinder-f0f8f15c-516d-4ca3-b7f4-6a69e79f0409-delete_volume" released by "delete_volume" :: held 1.667s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:30:53 devstack sudo[108506]: pam_unix(sudo:session): session closed for user root Aug 05 06:30:53 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-513b4728-2fea-415b-92fe-8340ecd94ebc tempest-VolumeAndVolumeTypeFromImageTest-719304038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9bb219fc-af1f-4eec-b3dc-517d57498a94 1G" returned: 0 in 0.421s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:30:53 devstack cinder-volume[88695]: DEBUG cinder.volume.volume_utils [None req-513b4728-2fea-415b-92fe-8340ecd94ebc tempest-VolumeAndVolumeTypeFromImageTest-719304038 None] Downloaded image 0070e005-4c44-478a-aa34-8f6476690d5f ((None, [{'url': 'file:///opt/stack/data/glance/images/0070e005-4c44-478a-aa34-8f6476690d5f', 'metadata': {}}])) to volume 9bb219fc-af1f-4eec-b3dc-517d57498a94 successfully. {{(pid=88695) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 05 06:30:53 devstack cinder-volume[88695]: DEBUG cinder.image.image_utils [None req-513b4728-2fea-415b-92fe-8340ecd94ebc tempest-VolumeAndVolumeTypeFromImageTest-719304038 None] Temporary image 0070e005-4c44-478a-aa34-8f6476690d5f for user 0e2ce0fc11f54a20aae5af42617cbe1a is deleted. {{(pid=88695) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 05 06:30:53 devstack cinder-volume[88695]: DEBUG cinder.volume.volume_utils [None req-513b4728-2fea-415b-92fe-8340ecd94ebc tempest-VolumeAndVolumeTypeFromImageTest-719304038 None] Marking volume 9bb219fc-af1f-4eec-b3dc-517d57498a94 as bootable. {{(pid=88695) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 05 06:30:53 devstack cinder-volume[88695]: DEBUG cinder.volume.flows.manager.create_volume [None req-513b4728-2fea-415b-92fe-8340ecd94ebc tempest-VolumeAndVolumeTypeFromImageTest-719304038 None] Copying metadata from image 0070e005-4c44-478a-aa34-8f6476690d5f to 9bb219fc-af1f-4eec-b3dc-517d57498a94. {{(pid=88695) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 05 06:30:53 devstack cinder-volume[88695]: DEBUG cinder.volume.flows.manager.create_volume [None req-513b4728-2fea-415b-92fe-8340ecd94ebc tempest-VolumeAndVolumeTypeFromImageTest-719304038 None] Creating volume glance metadata for volume 9bb219fc-af1f-4eec-b3dc-517d57498a94 backed by image 0070e005-4c44-478a-aa34-8f6476690d5f with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '0070e005-4c44-478a-aa34-8f6476690d5f', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '07633c6825fa1909531552b37b5b8c5e', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=88695) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 05 06:30:53 devstack sudo[108509]: pam_unix(sudo:session): session closed for user root Aug 05 06:30:53 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-3b826ef7-9ae6-4e15-a581-d3396ce92e03 tempest-CreateVolumesFromSnapshotTest-2119669264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-1a095fb1-8ad2-4938-8598-8d3af510338a" returned: 0 in 0.383s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:30:53 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-3b826ef7-9ae6-4e15-a581-d3396ce92e03 tempest-CreateVolumesFromSnapshotTest-2119669264 None] <== create_volume: return (983ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'} {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 06:30:53 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-3b826ef7-9ae6-4e15-a581-d3396ce92e03 tempest-CreateVolumesFromSnapshotTest-2119669264 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.986s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:30:53 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-e1eadc83-acc0-4bbc-9f1f-61e5ee7f18ed tempest-CreateVolumesFromSnapshotTest-2119669264 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.818s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:30:53 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-e1eadc83-acc0-4bbc-9f1f-61e5ee7f18ed tempest-CreateVolumesFromSnapshotTest-2119669264 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:30:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-418152216',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83e37e8c-7c78-4854-a900-3a3c33219c88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ed354397e4746949a3143134c0f9610',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:30:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:30:51Z,use_quota=True,user_id='3f4a957b9fec41f2a34ccfbae96acc10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)}" {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 06:30:53 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-e1eadc83-acc0-4bbc-9f1f-61e5ee7f18ed tempest-CreateVolumesFromSnapshotTest-2119669264 None] Creating volume 83e37e8c-7c78-4854-a900-3a3c33219c88 {{(pid=88695) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 06:30:53 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-e1eadc83-acc0-4bbc-9f1f-61e5ee7f18ed tempest-CreateVolumesFromSnapshotTest-2119669264 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:30:53 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-e1eadc83-acc0-4bbc-9f1f-61e5ee7f18ed tempest-CreateVolumesFromSnapshotTest-2119669264 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:30:53 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-e1eadc83-acc0-4bbc-9f1f-61e5ee7f18ed tempest-CreateVolumesFromSnapshotTest-2119669264 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:30:53 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-e1eadc83-acc0-4bbc-9f1f-61e5ee7f18ed tempest-CreateVolumesFromSnapshotTest-2119669264 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:30:53 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-e1eadc83-acc0-4bbc-9f1f-61e5ee7f18ed tempest-CreateVolumesFromSnapshotTest-2119669264 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:30:53 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-e1eadc83-acc0-4bbc-9f1f-61e5ee7f18ed tempest-CreateVolumesFromSnapshotTest-2119669264 None] Selected osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 as target Quobyte volume. {{(pid=88695) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 06:30:53 devstack cinder-volume[88695]: INFO cinder.volume.drivers.remotefs [None req-e1eadc83-acc0-4bbc-9f1f-61e5ee7f18ed tempest-CreateVolumesFromSnapshotTest-2119669264 None] casted to osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 Aug 05 06:30:53 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-e1eadc83-acc0-4bbc-9f1f-61e5ee7f18ed tempest-CreateVolumesFromSnapshotTest-2119669264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-83e37e8c-7c78-4854-a900-3a3c33219c88 1073741824 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:30:53 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-3b826ef7-9ae6-4e15-a581-d3396ce92e03 tempest-CreateVolumesFromSnapshotTest-2119669264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0411630-97b6-4416-83fb-206545ee67a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a095fb1-8ad2-4938-8598-8d3af510338a', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:30:53 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-3b826ef7-9ae6-4e15-a581-d3396ce92e03 tempest-CreateVolumesFromSnapshotTest-2119669264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7603a5b1-6642-4763-891a-f4bbce2a8186) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:30:53 devstack sudo[108516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-83e37e8c-7c78-4854-a900-3a3c33219c88 1073741824 Aug 05 06:30:53 devstack sudo[108516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:30:54 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-3b826ef7-9ae6-4e15-a581-d3396ce92e03 tempest-CreateVolumesFromSnapshotTest-2119669264 None] Volume volume-1a095fb1-8ad2-4938-8598-8d3af510338a (1a095fb1-8ad2-4938-8598-8d3af510338a): created successfully Aug 05 06:30:54 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-3b826ef7-9ae6-4e15-a581-d3396ce92e03 tempest-CreateVolumesFromSnapshotTest-2119669264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7603a5b1-6642-4763-891a-f4bbce2a8186) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:30:54 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-3b826ef7-9ae6-4e15-a581-d3396ce92e03 tempest-CreateVolumesFromSnapshotTest-2119669264 None] Flow 'volume_create_manager' (dca8b236-7e02-4434-b7d1-cf95d950a1a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:30:54 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-d6c9b721-0c1c-4345-a3b7-5f0b3bd2953b tempest-VolumeImageDependencyTests-768896694 None] Acquiring lock "cinder-1a48e355-7f38-41fc-8930-a87861389946-delete_volume" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:30:54 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-513b4728-2fea-415b-92fe-8340ecd94ebc tempest-VolumeAndVolumeTypeFromImageTest-719304038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fec5fea-f71d-4567-9462-22efbedd415d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9bb219fc-af1f-4eec-b3dc-517d57498a94', 'volume_size': 1, 'image_id': '0070e005-4c44-478a-aa34-8f6476690d5f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0070e005-4c44-478a-aa34-8f6476690d5f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '07633c6825fa1909531552b37b5b8c5e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'f8fe921f2e49452b9d0d288e7b5d625e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6330ee369bb2c3753911b33e2cc228d401b695a725391b7ef6a350c18c20836442e86c8976af0bc8aab7ce114f23f80c8b35d463558d24dc2280fb18c8c004c9', 'id': '0070e005-4c44-478a-aa34-8f6476690d5f', 'created_at': datetime.datetime(2026, 8, 5, 4, 30, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 5, 4, 30, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0070e005-4c44-478a-aa34-8f6476690d5f/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:30:54 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-513b4728-2fea-415b-92fe-8340ecd94ebc tempest-VolumeAndVolumeTypeFromImageTest-719304038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b6e71ff-05b6-4b4e-bdf5-cacb59b6e95c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:30:54 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-3b826ef7-9ae6-4e15-a581-d3396ce92e03 tempest-CreateVolumesFromSnapshotTest-2119669264 None] Created volume successfully. Aug 05 06:30:54 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-513b4728-2fea-415b-92fe-8340ecd94ebc tempest-VolumeAndVolumeTypeFromImageTest-719304038 None] Volume volume-9bb219fc-af1f-4eec-b3dc-517d57498a94 (9bb219fc-af1f-4eec-b3dc-517d57498a94): created successfully Aug 05 06:30:54 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-513b4728-2fea-415b-92fe-8340ecd94ebc tempest-VolumeAndVolumeTypeFromImageTest-719304038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b6e71ff-05b6-4b4e-bdf5-cacb59b6e95c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:30:54 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-513b4728-2fea-415b-92fe-8340ecd94ebc tempest-VolumeAndVolumeTypeFromImageTest-719304038 None] Flow 'volume_create_manager' (9c10184e-cbef-40e8-8dfa-36397ede13db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:30:54 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-d6c9b721-0c1c-4345-a3b7-5f0b3bd2953b tempest-VolumeImageDependencyTests-768896694 None] Lock "cinder-1a48e355-7f38-41fc-8930-a87861389946-delete_volume" acquired by "delete_volume" :: waited 0.068s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:30:54 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-513b4728-2fea-415b-92fe-8340ecd94ebc tempest-VolumeAndVolumeTypeFromImageTest-719304038 None] Created volume successfully. Aug 05 06:30:54 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-d6c9b721-0c1c-4345-a3b7-5f0b3bd2953b tempest-VolumeImageDependencyTests-768896694 None] Acquiring lock "cinder-quobyte-1a48e355-7f38-41fc-8930-a87861389946" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:30:54 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-d6c9b721-0c1c-4345-a3b7-5f0b3bd2953b tempest-VolumeImageDependencyTests-768896694 None] Lock "cinder-quobyte-1a48e355-7f38-41fc-8930-a87861389946" acquired by "delete_volume" :: waited 0.018s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:30:54 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9db0d92-806a-4b21-9732-821b8787daaa]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:30:54 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-d6c9b721-0c1c-4345-a3b7-5f0b3bd2953b tempest-VolumeImageDependencyTests-768896694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-1a48e355-7f38-41fc-8930-a87861389946 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:30:54 devstack sudo[108521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-1a48e355-7f38-41fc-8930-a87861389946 Aug 05 06:30:54 devstack sudo[108521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:30:54 devstack sudo[108516]: pam_unix(sudo:session): session closed for user root Aug 05 06:30:54 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-b3d498c2-b8b2-4106-ad73-09e936a54e27 tempest-CreateVolumesFromImageTest-1660354549 None] Acquiring lock "cinder-6ba13aa8-65cb-4089-8460-bfd804673440-delete_volume" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:30:54 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-e1eadc83-acc0-4bbc-9f1f-61e5ee7f18ed tempest-CreateVolumesFromSnapshotTest-2119669264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-83e37e8c-7c78-4854-a900-3a3c33219c88 1073741824" returned: 0 in 0.522s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:30:54 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-b3d498c2-b8b2-4106-ad73-09e936a54e27 tempest-CreateVolumesFromImageTest-1660354549 None] Lock "cinder-6ba13aa8-65cb-4089-8460-bfd804673440-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:30:54 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-e1eadc83-acc0-4bbc-9f1f-61e5ee7f18ed tempest-CreateVolumesFromSnapshotTest-2119669264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-83e37e8c-7c78-4854-a900-3a3c33219c88 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:30:54 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-b3d498c2-b8b2-4106-ad73-09e936a54e27 tempest-CreateVolumesFromImageTest-1660354549 None] Acquiring lock "cinder-quobyte-6ba13aa8-65cb-4089-8460-bfd804673440" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:30:54 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-b3d498c2-b8b2-4106-ad73-09e936a54e27 tempest-CreateVolumesFromImageTest-1660354549 None] Lock "cinder-quobyte-6ba13aa8-65cb-4089-8460-bfd804673440" acquired by "delete_volume" :: waited 0.019s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:30:54 devstack sudo[108523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-83e37e8c-7c78-4854-a900-3a3c33219c88 Aug 05 06:30:54 devstack sudo[108523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:30:54 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf3161c9-cea3-4351-b3d8-bf1928caa3fa]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:30:54 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-b3d498c2-b8b2-4106-ad73-09e936a54e27 tempest-CreateVolumesFromImageTest-1660354549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-6ba13aa8-65cb-4089-8460-bfd804673440 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:30:54 devstack sudo[108521]: pam_unix(sudo:session): session closed for user root Aug 05 06:30:54 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-d6c9b721-0c1c-4345-a3b7-5f0b3bd2953b tempest-VolumeImageDependencyTests-768896694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-1a48e355-7f38-41fc-8930-a87861389946" returned: 0 in 0.442s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:30:54 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-d6c9b721-0c1c-4345-a3b7-5f0b3bd2953b tempest-VolumeImageDependencyTests-768896694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-1a48e355-7f38-41fc-8930-a87861389946 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:30:54 devstack sudo[108526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-6ba13aa8-65cb-4089-8460-bfd804673440 Aug 05 06:30:54 devstack sudo[108526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:30:54 devstack sudo[108529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-1a48e355-7f38-41fc-8930-a87861389946 Aug 05 06:30:54 devstack sudo[108529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:30:54 devstack sudo[108523]: pam_unix(sudo:session): session closed for user root Aug 05 06:30:54 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-e1eadc83-acc0-4bbc-9f1f-61e5ee7f18ed tempest-CreateVolumesFromSnapshotTest-2119669264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-83e37e8c-7c78-4854-a900-3a3c33219c88" returned: 0 in 0.302s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:30:54 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-e1eadc83-acc0-4bbc-9f1f-61e5ee7f18ed tempest-CreateVolumesFromSnapshotTest-2119669264 None] <== create_volume: return (902ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'} {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 06:30:54 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-e1eadc83-acc0-4bbc-9f1f-61e5ee7f18ed tempest-CreateVolumesFromSnapshotTest-2119669264 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.905s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:30:54 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-1741ab19-c03a-4990-975d-70e2d8a8bacc tempest-CreateVolumesFromSnapshotTest-2119669264 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.039s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:30:54 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-1741ab19-c03a-4990-975d-70e2d8a8bacc tempest-CreateVolumesFromSnapshotTest-2119669264 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:30:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1523972696',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f70e629-3f42-4408-aa3c-e1d04d4121ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ed354397e4746949a3143134c0f9610',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:30:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:30:52Z,use_quota=True,user_id='3f4a957b9fec41f2a34ccfbae96acc10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)}" {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 06:30:54 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-1741ab19-c03a-4990-975d-70e2d8a8bacc tempest-CreateVolumesFromSnapshotTest-2119669264 None] Creating volume 9f70e629-3f42-4408-aa3c-e1d04d4121ad {{(pid=88695) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 06:30:54 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-1741ab19-c03a-4990-975d-70e2d8a8bacc tempest-CreateVolumesFromSnapshotTest-2119669264 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:30:54 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-1741ab19-c03a-4990-975d-70e2d8a8bacc tempest-CreateVolumesFromSnapshotTest-2119669264 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:30:54 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-1741ab19-c03a-4990-975d-70e2d8a8bacc tempest-CreateVolumesFromSnapshotTest-2119669264 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:30:54 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-1741ab19-c03a-4990-975d-70e2d8a8bacc tempest-CreateVolumesFromSnapshotTest-2119669264 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:30:54 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-1741ab19-c03a-4990-975d-70e2d8a8bacc tempest-CreateVolumesFromSnapshotTest-2119669264 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:30:54 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-1741ab19-c03a-4990-975d-70e2d8a8bacc tempest-CreateVolumesFromSnapshotTest-2119669264 None] Selected osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 as target Quobyte volume. {{(pid=88695) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 06:30:54 devstack cinder-volume[88695]: INFO cinder.volume.drivers.remotefs [None req-1741ab19-c03a-4990-975d-70e2d8a8bacc tempest-CreateVolumesFromSnapshotTest-2119669264 None] casted to osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 Aug 05 06:30:54 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-1741ab19-c03a-4990-975d-70e2d8a8bacc tempest-CreateVolumesFromSnapshotTest-2119669264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9f70e629-3f42-4408-aa3c-e1d04d4121ad 1073741824 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:30:54 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-e1eadc83-acc0-4bbc-9f1f-61e5ee7f18ed tempest-CreateVolumesFromSnapshotTest-2119669264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c790a06b-e77e-4207-852e-940e0a757598) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-83e37e8c-7c78-4854-a900-3a3c33219c88', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:30:54 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-e1eadc83-acc0-4bbc-9f1f-61e5ee7f18ed tempest-CreateVolumesFromSnapshotTest-2119669264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (490ece57-f586-4a42-aeba-508b6aacfd17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:30:54 devstack sudo[108533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9f70e629-3f42-4408-aa3c-e1d04d4121ad 1073741824 Aug 05 06:30:54 devstack sudo[108533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:30:54 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-e1eadc83-acc0-4bbc-9f1f-61e5ee7f18ed tempest-CreateVolumesFromSnapshotTest-2119669264 None] Volume volume-83e37e8c-7c78-4854-a900-3a3c33219c88 (83e37e8c-7c78-4854-a900-3a3c33219c88): created successfully Aug 05 06:30:54 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-e1eadc83-acc0-4bbc-9f1f-61e5ee7f18ed tempest-CreateVolumesFromSnapshotTest-2119669264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (490ece57-f586-4a42-aeba-508b6aacfd17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:30:54 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-e1eadc83-acc0-4bbc-9f1f-61e5ee7f18ed tempest-CreateVolumesFromSnapshotTest-2119669264 None] Flow 'volume_create_manager' (13235d0d-9528-491e-9679-affaa802ef28) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:30:55 devstack sudo[108529]: pam_unix(sudo:session): session closed for user root Aug 05 06:30:55 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-e1eadc83-acc0-4bbc-9f1f-61e5ee7f18ed tempest-CreateVolumesFromSnapshotTest-2119669264 None] Created volume successfully. Aug 05 06:30:55 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-d6c9b721-0c1c-4345-a3b7-5f0b3bd2953b tempest-VolumeImageDependencyTests-768896694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-1a48e355-7f38-41fc-8930-a87861389946" returned: 0 in 0.309s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:30:55 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-d6c9b721-0c1c-4345-a3b7-5f0b3bd2953b tempest-VolumeImageDependencyTests-768896694 None] Lock "cinder-quobyte-1a48e355-7f38-41fc-8930-a87861389946" released by "delete_volume" :: held 0.818s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:30:55 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-83e113b3-6846-48c2-87aa-d85c428cda06 tempest-VolumeAndVolumeTypeFromImageTest-719304038 None] Acquiring lock "cinder-9bb219fc-af1f-4eec-b3dc-517d57498a94-delete_volume" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:30:55 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-83e113b3-6846-48c2-87aa-d85c428cda06 tempest-VolumeAndVolumeTypeFromImageTest-719304038 None] Lock "cinder-9bb219fc-af1f-4eec-b3dc-517d57498a94-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:30:55 devstack sudo[108526]: pam_unix(sudo:session): session closed for user root Aug 05 06:30:55 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-b3d498c2-b8b2-4106-ad73-09e936a54e27 tempest-CreateVolumesFromImageTest-1660354549 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-6ba13aa8-65cb-4089-8460-bfd804673440" returned: 0 in 0.510s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:30:55 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-b3d498c2-b8b2-4106-ad73-09e936a54e27 tempest-CreateVolumesFromImageTest-1660354549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-6ba13aa8-65cb-4089-8460-bfd804673440 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:30:55 devstack sudo[108539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-6ba13aa8-65cb-4089-8460-bfd804673440 Aug 05 06:30:55 devstack sudo[108539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:30:55 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-83e113b3-6846-48c2-87aa-d85c428cda06 tempest-VolumeAndVolumeTypeFromImageTest-719304038 None] Acquiring lock "cinder-quobyte-9bb219fc-af1f-4eec-b3dc-517d57498a94" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:30:55 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-83e113b3-6846-48c2-87aa-d85c428cda06 tempest-VolumeAndVolumeTypeFromImageTest-719304038 None] Lock "cinder-quobyte-9bb219fc-af1f-4eec-b3dc-517d57498a94" acquired by "delete_volume" :: waited 0.028s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:30:55 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-d6c9b721-0c1c-4345-a3b7-5f0b3bd2953b tempest-VolumeImageDependencyTests-768896694 None] Created reservations ['cf71d462-9ee8-4f71-b7f0-81e50cde5be1', 'c6003e8d-7007-40bb-bcb1-c90c2dfab35b', '77f5dc6b-fc18-4612-8130-8f5ea4129b3a', 'dae4ab41-b406-4cc2-8850-6274709684f4'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:30:55 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d3cda02-ba28-4f35-bf6a-4e5592311bc0]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:30:55 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-83e113b3-6846-48c2-87aa-d85c428cda06 tempest-VolumeAndVolumeTypeFromImageTest-719304038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9bb219fc-af1f-4eec-b3dc-517d57498a94 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:30:55 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-d6c9b721-0c1c-4345-a3b7-5f0b3bd2953b tempest-VolumeImageDependencyTests-768896694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:30:55 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-d6c9b721-0c1c-4345-a3b7-5f0b3bd2953b tempest-VolumeImageDependencyTests-768896694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:30:55 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-d6c9b721-0c1c-4345-a3b7-5f0b3bd2953b tempest-VolumeImageDependencyTests-768896694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:30:55 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-d6c9b721-0c1c-4345-a3b7-5f0b3bd2953b tempest-VolumeImageDependencyTests-768896694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:30:55 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-d6c9b721-0c1c-4345-a3b7-5f0b3bd2953b tempest-VolumeImageDependencyTests-768896694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:30:55 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-d6c9b721-0c1c-4345-a3b7-5f0b3bd2953b tempest-VolumeImageDependencyTests-768896694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:30:55 devstack sudo[108544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9bb219fc-af1f-4eec-b3dc-517d57498a94 Aug 05 06:30:55 devstack sudo[108544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:30:55 devstack sudo[108545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce Aug 05 06:30:55 devstack sudo[108545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:30:55 devstack sudo[108539]: pam_unix(sudo:session): session closed for user root Aug 05 06:30:55 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-b3d498c2-b8b2-4106-ad73-09e936a54e27 tempest-CreateVolumesFromImageTest-1660354549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-6ba13aa8-65cb-4089-8460-bfd804673440" returned: 0 in 0.345s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:30:55 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-b3d498c2-b8b2-4106-ad73-09e936a54e27 tempest-CreateVolumesFromImageTest-1660354549 None] Lock "cinder-quobyte-6ba13aa8-65cb-4089-8460-bfd804673440" released by "delete_volume" :: held 0.910s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:30:55 devstack sudo[108533]: pam_unix(sudo:session): session closed for user root Aug 05 06:30:55 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-1741ab19-c03a-4990-975d-70e2d8a8bacc tempest-CreateVolumesFromSnapshotTest-2119669264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9f70e629-3f42-4408-aa3c-e1d04d4121ad 1073741824" returned: 0 in 0.684s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:30:55 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-b3d498c2-b8b2-4106-ad73-09e936a54e27 tempest-CreateVolumesFromImageTest-1660354549 None] Created reservations ['40eba053-1062-4faf-9fab-2fc876d31746', 'fb3a7a77-d52c-48c8-a868-4840d51767cc', '00fdca3b-4673-4dbf-9c3a-916a074637ff', '912ef978-3e49-43f6-91f1-95d27f433a34'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:30:55 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-1741ab19-c03a-4990-975d-70e2d8a8bacc tempest-CreateVolumesFromSnapshotTest-2119669264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9f70e629-3f42-4408-aa3c-e1d04d4121ad {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:30:55 devstack sudo[108550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9f70e629-3f42-4408-aa3c-e1d04d4121ad Aug 05 06:30:55 devstack sudo[108550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:30:55 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-b3d498c2-b8b2-4106-ad73-09e936a54e27 tempest-CreateVolumesFromImageTest-1660354549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:30:55 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-b3d498c2-b8b2-4106-ad73-09e936a54e27 tempest-CreateVolumesFromImageTest-1660354549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:30:55 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-b3d498c2-b8b2-4106-ad73-09e936a54e27 tempest-CreateVolumesFromImageTest-1660354549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:30:55 devstack sudo[108545]: pam_unix(sudo:session): session closed for user root Aug 05 06:30:55 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-b3d498c2-b8b2-4106-ad73-09e936a54e27 tempest-CreateVolumesFromImageTest-1660354549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:30:55 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-b3d498c2-b8b2-4106-ad73-09e936a54e27 tempest-CreateVolumesFromImageTest-1660354549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:30:55 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-b3d498c2-b8b2-4106-ad73-09e936a54e27 tempest-CreateVolumesFromImageTest-1660354549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:30:55 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-d6c9b721-0c1c-4345-a3b7-5f0b3bd2953b tempest-VolumeImageDependencyTests-768896694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce" returned: 0 in 0.357s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:30:55 devstack cinder-volume[88695]: DEBUG cinder.manager [None req-d6c9b721-0c1c-4345-a3b7-5f0b3bd2953b tempest-VolumeImageDependencyTests-768896694 None] Notifying Schedulers of capabilities ... {{(pid=88695) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 06:30:55 devstack sudo[108544]: pam_unix(sudo:session): session closed for user root Aug 05 06:30:55 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-d6c9b721-0c1c-4345-a3b7-5f0b3bd2953b tempest-VolumeImageDependencyTests-768896694 None] Deleted volume successfully. Aug 05 06:30:55 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-83e113b3-6846-48c2-87aa-d85c428cda06 tempest-VolumeAndVolumeTypeFromImageTest-719304038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9bb219fc-af1f-4eec-b3dc-517d57498a94" returned: 0 in 0.487s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:30:55 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-83e113b3-6846-48c2-87aa-d85c428cda06 tempest-VolumeAndVolumeTypeFromImageTest-719304038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9bb219fc-af1f-4eec-b3dc-517d57498a94 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:30:55 devstack sudo[108555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce Aug 05 06:30:55 devstack sudo[108555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:30:55 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-d6c9b721-0c1c-4345-a3b7-5f0b3bd2953b tempest-VolumeImageDependencyTests-768896694 None] Lock "cinder-1a48e355-7f38-41fc-8930-a87861389946-delete_volume" released by "delete_volume" :: held 1.612s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:30:55 devstack sudo[108557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9bb219fc-af1f-4eec-b3dc-517d57498a94 Aug 05 06:30:55 devstack sudo[108557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:30:55 devstack sudo[108550]: pam_unix(sudo:session): session closed for user root Aug 05 06:30:55 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-1741ab19-c03a-4990-975d-70e2d8a8bacc tempest-CreateVolumesFromSnapshotTest-2119669264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9f70e629-3f42-4408-aa3c-e1d04d4121ad" returned: 0 in 0.335s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:30:55 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-1741ab19-c03a-4990-975d-70e2d8a8bacc tempest-CreateVolumesFromSnapshotTest-2119669264 None] <== create_volume: return (1097ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'} {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 06:30:55 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-1741ab19-c03a-4990-975d-70e2d8a8bacc tempest-CreateVolumesFromSnapshotTest-2119669264 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.101s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:30:55 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-1741ab19-c03a-4990-975d-70e2d8a8bacc tempest-CreateVolumesFromSnapshotTest-2119669264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc620112-4816-4384-a7d9-0002180d4838) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f70e629-3f42-4408-aa3c-e1d04d4121ad', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:30:55 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-1741ab19-c03a-4990-975d-70e2d8a8bacc tempest-CreateVolumesFromSnapshotTest-2119669264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (811e1a52-7ebb-4c4f-90c0-fa8fce2b75d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:30:55 devstack sudo[108555]: pam_unix(sudo:session): session closed for user root Aug 05 06:30:56 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-b3d498c2-b8b2-4106-ad73-09e936a54e27 tempest-CreateVolumesFromImageTest-1660354549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce" returned: 0 in 0.274s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:30:56 devstack cinder-volume[88695]: DEBUG cinder.manager [None req-b3d498c2-b8b2-4106-ad73-09e936a54e27 tempest-CreateVolumesFromImageTest-1660354549 None] Notifying Schedulers of capabilities ... {{(pid=88695) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 06:30:56 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-b3d498c2-b8b2-4106-ad73-09e936a54e27 tempest-CreateVolumesFromImageTest-1660354549 None] Deleted volume successfully. Aug 05 06:30:56 devstack sudo[108557]: pam_unix(sudo:session): session closed for user root Aug 05 06:30:56 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-83e113b3-6846-48c2-87aa-d85c428cda06 tempest-VolumeAndVolumeTypeFromImageTest-719304038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9bb219fc-af1f-4eec-b3dc-517d57498a94" returned: 0 in 0.268s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:30:56 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-83e113b3-6846-48c2-87aa-d85c428cda06 tempest-VolumeAndVolumeTypeFromImageTest-719304038 None] Lock "cinder-quobyte-9bb219fc-af1f-4eec-b3dc-517d57498a94" released by "delete_volume" :: held 0.818s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:30:56 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-1741ab19-c03a-4990-975d-70e2d8a8bacc tempest-CreateVolumesFromSnapshotTest-2119669264 None] Volume volume-9f70e629-3f42-4408-aa3c-e1d04d4121ad (9f70e629-3f42-4408-aa3c-e1d04d4121ad): created successfully Aug 05 06:30:56 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-1741ab19-c03a-4990-975d-70e2d8a8bacc tempest-CreateVolumesFromSnapshotTest-2119669264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (811e1a52-7ebb-4c4f-90c0-fa8fce2b75d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:30:56 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-1741ab19-c03a-4990-975d-70e2d8a8bacc tempest-CreateVolumesFromSnapshotTest-2119669264 None] Flow 'volume_create_manager' (8cb1bd08-73de-4cf0-b5af-1c6627a8e924) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:30:56 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-83e113b3-6846-48c2-87aa-d85c428cda06 tempest-VolumeAndVolumeTypeFromImageTest-719304038 None] Created reservations ['8de72e2a-b17a-49d8-8b0d-788f0b222cea', 'b47cc247-4b75-413d-92f0-8bcaf5a378a2', '619904d6-b2b4-45d3-8d21-3dc7b2810245', '76b6cea6-d90b-4d7d-b1da-dfa2ed5af020'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:30:56 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-b3d498c2-b8b2-4106-ad73-09e936a54e27 tempest-CreateVolumesFromImageTest-1660354549 None] Lock "cinder-6ba13aa8-65cb-4089-8460-bfd804673440-delete_volume" released by "delete_volume" :: held 1.623s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:30:56 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-1741ab19-c03a-4990-975d-70e2d8a8bacc tempest-CreateVolumesFromSnapshotTest-2119669264 None] Created volume successfully. Aug 05 06:30:56 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-83e113b3-6846-48c2-87aa-d85c428cda06 tempest-VolumeAndVolumeTypeFromImageTest-719304038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:30:56 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-83e113b3-6846-48c2-87aa-d85c428cda06 tempest-VolumeAndVolumeTypeFromImageTest-719304038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:30:56 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-83e113b3-6846-48c2-87aa-d85c428cda06 tempest-VolumeAndVolumeTypeFromImageTest-719304038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:30:56 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-83e113b3-6846-48c2-87aa-d85c428cda06 tempest-VolumeAndVolumeTypeFromImageTest-719304038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:30:56 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-83e113b3-6846-48c2-87aa-d85c428cda06 tempest-VolumeAndVolumeTypeFromImageTest-719304038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:30:56 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-83e113b3-6846-48c2-87aa-d85c428cda06 tempest-VolumeAndVolumeTypeFromImageTest-719304038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:30:56 devstack sudo[108562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce Aug 05 06:30:56 devstack sudo[108562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:30:56 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-46719f5f-02da-4d37-90fb-13b35b0da5ef tempest-CreateVolumesFromSnapshotTest-2119669264 None] Acquiring lock "cinder-9f70e629-3f42-4408-aa3c-e1d04d4121ad-delete_volume" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:30:56 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-46719f5f-02da-4d37-90fb-13b35b0da5ef tempest-CreateVolumesFromSnapshotTest-2119669264 None] Lock "cinder-9f70e629-3f42-4408-aa3c-e1d04d4121ad-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:30:56 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-46719f5f-02da-4d37-90fb-13b35b0da5ef tempest-CreateVolumesFromSnapshotTest-2119669264 None] Acquiring lock "cinder-quobyte-9f70e629-3f42-4408-aa3c-e1d04d4121ad" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:30:56 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-46719f5f-02da-4d37-90fb-13b35b0da5ef tempest-CreateVolumesFromSnapshotTest-2119669264 None] Lock "cinder-quobyte-9f70e629-3f42-4408-aa3c-e1d04d4121ad" acquired by "delete_volume" :: waited 0.033s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:30:56 devstack sudo[108562]: pam_unix(sudo:session): session closed for user root Aug 05 06:30:56 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-83e113b3-6846-48c2-87aa-d85c428cda06 tempest-VolumeAndVolumeTypeFromImageTest-719304038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce" returned: 0 in 0.397s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:30:56 devstack cinder-volume[88695]: DEBUG cinder.manager [None req-83e113b3-6846-48c2-87aa-d85c428cda06 tempest-VolumeAndVolumeTypeFromImageTest-719304038 None] Notifying Schedulers of capabilities ... {{(pid=88695) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 06:30:56 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aef0fad-eb18-49a9-8b6b-6f9361fa517b]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:30:56 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-46719f5f-02da-4d37-90fb-13b35b0da5ef tempest-CreateVolumesFromSnapshotTest-2119669264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9f70e629-3f42-4408-aa3c-e1d04d4121ad {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:30:56 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-83e113b3-6846-48c2-87aa-d85c428cda06 tempest-VolumeAndVolumeTypeFromImageTest-719304038 None] Deleted volume successfully. Aug 05 06:30:56 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-83e113b3-6846-48c2-87aa-d85c428cda06 tempest-VolumeAndVolumeTypeFromImageTest-719304038 None] Lock "cinder-9bb219fc-af1f-4eec-b3dc-517d57498a94-delete_volume" released by "delete_volume" :: held 1.550s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:30:56 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-b49944ab-2d4f-41bb-b626-2629629b4ded tempest-CreateVolumesFromImageTest-1660354549 None] Acquiring lock "cinder-b785db54-adc6-4228-9b29-855281f55a92-delete_volume" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:30:56 devstack sudo[108565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9f70e629-3f42-4408-aa3c-e1d04d4121ad Aug 05 06:30:56 devstack sudo[108565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:30:56 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-b49944ab-2d4f-41bb-b626-2629629b4ded tempest-CreateVolumesFromImageTest-1660354549 None] Lock "cinder-b785db54-adc6-4228-9b29-855281f55a92-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:30:56 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-b49944ab-2d4f-41bb-b626-2629629b4ded tempest-CreateVolumesFromImageTest-1660354549 None] Acquiring lock "cinder-quobyte-b785db54-adc6-4228-9b29-855281f55a92" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:30:56 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-b49944ab-2d4f-41bb-b626-2629629b4ded tempest-CreateVolumesFromImageTest-1660354549 None] Lock "cinder-quobyte-b785db54-adc6-4228-9b29-855281f55a92" acquired by "delete_volume" :: waited 0.030s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:30:56 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[590bedf8-6568-4626-a702-dffa363dff92]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:30:56 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-b49944ab-2d4f-41bb-b626-2629629b4ded tempest-CreateVolumesFromImageTest-1660354549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-b785db54-adc6-4228-9b29-855281f55a92 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:30:57 devstack sudo[108567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-b785db54-adc6-4228-9b29-855281f55a92 Aug 05 06:30:57 devstack sudo[108567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:30:57 devstack sudo[108565]: pam_unix(sudo:session): session closed for user root Aug 05 06:30:57 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-46719f5f-02da-4d37-90fb-13b35b0da5ef tempest-CreateVolumesFromSnapshotTest-2119669264 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9f70e629-3f42-4408-aa3c-e1d04d4121ad" returned: 0 in 0.538s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:30:57 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-46719f5f-02da-4d37-90fb-13b35b0da5ef tempest-CreateVolumesFromSnapshotTest-2119669264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9f70e629-3f42-4408-aa3c-e1d04d4121ad {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:30:57 devstack sudo[108572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9f70e629-3f42-4408-aa3c-e1d04d4121ad Aug 05 06:30:57 devstack sudo[108572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:30:57 devstack sudo[108567]: pam_unix(sudo:session): session closed for user root Aug 05 06:30:57 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-b49944ab-2d4f-41bb-b626-2629629b4ded tempest-CreateVolumesFromImageTest-1660354549 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-b785db54-adc6-4228-9b29-855281f55a92" returned: 0 in 0.538s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:30:57 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-b49944ab-2d4f-41bb-b626-2629629b4ded tempest-CreateVolumesFromImageTest-1660354549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-b785db54-adc6-4228-9b29-855281f55a92 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:30:57 devstack sudo[108577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-b785db54-adc6-4228-9b29-855281f55a92 Aug 05 06:30:57 devstack sudo[108577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:30:57 devstack sudo[108572]: pam_unix(sudo:session): session closed for user root Aug 05 06:30:57 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-46719f5f-02da-4d37-90fb-13b35b0da5ef tempest-CreateVolumesFromSnapshotTest-2119669264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9f70e629-3f42-4408-aa3c-e1d04d4121ad" returned: 0 in 0.536s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:30:57 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-46719f5f-02da-4d37-90fb-13b35b0da5ef tempest-CreateVolumesFromSnapshotTest-2119669264 None] Lock "cinder-quobyte-9f70e629-3f42-4408-aa3c-e1d04d4121ad" released by "delete_volume" :: held 1.154s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:30:57 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-46719f5f-02da-4d37-90fb-13b35b0da5ef tempest-CreateVolumesFromSnapshotTest-2119669264 None] Created reservations ['b9d509c4-dc01-408f-9de9-d85e487e8b24', 'dd05f112-a42c-4544-85f8-101a300291c0', '98538c2e-4f47-4891-835d-77cc156aba5e', 'a8fd8719-adab-486f-a835-4926186e1570'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:30:57 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-46719f5f-02da-4d37-90fb-13b35b0da5ef tempest-CreateVolumesFromSnapshotTest-2119669264 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:30:57 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-46719f5f-02da-4d37-90fb-13b35b0da5ef tempest-CreateVolumesFromSnapshotTest-2119669264 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:30:57 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-46719f5f-02da-4d37-90fb-13b35b0da5ef tempest-CreateVolumesFromSnapshotTest-2119669264 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:30:57 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-46719f5f-02da-4d37-90fb-13b35b0da5ef tempest-CreateVolumesFromSnapshotTest-2119669264 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:30:57 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-46719f5f-02da-4d37-90fb-13b35b0da5ef tempest-CreateVolumesFromSnapshotTest-2119669264 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:30:57 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-46719f5f-02da-4d37-90fb-13b35b0da5ef tempest-CreateVolumesFromSnapshotTest-2119669264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:30:57 devstack sudo[108581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce Aug 05 06:30:57 devstack sudo[108581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:30:57 devstack sudo[108577]: pam_unix(sudo:session): session closed for user root Aug 05 06:30:57 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-b49944ab-2d4f-41bb-b626-2629629b4ded tempest-CreateVolumesFromImageTest-1660354549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-b785db54-adc6-4228-9b29-855281f55a92" returned: 0 in 0.464s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:30:58 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-b49944ab-2d4f-41bb-b626-2629629b4ded tempest-CreateVolumesFromImageTest-1660354549 None] Lock "cinder-quobyte-b785db54-adc6-4228-9b29-855281f55a92" released by "delete_volume" :: held 1.074s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:30:58 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-b49944ab-2d4f-41bb-b626-2629629b4ded tempest-CreateVolumesFromImageTest-1660354549 None] Created reservations ['d2342105-1033-4d2d-bc57-73abf0d5642b', '61b0c6fb-6bc5-49c2-81ae-052cc442e100', '30f72a2a-772c-4032-8a1b-53d2a529b19a', 'd3419c38-bd22-4ae2-ba08-ba79b6f717d5'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:30:58 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-b49944ab-2d4f-41bb-b626-2629629b4ded tempest-CreateVolumesFromImageTest-1660354549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:30:58 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-b49944ab-2d4f-41bb-b626-2629629b4ded tempest-CreateVolumesFromImageTest-1660354549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:30:58 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-b49944ab-2d4f-41bb-b626-2629629b4ded tempest-CreateVolumesFromImageTest-1660354549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:30:58 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-b49944ab-2d4f-41bb-b626-2629629b4ded tempest-CreateVolumesFromImageTest-1660354549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:30:58 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-b49944ab-2d4f-41bb-b626-2629629b4ded tempest-CreateVolumesFromImageTest-1660354549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:30:58 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-b49944ab-2d4f-41bb-b626-2629629b4ded tempest-CreateVolumesFromImageTest-1660354549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:30:58 devstack sudo[108581]: pam_unix(sudo:session): session closed for user root Aug 05 06:30:58 devstack sudo[108584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce Aug 05 06:30:58 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-46719f5f-02da-4d37-90fb-13b35b0da5ef tempest-CreateVolumesFromSnapshotTest-2119669264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce" returned: 0 in 0.322s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:30:58 devstack sudo[108584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:30:58 devstack cinder-volume[88695]: DEBUG cinder.manager [None req-46719f5f-02da-4d37-90fb-13b35b0da5ef tempest-CreateVolumesFromSnapshotTest-2119669264 None] Notifying Schedulers of capabilities ... {{(pid=88695) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 06:30:58 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-46719f5f-02da-4d37-90fb-13b35b0da5ef tempest-CreateVolumesFromSnapshotTest-2119669264 None] Deleted volume successfully. Aug 05 06:30:58 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-46719f5f-02da-4d37-90fb-13b35b0da5ef tempest-CreateVolumesFromSnapshotTest-2119669264 None] Lock "cinder-9f70e629-3f42-4408-aa3c-e1d04d4121ad-delete_volume" released by "delete_volume" :: held 1.843s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:30:58 devstack sudo[108584]: pam_unix(sudo:session): session closed for user root Aug 05 06:30:58 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-b49944ab-2d4f-41bb-b626-2629629b4ded tempest-CreateVolumesFromImageTest-1660354549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce" returned: 0 in 0.353s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:30:58 devstack cinder-volume[88695]: DEBUG cinder.manager [None req-b49944ab-2d4f-41bb-b626-2629629b4ded tempest-CreateVolumesFromImageTest-1660354549 None] Notifying Schedulers of capabilities ... {{(pid=88695) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 06:30:58 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-b49944ab-2d4f-41bb-b626-2629629b4ded tempest-CreateVolumesFromImageTest-1660354549 None] Deleted volume successfully. Aug 05 06:30:58 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-b49944ab-2d4f-41bb-b626-2629629b4ded tempest-CreateVolumesFromImageTest-1660354549 None] Lock "cinder-b785db54-adc6-4228-9b29-855281f55a92-delete_volume" released by "delete_volume" :: held 1.730s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:30:58 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-25107a61-176b-460c-89e1-0ef40bceb2e0 tempest-CreateVolumesFromSnapshotTest-2119669264 None] Acquiring lock "cinder-83e37e8c-7c78-4854-a900-3a3c33219c88-delete_volume" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:30:58 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-25107a61-176b-460c-89e1-0ef40bceb2e0 tempest-CreateVolumesFromSnapshotTest-2119669264 None] Lock "cinder-83e37e8c-7c78-4854-a900-3a3c33219c88-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:30:58 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-25107a61-176b-460c-89e1-0ef40bceb2e0 tempest-CreateVolumesFromSnapshotTest-2119669264 None] Acquiring lock "cinder-quobyte-83e37e8c-7c78-4854-a900-3a3c33219c88" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:30:58 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-25107a61-176b-460c-89e1-0ef40bceb2e0 tempest-CreateVolumesFromSnapshotTest-2119669264 None] Lock "cinder-quobyte-83e37e8c-7c78-4854-a900-3a3c33219c88" acquired by "delete_volume" :: waited 0.028s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:30:58 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[540e59ce-b603-4a3f-a3d4-cf796a9bd20b]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:30:58 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-25107a61-176b-460c-89e1-0ef40bceb2e0 tempest-CreateVolumesFromSnapshotTest-2119669264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-83e37e8c-7c78-4854-a900-3a3c33219c88 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:30:58 devstack sudo[108588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-83e37e8c-7c78-4854-a900-3a3c33219c88 Aug 05 06:30:58 devstack sudo[108588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:30:59 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-bac50c2c-9a7a-4c0c-9caf-ee1e300f1337 tempest-CreateVolumesFromImageTest-1660354549 None] Acquiring lock "cinder-e70f9afb-ce5b-4c1a-b58d-62f5d72d2a6b-delete_volume" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:30:59 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-bac50c2c-9a7a-4c0c-9caf-ee1e300f1337 tempest-CreateVolumesFromImageTest-1660354549 None] Lock "cinder-e70f9afb-ce5b-4c1a-b58d-62f5d72d2a6b-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:30:59 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-bac50c2c-9a7a-4c0c-9caf-ee1e300f1337 tempest-CreateVolumesFromImageTest-1660354549 None] Acquiring lock "cinder-quobyte-e70f9afb-ce5b-4c1a-b58d-62f5d72d2a6b" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:30:59 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-bac50c2c-9a7a-4c0c-9caf-ee1e300f1337 tempest-CreateVolumesFromImageTest-1660354549 None] Lock "cinder-quobyte-e70f9afb-ce5b-4c1a-b58d-62f5d72d2a6b" acquired by "delete_volume" :: waited 0.026s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:30:59 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[e21cd17d-0984-48ac-835c-0bb1bf59cd79]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:30:59 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-bac50c2c-9a7a-4c0c-9caf-ee1e300f1337 tempest-CreateVolumesFromImageTest-1660354549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-e70f9afb-ce5b-4c1a-b58d-62f5d72d2a6b {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:30:59 devstack sudo[108588]: pam_unix(sudo:session): session closed for user root Aug 05 06:30:59 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-25107a61-176b-460c-89e1-0ef40bceb2e0 tempest-CreateVolumesFromSnapshotTest-2119669264 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-83e37e8c-7c78-4854-a900-3a3c33219c88" returned: 0 in 0.609s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:30:59 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-25107a61-176b-460c-89e1-0ef40bceb2e0 tempest-CreateVolumesFromSnapshotTest-2119669264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-83e37e8c-7c78-4854-a900-3a3c33219c88 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:30:59 devstack sudo[108594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-83e37e8c-7c78-4854-a900-3a3c33219c88 Aug 05 06:30:59 devstack sudo[108594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:30:59 devstack sudo[108593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-e70f9afb-ce5b-4c1a-b58d-62f5d72d2a6b Aug 05 06:30:59 devstack sudo[108593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:30:59 devstack sudo[108594]: pam_unix(sudo:session): session closed for user root Aug 05 06:30:59 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-25107a61-176b-460c-89e1-0ef40bceb2e0 tempest-CreateVolumesFromSnapshotTest-2119669264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-83e37e8c-7c78-4854-a900-3a3c33219c88" returned: 0 in 0.413s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:30:59 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-25107a61-176b-460c-89e1-0ef40bceb2e0 tempest-CreateVolumesFromSnapshotTest-2119669264 None] Lock "cinder-quobyte-83e37e8c-7c78-4854-a900-3a3c33219c88" released by "delete_volume" :: held 1.082s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:30:59 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-25107a61-176b-460c-89e1-0ef40bceb2e0 tempest-CreateVolumesFromSnapshotTest-2119669264 None] Created reservations ['db9927b1-e49c-439f-8e78-b8061f2fa165', '829aaefb-bfee-4a56-b9b9-e2aaad21761b', '823cf6e7-efef-40b2-91bd-a21c1fe5acb8', 'dc65c0b5-85e7-48e4-9ca5-14dbbb8d6ff9'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:31:00 devstack sudo[108593]: pam_unix(sudo:session): session closed for user root Aug 05 06:31:00 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-25107a61-176b-460c-89e1-0ef40bceb2e0 tempest-CreateVolumesFromSnapshotTest-2119669264 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:31:00 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-25107a61-176b-460c-89e1-0ef40bceb2e0 tempest-CreateVolumesFromSnapshotTest-2119669264 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:31:00 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-25107a61-176b-460c-89e1-0ef40bceb2e0 tempest-CreateVolumesFromSnapshotTest-2119669264 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:31:00 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-25107a61-176b-460c-89e1-0ef40bceb2e0 tempest-CreateVolumesFromSnapshotTest-2119669264 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:31:00 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-25107a61-176b-460c-89e1-0ef40bceb2e0 tempest-CreateVolumesFromSnapshotTest-2119669264 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:31:00 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-25107a61-176b-460c-89e1-0ef40bceb2e0 tempest-CreateVolumesFromSnapshotTest-2119669264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:31:00 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-bac50c2c-9a7a-4c0c-9caf-ee1e300f1337 tempest-CreateVolumesFromImageTest-1660354549 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-e70f9afb-ce5b-4c1a-b58d-62f5d72d2a6b" returned: 0 in 0.666s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:31:00 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-bac50c2c-9a7a-4c0c-9caf-ee1e300f1337 tempest-CreateVolumesFromImageTest-1660354549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-e70f9afb-ce5b-4c1a-b58d-62f5d72d2a6b {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:31:00 devstack sudo[108601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce Aug 05 06:31:00 devstack sudo[108601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:31:00 devstack sudo[108602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-e70f9afb-ce5b-4c1a-b58d-62f5d72d2a6b Aug 05 06:31:00 devstack sudo[108602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:31:00 devstack cinder-volume[88695]: DEBUG oslo_service.periodic_task [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88695) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 06:31:00 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:31:00 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:31:00 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:31:00 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:31:00 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:31:00 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:31:00 devstack sudo[108607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce Aug 05 06:31:00 devstack sudo[108607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:31:00 devstack sudo[108602]: pam_unix(sudo:session): session closed for user root Aug 05 06:31:00 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-bac50c2c-9a7a-4c0c-9caf-ee1e300f1337 tempest-CreateVolumesFromImageTest-1660354549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-e70f9afb-ce5b-4c1a-b58d-62f5d72d2a6b" returned: 0 in 0.399s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:31:00 devstack sudo[108601]: pam_unix(sudo:session): session closed for user root Aug 05 06:31:00 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-25107a61-176b-460c-89e1-0ef40bceb2e0 tempest-CreateVolumesFromSnapshotTest-2119669264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce" returned: 0 in 0.435s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:31:00 devstack cinder-volume[88695]: DEBUG cinder.manager [None req-25107a61-176b-460c-89e1-0ef40bceb2e0 tempest-CreateVolumesFromSnapshotTest-2119669264 None] Notifying Schedulers of capabilities ... {{(pid=88695) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 06:31:00 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-bac50c2c-9a7a-4c0c-9caf-ee1e300f1337 tempest-CreateVolumesFromImageTest-1660354549 None] Lock "cinder-quobyte-e70f9afb-ce5b-4c1a-b58d-62f5d72d2a6b" released by "delete_volume" :: held 1.140s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:31:00 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-25107a61-176b-460c-89e1-0ef40bceb2e0 tempest-CreateVolumesFromSnapshotTest-2119669264 None] Deleted volume successfully. Aug 05 06:31:00 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-25107a61-176b-460c-89e1-0ef40bceb2e0 tempest-CreateVolumesFromSnapshotTest-2119669264 None] Lock "cinder-83e37e8c-7c78-4854-a900-3a3c33219c88-delete_volume" released by "delete_volume" :: held 1.882s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:31:00 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-bac50c2c-9a7a-4c0c-9caf-ee1e300f1337 tempest-CreateVolumesFromImageTest-1660354549 None] Created reservations ['fdf9676e-16a7-4026-b3f2-c2e570568fee', 'd16bcc38-4018-43c6-8bbf-ef8e02abb8d9', '7b9f3af7-4306-4f9b-abb3-f164f4e820d6', '2d87b3a9-7cd9-473b-9370-a26710e7f8a2'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:31:00 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-bac50c2c-9a7a-4c0c-9caf-ee1e300f1337 tempest-CreateVolumesFromImageTest-1660354549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:31:00 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-bac50c2c-9a7a-4c0c-9caf-ee1e300f1337 tempest-CreateVolumesFromImageTest-1660354549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:31:00 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-bac50c2c-9a7a-4c0c-9caf-ee1e300f1337 tempest-CreateVolumesFromImageTest-1660354549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:31:00 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-bac50c2c-9a7a-4c0c-9caf-ee1e300f1337 tempest-CreateVolumesFromImageTest-1660354549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:31:00 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-bac50c2c-9a7a-4c0c-9caf-ee1e300f1337 tempest-CreateVolumesFromImageTest-1660354549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:31:00 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-bac50c2c-9a7a-4c0c-9caf-ee1e300f1337 tempest-CreateVolumesFromImageTest-1660354549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:31:00 devstack sudo[108607]: pam_unix(sudo:session): session closed for user root Aug 05 06:31:00 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce" returned: 0 in 0.387s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:31:00 devstack cinder-volume[88695]: DEBUG cinder.manager [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] Notifying Schedulers of capabilities ... {{(pid=88695) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 06:31:00 devstack cinder-volume[88695]: DEBUG oslo_service.periodic_task [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] Running periodic task VolumeManager._thread_info {{(pid=88695) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 06:31:00 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] thread count: 28 {{(pid=88695) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 05 06:31:00 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] thread info: [<_MainThread(MainThread, started 134469211893888)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88695) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 05 06:31:00 devstack sudo[108610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce Aug 05 06:31:00 devstack sudo[108610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:31:01 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-81423e2e-852b-443a-8689-6fd439ab5c8f tempest-CreateVolumesFromSnapshotTest-2119669264 None] Acquiring lock "cinder-1a095fb1-8ad2-4938-8598-8d3af510338a-delete_volume" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:31:01 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-81423e2e-852b-443a-8689-6fd439ab5c8f tempest-CreateVolumesFromSnapshotTest-2119669264 None] Lock "cinder-1a095fb1-8ad2-4938-8598-8d3af510338a-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:31:01 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-81423e2e-852b-443a-8689-6fd439ab5c8f tempest-CreateVolumesFromSnapshotTest-2119669264 None] Acquiring lock "cinder-quobyte-1a095fb1-8ad2-4938-8598-8d3af510338a" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:31:01 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-81423e2e-852b-443a-8689-6fd439ab5c8f tempest-CreateVolumesFromSnapshotTest-2119669264 None] Lock "cinder-quobyte-1a095fb1-8ad2-4938-8598-8d3af510338a" acquired by "delete_volume" :: waited 0.020s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:31:01 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5a9b669-4945-4756-bedd-44cebae206d6]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:31:01 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-81423e2e-852b-443a-8689-6fd439ab5c8f tempest-CreateVolumesFromSnapshotTest-2119669264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-1a095fb1-8ad2-4938-8598-8d3af510338a {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:31:01 devstack sudo[108610]: pam_unix(sudo:session): session closed for user root Aug 05 06:31:01 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-bac50c2c-9a7a-4c0c-9caf-ee1e300f1337 tempest-CreateVolumesFromImageTest-1660354549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce" returned: 0 in 0.482s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:31:01 devstack cinder-volume[88695]: DEBUG cinder.manager [None req-bac50c2c-9a7a-4c0c-9caf-ee1e300f1337 tempest-CreateVolumesFromImageTest-1660354549 None] Notifying Schedulers of capabilities ... {{(pid=88695) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 06:31:01 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-bac50c2c-9a7a-4c0c-9caf-ee1e300f1337 tempest-CreateVolumesFromImageTest-1660354549 None] Deleted volume successfully. Aug 05 06:31:01 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-bac50c2c-9a7a-4c0c-9caf-ee1e300f1337 tempest-CreateVolumesFromImageTest-1660354549 None] Lock "cinder-e70f9afb-ce5b-4c1a-b58d-62f5d72d2a6b-delete_volume" released by "delete_volume" :: held 2.137s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:31:01 devstack sudo[108613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-1a095fb1-8ad2-4938-8598-8d3af510338a Aug 05 06:31:01 devstack sudo[108613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:31:01 devstack cinder-volume[88695]: DEBUG cinder.volume.flows.manager.create_volume [None req-91c21deb-d9fe-43d5-8785-dee81545f65d tempest-CinderUnicodeTest-1672876 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88695) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 06:31:01 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-91c21deb-d9fe-43d5-8785-dee81545f65d tempest-CinderUnicodeTest-1672876 None] Flow 'volume_create_manager' (664d7487-f8e2-4050-ac11-7a7e20707ee6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:31:01 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-91c21deb-d9fe-43d5-8785-dee81545f65d tempest-CinderUnicodeTest-1672876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (954108df-2879-4f6d-a2ea-c14798099891) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:31:01 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-91c21deb-d9fe-43d5-8785-dee81545f65d tempest-CinderUnicodeTest-1672876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (954108df-2879-4f6d-a2ea-c14798099891) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:31:01Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a1e9d1a-654b-444f-b9ba-8e75bc31c6f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='598f757b345f482ba7f1f7342e28b8e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:31:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:31:01Z,use_quota=True,user_id='e421647b1cb140e8b08e11b59dc1584e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:31:01 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-91c21deb-d9fe-43d5-8785-dee81545f65d tempest-CinderUnicodeTest-1672876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d859655f-4d4a-4e8a-b9bb-df015c3d78ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:31:01 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-91c21deb-d9fe-43d5-8785-dee81545f65d tempest-CinderUnicodeTest-1672876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d859655f-4d4a-4e8a-b9bb-df015c3d78ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:31:01 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-91c21deb-d9fe-43d5-8785-dee81545f65d tempest-CinderUnicodeTest-1672876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66db35c6-4fd5-45dc-b9a1-31a041d39dab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:31:01 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-91c21deb-d9fe-43d5-8785-dee81545f65d tempest-CinderUnicodeTest-1672876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66db35c6-4fd5-45dc-b9a1-31a041d39dab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a1e9d1a-654b-444f-b9ba-8e75bc31c6f9', 'volume_name': 'volume-7a1e9d1a-654b-444f-b9ba-8e75bc31c6f9', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:31:01 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-91c21deb-d9fe-43d5-8785-dee81545f65d tempest-CinderUnicodeTest-1672876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7069c93-dae6-4abc-9d2b-e9ab834dd94d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:31:01 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-91c21deb-d9fe-43d5-8785-dee81545f65d tempest-CinderUnicodeTest-1672876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7069c93-dae6-4abc-9d2b-e9ab834dd94d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:31:01 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-91c21deb-d9fe-43d5-8785-dee81545f65d tempest-CinderUnicodeTest-1672876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a778392-c022-4d5a-b3fa-a960a4298c11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:31:01 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-91c21deb-d9fe-43d5-8785-dee81545f65d tempest-CinderUnicodeTest-1672876 None] Volume 7a1e9d1a-654b-444f-b9ba-8e75bc31c6f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a1e9d1a-654b-444f-b9ba-8e75bc31c6f9', 'volume_size': 1} Aug 05 06:31:01 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-91c21deb-d9fe-43d5-8785-dee81545f65d tempest-CinderUnicodeTest-1672876 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:31:01 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-91c21deb-d9fe-43d5-8785-dee81545f65d tempest-CinderUnicodeTest-1672876 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:31:01 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-91c21deb-d9fe-43d5-8785-dee81545f65d tempest-CinderUnicodeTest-1672876 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:31:01Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a1e9d1a-654b-444f-b9ba-8e75bc31c6f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='598f757b345f482ba7f1f7342e28b8e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:31:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:31:01Z,use_quota=True,user_id='e421647b1cb140e8b08e11b59dc1584e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)}" {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 06:31:01 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-91c21deb-d9fe-43d5-8785-dee81545f65d tempest-CinderUnicodeTest-1672876 None] Creating volume 7a1e9d1a-654b-444f-b9ba-8e75bc31c6f9 {{(pid=88695) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 06:31:01 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-91c21deb-d9fe-43d5-8785-dee81545f65d tempest-CinderUnicodeTest-1672876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:31:01 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-91c21deb-d9fe-43d5-8785-dee81545f65d tempest-CinderUnicodeTest-1672876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:31:01 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-91c21deb-d9fe-43d5-8785-dee81545f65d tempest-CinderUnicodeTest-1672876 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:31:01 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-91c21deb-d9fe-43d5-8785-dee81545f65d tempest-CinderUnicodeTest-1672876 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:31:01 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-91c21deb-d9fe-43d5-8785-dee81545f65d tempest-CinderUnicodeTest-1672876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:31:01 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-91c21deb-d9fe-43d5-8785-dee81545f65d tempest-CinderUnicodeTest-1672876 None] Selected osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 as target Quobyte volume. {{(pid=88695) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 06:31:01 devstack cinder-volume[88695]: INFO cinder.volume.drivers.remotefs [None req-91c21deb-d9fe-43d5-8785-dee81545f65d tempest-CinderUnicodeTest-1672876 None] casted to osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 Aug 05 06:31:01 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-91c21deb-d9fe-43d5-8785-dee81545f65d tempest-CinderUnicodeTest-1672876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7a1e9d1a-654b-444f-b9ba-8e75bc31c6f9 1073741824 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:31:01 devstack sudo[108615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7a1e9d1a-654b-444f-b9ba-8e75bc31c6f9 1073741824 Aug 05 06:31:01 devstack sudo[108615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:31:01 devstack sudo[108613]: pam_unix(sudo:session): session closed for user root Aug 05 06:31:01 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-81423e2e-852b-443a-8689-6fd439ab5c8f tempest-CreateVolumesFromSnapshotTest-2119669264 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-1a095fb1-8ad2-4938-8598-8d3af510338a" returned: 0 in 0.540s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:31:01 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-81423e2e-852b-443a-8689-6fd439ab5c8f tempest-CreateVolumesFromSnapshotTest-2119669264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-1a095fb1-8ad2-4938-8598-8d3af510338a {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:31:01 devstack sudo[108620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-1a095fb1-8ad2-4938-8598-8d3af510338a Aug 05 06:31:01 devstack sudo[108620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:31:02 devstack sudo[108620]: pam_unix(sudo:session): session closed for user root Aug 05 06:31:02 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-81423e2e-852b-443a-8689-6fd439ab5c8f tempest-CreateVolumesFromSnapshotTest-2119669264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-1a095fb1-8ad2-4938-8598-8d3af510338a" returned: 0 in 0.358s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:31:02 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-81423e2e-852b-443a-8689-6fd439ab5c8f tempest-CreateVolumesFromSnapshotTest-2119669264 None] Lock "cinder-quobyte-1a095fb1-8ad2-4938-8598-8d3af510338a" released by "delete_volume" :: held 0.971s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:31:02 devstack sudo[108615]: pam_unix(sudo:session): session closed for user root Aug 05 06:31:02 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-91c21deb-d9fe-43d5-8785-dee81545f65d tempest-CinderUnicodeTest-1672876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7a1e9d1a-654b-444f-b9ba-8e75bc31c6f9 1073741824" returned: 0 in 0.642s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:31:02 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-91c21deb-d9fe-43d5-8785-dee81545f65d tempest-CinderUnicodeTest-1672876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7a1e9d1a-654b-444f-b9ba-8e75bc31c6f9 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:31:02 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-81423e2e-852b-443a-8689-6fd439ab5c8f tempest-CreateVolumesFromSnapshotTest-2119669264 None] Created reservations ['93e671bb-3b63-418c-b652-c8fba4a30b63', '48b7ca61-ec10-4bed-8dbf-4ca7d5eabc22', 'de3ea587-7e9d-4c36-9cb8-a62a84aa7b88', '22abe713-f4f1-4560-87b8-08d45eb630f4'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:31:02 devstack sudo[108627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7a1e9d1a-654b-444f-b9ba-8e75bc31c6f9 Aug 05 06:31:02 devstack sudo[108627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:31:02 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-81423e2e-852b-443a-8689-6fd439ab5c8f tempest-CreateVolumesFromSnapshotTest-2119669264 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:31:02 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-81423e2e-852b-443a-8689-6fd439ab5c8f tempest-CreateVolumesFromSnapshotTest-2119669264 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:31:02 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-81423e2e-852b-443a-8689-6fd439ab5c8f tempest-CreateVolumesFromSnapshotTest-2119669264 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:31:02 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-81423e2e-852b-443a-8689-6fd439ab5c8f tempest-CreateVolumesFromSnapshotTest-2119669264 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:31:02 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-81423e2e-852b-443a-8689-6fd439ab5c8f tempest-CreateVolumesFromSnapshotTest-2119669264 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:31:02 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-81423e2e-852b-443a-8689-6fd439ab5c8f tempest-CreateVolumesFromSnapshotTest-2119669264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:31:02 devstack sudo[108629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce Aug 05 06:31:02 devstack sudo[108629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:31:02 devstack sudo[108627]: pam_unix(sudo:session): session closed for user root Aug 05 06:31:02 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-91c21deb-d9fe-43d5-8785-dee81545f65d tempest-CinderUnicodeTest-1672876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7a1e9d1a-654b-444f-b9ba-8e75bc31c6f9" returned: 0 in 0.435s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:31:02 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-91c21deb-d9fe-43d5-8785-dee81545f65d tempest-CinderUnicodeTest-1672876 None] <== create_volume: return (1169ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'} {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 06:31:02 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-91c21deb-d9fe-43d5-8785-dee81545f65d tempest-CinderUnicodeTest-1672876 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.174s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:31:02 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-91c21deb-d9fe-43d5-8785-dee81545f65d tempest-CinderUnicodeTest-1672876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a778392-c022-4d5a-b3fa-a960a4298c11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a1e9d1a-654b-444f-b9ba-8e75bc31c6f9', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:31:02 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-91c21deb-d9fe-43d5-8785-dee81545f65d tempest-CinderUnicodeTest-1672876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32d9f834-934a-4b53-92a9-9f41b459c5ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:31:02 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-91c21deb-d9fe-43d5-8785-dee81545f65d tempest-CinderUnicodeTest-1672876 None] Volume volume-7a1e9d1a-654b-444f-b9ba-8e75bc31c6f9 (7a1e9d1a-654b-444f-b9ba-8e75bc31c6f9): created successfully Aug 05 06:31:02 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-91c21deb-d9fe-43d5-8785-dee81545f65d tempest-CinderUnicodeTest-1672876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32d9f834-934a-4b53-92a9-9f41b459c5ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:31:02 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-91c21deb-d9fe-43d5-8785-dee81545f65d tempest-CinderUnicodeTest-1672876 None] Flow 'volume_create_manager' (664d7487-f8e2-4050-ac11-7a7e20707ee6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:31:02 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-91c21deb-d9fe-43d5-8785-dee81545f65d tempest-CinderUnicodeTest-1672876 None] Created volume successfully. Aug 05 06:31:02 devstack sudo[108629]: pam_unix(sudo:session): session closed for user root Aug 05 06:31:02 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-81423e2e-852b-443a-8689-6fd439ab5c8f tempest-CreateVolumesFromSnapshotTest-2119669264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce" returned: 0 in 0.361s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:31:02 devstack cinder-volume[88695]: DEBUG cinder.manager [None req-81423e2e-852b-443a-8689-6fd439ab5c8f tempest-CreateVolumesFromSnapshotTest-2119669264 None] Notifying Schedulers of capabilities ... {{(pid=88695) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 06:31:02 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-81423e2e-852b-443a-8689-6fd439ab5c8f tempest-CreateVolumesFromSnapshotTest-2119669264 None] Deleted volume successfully. Aug 05 06:31:02 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-81423e2e-852b-443a-8689-6fd439ab5c8f tempest-CreateVolumesFromSnapshotTest-2119669264 None] Lock "cinder-1a095fb1-8ad2-4938-8598-8d3af510338a-delete_volume" released by "delete_volume" :: held 1.853s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:31:03 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-8a6a64e8-1252-4421-ad57-989cb533e8f5 tempest-CreateVolumesFromSnapshotTest-2119669264 None] Acquiring lock "cinder-03d7382d-6a9f-428c-9c20-ce26215b4baa-delete_volume" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:31:03 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-8a6a64e8-1252-4421-ad57-989cb533e8f5 tempest-CreateVolumesFromSnapshotTest-2119669264 None] Lock "cinder-03d7382d-6a9f-428c-9c20-ce26215b4baa-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:31:03 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-8a6a64e8-1252-4421-ad57-989cb533e8f5 tempest-CreateVolumesFromSnapshotTest-2119669264 None] Acquiring lock "cinder-quobyte-03d7382d-6a9f-428c-9c20-ce26215b4baa" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:31:03 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-8a6a64e8-1252-4421-ad57-989cb533e8f5 tempest-CreateVolumesFromSnapshotTest-2119669264 None] Lock "cinder-quobyte-03d7382d-6a9f-428c-9c20-ce26215b4baa" acquired by "delete_volume" :: waited 0.028s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:31:03 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[731fb364-db8d-4e00-a794-ba06e6e90659]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:31:03 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-8a6a64e8-1252-4421-ad57-989cb533e8f5 tempest-CreateVolumesFromSnapshotTest-2119669264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-03d7382d-6a9f-428c-9c20-ce26215b4baa {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:31:03 devstack sudo[108633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-03d7382d-6a9f-428c-9c20-ce26215b4baa Aug 05 06:31:03 devstack sudo[108633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:31:04 devstack cinder-volume[88695]: DEBUG cinder.volume.flows.manager.create_volume [None req-32420e63-165d-4abd-854b-48f265e58e9e tempest-CinderUnicodeTest-1672876 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88695) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 06:31:04 devstack sudo[108633]: pam_unix(sudo:session): session closed for user root Aug 05 06:31:04 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-32420e63-165d-4abd-854b-48f265e58e9e tempest-CinderUnicodeTest-1672876 None] Flow 'volume_create_manager' (6b341b55-3a82-47c7-9c2c-3a1c98d5ea71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:31:04 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-32420e63-165d-4abd-854b-48f265e58e9e tempest-CinderUnicodeTest-1672876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48534f1e-fa21-4013-aa26-eb918cfb67d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:31:04 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-8a6a64e8-1252-4421-ad57-989cb533e8f5 tempest-CreateVolumesFromSnapshotTest-2119669264 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-03d7382d-6a9f-428c-9c20-ce26215b4baa" returned: 0 in 0.582s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:31:04 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-8a6a64e8-1252-4421-ad57-989cb533e8f5 tempest-CreateVolumesFromSnapshotTest-2119669264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-03d7382d-6a9f-428c-9c20-ce26215b4baa {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:31:04 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-32420e63-165d-4abd-854b-48f265e58e9e tempest-CinderUnicodeTest-1672876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48534f1e-fa21-4013-aa26-eb918cfb67d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:31:04Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1949367853',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f8c60c4-c841-4870-a2e6-750b679930f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='598f757b345f482ba7f1f7342e28b8e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:31:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:31:04Z,use_quota=True,user_id='e421647b1cb140e8b08e11b59dc1584e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:31:04 devstack sudo[108638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-03d7382d-6a9f-428c-9c20-ce26215b4baa Aug 05 06:31:04 devstack sudo[108638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:31:04 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-32420e63-165d-4abd-854b-48f265e58e9e tempest-CinderUnicodeTest-1672876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98c7c28b-cc23-43f8-82b3-8eb2c076e33a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:31:04 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-32420e63-165d-4abd-854b-48f265e58e9e tempest-CinderUnicodeTest-1672876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98c7c28b-cc23-43f8-82b3-8eb2c076e33a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:31:04 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-32420e63-165d-4abd-854b-48f265e58e9e tempest-CinderUnicodeTest-1672876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31aca3f4-91b2-4f20-a369-4e879869c78c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:31:04 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-32420e63-165d-4abd-854b-48f265e58e9e tempest-CinderUnicodeTest-1672876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31aca3f4-91b2-4f20-a369-4e879869c78c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f8c60c4-c841-4870-a2e6-750b679930f1', 'volume_name': 'volume-3f8c60c4-c841-4870-a2e6-750b679930f1', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:31:04 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-32420e63-165d-4abd-854b-48f265e58e9e tempest-CinderUnicodeTest-1672876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94223a2b-bfc8-4199-8448-0496479e855c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:31:04 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-32420e63-165d-4abd-854b-48f265e58e9e tempest-CinderUnicodeTest-1672876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94223a2b-bfc8-4199-8448-0496479e855c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:31:04 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-32420e63-165d-4abd-854b-48f265e58e9e tempest-CinderUnicodeTest-1672876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea458e0a-c7b2-4833-9e3e-0d185a1cee45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:31:04 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-32420e63-165d-4abd-854b-48f265e58e9e tempest-CinderUnicodeTest-1672876 None] Volume 3f8c60c4-c841-4870-a2e6-750b679930f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f8c60c4-c841-4870-a2e6-750b679930f1', 'volume_size': 1} Aug 05 06:31:04 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-32420e63-165d-4abd-854b-48f265e58e9e tempest-CinderUnicodeTest-1672876 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:31:04 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-32420e63-165d-4abd-854b-48f265e58e9e tempest-CinderUnicodeTest-1672876 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:31:04 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-32420e63-165d-4abd-854b-48f265e58e9e tempest-CinderUnicodeTest-1672876 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:31:04Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1949367853',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f8c60c4-c841-4870-a2e6-750b679930f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='598f757b345f482ba7f1f7342e28b8e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:31:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:31:04Z,use_quota=True,user_id='e421647b1cb140e8b08e11b59dc1584e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)}" {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 06:31:04 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-32420e63-165d-4abd-854b-48f265e58e9e tempest-CinderUnicodeTest-1672876 None] Creating volume 3f8c60c4-c841-4870-a2e6-750b679930f1 {{(pid=88695) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 06:31:04 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-32420e63-165d-4abd-854b-48f265e58e9e tempest-CinderUnicodeTest-1672876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:31:04 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-32420e63-165d-4abd-854b-48f265e58e9e tempest-CinderUnicodeTest-1672876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:31:04 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-32420e63-165d-4abd-854b-48f265e58e9e tempest-CinderUnicodeTest-1672876 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:31:04 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-32420e63-165d-4abd-854b-48f265e58e9e tempest-CinderUnicodeTest-1672876 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:31:04 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-32420e63-165d-4abd-854b-48f265e58e9e tempest-CinderUnicodeTest-1672876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:31:04 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-32420e63-165d-4abd-854b-48f265e58e9e tempest-CinderUnicodeTest-1672876 None] Selected osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 as target Quobyte volume. {{(pid=88695) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 06:31:04 devstack cinder-volume[88695]: INFO cinder.volume.drivers.remotefs [None req-32420e63-165d-4abd-854b-48f265e58e9e tempest-CinderUnicodeTest-1672876 None] casted to osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 Aug 05 06:31:04 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-32420e63-165d-4abd-854b-48f265e58e9e tempest-CinderUnicodeTest-1672876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-3f8c60c4-c841-4870-a2e6-750b679930f1 1073741824 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:31:04 devstack sudo[108640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-3f8c60c4-c841-4870-a2e6-750b679930f1 1073741824 Aug 05 06:31:04 devstack sudo[108640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:31:04 devstack sudo[108638]: pam_unix(sudo:session): session closed for user root Aug 05 06:31:04 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-8a6a64e8-1252-4421-ad57-989cb533e8f5 tempest-CreateVolumesFromSnapshotTest-2119669264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-03d7382d-6a9f-428c-9c20-ce26215b4baa" returned: 0 in 0.321s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:31:04 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-8a6a64e8-1252-4421-ad57-989cb533e8f5 tempest-CreateVolumesFromSnapshotTest-2119669264 None] Lock "cinder-quobyte-03d7382d-6a9f-428c-9c20-ce26215b4baa" released by "delete_volume" :: held 0.978s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:31:04 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-8a6a64e8-1252-4421-ad57-989cb533e8f5 tempest-CreateVolumesFromSnapshotTest-2119669264 None] Created reservations ['e4809f04-9389-41cf-9b54-d79dcc436cae', 'a3866460-636b-4b54-9dd1-bebc8487ad4d', 'ee796c17-5de9-42ad-ac62-92a803278e03', '047667f2-28dc-4d46-bbbd-48253de4c193'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:31:04 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-8a6a64e8-1252-4421-ad57-989cb533e8f5 tempest-CreateVolumesFromSnapshotTest-2119669264 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:31:04 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-8a6a64e8-1252-4421-ad57-989cb533e8f5 tempest-CreateVolumesFromSnapshotTest-2119669264 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:31:04 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-8a6a64e8-1252-4421-ad57-989cb533e8f5 tempest-CreateVolumesFromSnapshotTest-2119669264 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:31:04 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-8a6a64e8-1252-4421-ad57-989cb533e8f5 tempest-CreateVolumesFromSnapshotTest-2119669264 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:31:04 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-8a6a64e8-1252-4421-ad57-989cb533e8f5 tempest-CreateVolumesFromSnapshotTest-2119669264 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:31:04 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-8a6a64e8-1252-4421-ad57-989cb533e8f5 tempest-CreateVolumesFromSnapshotTest-2119669264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:31:04 devstack sudo[108646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce Aug 05 06:31:04 devstack sudo[108646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:31:05 devstack sudo[108640]: pam_unix(sudo:session): session closed for user root Aug 05 06:31:05 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-32420e63-165d-4abd-854b-48f265e58e9e tempest-CinderUnicodeTest-1672876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-3f8c60c4-c841-4870-a2e6-750b679930f1 1073741824" returned: 0 in 0.654s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:31:05 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-32420e63-165d-4abd-854b-48f265e58e9e tempest-CinderUnicodeTest-1672876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-3f8c60c4-c841-4870-a2e6-750b679930f1 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:31:05 devstack sudo[108650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-3f8c60c4-c841-4870-a2e6-750b679930f1 Aug 05 06:31:05 devstack sudo[108650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:31:05 devstack sudo[108646]: pam_unix(sudo:session): session closed for user root Aug 05 06:31:05 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-8a6a64e8-1252-4421-ad57-989cb533e8f5 tempest-CreateVolumesFromSnapshotTest-2119669264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce" returned: 0 in 0.356s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:31:05 devstack cinder-volume[88695]: DEBUG cinder.manager [None req-8a6a64e8-1252-4421-ad57-989cb533e8f5 tempest-CreateVolumesFromSnapshotTest-2119669264 None] Notifying Schedulers of capabilities ... {{(pid=88695) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 06:31:05 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-8a6a64e8-1252-4421-ad57-989cb533e8f5 tempest-CreateVolumesFromSnapshotTest-2119669264 None] Deleted volume successfully. Aug 05 06:31:05 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-8a6a64e8-1252-4421-ad57-989cb533e8f5 tempest-CreateVolumesFromSnapshotTest-2119669264 None] Lock "cinder-03d7382d-6a9f-428c-9c20-ce26215b4baa-delete_volume" released by "delete_volume" :: held 1.634s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:31:05 devstack sudo[108650]: pam_unix(sudo:session): session closed for user root Aug 05 06:31:05 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-32420e63-165d-4abd-854b-48f265e58e9e tempest-CinderUnicodeTest-1672876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-3f8c60c4-c841-4870-a2e6-750b679930f1" returned: 0 in 0.321s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:31:05 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-32420e63-165d-4abd-854b-48f265e58e9e tempest-CinderUnicodeTest-1672876 None] <== create_volume: return (1044ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'} {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 06:31:05 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-32420e63-165d-4abd-854b-48f265e58e9e tempest-CinderUnicodeTest-1672876 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.049s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:31:05 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-32420e63-165d-4abd-854b-48f265e58e9e tempest-CinderUnicodeTest-1672876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea458e0a-c7b2-4833-9e3e-0d185a1cee45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f8c60c4-c841-4870-a2e6-750b679930f1', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:31:05 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-32420e63-165d-4abd-854b-48f265e58e9e tempest-CinderUnicodeTest-1672876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6f41bb8-238e-44b2-a23d-dd5668204048) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:31:05 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-32420e63-165d-4abd-854b-48f265e58e9e tempest-CinderUnicodeTest-1672876 None] Volume volume-3f8c60c4-c841-4870-a2e6-750b679930f1 (3f8c60c4-c841-4870-a2e6-750b679930f1): created successfully Aug 05 06:31:05 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-32420e63-165d-4abd-854b-48f265e58e9e tempest-CinderUnicodeTest-1672876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6f41bb8-238e-44b2-a23d-dd5668204048) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:31:05 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-32420e63-165d-4abd-854b-48f265e58e9e tempest-CinderUnicodeTest-1672876 None] Flow 'volume_create_manager' (6b341b55-3a82-47c7-9c2c-3a1c98d5ea71) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:31:05 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-32420e63-165d-4abd-854b-48f265e58e9e tempest-CinderUnicodeTest-1672876 None] Created volume successfully. Aug 05 06:31:05 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-4fcf4ddb-1e6f-4e61-85a3-ea9b4c87a3c5 tempest-CreateVolumesFromSnapshotTest-2119669264 None] Acquiring lock "cinder-e6a1f0a3-9533-4004-a009-213a3e8c4b2e-delete_volume" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:31:05 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-4fcf4ddb-1e6f-4e61-85a3-ea9b4c87a3c5 tempest-CreateVolumesFromSnapshotTest-2119669264 None] Lock "cinder-e6a1f0a3-9533-4004-a009-213a3e8c4b2e-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:31:06 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-4fcf4ddb-1e6f-4e61-85a3-ea9b4c87a3c5 tempest-CreateVolumesFromSnapshotTest-2119669264 None] Acquiring lock "cinder-quobyte-e6a1f0a3-9533-4004-a009-213a3e8c4b2e" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:31:06 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-4fcf4ddb-1e6f-4e61-85a3-ea9b4c87a3c5 tempest-CreateVolumesFromSnapshotTest-2119669264 None] Lock "cinder-quobyte-e6a1f0a3-9533-4004-a009-213a3e8c4b2e" acquired by "delete_volume" :: waited 0.019s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:31:06 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e01a377-ef89-4fb4-ae4a-f90722f2ec39]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:31:06 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-4fcf4ddb-1e6f-4e61-85a3-ea9b4c87a3c5 tempest-CreateVolumesFromSnapshotTest-2119669264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-e6a1f0a3-9533-4004-a009-213a3e8c4b2e {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:31:06 devstack sudo[108653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-e6a1f0a3-9533-4004-a009-213a3e8c4b2e Aug 05 06:31:06 devstack sudo[108653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:31:06 devstack cinder-volume[88695]: DEBUG cinder.volume.flows.manager.create_volume [None req-438e1792-291f-48d1-801c-13cdf11a79de tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88695) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 06:31:06 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-438e1792-291f-48d1-801c-13cdf11a79de tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Flow 'volume_create_manager' (a93e4ed8-7a0b-4fd1-849b-a1317c45b943) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:31:06 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-438e1792-291f-48d1-801c-13cdf11a79de tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15b6ba51-f39a-4b7a-b339-3b154f8e612b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:31:06 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-438e1792-291f-48d1-801c-13cdf11a79de tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15b6ba51-f39a-4b7a-b339-3b154f8e612b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:31:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1454462433',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44b1149a-b640-4a3b-b3db-97ba5c97fd29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c55203427ada47e99fdde77275d8e7e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:31:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:31:06Z,use_quota=True,user_id='24f733aca06a4d75be2245b2178c1d0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:31:06 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-438e1792-291f-48d1-801c-13cdf11a79de tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a380913-232b-4290-ac9d-173adc65fa19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:31:06 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-438e1792-291f-48d1-801c-13cdf11a79de tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a380913-232b-4290-ac9d-173adc65fa19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:31:06 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-438e1792-291f-48d1-801c-13cdf11a79de tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81c5248e-6c87-4ebd-8cd1-a09df0be5ab8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:31:06 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-438e1792-291f-48d1-801c-13cdf11a79de tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81c5248e-6c87-4ebd-8cd1-a09df0be5ab8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44b1149a-b640-4a3b-b3db-97ba5c97fd29', 'volume_name': 'volume-44b1149a-b640-4a3b-b3db-97ba5c97fd29', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:31:06 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-438e1792-291f-48d1-801c-13cdf11a79de tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e55dd03b-4e3b-4e84-8c0f-8890328f32ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:31:06 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-438e1792-291f-48d1-801c-13cdf11a79de tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e55dd03b-4e3b-4e84-8c0f-8890328f32ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:31:06 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-438e1792-291f-48d1-801c-13cdf11a79de tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9e0f5ab-11d4-454e-8c66-759747b254c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:31:06 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-438e1792-291f-48d1-801c-13cdf11a79de tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Volume 44b1149a-b640-4a3b-b3db-97ba5c97fd29: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44b1149a-b640-4a3b-b3db-97ba5c97fd29', 'volume_size': 1} Aug 05 06:31:06 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-438e1792-291f-48d1-801c-13cdf11a79de tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:31:06 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-438e1792-291f-48d1-801c-13cdf11a79de tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:31:06 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-438e1792-291f-48d1-801c-13cdf11a79de tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:31:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1454462433',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44b1149a-b640-4a3b-b3db-97ba5c97fd29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c55203427ada47e99fdde77275d8e7e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:31:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:31:06Z,use_quota=True,user_id='24f733aca06a4d75be2245b2178c1d0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)}" {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 06:31:06 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-438e1792-291f-48d1-801c-13cdf11a79de tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Creating volume 44b1149a-b640-4a3b-b3db-97ba5c97fd29 {{(pid=88695) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 06:31:06 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-438e1792-291f-48d1-801c-13cdf11a79de tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:31:06 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-438e1792-291f-48d1-801c-13cdf11a79de tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:31:06 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-438e1792-291f-48d1-801c-13cdf11a79de tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:31:06 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-438e1792-291f-48d1-801c-13cdf11a79de tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:31:06 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-438e1792-291f-48d1-801c-13cdf11a79de tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:31:06 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-438e1792-291f-48d1-801c-13cdf11a79de tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Selected osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 as target Quobyte volume. {{(pid=88695) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 06:31:06 devstack cinder-volume[88695]: INFO cinder.volume.drivers.remotefs [None req-438e1792-291f-48d1-801c-13cdf11a79de tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] casted to osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 Aug 05 06:31:06 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-438e1792-291f-48d1-801c-13cdf11a79de tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-44b1149a-b640-4a3b-b3db-97ba5c97fd29 1073741824 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:31:06 devstack sudo[108655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-44b1149a-b640-4a3b-b3db-97ba5c97fd29 1073741824 Aug 05 06:31:06 devstack sudo[108655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:31:06 devstack sudo[108653]: pam_unix(sudo:session): session closed for user root Aug 05 06:31:06 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-4fcf4ddb-1e6f-4e61-85a3-ea9b4c87a3c5 tempest-CreateVolumesFromSnapshotTest-2119669264 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-e6a1f0a3-9533-4004-a009-213a3e8c4b2e" returned: 0 in 0.565s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:31:06 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-4fcf4ddb-1e6f-4e61-85a3-ea9b4c87a3c5 tempest-CreateVolumesFromSnapshotTest-2119669264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-e6a1f0a3-9533-4004-a009-213a3e8c4b2e {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:31:06 devstack sudo[108662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-e6a1f0a3-9533-4004-a009-213a3e8c4b2e Aug 05 06:31:06 devstack sudo[108662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:31:06 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-43169b1f-a99b-40d5-807d-600e8566db21 tempest-CinderUnicodeTest-1672876 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:31:06 devstack sudo[108655]: pam_unix(sudo:session): session closed for user root Aug 05 06:31:06 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-438e1792-291f-48d1-801c-13cdf11a79de tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-44b1149a-b640-4a3b-b3db-97ba5c97fd29 1073741824" returned: 0 in 0.589s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:31:06 devstack sudo[108662]: pam_unix(sudo:session): session closed for user root Aug 05 06:31:07 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-438e1792-291f-48d1-801c-13cdf11a79de tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-44b1149a-b640-4a3b-b3db-97ba5c97fd29 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:31:07 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-4fcf4ddb-1e6f-4e61-85a3-ea9b4c87a3c5 tempest-CreateVolumesFromSnapshotTest-2119669264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-e6a1f0a3-9533-4004-a009-213a3e8c4b2e" returned: 0 in 0.340s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:31:07 devstack sudo[108666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-44b1149a-b640-4a3b-b3db-97ba5c97fd29 Aug 05 06:31:07 devstack sudo[108666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:31:07 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-4fcf4ddb-1e6f-4e61-85a3-ea9b4c87a3c5 tempest-CreateVolumesFromSnapshotTest-2119669264 None] Lock "cinder-quobyte-e6a1f0a3-9533-4004-a009-213a3e8c4b2e" released by "delete_volume" :: held 0.971s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:31:07 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-4fcf4ddb-1e6f-4e61-85a3-ea9b4c87a3c5 tempest-CreateVolumesFromSnapshotTest-2119669264 None] Created reservations ['998fe4c3-517f-4d79-9f86-1845e08d88b3', '97544e07-c682-4866-89e3-fafb40346132', '85361b5d-e918-4906-b1bf-c947199de1ce', '604c64c8-9524-4349-a50e-7c0a8241cbcc'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:31:07 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-4fcf4ddb-1e6f-4e61-85a3-ea9b4c87a3c5 tempest-CreateVolumesFromSnapshotTest-2119669264 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:31:07 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-4fcf4ddb-1e6f-4e61-85a3-ea9b4c87a3c5 tempest-CreateVolumesFromSnapshotTest-2119669264 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:31:07 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-4fcf4ddb-1e6f-4e61-85a3-ea9b4c87a3c5 tempest-CreateVolumesFromSnapshotTest-2119669264 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:31:07 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-4fcf4ddb-1e6f-4e61-85a3-ea9b4c87a3c5 tempest-CreateVolumesFromSnapshotTest-2119669264 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:31:07 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-4fcf4ddb-1e6f-4e61-85a3-ea9b4c87a3c5 tempest-CreateVolumesFromSnapshotTest-2119669264 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:31:07 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-4fcf4ddb-1e6f-4e61-85a3-ea9b4c87a3c5 tempest-CreateVolumesFromSnapshotTest-2119669264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:31:07 devstack sudo[108668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce Aug 05 06:31:07 devstack sudo[108668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:31:07 devstack sudo[108666]: pam_unix(sudo:session): session closed for user root Aug 05 06:31:07 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-438e1792-291f-48d1-801c-13cdf11a79de tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-44b1149a-b640-4a3b-b3db-97ba5c97fd29" returned: 0 in 0.322s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:31:07 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-438e1792-291f-48d1-801c-13cdf11a79de tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] <== create_volume: return (964ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'} {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 06:31:07 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-438e1792-291f-48d1-801c-13cdf11a79de tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.967s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:31:07 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-43169b1f-a99b-40d5-807d-600e8566db21 tempest-CinderUnicodeTest-1672876 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.572s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:31:07 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-438e1792-291f-48d1-801c-13cdf11a79de tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9e0f5ab-11d4-454e-8c66-759747b254c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44b1149a-b640-4a3b-b3db-97ba5c97fd29', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:31:07 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-438e1792-291f-48d1-801c-13cdf11a79de tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39241e8e-3923-40b6-bd4f-27665cc2a880) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:31:07 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-43169b1f-a99b-40d5-807d-600e8566db21 tempest-CinderUnicodeTest-1672876 None] Creating offline snapshot 8c8b55f9-9908-42d4-9efa-066b5b1ed4c0 of volume 3f8c60c4-c841-4870-a2e6-750b679930f1 {{(pid=88695) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 06:31:07 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e4d78aa-719b-4b5a-812d-48b639a7d67a]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:31:07 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-43169b1f-a99b-40d5-807d-600e8566db21 tempest-CinderUnicodeTest-1672876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-3f8c60c4-c841-4870-a2e6-750b679930f1 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:31:07 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-438e1792-291f-48d1-801c-13cdf11a79de tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Volume volume-44b1149a-b640-4a3b-b3db-97ba5c97fd29 (44b1149a-b640-4a3b-b3db-97ba5c97fd29): created successfully Aug 05 06:31:07 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-438e1792-291f-48d1-801c-13cdf11a79de tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39241e8e-3923-40b6-bd4f-27665cc2a880) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:31:07 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-438e1792-291f-48d1-801c-13cdf11a79de tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Flow 'volume_create_manager' (a93e4ed8-7a0b-4fd1-849b-a1317c45b943) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:31:07 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-438e1792-291f-48d1-801c-13cdf11a79de tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Created volume successfully. Aug 05 06:31:07 devstack sudo[108668]: pam_unix(sudo:session): session closed for user root Aug 05 06:31:07 devstack sudo[108671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-3f8c60c4-c841-4870-a2e6-750b679930f1 Aug 05 06:31:07 devstack sudo[108671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:31:07 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-4fcf4ddb-1e6f-4e61-85a3-ea9b4c87a3c5 tempest-CreateVolumesFromSnapshotTest-2119669264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce" returned: 0 in 0.283s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:31:07 devstack cinder-volume[88695]: DEBUG cinder.manager [None req-4fcf4ddb-1e6f-4e61-85a3-ea9b4c87a3c5 tempest-CreateVolumesFromSnapshotTest-2119669264 None] Notifying Schedulers of capabilities ... {{(pid=88695) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 06:31:07 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-4fcf4ddb-1e6f-4e61-85a3-ea9b4c87a3c5 tempest-CreateVolumesFromSnapshotTest-2119669264 None] Deleted volume successfully. Aug 05 06:31:07 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-4fcf4ddb-1e6f-4e61-85a3-ea9b4c87a3c5 tempest-CreateVolumesFromSnapshotTest-2119669264 None] Lock "cinder-e6a1f0a3-9533-4004-a009-213a3e8c4b2e-delete_volume" released by "delete_volume" :: held 1.581s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:31:07 devstack sudo[108671]: pam_unix(sudo:session): session closed for user root Aug 05 06:31:07 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-43169b1f-a99b-40d5-807d-600e8566db21 tempest-CinderUnicodeTest-1672876 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-3f8c60c4-c841-4870-a2e6-750b679930f1" returned: 0 in 0.449s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:31:07 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-43169b1f-a99b-40d5-807d-600e8566db21 tempest-CinderUnicodeTest-1672876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-3f8c60c4-c841-4870-a2e6-750b679930f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-3f8c60c4-c841-4870-a2e6-750b679930f1.8c8b55f9-9908-42d4-9efa-066b5b1ed4c0 1G {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:31:07 devstack sudo[108678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-3f8c60c4-c841-4870-a2e6-750b679930f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-3f8c60c4-c841-4870-a2e6-750b679930f1.8c8b55f9-9908-42d4-9efa-066b5b1ed4c0 1G Aug 05 06:31:07 devstack sudo[108678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:31:08 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-d2d61e9c-a7ae-46ff-8313-6fc9ba6c9cc3 tempest-CreateVolumesFromSnapshotTest-2119669264 None] Acquiring lock "cinder-37e0b55e-543f-45ce-b8d6-278051035468-delete_snapshot" by "delete_snapshot" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:31:08 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-d2d61e9c-a7ae-46ff-8313-6fc9ba6c9cc3 tempest-CreateVolumesFromSnapshotTest-2119669264 None] Lock "cinder-37e0b55e-543f-45ce-b8d6-278051035468-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:31:08 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-d2d61e9c-a7ae-46ff-8313-6fc9ba6c9cc3 tempest-CreateVolumesFromSnapshotTest-2119669264 None] Acquiring lock "cinder-quobyte-8f20ffa7-b1ae-44bc-840b-e69aad0b54f7" by "delete_snapshot" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:31:08 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-d2d61e9c-a7ae-46ff-8313-6fc9ba6c9cc3 tempest-CreateVolumesFromSnapshotTest-2119669264 None] Lock "cinder-quobyte-8f20ffa7-b1ae-44bc-840b-e69aad0b54f7" acquired by "delete_snapshot" :: waited 0.043s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:31:08 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-d2d61e9c-a7ae-46ff-8313-6fc9ba6c9cc3 tempest-CreateVolumesFromSnapshotTest-2119669264 None] Acquiring lock "cinder-quobyte-37e0b55e-543f-45ce-b8d6-278051035468" by "_delete_snapshot" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:31:08 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-d2d61e9c-a7ae-46ff-8313-6fc9ba6c9cc3 tempest-CreateVolumesFromSnapshotTest-2119669264 None] Lock "cinder-quobyte-37e0b55e-543f-45ce-b8d6-278051035468" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:31:08 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-d2d61e9c-a7ae-46ff-8313-6fc9ba6c9cc3 tempest-CreateVolumesFromSnapshotTest-2119669264 None] Deleting offline snapshot 37e0b55e-543f-45ce-b8d6-278051035468 of volume 8f20ffa7-b1ae-44bc-840b-e69aad0b54f7 {{(pid=88695) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 06:31:08 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-d2d61e9c-a7ae-46ff-8313-6fc9ba6c9cc3 tempest-CreateVolumesFromSnapshotTest-2119669264 None] snapshot_file for this snap is: volume-8f20ffa7-b1ae-44bc-840b-e69aad0b54f7.37e0b55e-543f-45ce-b8d6-278051035468 {{(pid=88695) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 06:31:08 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[3edebf66-f2f1-4400-afbe-979f108734b4]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:31:08 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-d2d61e9c-a7ae-46ff-8313-6fc9ba6c9cc3 tempest-CreateVolumesFromSnapshotTest-2119669264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8f20ffa7-b1ae-44bc-840b-e69aad0b54f7.37e0b55e-543f-45ce-b8d6-278051035468 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:31:08 devstack sudo[108678]: pam_unix(sudo:session): session closed for user root Aug 05 06:31:08 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-43169b1f-a99b-40d5-807d-600e8566db21 tempest-CinderUnicodeTest-1672876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-3f8c60c4-c841-4870-a2e6-750b679930f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-3f8c60c4-c841-4870-a2e6-750b679930f1.8c8b55f9-9908-42d4-9efa-066b5b1ed4c0 1G" returned: 0 in 0.603s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:31:08 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-43169b1f-a99b-40d5-807d-600e8566db21 tempest-CinderUnicodeTest-1672876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f8c60c4-c841-4870-a2e6-750b679930f1 -F qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-3f8c60c4-c841-4870-a2e6-750b679930f1.8c8b55f9-9908-42d4-9efa-066b5b1ed4c0 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:31:08 devstack sudo[108686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f8c60c4-c841-4870-a2e6-750b679930f1 -F qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-3f8c60c4-c841-4870-a2e6-750b679930f1.8c8b55f9-9908-42d4-9efa-066b5b1ed4c0 Aug 05 06:31:08 devstack sudo[108686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:31:08 devstack sudo[108685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8f20ffa7-b1ae-44bc-840b-e69aad0b54f7.37e0b55e-543f-45ce-b8d6-278051035468 Aug 05 06:31:08 devstack sudo[108685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:31:08 devstack sudo[108685]: pam_unix(sudo:session): session closed for user root Aug 05 06:31:08 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-d2d61e9c-a7ae-46ff-8313-6fc9ba6c9cc3 tempest-CreateVolumesFromSnapshotTest-2119669264 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8f20ffa7-b1ae-44bc-840b-e69aad0b54f7.37e0b55e-543f-45ce-b8d6-278051035468" returned: 0 in 0.508s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:31:08 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-d2d61e9c-a7ae-46ff-8313-6fc9ba6c9cc3 tempest-CreateVolumesFromSnapshotTest-2119669264 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8f20ffa7-b1ae-44bc-840b-e69aad0b54f7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88695) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 06:31:08 devstack sudo[108686]: pam_unix(sudo:session): session closed for user root Aug 05 06:31:08 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-43169b1f-a99b-40d5-807d-600e8566db21 tempest-CinderUnicodeTest-1672876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f8c60c4-c841-4870-a2e6-750b679930f1 -F qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-3f8c60c4-c841-4870-a2e6-750b679930f1.8c8b55f9-9908-42d4-9efa-066b5b1ed4c0" returned: 0 in 0.529s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:31:08 devstack cinder-volume[88695]: WARNING cinder.volume.drivers.remotefs [None req-43169b1f-a99b-40d5-807d-600e8566db21 tempest-CinderUnicodeTest-1672876 None] /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-3f8c60c4-c841-4870-a2e6-750b679930f1.8c8b55f9-9908-42d4-9efa-066b5b1ed4c0 is being set with open permissions: ugo+rw Aug 05 06:31:08 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-43169b1f-a99b-40d5-807d-600e8566db21 tempest-CinderUnicodeTest-1672876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-3f8c60c4-c841-4870-a2e6-750b679930f1.8c8b55f9-9908-42d4-9efa-066b5b1ed4c0 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:31:09 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f8d25ad-ea9e-474b-a813-1e6dc39e393e]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:31:09 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-d2d61e9c-a7ae-46ff-8313-6fc9ba6c9cc3 tempest-CreateVolumesFromSnapshotTest-2119669264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8f20ffa7-b1ae-44bc-840b-e69aad0b54f7 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:31:09 devstack sudo[108695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-3f8c60c4-c841-4870-a2e6-750b679930f1.8c8b55f9-9908-42d4-9efa-066b5b1ed4c0 Aug 05 06:31:09 devstack sudo[108695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:31:09 devstack cinder-volume[88695]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f2fd871-28a7-4075-bf88-afa1b5b77df4 tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88695) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 06:31:09 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-0f2fd871-28a7-4075-bf88-afa1b5b77df4 tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Flow 'volume_create_manager' (efa3c1a2-81e3-4e85-b065-ba0461793ae2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:31:09 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-0f2fd871-28a7-4075-bf88-afa1b5b77df4 tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b97e5eab-44ee-4feb-9011-93b6a22ad370) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:31:09 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-0f2fd871-28a7-4075-bf88-afa1b5b77df4 tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b97e5eab-44ee-4feb-9011-93b6a22ad370) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:31:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-558589829',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67b37c58-d702-4d8c-b7d4-e705b19b202f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c55203427ada47e99fdde77275d8e7e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:31:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:31:09Z,use_quota=True,user_id='24f733aca06a4d75be2245b2178c1d0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:31:09 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-0f2fd871-28a7-4075-bf88-afa1b5b77df4 tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd526bd5-229b-484e-a920-65cddeb7cb5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:31:09 devstack sudo[108697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8f20ffa7-b1ae-44bc-840b-e69aad0b54f7 Aug 05 06:31:09 devstack sudo[108697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:31:09 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-0f2fd871-28a7-4075-bf88-afa1b5b77df4 tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd526bd5-229b-484e-a920-65cddeb7cb5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:31:09 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-0f2fd871-28a7-4075-bf88-afa1b5b77df4 tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0c11e0f-fc9f-4e65-a7db-324f9d9ce5a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:31:09 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-0f2fd871-28a7-4075-bf88-afa1b5b77df4 tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0c11e0f-fc9f-4e65-a7db-324f9d9ce5a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '67b37c58-d702-4d8c-b7d4-e705b19b202f', 'volume_name': 'volume-67b37c58-d702-4d8c-b7d4-e705b19b202f', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:31:09 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-0f2fd871-28a7-4075-bf88-afa1b5b77df4 tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd4996ac-4927-4e72-8b6a-25b621b32573) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:31:09 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-0f2fd871-28a7-4075-bf88-afa1b5b77df4 tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd4996ac-4927-4e72-8b6a-25b621b32573) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:31:09 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-0f2fd871-28a7-4075-bf88-afa1b5b77df4 tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d85a8daf-4721-4528-ac3f-3e9709698622) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:31:09 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-0f2fd871-28a7-4075-bf88-afa1b5b77df4 tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Volume 67b37c58-d702-4d8c-b7d4-e705b19b202f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-67b37c58-d702-4d8c-b7d4-e705b19b202f', 'volume_size': 1} Aug 05 06:31:09 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-0f2fd871-28a7-4075-bf88-afa1b5b77df4 tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:31:09 devstack sudo[108695]: pam_unix(sudo:session): session closed for user root Aug 05 06:31:09 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-43169b1f-a99b-40d5-807d-600e8566db21 tempest-CinderUnicodeTest-1672876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-3f8c60c4-c841-4870-a2e6-750b679930f1.8c8b55f9-9908-42d4-9efa-066b5b1ed4c0" returned: 0 in 0.512s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:31:09 devstack cinder-volume[88695]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ea49b6d-b6e5-497a-a639-0509ec73419a tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88695) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 06:31:09 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-2ea49b6d-b6e5-497a-a639-0509ec73419a tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Flow 'volume_create_manager' (ab045f21-51d2-4d20-a12c-594ae3c74a35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:31:09 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-2ea49b6d-b6e5-497a-a639-0509ec73419a tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b798f729-7faa-4ebd-89b0-2ef0268d6321) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:31:09 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-2ea49b6d-b6e5-497a-a639-0509ec73419a tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b798f729-7faa-4ebd-89b0-2ef0268d6321) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:31:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1418037784',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a538fae4-9e2b-4d5e-8178-0260718a6e5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c55203427ada47e99fdde77275d8e7e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:31:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:31:09Z,use_quota=True,user_id='24f733aca06a4d75be2245b2178c1d0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:31:09 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-2ea49b6d-b6e5-497a-a639-0509ec73419a tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f00e83d1-6dcd-4702-81fb-96487e7b20e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:31:09 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-2ea49b6d-b6e5-497a-a639-0509ec73419a tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f00e83d1-6dcd-4702-81fb-96487e7b20e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:31:09 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-2ea49b6d-b6e5-497a-a639-0509ec73419a tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31c82f78-fb15-4a3c-9798-79f7815bf628) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:31:09 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-2ea49b6d-b6e5-497a-a639-0509ec73419a tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31c82f78-fb15-4a3c-9798-79f7815bf628) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a538fae4-9e2b-4d5e-8178-0260718a6e5e', 'volume_name': 'volume-a538fae4-9e2b-4d5e-8178-0260718a6e5e', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:31:09 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-2ea49b6d-b6e5-497a-a639-0509ec73419a tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bb78648-3af4-4385-a6c8-6f9192bdb3eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:31:09 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-2ea49b6d-b6e5-497a-a639-0509ec73419a tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bb78648-3af4-4385-a6c8-6f9192bdb3eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:31:09 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-2ea49b6d-b6e5-497a-a639-0509ec73419a tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2ee27d1-705f-4fa7-9f3c-ec5249b7b6d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:31:09 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-2ea49b6d-b6e5-497a-a639-0509ec73419a tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Volume a538fae4-9e2b-4d5e-8178-0260718a6e5e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a538fae4-9e2b-4d5e-8178-0260718a6e5e', 'volume_size': 1} Aug 05 06:31:09 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-2ea49b6d-b6e5-497a-a639-0509ec73419a tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:31:09 devstack sudo[108697]: pam_unix(sudo:session): session closed for user root Aug 05 06:31:09 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-43169b1f-a99b-40d5-807d-600e8566db21 tempest-CinderUnicodeTest-1672876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-3f8c60c4-c841-4870-a2e6-750b679930f1.info {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:31:09 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-d2d61e9c-a7ae-46ff-8313-6fc9ba6c9cc3 tempest-CreateVolumesFromSnapshotTest-2119669264 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8f20ffa7-b1ae-44bc-840b-e69aad0b54f7" returned: 0 in 0.666s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:31:09 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-d2d61e9c-a7ae-46ff-8313-6fc9ba6c9cc3 tempest-CreateVolumesFromSnapshotTest-2119669264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8f20ffa7-b1ae-44bc-840b-e69aad0b54f7.37e0b55e-543f-45ce-b8d6-278051035468 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:31:09 devstack sudo[108704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-3f8c60c4-c841-4870-a2e6-750b679930f1.info Aug 05 06:31:09 devstack sudo[108704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:31:09 devstack sudo[108705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8f20ffa7-b1ae-44bc-840b-e69aad0b54f7.37e0b55e-543f-45ce-b8d6-278051035468 Aug 05 06:31:09 devstack sudo[108705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:31:09 devstack cinder-volume[88695]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ee45722-c606-488d-9ab0-f10fb846c2bc tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88695) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 06:31:10 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-8ee45722-c606-488d-9ab0-f10fb846c2bc tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Flow 'volume_create_manager' (b0c2ba0b-0d43-485b-9867-16566732524f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:31:10 devstack sudo[108704]: pam_unix(sudo:session): session closed for user root Aug 05 06:31:10 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-8ee45722-c606-488d-9ab0-f10fb846c2bc tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb287d99-aec2-41c2-9269-1af0157a8efd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:31:10 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-43169b1f-a99b-40d5-807d-600e8566db21 tempest-CinderUnicodeTest-1672876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-3f8c60c4-c841-4870-a2e6-750b679930f1.info" returned: 0 in 0.417s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:31:10 devstack cinder-volume[88695]: WARNING cinder.volume.drivers.remotefs [None req-43169b1f-a99b-40d5-807d-600e8566db21 tempest-CinderUnicodeTest-1672876 None] /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-3f8c60c4-c841-4870-a2e6-750b679930f1.info is being set with open permissions: ugo+rw Aug 05 06:31:10 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-43169b1f-a99b-40d5-807d-600e8566db21 tempest-CinderUnicodeTest-1672876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-3f8c60c4-c841-4870-a2e6-750b679930f1.info {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:31:10 devstack sudo[108713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-3f8c60c4-c841-4870-a2e6-750b679930f1.info Aug 05 06:31:10 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-8ee45722-c606-488d-9ab0-f10fb846c2bc tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb287d99-aec2-41c2-9269-1af0157a8efd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:31:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1720804571',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c107508a-51f6-418f-beb7-a834fa15d809,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c55203427ada47e99fdde77275d8e7e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:31:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:31:10Z,use_quota=True,user_id='24f733aca06a4d75be2245b2178c1d0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:31:10 devstack sudo[108713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:31:10 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-8ee45722-c606-488d-9ab0-f10fb846c2bc tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4dcaf1e-a7f8-4185-9c0b-3b57bac2e59f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:31:10 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-8ee45722-c606-488d-9ab0-f10fb846c2bc tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4dcaf1e-a7f8-4185-9c0b-3b57bac2e59f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:31:10 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-8ee45722-c606-488d-9ab0-f10fb846c2bc tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb01eb19-16e1-4aa0-830a-ec8b60d44b75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:31:10 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-8ee45722-c606-488d-9ab0-f10fb846c2bc tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb01eb19-16e1-4aa0-830a-ec8b60d44b75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c107508a-51f6-418f-beb7-a834fa15d809', 'volume_name': 'volume-c107508a-51f6-418f-beb7-a834fa15d809', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:31:10 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-8ee45722-c606-488d-9ab0-f10fb846c2bc tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c28c43a7-f14d-482a-a5ae-ca5ae324935c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:31:10 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-8ee45722-c606-488d-9ab0-f10fb846c2bc tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c28c43a7-f14d-482a-a5ae-ca5ae324935c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:31:10 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-8ee45722-c606-488d-9ab0-f10fb846c2bc tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (625468c3-64e1-42ee-9b3f-7cc7b2e81696) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:31:10 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-8ee45722-c606-488d-9ab0-f10fb846c2bc tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Volume c107508a-51f6-418f-beb7-a834fa15d809: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c107508a-51f6-418f-beb7-a834fa15d809', 'volume_size': 1} Aug 05 06:31:10 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-8ee45722-c606-488d-9ab0-f10fb846c2bc tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:31:10 devstack sudo[108705]: pam_unix(sudo:session): session closed for user root Aug 05 06:31:10 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-d2d61e9c-a7ae-46ff-8313-6fc9ba6c9cc3 tempest-CreateVolumesFromSnapshotTest-2119669264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8f20ffa7-b1ae-44bc-840b-e69aad0b54f7.37e0b55e-543f-45ce-b8d6-278051035468" returned: 0 in 0.519s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:31:10 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-d2d61e9c-a7ae-46ff-8313-6fc9ba6c9cc3 tempest-CreateVolumesFromSnapshotTest-2119669264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8f20ffa7-b1ae-44bc-840b-e69aad0b54f7.37e0b55e-543f-45ce-b8d6-278051035468 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:31:10 devstack sudo[108715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8f20ffa7-b1ae-44bc-840b-e69aad0b54f7.37e0b55e-543f-45ce-b8d6-278051035468 Aug 05 06:31:10 devstack sudo[108715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:31:10 devstack sudo[108713]: pam_unix(sudo:session): session closed for user root Aug 05 06:31:10 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-43169b1f-a99b-40d5-807d-600e8566db21 tempest-CinderUnicodeTest-1672876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-3f8c60c4-c841-4870-a2e6-750b679930f1.info" returned: 0 in 0.434s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:31:10 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-43169b1f-a99b-40d5-807d-600e8566db21 tempest-CinderUnicodeTest-1672876 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.215s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:31:10 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-0f2fd871-28a7-4075-bf88-afa1b5b77df4 tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.288s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:31:10 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-0f2fd871-28a7-4075-bf88-afa1b5b77df4 tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:31:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-558589829',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67b37c58-d702-4d8c-b7d4-e705b19b202f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c55203427ada47e99fdde77275d8e7e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:31:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:31:09Z,use_quota=True,user_id='24f733aca06a4d75be2245b2178c1d0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)}" {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 06:31:10 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-0f2fd871-28a7-4075-bf88-afa1b5b77df4 tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Creating volume 67b37c58-d702-4d8c-b7d4-e705b19b202f {{(pid=88695) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 06:31:10 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-0f2fd871-28a7-4075-bf88-afa1b5b77df4 tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:31:10 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-0f2fd871-28a7-4075-bf88-afa1b5b77df4 tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:31:10 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-0f2fd871-28a7-4075-bf88-afa1b5b77df4 tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:31:10 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-0f2fd871-28a7-4075-bf88-afa1b5b77df4 tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:31:10 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-0f2fd871-28a7-4075-bf88-afa1b5b77df4 tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:31:10 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-0f2fd871-28a7-4075-bf88-afa1b5b77df4 tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Selected osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 as target Quobyte volume. {{(pid=88695) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 06:31:10 devstack cinder-volume[88695]: INFO cinder.volume.drivers.remotefs [None req-0f2fd871-28a7-4075-bf88-afa1b5b77df4 tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] casted to osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 Aug 05 06:31:10 devstack sudo[108715]: pam_unix(sudo:session): session closed for user root Aug 05 06:31:10 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-0f2fd871-28a7-4075-bf88-afa1b5b77df4 tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-67b37c58-d702-4d8c-b7d4-e705b19b202f 1073741824 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:31:10 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-d2d61e9c-a7ae-46ff-8313-6fc9ba6c9cc3 tempest-CreateVolumesFromSnapshotTest-2119669264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8f20ffa7-b1ae-44bc-840b-e69aad0b54f7.37e0b55e-543f-45ce-b8d6-278051035468" returned: 0 in 0.398s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:31:10 devstack sudo[108720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-67b37c58-d702-4d8c-b7d4-e705b19b202f 1073741824 Aug 05 06:31:10 devstack sudo[108720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:31:10 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-d2d61e9c-a7ae-46ff-8313-6fc9ba6c9cc3 tempest-CreateVolumesFromSnapshotTest-2119669264 None] Lock "cinder-quobyte-37e0b55e-543f-45ce-b8d6-278051035468" released by "_delete_snapshot" :: held 2.338s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:31:10 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-43169b1f-a99b-40d5-807d-600e8566db21 tempest-CinderUnicodeTest-1672876 None] Create snapshot completed successfully Aug 05 06:31:10 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-d2d61e9c-a7ae-46ff-8313-6fc9ba6c9cc3 tempest-CreateVolumesFromSnapshotTest-2119669264 None] Lock "cinder-quobyte-8f20ffa7-b1ae-44bc-840b-e69aad0b54f7" released by "delete_snapshot" :: held 2.381s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:31:10 devstack cinder-volume[88695]: DEBUG cinder.volume.flows.manager.create_volume [None req-abd5c277-47ac-4e1a-a1d4-8c8ac09143a4 tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88695) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 06:31:10 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-abd5c277-47ac-4e1a-a1d4-8c8ac09143a4 tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Flow 'volume_create_manager' (a3792dd6-b802-4b26-8c47-dfdfa0a45b32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:31:10 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-abd5c277-47ac-4e1a-a1d4-8c8ac09143a4 tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49dd361e-8690-489e-b17c-214daeaf35c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:31:10 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-abd5c277-47ac-4e1a-a1d4-8c8ac09143a4 tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49dd361e-8690-489e-b17c-214daeaf35c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:31:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-352532363',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebe2d8b6-4e9e-4c7a-bfd8-7c5c01a5c5bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c55203427ada47e99fdde77275d8e7e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:31:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:31:11Z,use_quota=True,user_id='24f733aca06a4d75be2245b2178c1d0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:31:10 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-abd5c277-47ac-4e1a-a1d4-8c8ac09143a4 tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b60e6572-41bf-4d18-8fc5-8a20fc405e08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:31:10 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-abd5c277-47ac-4e1a-a1d4-8c8ac09143a4 tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b60e6572-41bf-4d18-8fc5-8a20fc405e08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:31:10 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-abd5c277-47ac-4e1a-a1d4-8c8ac09143a4 tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0303700-65d6-4333-93a2-cbc67268f49e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:31:10 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-abd5c277-47ac-4e1a-a1d4-8c8ac09143a4 tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0303700-65d6-4333-93a2-cbc67268f49e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ebe2d8b6-4e9e-4c7a-bfd8-7c5c01a5c5bf', 'volume_name': 'volume-ebe2d8b6-4e9e-4c7a-bfd8-7c5c01a5c5bf', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:31:10 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-abd5c277-47ac-4e1a-a1d4-8c8ac09143a4 tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5c959fa-b3ed-41b6-959e-ff98e32adf8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:31:10 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-abd5c277-47ac-4e1a-a1d4-8c8ac09143a4 tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5c959fa-b3ed-41b6-959e-ff98e32adf8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:31:10 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-abd5c277-47ac-4e1a-a1d4-8c8ac09143a4 tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20ba4bed-1fd8-451c-a959-90fab3b092b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:31:10 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-abd5c277-47ac-4e1a-a1d4-8c8ac09143a4 tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Volume ebe2d8b6-4e9e-4c7a-bfd8-7c5c01a5c5bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ebe2d8b6-4e9e-4c7a-bfd8-7c5c01a5c5bf', 'volume_size': 1} Aug 05 06:31:10 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-abd5c277-47ac-4e1a-a1d4-8c8ac09143a4 tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:31:10 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-d2d61e9c-a7ae-46ff-8313-6fc9ba6c9cc3 tempest-CreateVolumesFromSnapshotTest-2119669264 None] Created reservations ['964a6836-7b6f-4dd1-9508-c17689686bda', 'eebec725-cfe4-446d-bf33-3cc568031b9d', '0c58beeb-1093-439c-835f-bd09829a6706', 'a7af57f4-9bc0-4a6a-aa8a-6ef4a3c02465'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:31:11 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-d2d61e9c-a7ae-46ff-8313-6fc9ba6c9cc3 tempest-CreateVolumesFromSnapshotTest-2119669264 None] Delete snapshot completed successfully. Aug 05 06:31:11 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-d2d61e9c-a7ae-46ff-8313-6fc9ba6c9cc3 tempest-CreateVolumesFromSnapshotTest-2119669264 None] Lock "cinder-37e0b55e-543f-45ce-b8d6-278051035468-delete_snapshot" released by "delete_snapshot" :: held 2.731s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:31:11 devstack cinder-volume[88695]: DEBUG cinder.volume.flows.manager.create_volume [None req-48e2e8cd-57b0-4c94-ab26-e299d255f899 tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88695) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 06:31:11 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-48e2e8cd-57b0-4c94-ab26-e299d255f899 tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Flow 'volume_create_manager' (3fb7863e-9057-42bc-97ba-0042063b436d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:31:11 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-48e2e8cd-57b0-4c94-ab26-e299d255f899 tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8dc5a88b-705b-4306-8176-ba4f37807d87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:31:11 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-48e2e8cd-57b0-4c94-ab26-e299d255f899 tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8dc5a88b-705b-4306-8176-ba4f37807d87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:31:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-825396816',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba80be52-bb4a-40f4-a7de-fc436af5d720,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c55203427ada47e99fdde77275d8e7e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:31:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:31:11Z,use_quota=True,user_id='24f733aca06a4d75be2245b2178c1d0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:31:11 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-48e2e8cd-57b0-4c94-ab26-e299d255f899 tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3167609b-58a5-46f0-810e-fba2d432edc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:31:11 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-48e2e8cd-57b0-4c94-ab26-e299d255f899 tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3167609b-58a5-46f0-810e-fba2d432edc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:31:11 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-48e2e8cd-57b0-4c94-ab26-e299d255f899 tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (887b4401-73a0-433a-9185-7f3986b267d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:31:11 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-48e2e8cd-57b0-4c94-ab26-e299d255f899 tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (887b4401-73a0-433a-9185-7f3986b267d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba80be52-bb4a-40f4-a7de-fc436af5d720', 'volume_name': 'volume-ba80be52-bb4a-40f4-a7de-fc436af5d720', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:31:11 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-48e2e8cd-57b0-4c94-ab26-e299d255f899 tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e59b40c5-becc-4bf0-9e27-3f2aa2909224) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:31:11 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-48e2e8cd-57b0-4c94-ab26-e299d255f899 tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e59b40c5-becc-4bf0-9e27-3f2aa2909224) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:31:11 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-48e2e8cd-57b0-4c94-ab26-e299d255f899 tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a56f185e-82ec-4d3f-bc69-e67e338c5229) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:31:11 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-48e2e8cd-57b0-4c94-ab26-e299d255f899 tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Volume ba80be52-bb4a-40f4-a7de-fc436af5d720: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba80be52-bb4a-40f4-a7de-fc436af5d720', 'volume_size': 1} Aug 05 06:31:11 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-48e2e8cd-57b0-4c94-ab26-e299d255f899 tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:31:11 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-bf303ede-4cfd-4c1a-9978-ab97fb1ee2ff tempest-CinderUnicodeTest-1672876 None] Acquiring lock "cinder-8c8b55f9-9908-42d4-9efa-066b5b1ed4c0-delete_snapshot" by "delete_snapshot" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:31:11 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-bf303ede-4cfd-4c1a-9978-ab97fb1ee2ff tempest-CinderUnicodeTest-1672876 None] Lock "cinder-8c8b55f9-9908-42d4-9efa-066b5b1ed4c0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:31:11 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-bf303ede-4cfd-4c1a-9978-ab97fb1ee2ff tempest-CinderUnicodeTest-1672876 None] Acquiring lock "cinder-quobyte-3f8c60c4-c841-4870-a2e6-750b679930f1" by "delete_snapshot" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:31:11 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-bf303ede-4cfd-4c1a-9978-ab97fb1ee2ff tempest-CinderUnicodeTest-1672876 None] Lock "cinder-quobyte-3f8c60c4-c841-4870-a2e6-750b679930f1" acquired by "delete_snapshot" :: waited 0.023s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:31:11 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-bf303ede-4cfd-4c1a-9978-ab97fb1ee2ff tempest-CinderUnicodeTest-1672876 None] Acquiring lock "cinder-quobyte-8c8b55f9-9908-42d4-9efa-066b5b1ed4c0" by "_delete_snapshot" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:31:11 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-bf303ede-4cfd-4c1a-9978-ab97fb1ee2ff tempest-CinderUnicodeTest-1672876 None] Lock "cinder-quobyte-8c8b55f9-9908-42d4-9efa-066b5b1ed4c0" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:31:11 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-bf303ede-4cfd-4c1a-9978-ab97fb1ee2ff tempest-CinderUnicodeTest-1672876 None] Deleting offline snapshot 8c8b55f9-9908-42d4-9efa-066b5b1ed4c0 of volume 3f8c60c4-c841-4870-a2e6-750b679930f1 {{(pid=88695) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 06:31:11 devstack sudo[108720]: pam_unix(sudo:session): session closed for user root Aug 05 06:31:11 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-bf303ede-4cfd-4c1a-9978-ab97fb1ee2ff tempest-CinderUnicodeTest-1672876 None] snapshot_file for this snap is: volume-3f8c60c4-c841-4870-a2e6-750b679930f1.8c8b55f9-9908-42d4-9efa-066b5b1ed4c0 {{(pid=88695) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 06:31:11 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-0f2fd871-28a7-4075-bf88-afa1b5b77df4 tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-67b37c58-d702-4d8c-b7d4-e705b19b202f 1073741824" returned: 0 in 0.785s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:31:11 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b59fd03-1255-4e78-b2f9-56a0a9dec697]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:31:11 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-bf303ede-4cfd-4c1a-9978-ab97fb1ee2ff tempest-CinderUnicodeTest-1672876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-3f8c60c4-c841-4870-a2e6-750b679930f1.8c8b55f9-9908-42d4-9efa-066b5b1ed4c0 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:31:11 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-0f2fd871-28a7-4075-bf88-afa1b5b77df4 tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-67b37c58-d702-4d8c-b7d4-e705b19b202f {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:31:11 devstack sudo[108727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-67b37c58-d702-4d8c-b7d4-e705b19b202f Aug 05 06:31:11 devstack sudo[108727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:31:11 devstack sudo[108726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-3f8c60c4-c841-4870-a2e6-750b679930f1.8c8b55f9-9908-42d4-9efa-066b5b1ed4c0 Aug 05 06:31:11 devstack sudo[108726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:31:11 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-6605c02d-b2c1-4c18-8053-fee988e7810f tempest-CreateVolumesFromSnapshotTest-2119669264 None] Acquiring lock "cinder-8f20ffa7-b1ae-44bc-840b-e69aad0b54f7-delete_volume" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:31:11 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-6605c02d-b2c1-4c18-8053-fee988e7810f tempest-CreateVolumesFromSnapshotTest-2119669264 None] Lock "cinder-8f20ffa7-b1ae-44bc-840b-e69aad0b54f7-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:31:11 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-6605c02d-b2c1-4c18-8053-fee988e7810f tempest-CreateVolumesFromSnapshotTest-2119669264 None] Acquiring lock "cinder-quobyte-8f20ffa7-b1ae-44bc-840b-e69aad0b54f7" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:31:11 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-6605c02d-b2c1-4c18-8053-fee988e7810f tempest-CreateVolumesFromSnapshotTest-2119669264 None] Lock "cinder-quobyte-8f20ffa7-b1ae-44bc-840b-e69aad0b54f7" acquired by "delete_volume" :: waited 0.042s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:31:11 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[87ca6348-e8c7-4e2f-8cf1-b920f26f4afa]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:31:11 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-6605c02d-b2c1-4c18-8053-fee988e7810f tempest-CreateVolumesFromSnapshotTest-2119669264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8f20ffa7-b1ae-44bc-840b-e69aad0b54f7 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:31:11 devstack sudo[108726]: pam_unix(sudo:session): session closed for user root Aug 05 06:31:11 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-bf303ede-4cfd-4c1a-9978-ab97fb1ee2ff tempest-CinderUnicodeTest-1672876 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-3f8c60c4-c841-4870-a2e6-750b679930f1.8c8b55f9-9908-42d4-9efa-066b5b1ed4c0" returned: 0 in 0.456s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:31:11 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-bf303ede-4cfd-4c1a-9978-ab97fb1ee2ff tempest-CinderUnicodeTest-1672876 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3f8c60c4-c841-4870-a2e6-750b679930f1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88695) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 06:31:11 devstack sudo[108727]: pam_unix(sudo:session): session closed for user root Aug 05 06:31:11 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-0f2fd871-28a7-4075-bf88-afa1b5b77df4 tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-67b37c58-d702-4d8c-b7d4-e705b19b202f" returned: 0 in 0.417s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:31:11 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-0f2fd871-28a7-4075-bf88-afa1b5b77df4 tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] <== create_volume: return (1306ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'} {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 06:31:11 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-0f2fd871-28a7-4075-bf88-afa1b5b77df4 tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.311s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:31:11 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0096895-8fc4-45cc-8fee-9c8c6925d1c8]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:31:11 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-2ea49b6d-b6e5-497a-a639-0509ec73419a tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.254s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:31:11 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-2ea49b6d-b6e5-497a-a639-0509ec73419a tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:31:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1418037784',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a538fae4-9e2b-4d5e-8178-0260718a6e5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c55203427ada47e99fdde77275d8e7e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:31:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:31:09Z,use_quota=True,user_id='24f733aca06a4d75be2245b2178c1d0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)}" {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 06:31:11 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-2ea49b6d-b6e5-497a-a639-0509ec73419a tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Creating volume a538fae4-9e2b-4d5e-8178-0260718a6e5e {{(pid=88695) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 06:31:11 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-2ea49b6d-b6e5-497a-a639-0509ec73419a tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:31:11 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-2ea49b6d-b6e5-497a-a639-0509ec73419a tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:31:11 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-2ea49b6d-b6e5-497a-a639-0509ec73419a tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:31:11 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-2ea49b6d-b6e5-497a-a639-0509ec73419a tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:31:11 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-2ea49b6d-b6e5-497a-a639-0509ec73419a tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:31:11 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-2ea49b6d-b6e5-497a-a639-0509ec73419a tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Selected osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 as target Quobyte volume. {{(pid=88695) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 06:31:11 devstack cinder-volume[88695]: INFO cinder.volume.drivers.remotefs [None req-2ea49b6d-b6e5-497a-a639-0509ec73419a tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] casted to osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 Aug 05 06:31:11 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-2ea49b6d-b6e5-497a-a639-0509ec73419a tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a538fae4-9e2b-4d5e-8178-0260718a6e5e 1073741824 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:31:11 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-bf303ede-4cfd-4c1a-9978-ab97fb1ee2ff tempest-CinderUnicodeTest-1672876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-3f8c60c4-c841-4870-a2e6-750b679930f1 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:31:11 devstack sudo[108733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8f20ffa7-b1ae-44bc-840b-e69aad0b54f7 Aug 05 06:31:11 devstack sudo[108733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:31:11 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-0f2fd871-28a7-4075-bf88-afa1b5b77df4 tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d85a8daf-4721-4528-ac3f-3e9709698622) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-67b37c58-d702-4d8c-b7d4-e705b19b202f', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:31:11 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-0f2fd871-28a7-4075-bf88-afa1b5b77df4 tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fd157fc-3e68-47ba-8783-1dd8a4e322f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:31:11 devstack sudo[108735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a538fae4-9e2b-4d5e-8178-0260718a6e5e 1073741824 Aug 05 06:31:11 devstack sudo[108735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:31:11 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-0f2fd871-28a7-4075-bf88-afa1b5b77df4 tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Volume volume-67b37c58-d702-4d8c-b7d4-e705b19b202f (67b37c58-d702-4d8c-b7d4-e705b19b202f): created successfully Aug 05 06:31:11 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-0f2fd871-28a7-4075-bf88-afa1b5b77df4 tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fd157fc-3e68-47ba-8783-1dd8a4e322f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:31:11 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-0f2fd871-28a7-4075-bf88-afa1b5b77df4 tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Flow 'volume_create_manager' (efa3c1a2-81e3-4e85-b065-ba0461793ae2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:31:11 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-0f2fd871-28a7-4075-bf88-afa1b5b77df4 tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Created volume successfully. Aug 05 06:31:12 devstack sudo[108737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-3f8c60c4-c841-4870-a2e6-750b679930f1 Aug 05 06:31:12 devstack sudo[108737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:31:12 devstack sudo[108733]: pam_unix(sudo:session): session closed for user root Aug 05 06:31:12 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-6605c02d-b2c1-4c18-8053-fee988e7810f tempest-CreateVolumesFromSnapshotTest-2119669264 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8f20ffa7-b1ae-44bc-840b-e69aad0b54f7" returned: 0 in 0.538s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:31:12 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-6605c02d-b2c1-4c18-8053-fee988e7810f tempest-CreateVolumesFromSnapshotTest-2119669264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8f20ffa7-b1ae-44bc-840b-e69aad0b54f7 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:31:12 devstack sudo[108747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8f20ffa7-b1ae-44bc-840b-e69aad0b54f7 Aug 05 06:31:12 devstack sudo[108747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:31:12 devstack sudo[108737]: pam_unix(sudo:session): session closed for user root Aug 05 06:31:12 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-bf303ede-4cfd-4c1a-9978-ab97fb1ee2ff tempest-CinderUnicodeTest-1672876 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-3f8c60c4-c841-4870-a2e6-750b679930f1" returned: 0 in 0.621s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:31:12 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-bf303ede-4cfd-4c1a-9978-ab97fb1ee2ff tempest-CinderUnicodeTest-1672876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-3f8c60c4-c841-4870-a2e6-750b679930f1.8c8b55f9-9908-42d4-9efa-066b5b1ed4c0 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:31:12 devstack sudo[108753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-3f8c60c4-c841-4870-a2e6-750b679930f1.8c8b55f9-9908-42d4-9efa-066b5b1ed4c0 Aug 05 06:31:12 devstack sudo[108753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:31:12 devstack sudo[108735]: pam_unix(sudo:session): session closed for user root Aug 05 06:31:12 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-2ea49b6d-b6e5-497a-a639-0509ec73419a tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a538fae4-9e2b-4d5e-8178-0260718a6e5e 1073741824" returned: 0 in 0.721s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:31:12 devstack sudo[108747]: pam_unix(sudo:session): session closed for user root Aug 05 06:31:12 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-2ea49b6d-b6e5-497a-a639-0509ec73419a tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a538fae4-9e2b-4d5e-8178-0260718a6e5e {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:31:12 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-6605c02d-b2c1-4c18-8053-fee988e7810f tempest-CreateVolumesFromSnapshotTest-2119669264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8f20ffa7-b1ae-44bc-840b-e69aad0b54f7" returned: 0 in 0.368s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:31:12 devstack sudo[108756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a538fae4-9e2b-4d5e-8178-0260718a6e5e Aug 05 06:31:12 devstack sudo[108756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:31:12 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-6605c02d-b2c1-4c18-8053-fee988e7810f tempest-CreateVolumesFromSnapshotTest-2119669264 None] Lock "cinder-quobyte-8f20ffa7-b1ae-44bc-840b-e69aad0b54f7" released by "delete_volume" :: held 1.005s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:31:12 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-6605c02d-b2c1-4c18-8053-fee988e7810f tempest-CreateVolumesFromSnapshotTest-2119669264 None] Created reservations ['30c21e19-3a0c-4f4d-8e59-ee05dde93976', 'c85cf0ae-82ba-4a2b-a444-23e8043d798f', '65531368-7ebd-43c9-aac9-939510f6cb53', 'c343d32f-ec2c-4277-bf99-9d5a305004f0'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:31:12 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-6605c02d-b2c1-4c18-8053-fee988e7810f tempest-CreateVolumesFromSnapshotTest-2119669264 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:31:12 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-6605c02d-b2c1-4c18-8053-fee988e7810f tempest-CreateVolumesFromSnapshotTest-2119669264 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:31:12 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-6605c02d-b2c1-4c18-8053-fee988e7810f tempest-CreateVolumesFromSnapshotTest-2119669264 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:31:12 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-6605c02d-b2c1-4c18-8053-fee988e7810f tempest-CreateVolumesFromSnapshotTest-2119669264 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:31:12 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-6605c02d-b2c1-4c18-8053-fee988e7810f tempest-CreateVolumesFromSnapshotTest-2119669264 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:31:12 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-6605c02d-b2c1-4c18-8053-fee988e7810f tempest-CreateVolumesFromSnapshotTest-2119669264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:31:12 devstack sudo[108761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce Aug 05 06:31:12 devstack sudo[108761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:31:13 devstack sudo[108756]: pam_unix(sudo:session): session closed for user root Aug 05 06:31:13 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-2ea49b6d-b6e5-497a-a639-0509ec73419a tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a538fae4-9e2b-4d5e-8178-0260718a6e5e" returned: 0 in 0.385s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:31:13 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-2ea49b6d-b6e5-497a-a639-0509ec73419a tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] <== create_volume: return (1169ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'} {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 06:31:13 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-2ea49b6d-b6e5-497a-a639-0509ec73419a tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.173s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:31:13 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-8ee45722-c606-488d-9ab0-f10fb846c2bc tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.897s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:31:13 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-8ee45722-c606-488d-9ab0-f10fb846c2bc tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:31:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1720804571',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c107508a-51f6-418f-beb7-a834fa15d809,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c55203427ada47e99fdde77275d8e7e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:31:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:31:10Z,use_quota=True,user_id='24f733aca06a4d75be2245b2178c1d0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)}" {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 06:31:13 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-8ee45722-c606-488d-9ab0-f10fb846c2bc tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Creating volume c107508a-51f6-418f-beb7-a834fa15d809 {{(pid=88695) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 06:31:13 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-8ee45722-c606-488d-9ab0-f10fb846c2bc tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:31:13 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-8ee45722-c606-488d-9ab0-f10fb846c2bc tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:31:13 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-8ee45722-c606-488d-9ab0-f10fb846c2bc tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:31:13 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-8ee45722-c606-488d-9ab0-f10fb846c2bc tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:31:13 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-8ee45722-c606-488d-9ab0-f10fb846c2bc tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:31:13 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-8ee45722-c606-488d-9ab0-f10fb846c2bc tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Selected osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 as target Quobyte volume. {{(pid=88695) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 06:31:13 devstack cinder-volume[88695]: INFO cinder.volume.drivers.remotefs [None req-8ee45722-c606-488d-9ab0-f10fb846c2bc tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] casted to osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 Aug 05 06:31:13 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-8ee45722-c606-488d-9ab0-f10fb846c2bc tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-c107508a-51f6-418f-beb7-a834fa15d809 1073741824 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:31:13 devstack sudo[108753]: pam_unix(sudo:session): session closed for user root Aug 05 06:31:13 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-bf303ede-4cfd-4c1a-9978-ab97fb1ee2ff tempest-CinderUnicodeTest-1672876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-3f8c60c4-c841-4870-a2e6-750b679930f1.8c8b55f9-9908-42d4-9efa-066b5b1ed4c0" returned: 0 in 0.592s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:31:13 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-bf303ede-4cfd-4c1a-9978-ab97fb1ee2ff tempest-CinderUnicodeTest-1672876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-3f8c60c4-c841-4870-a2e6-750b679930f1.8c8b55f9-9908-42d4-9efa-066b5b1ed4c0 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:31:13 devstack sudo[108769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-c107508a-51f6-418f-beb7-a834fa15d809 1073741824 Aug 05 06:31:13 devstack sudo[108769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:31:13 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-2ea49b6d-b6e5-497a-a639-0509ec73419a tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2ee27d1-705f-4fa7-9f3c-ec5249b7b6d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a538fae4-9e2b-4d5e-8178-0260718a6e5e', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:31:13 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-2ea49b6d-b6e5-497a-a639-0509ec73419a tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e545d0bf-9374-4f53-af54-cf07c97a343a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:31:13 devstack sudo[108770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-3f8c60c4-c841-4870-a2e6-750b679930f1.8c8b55f9-9908-42d4-9efa-066b5b1ed4c0 Aug 05 06:31:13 devstack sudo[108770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:31:13 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-2ea49b6d-b6e5-497a-a639-0509ec73419a tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Volume volume-a538fae4-9e2b-4d5e-8178-0260718a6e5e (a538fae4-9e2b-4d5e-8178-0260718a6e5e): created successfully Aug 05 06:31:13 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-2ea49b6d-b6e5-497a-a639-0509ec73419a tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e545d0bf-9374-4f53-af54-cf07c97a343a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:31:13 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-2ea49b6d-b6e5-497a-a639-0509ec73419a tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Flow 'volume_create_manager' (ab045f21-51d2-4d20-a12c-594ae3c74a35) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:31:13 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-2ea49b6d-b6e5-497a-a639-0509ec73419a tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Created volume successfully. Aug 05 06:31:13 devstack sudo[108761]: pam_unix(sudo:session): session closed for user root Aug 05 06:31:13 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-6605c02d-b2c1-4c18-8053-fee988e7810f tempest-CreateVolumesFromSnapshotTest-2119669264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce" returned: 0 in 0.484s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:31:13 devstack cinder-volume[88695]: DEBUG cinder.manager [None req-6605c02d-b2c1-4c18-8053-fee988e7810f tempest-CreateVolumesFromSnapshotTest-2119669264 None] Notifying Schedulers of capabilities ... {{(pid=88695) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 06:31:13 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-6605c02d-b2c1-4c18-8053-fee988e7810f tempest-CreateVolumesFromSnapshotTest-2119669264 None] Deleted volume successfully. Aug 05 06:31:13 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-6605c02d-b2c1-4c18-8053-fee988e7810f tempest-CreateVolumesFromSnapshotTest-2119669264 None] Lock "cinder-8f20ffa7-b1ae-44bc-840b-e69aad0b54f7-delete_volume" released by "delete_volume" :: held 1.846s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:31:13 devstack sudo[108770]: pam_unix(sudo:session): session closed for user root Aug 05 06:31:13 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-bf303ede-4cfd-4c1a-9978-ab97fb1ee2ff tempest-CinderUnicodeTest-1672876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-3f8c60c4-c841-4870-a2e6-750b679930f1.8c8b55f9-9908-42d4-9efa-066b5b1ed4c0" returned: 0 in 0.453s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:31:13 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-bf303ede-4cfd-4c1a-9978-ab97fb1ee2ff tempest-CinderUnicodeTest-1672876 None] Lock "cinder-quobyte-8c8b55f9-9908-42d4-9efa-066b5b1ed4c0" released by "_delete_snapshot" :: held 2.301s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:31:13 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-bf303ede-4cfd-4c1a-9978-ab97fb1ee2ff tempest-CinderUnicodeTest-1672876 None] Lock "cinder-quobyte-3f8c60c4-c841-4870-a2e6-750b679930f1" released by "delete_snapshot" :: held 2.330s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:31:13 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-bf303ede-4cfd-4c1a-9978-ab97fb1ee2ff tempest-CinderUnicodeTest-1672876 None] Created reservations ['d70f06d8-0b5f-4f67-95c4-1abef6fa6ca2', '1cc6642c-5adc-421c-b126-2c91d4460724', '4dbf616b-3e2f-4454-8564-9d945e4523b7', '1cddf8fe-1c1d-4894-a2aa-d58228b1bf00'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:31:13 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-bf303ede-4cfd-4c1a-9978-ab97fb1ee2ff tempest-CinderUnicodeTest-1672876 None] Delete snapshot completed successfully. Aug 05 06:31:13 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-bf303ede-4cfd-4c1a-9978-ab97fb1ee2ff tempest-CinderUnicodeTest-1672876 None] Lock "cinder-8c8b55f9-9908-42d4-9efa-066b5b1ed4c0-delete_snapshot" released by "delete_snapshot" :: held 2.528s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:31:13 devstack sudo[108769]: pam_unix(sudo:session): session closed for user root Aug 05 06:31:13 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-8ee45722-c606-488d-9ab0-f10fb846c2bc tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-c107508a-51f6-418f-beb7-a834fa15d809 1073741824" returned: 0 in 0.751s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:31:13 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-8ee45722-c606-488d-9ab0-f10fb846c2bc tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-c107508a-51f6-418f-beb7-a834fa15d809 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:31:13 devstack sudo[108779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-c107508a-51f6-418f-beb7-a834fa15d809 Aug 05 06:31:13 devstack sudo[108779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:31:14 devstack sudo[108779]: pam_unix(sudo:session): session closed for user root Aug 05 06:31:14 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-8ee45722-c606-488d-9ab0-f10fb846c2bc tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-c107508a-51f6-418f-beb7-a834fa15d809" returned: 0 in 0.303s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:31:14 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-8ee45722-c606-488d-9ab0-f10fb846c2bc tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] <== create_volume: return (1117ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'} {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 06:31:14 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-8ee45722-c606-488d-9ab0-f10fb846c2bc tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.121s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:31:14 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-abd5c277-47ac-4e1a-a1d4-8c8ac09143a4 tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.298s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:31:14 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-abd5c277-47ac-4e1a-a1d4-8c8ac09143a4 tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:31:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-352532363',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebe2d8b6-4e9e-4c7a-bfd8-7c5c01a5c5bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c55203427ada47e99fdde77275d8e7e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:31:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:31:11Z,use_quota=True,user_id='24f733aca06a4d75be2245b2178c1d0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)}" {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 06:31:14 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-abd5c277-47ac-4e1a-a1d4-8c8ac09143a4 tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Creating volume ebe2d8b6-4e9e-4c7a-bfd8-7c5c01a5c5bf {{(pid=88695) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 06:31:14 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-abd5c277-47ac-4e1a-a1d4-8c8ac09143a4 tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:31:14 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-abd5c277-47ac-4e1a-a1d4-8c8ac09143a4 tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:31:14 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-abd5c277-47ac-4e1a-a1d4-8c8ac09143a4 tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:31:14 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-abd5c277-47ac-4e1a-a1d4-8c8ac09143a4 tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:31:14 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-abd5c277-47ac-4e1a-a1d4-8c8ac09143a4 tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:31:14 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-abd5c277-47ac-4e1a-a1d4-8c8ac09143a4 tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Selected osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 as target Quobyte volume. {{(pid=88695) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 06:31:14 devstack cinder-volume[88695]: INFO cinder.volume.drivers.remotefs [None req-abd5c277-47ac-4e1a-a1d4-8c8ac09143a4 tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] casted to osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 Aug 05 06:31:14 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-abd5c277-47ac-4e1a-a1d4-8c8ac09143a4 tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-ebe2d8b6-4e9e-4c7a-bfd8-7c5c01a5c5bf 1073741824 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:31:14 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-8ee45722-c606-488d-9ab0-f10fb846c2bc tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (625468c3-64e1-42ee-9b3f-7cc7b2e81696) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c107508a-51f6-418f-beb7-a834fa15d809', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:31:14 devstack sudo[108782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-ebe2d8b6-4e9e-4c7a-bfd8-7c5c01a5c5bf 1073741824 Aug 05 06:31:14 devstack sudo[108782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:31:14 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-8ee45722-c606-488d-9ab0-f10fb846c2bc tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23afccad-18c9-4410-a329-df5682783961) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:31:14 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-8ee45722-c606-488d-9ab0-f10fb846c2bc tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Volume volume-c107508a-51f6-418f-beb7-a834fa15d809 (c107508a-51f6-418f-beb7-a834fa15d809): created successfully Aug 05 06:31:14 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-8ee45722-c606-488d-9ab0-f10fb846c2bc tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23afccad-18c9-4410-a329-df5682783961) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:31:14 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-8ee45722-c606-488d-9ab0-f10fb846c2bc tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Flow 'volume_create_manager' (b0c2ba0b-0d43-485b-9867-16566732524f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:31:14 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-8ee45722-c606-488d-9ab0-f10fb846c2bc tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Created volume successfully. Aug 05 06:31:14 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-68cd092f-1539-4098-85d4-61d6cb40f3b4 tempest-CinderUnicodeTest-1672876 None] Acquiring lock "cinder-3f8c60c4-c841-4870-a2e6-750b679930f1-delete_volume" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:31:14 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-68cd092f-1539-4098-85d4-61d6cb40f3b4 tempest-CinderUnicodeTest-1672876 None] Lock "cinder-3f8c60c4-c841-4870-a2e6-750b679930f1-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:31:14 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-68cd092f-1539-4098-85d4-61d6cb40f3b4 tempest-CinderUnicodeTest-1672876 None] Acquiring lock "cinder-quobyte-3f8c60c4-c841-4870-a2e6-750b679930f1" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:31:14 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-68cd092f-1539-4098-85d4-61d6cb40f3b4 tempest-CinderUnicodeTest-1672876 None] Lock "cinder-quobyte-3f8c60c4-c841-4870-a2e6-750b679930f1" acquired by "delete_volume" :: waited 0.026s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:31:14 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b3e36cc-db25-45c0-92ee-cbce033cf8de]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:31:14 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-68cd092f-1539-4098-85d4-61d6cb40f3b4 tempest-CinderUnicodeTest-1672876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-3f8c60c4-c841-4870-a2e6-750b679930f1 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:31:14 devstack sudo[108782]: pam_unix(sudo:session): session closed for user root Aug 05 06:31:14 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-abd5c277-47ac-4e1a-a1d4-8c8ac09143a4 tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-ebe2d8b6-4e9e-4c7a-bfd8-7c5c01a5c5bf 1073741824" returned: 0 in 0.664s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:31:14 devstack sudo[108788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-3f8c60c4-c841-4870-a2e6-750b679930f1 Aug 05 06:31:14 devstack sudo[108788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:31:14 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-abd5c277-47ac-4e1a-a1d4-8c8ac09143a4 tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-ebe2d8b6-4e9e-4c7a-bfd8-7c5c01a5c5bf {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:31:14 devstack sudo[108790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-ebe2d8b6-4e9e-4c7a-bfd8-7c5c01a5c5bf Aug 05 06:31:14 devstack sudo[108790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:31:15 devstack sudo[108788]: pam_unix(sudo:session): session closed for user root Aug 05 06:31:15 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-68cd092f-1539-4098-85d4-61d6cb40f3b4 tempest-CinderUnicodeTest-1672876 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-3f8c60c4-c841-4870-a2e6-750b679930f1" returned: 0 in 0.539s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:31:15 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-68cd092f-1539-4098-85d4-61d6cb40f3b4 tempest-CinderUnicodeTest-1672876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-3f8c60c4-c841-4870-a2e6-750b679930f1 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:31:15 devstack sudo[108790]: pam_unix(sudo:session): session closed for user root Aug 05 06:31:15 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-abd5c277-47ac-4e1a-a1d4-8c8ac09143a4 tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-ebe2d8b6-4e9e-4c7a-bfd8-7c5c01a5c5bf" returned: 0 in 0.340s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:31:15 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-abd5c277-47ac-4e1a-a1d4-8c8ac09143a4 tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] <== create_volume: return (1092ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'} {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 06:31:15 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-abd5c277-47ac-4e1a-a1d4-8c8ac09143a4 tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.096s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:31:15 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-48e2e8cd-57b0-4c94-ab26-e299d255f899 tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.047s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:31:15 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-48e2e8cd-57b0-4c94-ab26-e299d255f899 tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:31:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-825396816',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba80be52-bb4a-40f4-a7de-fc436af5d720,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c55203427ada47e99fdde77275d8e7e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:31:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:31:11Z,use_quota=True,user_id='24f733aca06a4d75be2245b2178c1d0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)}" {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 06:31:15 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-48e2e8cd-57b0-4c94-ab26-e299d255f899 tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Creating volume ba80be52-bb4a-40f4-a7de-fc436af5d720 {{(pid=88695) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 06:31:15 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-48e2e8cd-57b0-4c94-ab26-e299d255f899 tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:31:15 devstack sudo[108796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-3f8c60c4-c841-4870-a2e6-750b679930f1 Aug 05 06:31:15 devstack sudo[108796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:31:15 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-48e2e8cd-57b0-4c94-ab26-e299d255f899 tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:31:15 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-48e2e8cd-57b0-4c94-ab26-e299d255f899 tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:31:15 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-48e2e8cd-57b0-4c94-ab26-e299d255f899 tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:31:15 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-48e2e8cd-57b0-4c94-ab26-e299d255f899 tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:31:15 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-48e2e8cd-57b0-4c94-ab26-e299d255f899 tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Selected osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 as target Quobyte volume. {{(pid=88695) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 06:31:15 devstack cinder-volume[88695]: INFO cinder.volume.drivers.remotefs [None req-48e2e8cd-57b0-4c94-ab26-e299d255f899 tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] casted to osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 Aug 05 06:31:15 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-48e2e8cd-57b0-4c94-ab26-e299d255f899 tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-ba80be52-bb4a-40f4-a7de-fc436af5d720 1073741824 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:31:15 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-abd5c277-47ac-4e1a-a1d4-8c8ac09143a4 tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20ba4bed-1fd8-451c-a959-90fab3b092b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ebe2d8b6-4e9e-4c7a-bfd8-7c5c01a5c5bf', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:31:15 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-abd5c277-47ac-4e1a-a1d4-8c8ac09143a4 tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fec6aa2f-bbc6-4cc2-8975-7862cc5932a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:31:15 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-abd5c277-47ac-4e1a-a1d4-8c8ac09143a4 tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Volume volume-ebe2d8b6-4e9e-4c7a-bfd8-7c5c01a5c5bf (ebe2d8b6-4e9e-4c7a-bfd8-7c5c01a5c5bf): created successfully Aug 05 06:31:15 devstack sudo[108798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-ba80be52-bb4a-40f4-a7de-fc436af5d720 1073741824 Aug 05 06:31:15 devstack sudo[108798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:31:15 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-abd5c277-47ac-4e1a-a1d4-8c8ac09143a4 tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fec6aa2f-bbc6-4cc2-8975-7862cc5932a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:31:15 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-abd5c277-47ac-4e1a-a1d4-8c8ac09143a4 tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Flow 'volume_create_manager' (a3792dd6-b802-4b26-8c47-dfdfa0a45b32) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:31:15 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-abd5c277-47ac-4e1a-a1d4-8c8ac09143a4 tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Created volume successfully. Aug 05 06:31:15 devstack sudo[108796]: pam_unix(sudo:session): session closed for user root Aug 05 06:31:15 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-68cd092f-1539-4098-85d4-61d6cb40f3b4 tempest-CinderUnicodeTest-1672876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-3f8c60c4-c841-4870-a2e6-750b679930f1" returned: 0 in 0.342s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:31:15 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-68cd092f-1539-4098-85d4-61d6cb40f3b4 tempest-CinderUnicodeTest-1672876 None] Lock "cinder-quobyte-3f8c60c4-c841-4870-a2e6-750b679930f1" released by "delete_volume" :: held 0.989s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:31:15 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-68cd092f-1539-4098-85d4-61d6cb40f3b4 tempest-CinderUnicodeTest-1672876 None] Created reservations ['eaa0405e-0524-4fe7-80fd-a87442a703af', '66f49028-06e1-4e20-afbd-4c0a41821711', '886fe634-27c9-4e6a-bc65-7f3a7b929142', 'dd6edb1a-3db9-4062-92be-3f7a037c2152'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:31:15 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-68cd092f-1539-4098-85d4-61d6cb40f3b4 tempest-CinderUnicodeTest-1672876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:31:15 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-68cd092f-1539-4098-85d4-61d6cb40f3b4 tempest-CinderUnicodeTest-1672876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:31:15 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-68cd092f-1539-4098-85d4-61d6cb40f3b4 tempest-CinderUnicodeTest-1672876 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:31:15 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-68cd092f-1539-4098-85d4-61d6cb40f3b4 tempest-CinderUnicodeTest-1672876 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:31:15 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-68cd092f-1539-4098-85d4-61d6cb40f3b4 tempest-CinderUnicodeTest-1672876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:31:15 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-68cd092f-1539-4098-85d4-61d6cb40f3b4 tempest-CinderUnicodeTest-1672876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:31:15 devstack sudo[108805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce Aug 05 06:31:15 devstack sudo[108805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:31:16 devstack sudo[108798]: pam_unix(sudo:session): session closed for user root Aug 05 06:31:16 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-48e2e8cd-57b0-4c94-ab26-e299d255f899 tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-ba80be52-bb4a-40f4-a7de-fc436af5d720 1073741824" returned: 0 in 0.734s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:31:16 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-48e2e8cd-57b0-4c94-ab26-e299d255f899 tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-ba80be52-bb4a-40f4-a7de-fc436af5d720 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:31:16 devstack sudo[108807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-ba80be52-bb4a-40f4-a7de-fc436af5d720 Aug 05 06:31:16 devstack sudo[108807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:31:16 devstack sudo[108805]: pam_unix(sudo:session): session closed for user root Aug 05 06:31:16 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-68cd092f-1539-4098-85d4-61d6cb40f3b4 tempest-CinderUnicodeTest-1672876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce" returned: 0 in 0.412s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:31:16 devstack cinder-volume[88695]: DEBUG cinder.manager [None req-68cd092f-1539-4098-85d4-61d6cb40f3b4 tempest-CinderUnicodeTest-1672876 None] Notifying Schedulers of capabilities ... {{(pid=88695) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 06:31:16 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-68cd092f-1539-4098-85d4-61d6cb40f3b4 tempest-CinderUnicodeTest-1672876 None] Deleted volume successfully. Aug 05 06:31:16 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-68cd092f-1539-4098-85d4-61d6cb40f3b4 tempest-CinderUnicodeTest-1672876 None] Lock "cinder-3f8c60c4-c841-4870-a2e6-750b679930f1-delete_volume" released by "delete_volume" :: held 1.849s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:31:16 devstack sudo[108807]: pam_unix(sudo:session): session closed for user root Aug 05 06:31:16 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-48e2e8cd-57b0-4c94-ab26-e299d255f899 tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-ba80be52-bb4a-40f4-a7de-fc436af5d720" returned: 0 in 0.372s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:31:16 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-48e2e8cd-57b0-4c94-ab26-e299d255f899 tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] <== create_volume: return (1215ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'} {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 06:31:16 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-48e2e8cd-57b0-4c94-ab26-e299d255f899 tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.223s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:31:16 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-48e2e8cd-57b0-4c94-ab26-e299d255f899 tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a56f185e-82ec-4d3f-bc69-e67e338c5229) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba80be52-bb4a-40f4-a7de-fc436af5d720', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:31:16 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-48e2e8cd-57b0-4c94-ab26-e299d255f899 tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84642504-269d-4c04-9a59-68faa6b258d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:31:16 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-48e2e8cd-57b0-4c94-ab26-e299d255f899 tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Volume volume-ba80be52-bb4a-40f4-a7de-fc436af5d720 (ba80be52-bb4a-40f4-a7de-fc436af5d720): created successfully Aug 05 06:31:16 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-48e2e8cd-57b0-4c94-ab26-e299d255f899 tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84642504-269d-4c04-9a59-68faa6b258d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:31:16 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-48e2e8cd-57b0-4c94-ab26-e299d255f899 tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Flow 'volume_create_manager' (3fb7863e-9057-42bc-97ba-0042063b436d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:31:16 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-48e2e8cd-57b0-4c94-ab26-e299d255f899 tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Created volume successfully. Aug 05 06:31:16 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-449757b1-5a54-4568-ad6f-d0cc4e089323 tempest-CinderUnicodeTest-1672876 None] Acquiring lock "cinder-7a1e9d1a-654b-444f-b9ba-8e75bc31c6f9-delete_volume" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:31:16 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-449757b1-5a54-4568-ad6f-d0cc4e089323 tempest-CinderUnicodeTest-1672876 None] Lock "cinder-7a1e9d1a-654b-444f-b9ba-8e75bc31c6f9-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:31:16 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-449757b1-5a54-4568-ad6f-d0cc4e089323 tempest-CinderUnicodeTest-1672876 None] Acquiring lock "cinder-quobyte-7a1e9d1a-654b-444f-b9ba-8e75bc31c6f9" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:31:16 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-449757b1-5a54-4568-ad6f-d0cc4e089323 tempest-CinderUnicodeTest-1672876 None] Lock "cinder-quobyte-7a1e9d1a-654b-444f-b9ba-8e75bc31c6f9" acquired by "delete_volume" :: waited 0.022s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:31:16 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5d83445-8b31-499c-ba14-9792f2b55595]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:31:16 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-449757b1-5a54-4568-ad6f-d0cc4e089323 tempest-CinderUnicodeTest-1672876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7a1e9d1a-654b-444f-b9ba-8e75bc31c6f9 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:31:17 devstack sudo[108811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7a1e9d1a-654b-444f-b9ba-8e75bc31c6f9 Aug 05 06:31:17 devstack sudo[108811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:31:17 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-320c547a-eec1-4152-b731-41d819604d3b tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Acquiring lock "cinder-ba80be52-bb4a-40f4-a7de-fc436af5d720-delete_volume" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:31:17 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-320c547a-eec1-4152-b731-41d819604d3b tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Lock "cinder-ba80be52-bb4a-40f4-a7de-fc436af5d720-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:31:17 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-320c547a-eec1-4152-b731-41d819604d3b tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Acquiring lock "cinder-quobyte-ba80be52-bb4a-40f4-a7de-fc436af5d720" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:31:17 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-320c547a-eec1-4152-b731-41d819604d3b tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Lock "cinder-quobyte-ba80be52-bb4a-40f4-a7de-fc436af5d720" acquired by "delete_volume" :: waited 0.025s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:31:17 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[a68180d0-3a15-49d7-963c-2126e087cecb]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:31:17 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-320c547a-eec1-4152-b731-41d819604d3b tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-ba80be52-bb4a-40f4-a7de-fc436af5d720 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:31:17 devstack sudo[108811]: pam_unix(sudo:session): session closed for user root Aug 05 06:31:17 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-449757b1-5a54-4568-ad6f-d0cc4e089323 tempest-CinderUnicodeTest-1672876 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7a1e9d1a-654b-444f-b9ba-8e75bc31c6f9" returned: 0 in 0.542s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:31:17 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-449757b1-5a54-4568-ad6f-d0cc4e089323 tempest-CinderUnicodeTest-1672876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7a1e9d1a-654b-444f-b9ba-8e75bc31c6f9 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:31:17 devstack sudo[108817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7a1e9d1a-654b-444f-b9ba-8e75bc31c6f9 Aug 05 06:31:17 devstack sudo[108817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:31:17 devstack sudo[108816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-ba80be52-bb4a-40f4-a7de-fc436af5d720 Aug 05 06:31:17 devstack sudo[108816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:31:17 devstack sudo[108817]: pam_unix(sudo:session): session closed for user root Aug 05 06:31:17 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-449757b1-5a54-4568-ad6f-d0cc4e089323 tempest-CinderUnicodeTest-1672876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7a1e9d1a-654b-444f-b9ba-8e75bc31c6f9" returned: 0 in 0.308s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:31:17 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-449757b1-5a54-4568-ad6f-d0cc4e089323 tempest-CinderUnicodeTest-1672876 None] Lock "cinder-quobyte-7a1e9d1a-654b-444f-b9ba-8e75bc31c6f9" released by "delete_volume" :: held 0.914s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:31:17 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-449757b1-5a54-4568-ad6f-d0cc4e089323 tempest-CinderUnicodeTest-1672876 None] Created reservations ['bd46c80e-7834-408d-a06d-eec4daf4356c', 'b159b08d-cf36-44db-ab26-a9ed83ce382e', '10a9e5a6-e90d-4bcd-a70f-4a41a3125d59', '715f9581-6dca-4410-bc16-710b71bd0886'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:31:18 devstack sudo[108816]: pam_unix(sudo:session): session closed for user root Aug 05 06:31:18 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-320c547a-eec1-4152-b731-41d819604d3b tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-ba80be52-bb4a-40f4-a7de-fc436af5d720" returned: 0 in 0.514s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:31:18 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-320c547a-eec1-4152-b731-41d819604d3b tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-ba80be52-bb4a-40f4-a7de-fc436af5d720 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:31:18 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-449757b1-5a54-4568-ad6f-d0cc4e089323 tempest-CinderUnicodeTest-1672876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:31:18 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-449757b1-5a54-4568-ad6f-d0cc4e089323 tempest-CinderUnicodeTest-1672876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:31:18 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-449757b1-5a54-4568-ad6f-d0cc4e089323 tempest-CinderUnicodeTest-1672876 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:31:18 devstack sudo[108824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-ba80be52-bb4a-40f4-a7de-fc436af5d720 Aug 05 06:31:18 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-449757b1-5a54-4568-ad6f-d0cc4e089323 tempest-CinderUnicodeTest-1672876 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:31:18 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-449757b1-5a54-4568-ad6f-d0cc4e089323 tempest-CinderUnicodeTest-1672876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:31:18 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-449757b1-5a54-4568-ad6f-d0cc4e089323 tempest-CinderUnicodeTest-1672876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:31:18 devstack sudo[108824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:31:18 devstack sudo[108826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce Aug 05 06:31:18 devstack sudo[108826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:31:18 devstack sudo[108824]: pam_unix(sudo:session): session closed for user root Aug 05 06:31:18 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-320c547a-eec1-4152-b731-41d819604d3b tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-ba80be52-bb4a-40f4-a7de-fc436af5d720" returned: 0 in 0.367s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:31:18 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-320c547a-eec1-4152-b731-41d819604d3b tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Lock "cinder-quobyte-ba80be52-bb4a-40f4-a7de-fc436af5d720" released by "delete_volume" :: held 0.946s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:31:18 devstack sudo[108826]: pam_unix(sudo:session): session closed for user root Aug 05 06:31:18 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-449757b1-5a54-4568-ad6f-d0cc4e089323 tempest-CinderUnicodeTest-1672876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce" returned: 0 in 0.335s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:31:18 devstack cinder-volume[88695]: DEBUG cinder.manager [None req-449757b1-5a54-4568-ad6f-d0cc4e089323 tempest-CinderUnicodeTest-1672876 None] Notifying Schedulers of capabilities ... {{(pid=88695) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 06:31:18 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-449757b1-5a54-4568-ad6f-d0cc4e089323 tempest-CinderUnicodeTest-1672876 None] Deleted volume successfully. Aug 05 06:31:18 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-449757b1-5a54-4568-ad6f-d0cc4e089323 tempest-CinderUnicodeTest-1672876 None] Lock "cinder-7a1e9d1a-654b-444f-b9ba-8e75bc31c6f9-delete_volume" released by "delete_volume" :: held 1.590s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:31:18 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-320c547a-eec1-4152-b731-41d819604d3b tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Created reservations ['34d42f65-3efb-44b0-a767-5a60c1601f55', '169c235c-f77b-48f5-bda8-00b1a274210f', '3f01c646-e436-4232-aede-86c9f37a3176', 'c4d438fb-014e-4186-b96e-f2ded11cd95e'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:31:18 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-320c547a-eec1-4152-b731-41d819604d3b tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:31:18 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-320c547a-eec1-4152-b731-41d819604d3b tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:31:18 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-320c547a-eec1-4152-b731-41d819604d3b tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:31:18 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-320c547a-eec1-4152-b731-41d819604d3b tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:31:18 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-320c547a-eec1-4152-b731-41d819604d3b tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:31:18 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-320c547a-eec1-4152-b731-41d819604d3b tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:31:18 devstack sudo[108831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce Aug 05 06:31:18 devstack sudo[108831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:31:18 devstack sudo[108831]: pam_unix(sudo:session): session closed for user root Aug 05 06:31:18 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-320c547a-eec1-4152-b731-41d819604d3b tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce" returned: 0 in 0.310s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:31:18 devstack cinder-volume[88695]: DEBUG cinder.manager [None req-320c547a-eec1-4152-b731-41d819604d3b tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Notifying Schedulers of capabilities ... {{(pid=88695) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 06:31:18 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-320c547a-eec1-4152-b731-41d819604d3b tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Deleted volume successfully. Aug 05 06:31:18 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-320c547a-eec1-4152-b731-41d819604d3b tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Lock "cinder-ba80be52-bb4a-40f4-a7de-fc436af5d720-delete_volume" released by "delete_volume" :: held 1.594s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:31:19 devstack cinder-volume[88695]: DEBUG cinder.volume.flows.manager.create_volume [None req-deed89c0-e21a-4e34-b4c5-bca093f38c71 tempest-ProjectMemberTests-475949430 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88695) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 06:31:19 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-deed89c0-e21a-4e34-b4c5-bca093f38c71 tempest-ProjectMemberTests-475949430 None] Flow 'volume_create_manager' (c78718da-6e5c-4874-9252-3d24b5fdf28d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:31:19 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-deed89c0-e21a-4e34-b4c5-bca093f38c71 tempest-ProjectMemberTests-475949430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8761292-e1f2-4366-be59-fa76013e8076) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:31:19 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-deed89c0-e21a-4e34-b4c5-bca093f38c71 tempest-ProjectMemberTests-475949430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8761292-e1f2-4366-be59-fa76013e8076) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:31:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1053236622',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5045a1c9-b061-4abb-a112-d84657e90f6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe85d705f6434b70a55dac31b79c0714',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:31:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:31:19Z,use_quota=True,user_id='a9de9bccd062450c95c9f7f6cf4317f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:31:19 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-deed89c0-e21a-4e34-b4c5-bca093f38c71 tempest-ProjectMemberTests-475949430 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb3fdf61-fd65-4993-8c34-119e1f469c54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:31:19 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-deed89c0-e21a-4e34-b4c5-bca093f38c71 tempest-ProjectMemberTests-475949430 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb3fdf61-fd65-4993-8c34-119e1f469c54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:31:19 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-deed89c0-e21a-4e34-b4c5-bca093f38c71 tempest-ProjectMemberTests-475949430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1505728-34fe-496a-a9ff-6a18cb9c47d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:31:19 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-deed89c0-e21a-4e34-b4c5-bca093f38c71 tempest-ProjectMemberTests-475949430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1505728-34fe-496a-a9ff-6a18cb9c47d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5045a1c9-b061-4abb-a112-d84657e90f6a', 'volume_name': 'volume-5045a1c9-b061-4abb-a112-d84657e90f6a', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:31:19 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-deed89c0-e21a-4e34-b4c5-bca093f38c71 tempest-ProjectMemberTests-475949430 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0bca1dd-bcca-469a-a911-d48b759f1120) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:31:19 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-deed89c0-e21a-4e34-b4c5-bca093f38c71 tempest-ProjectMemberTests-475949430 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0bca1dd-bcca-469a-a911-d48b759f1120) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:31:19 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-deed89c0-e21a-4e34-b4c5-bca093f38c71 tempest-ProjectMemberTests-475949430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc421892-4f54-4ac6-bf44-557b57c315bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:31:19 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-deed89c0-e21a-4e34-b4c5-bca093f38c71 tempest-ProjectMemberTests-475949430 None] Volume 5045a1c9-b061-4abb-a112-d84657e90f6a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5045a1c9-b061-4abb-a112-d84657e90f6a', 'volume_size': 1} Aug 05 06:31:19 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-deed89c0-e21a-4e34-b4c5-bca093f38c71 tempest-ProjectMemberTests-475949430 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:31:19 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-deed89c0-e21a-4e34-b4c5-bca093f38c71 tempest-ProjectMemberTests-475949430 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:31:19 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-deed89c0-e21a-4e34-b4c5-bca093f38c71 tempest-ProjectMemberTests-475949430 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:31:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1053236622',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5045a1c9-b061-4abb-a112-d84657e90f6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe85d705f6434b70a55dac31b79c0714',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:31:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:31:19Z,use_quota=True,user_id='a9de9bccd062450c95c9f7f6cf4317f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)}" {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 06:31:19 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-deed89c0-e21a-4e34-b4c5-bca093f38c71 tempest-ProjectMemberTests-475949430 None] Creating volume 5045a1c9-b061-4abb-a112-d84657e90f6a {{(pid=88695) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 06:31:19 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-deed89c0-e21a-4e34-b4c5-bca093f38c71 tempest-ProjectMemberTests-475949430 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:31:19 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-deed89c0-e21a-4e34-b4c5-bca093f38c71 tempest-ProjectMemberTests-475949430 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:31:19 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-deed89c0-e21a-4e34-b4c5-bca093f38c71 tempest-ProjectMemberTests-475949430 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:31:19 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-deed89c0-e21a-4e34-b4c5-bca093f38c71 tempest-ProjectMemberTests-475949430 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:31:19 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-deed89c0-e21a-4e34-b4c5-bca093f38c71 tempest-ProjectMemberTests-475949430 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:31:19 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-deed89c0-e21a-4e34-b4c5-bca093f38c71 tempest-ProjectMemberTests-475949430 None] Selected osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 as target Quobyte volume. {{(pid=88695) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 06:31:19 devstack cinder-volume[88695]: INFO cinder.volume.drivers.remotefs [None req-deed89c0-e21a-4e34-b4c5-bca093f38c71 tempest-ProjectMemberTests-475949430 None] casted to osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 Aug 05 06:31:19 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-deed89c0-e21a-4e34-b4c5-bca093f38c71 tempest-ProjectMemberTests-475949430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-5045a1c9-b061-4abb-a112-d84657e90f6a 1073741824 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:31:19 devstack sudo[108834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-5045a1c9-b061-4abb-a112-d84657e90f6a 1073741824 Aug 05 06:31:19 devstack sudo[108834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:31:19 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-0c174cf5-38a3-4977-a210-93cc8c1d0cee tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Acquiring lock "cinder-ebe2d8b6-4e9e-4c7a-bfd8-7c5c01a5c5bf-delete_volume" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:31:19 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-0c174cf5-38a3-4977-a210-93cc8c1d0cee tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Lock "cinder-ebe2d8b6-4e9e-4c7a-bfd8-7c5c01a5c5bf-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:31:19 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-0c174cf5-38a3-4977-a210-93cc8c1d0cee tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Acquiring lock "cinder-quobyte-ebe2d8b6-4e9e-4c7a-bfd8-7c5c01a5c5bf" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:31:19 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-0c174cf5-38a3-4977-a210-93cc8c1d0cee tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Lock "cinder-quobyte-ebe2d8b6-4e9e-4c7a-bfd8-7c5c01a5c5bf" acquired by "delete_volume" :: waited 0.026s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:31:19 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1feee77-3e20-411c-9460-c61f54120c55]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:31:19 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-0c174cf5-38a3-4977-a210-93cc8c1d0cee tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-ebe2d8b6-4e9e-4c7a-bfd8-7c5c01a5c5bf {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:31:20 devstack sudo[108839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-ebe2d8b6-4e9e-4c7a-bfd8-7c5c01a5c5bf Aug 05 06:31:20 devstack sudo[108839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:31:20 devstack sudo[108834]: pam_unix(sudo:session): session closed for user root Aug 05 06:31:20 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-deed89c0-e21a-4e34-b4c5-bca093f38c71 tempest-ProjectMemberTests-475949430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-5045a1c9-b061-4abb-a112-d84657e90f6a 1073741824" returned: 0 in 0.621s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:31:20 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-deed89c0-e21a-4e34-b4c5-bca093f38c71 tempest-ProjectMemberTests-475949430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-5045a1c9-b061-4abb-a112-d84657e90f6a {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:31:20 devstack sudo[108842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-5045a1c9-b061-4abb-a112-d84657e90f6a Aug 05 06:31:20 devstack sudo[108842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:31:20 devstack sudo[108839]: pam_unix(sudo:session): session closed for user root Aug 05 06:31:20 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-0c174cf5-38a3-4977-a210-93cc8c1d0cee tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-ebe2d8b6-4e9e-4c7a-bfd8-7c5c01a5c5bf" returned: 0 in 0.566s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:31:20 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-0c174cf5-38a3-4977-a210-93cc8c1d0cee tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-ebe2d8b6-4e9e-4c7a-bfd8-7c5c01a5c5bf {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:31:20 devstack sudo[108847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-ebe2d8b6-4e9e-4c7a-bfd8-7c5c01a5c5bf Aug 05 06:31:20 devstack sudo[108847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:31:20 devstack sudo[108842]: pam_unix(sudo:session): session closed for user root Aug 05 06:31:20 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-deed89c0-e21a-4e34-b4c5-bca093f38c71 tempest-ProjectMemberTests-475949430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-5045a1c9-b061-4abb-a112-d84657e90f6a" returned: 0 in 0.428s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:31:20 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-deed89c0-e21a-4e34-b4c5-bca093f38c71 tempest-ProjectMemberTests-475949430 None] <== create_volume: return (1112ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'} {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 06:31:20 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-deed89c0-e21a-4e34-b4c5-bca093f38c71 tempest-ProjectMemberTests-475949430 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.115s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:31:20 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-deed89c0-e21a-4e34-b4c5-bca093f38c71 tempest-ProjectMemberTests-475949430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc421892-4f54-4ac6-bf44-557b57c315bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5045a1c9-b061-4abb-a112-d84657e90f6a', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:31:20 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-deed89c0-e21a-4e34-b4c5-bca093f38c71 tempest-ProjectMemberTests-475949430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c29f0f8-0574-4986-a875-187f5707d6f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:31:20 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-deed89c0-e21a-4e34-b4c5-bca093f38c71 tempest-ProjectMemberTests-475949430 None] Volume volume-5045a1c9-b061-4abb-a112-d84657e90f6a (5045a1c9-b061-4abb-a112-d84657e90f6a): created successfully Aug 05 06:31:20 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-deed89c0-e21a-4e34-b4c5-bca093f38c71 tempest-ProjectMemberTests-475949430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c29f0f8-0574-4986-a875-187f5707d6f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:31:20 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-deed89c0-e21a-4e34-b4c5-bca093f38c71 tempest-ProjectMemberTests-475949430 None] Flow 'volume_create_manager' (c78718da-6e5c-4874-9252-3d24b5fdf28d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:31:20 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-deed89c0-e21a-4e34-b4c5-bca093f38c71 tempest-ProjectMemberTests-475949430 None] Created volume successfully. Aug 05 06:31:20 devstack sudo[108847]: pam_unix(sudo:session): session closed for user root Aug 05 06:31:20 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-0c174cf5-38a3-4977-a210-93cc8c1d0cee tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-ebe2d8b6-4e9e-4c7a-bfd8-7c5c01a5c5bf" returned: 0 in 0.391s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:31:20 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-0c174cf5-38a3-4977-a210-93cc8c1d0cee tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Lock "cinder-quobyte-ebe2d8b6-4e9e-4c7a-bfd8-7c5c01a5c5bf" released by "delete_volume" :: held 1.016s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:31:20 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-0c174cf5-38a3-4977-a210-93cc8c1d0cee tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Created reservations ['a4b161f0-65eb-4411-9677-0a7ae96796c3', '3f5a1eb9-e3fa-4229-b148-02a76f188f56', 'e8d090c7-d571-4c39-959f-c0af30073a14', '5e447850-05f8-43ba-a2a1-53e3f438b11f'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:31:21 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-0c174cf5-38a3-4977-a210-93cc8c1d0cee tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:31:21 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-0c174cf5-38a3-4977-a210-93cc8c1d0cee tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:31:21 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-0c174cf5-38a3-4977-a210-93cc8c1d0cee tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:31:21 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-0c174cf5-38a3-4977-a210-93cc8c1d0cee tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:31:21 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-0c174cf5-38a3-4977-a210-93cc8c1d0cee tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:31:21 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-0c174cf5-38a3-4977-a210-93cc8c1d0cee tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:31:21 devstack sudo[108851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce Aug 05 06:31:21 devstack sudo[108851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:31:21 devstack sudo[108851]: pam_unix(sudo:session): session closed for user root Aug 05 06:31:21 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-0c174cf5-38a3-4977-a210-93cc8c1d0cee tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce" returned: 0 in 0.296s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:31:21 devstack cinder-volume[88695]: DEBUG cinder.manager [None req-0c174cf5-38a3-4977-a210-93cc8c1d0cee tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Notifying Schedulers of capabilities ... {{(pid=88695) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 06:31:21 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-0c174cf5-38a3-4977-a210-93cc8c1d0cee tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Deleted volume successfully. Aug 05 06:31:21 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-0c174cf5-38a3-4977-a210-93cc8c1d0cee tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Lock "cinder-ebe2d8b6-4e9e-4c7a-bfd8-7c5c01a5c5bf-delete_volume" released by "delete_volume" :: held 1.620s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:31:22 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-a5641f4b-6b08-477d-8fbd-4aa9c572f3ee tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Acquiring lock "cinder-c107508a-51f6-418f-beb7-a834fa15d809-delete_volume" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:31:22 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-a5641f4b-6b08-477d-8fbd-4aa9c572f3ee tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Lock "cinder-c107508a-51f6-418f-beb7-a834fa15d809-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:31:22 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-680ddbd6-2ded-4c03-bc43-37ad000d1984 tempest-ProjectMemberTests-475949430 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:31:22 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-680ddbd6-2ded-4c03-bc43-37ad000d1984 tempest-ProjectMemberTests-475949430 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.010s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:31:22 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-680ddbd6-2ded-4c03-bc43-37ad000d1984 tempest-ProjectMemberTests-475949430 None] Creating offline snapshot a9166ff5-1034-46b5-ab73-8a50aa0d7077 of volume 5045a1c9-b061-4abb-a112-d84657e90f6a {{(pid=88695) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 06:31:22 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-a5641f4b-6b08-477d-8fbd-4aa9c572f3ee tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Acquiring lock "cinder-quobyte-c107508a-51f6-418f-beb7-a834fa15d809" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:31:22 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[66065a19-a769-440c-a431-39c4d56c21f9]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:31:22 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-a5641f4b-6b08-477d-8fbd-4aa9c572f3ee tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Lock "cinder-quobyte-c107508a-51f6-418f-beb7-a834fa15d809" acquired by "delete_volume" :: waited 0.022s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:31:22 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-680ddbd6-2ded-4c03-bc43-37ad000d1984 tempest-ProjectMemberTests-475949430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-5045a1c9-b061-4abb-a112-d84657e90f6a {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:31:22 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4a75e4b-b579-4e99-a9e2-c56bfb357249]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:31:22 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-a5641f4b-6b08-477d-8fbd-4aa9c572f3ee tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-c107508a-51f6-418f-beb7-a834fa15d809 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:31:22 devstack sudo[108855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-c107508a-51f6-418f-beb7-a834fa15d809 Aug 05 06:31:22 devstack sudo[108855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:31:22 devstack sudo[108854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-5045a1c9-b061-4abb-a112-d84657e90f6a Aug 05 06:31:22 devstack sudo[108854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:31:22 devstack sudo[108855]: pam_unix(sudo:session): session closed for user root Aug 05 06:31:22 devstack sudo[108854]: pam_unix(sudo:session): session closed for user root Aug 05 06:31:22 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-680ddbd6-2ded-4c03-bc43-37ad000d1984 tempest-ProjectMemberTests-475949430 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-5045a1c9-b061-4abb-a112-d84657e90f6a" returned: 0 in 0.481s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:31:22 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-680ddbd6-2ded-4c03-bc43-37ad000d1984 tempest-ProjectMemberTests-475949430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-5045a1c9-b061-4abb-a112-d84657e90f6a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-5045a1c9-b061-4abb-a112-d84657e90f6a.a9166ff5-1034-46b5-ab73-8a50aa0d7077 1G {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:31:22 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-a5641f4b-6b08-477d-8fbd-4aa9c572f3ee tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-c107508a-51f6-418f-beb7-a834fa15d809" returned: 0 in 0.470s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:31:22 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-a5641f4b-6b08-477d-8fbd-4aa9c572f3ee tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-c107508a-51f6-418f-beb7-a834fa15d809 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:31:22 devstack sudo[108864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-5045a1c9-b061-4abb-a112-d84657e90f6a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-5045a1c9-b061-4abb-a112-d84657e90f6a.a9166ff5-1034-46b5-ab73-8a50aa0d7077 1G Aug 05 06:31:22 devstack sudo[108864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:31:22 devstack sudo[108865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-c107508a-51f6-418f-beb7-a834fa15d809 Aug 05 06:31:22 devstack sudo[108865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:31:23 devstack sudo[108865]: pam_unix(sudo:session): session closed for user root Aug 05 06:31:23 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-a5641f4b-6b08-477d-8fbd-4aa9c572f3ee tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-c107508a-51f6-418f-beb7-a834fa15d809" returned: 0 in 0.272s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:31:23 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-a5641f4b-6b08-477d-8fbd-4aa9c572f3ee tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Lock "cinder-quobyte-c107508a-51f6-418f-beb7-a834fa15d809" released by "delete_volume" :: held 0.800s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:31:23 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-a5641f4b-6b08-477d-8fbd-4aa9c572f3ee tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Created reservations ['4b9482a3-f6ea-4be0-809f-04ae3bfc4cdd', 'df702347-680b-40c9-bd25-d23b91db049a', '5f13b8b4-9651-4e84-8844-0bcbebc4b5c3', '395fa034-130a-4d7e-802c-b496635a4e41'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:31:23 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-a5641f4b-6b08-477d-8fbd-4aa9c572f3ee tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:31:23 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-a5641f4b-6b08-477d-8fbd-4aa9c572f3ee tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:31:23 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-a5641f4b-6b08-477d-8fbd-4aa9c572f3ee tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:31:23 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-a5641f4b-6b08-477d-8fbd-4aa9c572f3ee tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:31:23 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-a5641f4b-6b08-477d-8fbd-4aa9c572f3ee tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:31:23 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-a5641f4b-6b08-477d-8fbd-4aa9c572f3ee tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:31:23 devstack sudo[108873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce Aug 05 06:31:23 devstack sudo[108873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:31:23 devstack sudo[108864]: pam_unix(sudo:session): session closed for user root Aug 05 06:31:23 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-680ddbd6-2ded-4c03-bc43-37ad000d1984 tempest-ProjectMemberTests-475949430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-5045a1c9-b061-4abb-a112-d84657e90f6a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-5045a1c9-b061-4abb-a112-d84657e90f6a.a9166ff5-1034-46b5-ab73-8a50aa0d7077 1G" returned: 0 in 0.554s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:31:23 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-680ddbd6-2ded-4c03-bc43-37ad000d1984 tempest-ProjectMemberTests-475949430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5045a1c9-b061-4abb-a112-d84657e90f6a -F qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-5045a1c9-b061-4abb-a112-d84657e90f6a.a9166ff5-1034-46b5-ab73-8a50aa0d7077 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:31:23 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-30d9e7ff-f001-442d-b773-2e3d734b8828 tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Acquiring lock "cinder-a538fae4-9e2b-4d5e-8178-0260718a6e5e-delete_volume" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:31:23 devstack sudo[108875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5045a1c9-b061-4abb-a112-d84657e90f6a -F qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-5045a1c9-b061-4abb-a112-d84657e90f6a.a9166ff5-1034-46b5-ab73-8a50aa0d7077 Aug 05 06:31:23 devstack sudo[108875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:31:23 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-deaf2f6a-338a-4ffa-9abc-34c5a47bf625 tempest-ProjectAdminTests-509473257 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.743049621582, 'free_capacity_gb': 1775.743049621582, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=88695) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Aug 05 06:31:23 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-30d9e7ff-f001-442d-b773-2e3d734b8828 tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Lock "cinder-a538fae4-9e2b-4d5e-8178-0260718a6e5e-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:31:23 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-30d9e7ff-f001-442d-b773-2e3d734b8828 tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Acquiring lock "cinder-quobyte-a538fae4-9e2b-4d5e-8178-0260718a6e5e" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:31:23 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-30d9e7ff-f001-442d-b773-2e3d734b8828 tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Lock "cinder-quobyte-a538fae4-9e2b-4d5e-8178-0260718a6e5e" acquired by "delete_volume" :: waited 0.029s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:31:23 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[eab23f76-248e-49d0-99d0-e1e752532422]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:31:23 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-30d9e7ff-f001-442d-b773-2e3d734b8828 tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a538fae4-9e2b-4d5e-8178-0260718a6e5e {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:31:23 devstack sudo[108873]: pam_unix(sudo:session): session closed for user root Aug 05 06:31:23 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-a5641f4b-6b08-477d-8fbd-4aa9c572f3ee tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce" returned: 0 in 0.446s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:31:23 devstack cinder-volume[88695]: DEBUG cinder.manager [None req-a5641f4b-6b08-477d-8fbd-4aa9c572f3ee tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Notifying Schedulers of capabilities ... {{(pid=88695) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 06:31:23 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-a5641f4b-6b08-477d-8fbd-4aa9c572f3ee tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Deleted volume successfully. Aug 05 06:31:23 devstack sudo[108877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a538fae4-9e2b-4d5e-8178-0260718a6e5e Aug 05 06:31:23 devstack sudo[108877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:31:23 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-a5641f4b-6b08-477d-8fbd-4aa9c572f3ee tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Lock "cinder-c107508a-51f6-418f-beb7-a834fa15d809-delete_volume" released by "delete_volume" :: held 1.572s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:31:23 devstack sudo[108875]: pam_unix(sudo:session): session closed for user root Aug 05 06:31:23 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-680ddbd6-2ded-4c03-bc43-37ad000d1984 tempest-ProjectMemberTests-475949430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5045a1c9-b061-4abb-a112-d84657e90f6a -F qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-5045a1c9-b061-4abb-a112-d84657e90f6a.a9166ff5-1034-46b5-ab73-8a50aa0d7077" returned: 0 in 0.423s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:31:23 devstack cinder-volume[88695]: WARNING cinder.volume.drivers.remotefs [None req-680ddbd6-2ded-4c03-bc43-37ad000d1984 tempest-ProjectMemberTests-475949430 None] /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-5045a1c9-b061-4abb-a112-d84657e90f6a.a9166ff5-1034-46b5-ab73-8a50aa0d7077 is being set with open permissions: ugo+rw Aug 05 06:31:23 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-680ddbd6-2ded-4c03-bc43-37ad000d1984 tempest-ProjectMemberTests-475949430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-5045a1c9-b061-4abb-a112-d84657e90f6a.a9166ff5-1034-46b5-ab73-8a50aa0d7077 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:31:23 devstack sudo[108886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-5045a1c9-b061-4abb-a112-d84657e90f6a.a9166ff5-1034-46b5-ab73-8a50aa0d7077 Aug 05 06:31:23 devstack sudo[108886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:31:24 devstack sudo[108886]: pam_unix(sudo:session): session closed for user root Aug 05 06:31:24 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-680ddbd6-2ded-4c03-bc43-37ad000d1984 tempest-ProjectMemberTests-475949430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-5045a1c9-b061-4abb-a112-d84657e90f6a.a9166ff5-1034-46b5-ab73-8a50aa0d7077" returned: 0 in 0.332s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:31:24 devstack sudo[108877]: pam_unix(sudo:session): session closed for user root Aug 05 06:31:24 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-30d9e7ff-f001-442d-b773-2e3d734b8828 tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a538fae4-9e2b-4d5e-8178-0260718a6e5e" returned: 0 in 0.573s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:31:24 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-30d9e7ff-f001-442d-b773-2e3d734b8828 tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a538fae4-9e2b-4d5e-8178-0260718a6e5e {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:31:24 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-680ddbd6-2ded-4c03-bc43-37ad000d1984 tempest-ProjectMemberTests-475949430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-5045a1c9-b061-4abb-a112-d84657e90f6a.info {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:31:24 devstack sudo[108892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a538fae4-9e2b-4d5e-8178-0260718a6e5e Aug 05 06:31:24 devstack sudo[108892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:31:24 devstack sudo[108893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-5045a1c9-b061-4abb-a112-d84657e90f6a.info Aug 05 06:31:24 devstack sudo[108893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:31:24 devstack cinder-volume[88695]: DEBUG cinder.volume.flows.manager.create_volume [None req-98ac2f81-cfe0-4d39-a752-3f6291debcb8 tempest-ProjectReaderTests-1983688842 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88695) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 06:31:24 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-98ac2f81-cfe0-4d39-a752-3f6291debcb8 tempest-ProjectReaderTests-1983688842 None] Flow 'volume_create_manager' (c4f3f127-c070-4c3b-a8ea-39561aa79988) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:31:24 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-98ac2f81-cfe0-4d39-a752-3f6291debcb8 tempest-ProjectReaderTests-1983688842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34571385-dc4b-45b3-8125-58b3d3896ba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:31:24 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-98ac2f81-cfe0-4d39-a752-3f6291debcb8 tempest-ProjectReaderTests-1983688842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34571385-dc4b-45b3-8125-58b3d3896ba5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:31:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1995545229',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce4d1b72-0e58-489c-9297-18cdd46b1e7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7b53be6a57a458f9adb84f514f8d4da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:31:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:31:24Z,use_quota=True,user_id='9099d583e3aa47ef81997420b42f60f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:31:24 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-98ac2f81-cfe0-4d39-a752-3f6291debcb8 tempest-ProjectReaderTests-1983688842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c66e8d0e-89b4-414d-b99c-2d8c7f18a451) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:31:24 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-98ac2f81-cfe0-4d39-a752-3f6291debcb8 tempest-ProjectReaderTests-1983688842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c66e8d0e-89b4-414d-b99c-2d8c7f18a451) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:31:24 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-98ac2f81-cfe0-4d39-a752-3f6291debcb8 tempest-ProjectReaderTests-1983688842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (739270b8-b68c-44da-8ab5-45bc764e8820) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:31:24 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-98ac2f81-cfe0-4d39-a752-3f6291debcb8 tempest-ProjectReaderTests-1983688842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (739270b8-b68c-44da-8ab5-45bc764e8820) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce4d1b72-0e58-489c-9297-18cdd46b1e7b', 'volume_name': 'volume-ce4d1b72-0e58-489c-9297-18cdd46b1e7b', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:31:24 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-98ac2f81-cfe0-4d39-a752-3f6291debcb8 tempest-ProjectReaderTests-1983688842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6468a396-535d-411c-8f05-cecda3425f9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:31:24 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-98ac2f81-cfe0-4d39-a752-3f6291debcb8 tempest-ProjectReaderTests-1983688842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6468a396-535d-411c-8f05-cecda3425f9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:31:24 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-98ac2f81-cfe0-4d39-a752-3f6291debcb8 tempest-ProjectReaderTests-1983688842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e8efc81-a463-4263-80f4-1d3a412afb94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:31:24 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-98ac2f81-cfe0-4d39-a752-3f6291debcb8 tempest-ProjectReaderTests-1983688842 None] Volume ce4d1b72-0e58-489c-9297-18cdd46b1e7b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce4d1b72-0e58-489c-9297-18cdd46b1e7b', 'volume_size': 1} Aug 05 06:31:24 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-98ac2f81-cfe0-4d39-a752-3f6291debcb8 tempest-ProjectReaderTests-1983688842 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:31:24 devstack sudo[108892]: pam_unix(sudo:session): session closed for user root Aug 05 06:31:24 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-30d9e7ff-f001-442d-b773-2e3d734b8828 tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a538fae4-9e2b-4d5e-8178-0260718a6e5e" returned: 0 in 0.304s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:31:24 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-30d9e7ff-f001-442d-b773-2e3d734b8828 tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Lock "cinder-quobyte-a538fae4-9e2b-4d5e-8178-0260718a6e5e" released by "delete_volume" :: held 0.942s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:31:24 devstack sudo[108893]: pam_unix(sudo:session): session closed for user root Aug 05 06:31:24 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-680ddbd6-2ded-4c03-bc43-37ad000d1984 tempest-ProjectMemberTests-475949430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-5045a1c9-b061-4abb-a112-d84657e90f6a.info" returned: 0 in 0.326s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:31:24 devstack cinder-volume[88695]: WARNING cinder.volume.drivers.remotefs [None req-680ddbd6-2ded-4c03-bc43-37ad000d1984 tempest-ProjectMemberTests-475949430 None] /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-5045a1c9-b061-4abb-a112-d84657e90f6a.info is being set with open permissions: ugo+rw Aug 05 06:31:24 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-680ddbd6-2ded-4c03-bc43-37ad000d1984 tempest-ProjectMemberTests-475949430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-5045a1c9-b061-4abb-a112-d84657e90f6a.info {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:31:24 devstack sudo[108898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-5045a1c9-b061-4abb-a112-d84657e90f6a.info Aug 05 06:31:24 devstack sudo[108898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:31:24 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-30d9e7ff-f001-442d-b773-2e3d734b8828 tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Created reservations ['37047985-4452-43fd-a624-2873b0ac564a', 'fa10af77-cedd-41fb-b832-783ca6948b34', '8448575f-5066-4319-8780-849cc872f674', '9862386f-c191-4012-bf25-c76b64301628'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:31:24 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-30d9e7ff-f001-442d-b773-2e3d734b8828 tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:31:24 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-30d9e7ff-f001-442d-b773-2e3d734b8828 tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:31:24 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-30d9e7ff-f001-442d-b773-2e3d734b8828 tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:31:24 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-30d9e7ff-f001-442d-b773-2e3d734b8828 tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:31:24 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-30d9e7ff-f001-442d-b773-2e3d734b8828 tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:31:24 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-30d9e7ff-f001-442d-b773-2e3d734b8828 tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:31:24 devstack sudo[108900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce Aug 05 06:31:24 devstack sudo[108900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:31:24 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-d0a477fc-4a91-4f4d-8c0a-4be6c1ad82e6 tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Acquiring lock "cinder-67b37c58-d702-4d8c-b7d4-e705b19b202f-delete_volume" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:31:24 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-d0a477fc-4a91-4f4d-8c0a-4be6c1ad82e6 tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Lock "cinder-67b37c58-d702-4d8c-b7d4-e705b19b202f-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:31:24 devstack sudo[108898]: pam_unix(sudo:session): session closed for user root Aug 05 06:31:24 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-680ddbd6-2ded-4c03-bc43-37ad000d1984 tempest-ProjectMemberTests-475949430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-5045a1c9-b061-4abb-a112-d84657e90f6a.info" returned: 0 in 0.328s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:31:24 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-680ddbd6-2ded-4c03-bc43-37ad000d1984 tempest-ProjectMemberTests-475949430 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.598s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:31:24 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-98ac2f81-cfe0-4d39-a752-3f6291debcb8 tempest-ProjectReaderTests-1983688842 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.420s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:31:24 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-98ac2f81-cfe0-4d39-a752-3f6291debcb8 tempest-ProjectReaderTests-1983688842 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:31:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1995545229',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce4d1b72-0e58-489c-9297-18cdd46b1e7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7b53be6a57a458f9adb84f514f8d4da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:31:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:31:24Z,use_quota=True,user_id='9099d583e3aa47ef81997420b42f60f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)}" {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 06:31:24 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-98ac2f81-cfe0-4d39-a752-3f6291debcb8 tempest-ProjectReaderTests-1983688842 None] Creating volume ce4d1b72-0e58-489c-9297-18cdd46b1e7b {{(pid=88695) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 06:31:24 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-98ac2f81-cfe0-4d39-a752-3f6291debcb8 tempest-ProjectReaderTests-1983688842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:31:24 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-98ac2f81-cfe0-4d39-a752-3f6291debcb8 tempest-ProjectReaderTests-1983688842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:31:24 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-98ac2f81-cfe0-4d39-a752-3f6291debcb8 tempest-ProjectReaderTests-1983688842 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:31:24 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-98ac2f81-cfe0-4d39-a752-3f6291debcb8 tempest-ProjectReaderTests-1983688842 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:31:24 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-98ac2f81-cfe0-4d39-a752-3f6291debcb8 tempest-ProjectReaderTests-1983688842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:31:24 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-98ac2f81-cfe0-4d39-a752-3f6291debcb8 tempest-ProjectReaderTests-1983688842 None] Selected osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 as target Quobyte volume. {{(pid=88695) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 06:31:24 devstack cinder-volume[88695]: INFO cinder.volume.drivers.remotefs [None req-98ac2f81-cfe0-4d39-a752-3f6291debcb8 tempest-ProjectReaderTests-1983688842 None] casted to osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 Aug 05 06:31:24 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-98ac2f81-cfe0-4d39-a752-3f6291debcb8 tempest-ProjectReaderTests-1983688842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-ce4d1b72-0e58-489c-9297-18cdd46b1e7b 1073741824 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:31:24 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-d0a477fc-4a91-4f4d-8c0a-4be6c1ad82e6 tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Acquiring lock "cinder-quobyte-67b37c58-d702-4d8c-b7d4-e705b19b202f" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:31:24 devstack sudo[108903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-ce4d1b72-0e58-489c-9297-18cdd46b1e7b 1073741824 Aug 05 06:31:24 devstack sudo[108903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:31:24 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-d0a477fc-4a91-4f4d-8c0a-4be6c1ad82e6 tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Lock "cinder-quobyte-67b37c58-d702-4d8c-b7d4-e705b19b202f" acquired by "delete_volume" :: waited 0.044s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:31:24 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-680ddbd6-2ded-4c03-bc43-37ad000d1984 tempest-ProjectMemberTests-475949430 None] Create snapshot completed successfully Aug 05 06:31:24 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0680a98-1dbb-432a-8087-1826c81ee09a]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:31:24 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-d0a477fc-4a91-4f4d-8c0a-4be6c1ad82e6 tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-67b37c58-d702-4d8c-b7d4-e705b19b202f {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:31:24 devstack sudo[108900]: pam_unix(sudo:session): session closed for user root Aug 05 06:31:24 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-30d9e7ff-f001-442d-b773-2e3d734b8828 tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce" returned: 0 in 0.387s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:31:24 devstack cinder-volume[88695]: DEBUG cinder.manager [None req-30d9e7ff-f001-442d-b773-2e3d734b8828 tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Notifying Schedulers of capabilities ... {{(pid=88695) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 06:31:24 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-30d9e7ff-f001-442d-b773-2e3d734b8828 tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Deleted volume successfully. Aug 05 06:31:25 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-30d9e7ff-f001-442d-b773-2e3d734b8828 tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Lock "cinder-a538fae4-9e2b-4d5e-8178-0260718a6e5e-delete_volume" released by "delete_volume" :: held 1.649s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:31:25 devstack sudo[108906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-67b37c58-d702-4d8c-b7d4-e705b19b202f Aug 05 06:31:25 devstack sudo[108906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:31:25 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-de54e0c7-f52d-49e5-84e4-f4167782a73c tempest-ProjectMemberTests-475949430 None] Acquiring lock "cinder-a9166ff5-1034-46b5-ab73-8a50aa0d7077-delete_snapshot" by "delete_snapshot" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:31:25 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-de54e0c7-f52d-49e5-84e4-f4167782a73c tempest-ProjectMemberTests-475949430 None] Lock "cinder-a9166ff5-1034-46b5-ab73-8a50aa0d7077-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:31:25 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-de54e0c7-f52d-49e5-84e4-f4167782a73c tempest-ProjectMemberTests-475949430 None] Acquiring lock "cinder-quobyte-5045a1c9-b061-4abb-a112-d84657e90f6a" by "delete_snapshot" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:31:25 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-de54e0c7-f52d-49e5-84e4-f4167782a73c tempest-ProjectMemberTests-475949430 None] Lock "cinder-quobyte-5045a1c9-b061-4abb-a112-d84657e90f6a" acquired by "delete_snapshot" :: waited 0.025s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:31:25 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-de54e0c7-f52d-49e5-84e4-f4167782a73c tempest-ProjectMemberTests-475949430 None] Acquiring lock "cinder-quobyte-a9166ff5-1034-46b5-ab73-8a50aa0d7077" by "_delete_snapshot" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:31:25 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-de54e0c7-f52d-49e5-84e4-f4167782a73c tempest-ProjectMemberTests-475949430 None] Lock "cinder-quobyte-a9166ff5-1034-46b5-ab73-8a50aa0d7077" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:31:25 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-de54e0c7-f52d-49e5-84e4-f4167782a73c tempest-ProjectMemberTests-475949430 None] Deleting offline snapshot a9166ff5-1034-46b5-ab73-8a50aa0d7077 of volume 5045a1c9-b061-4abb-a112-d84657e90f6a {{(pid=88695) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 06:31:25 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-de54e0c7-f52d-49e5-84e4-f4167782a73c tempest-ProjectMemberTests-475949430 None] snapshot_file for this snap is: volume-5045a1c9-b061-4abb-a112-d84657e90f6a.a9166ff5-1034-46b5-ab73-8a50aa0d7077 {{(pid=88695) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 06:31:25 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac2f894e-0b20-4d79-a135-8508ea5cf47b]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:31:25 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-de54e0c7-f52d-49e5-84e4-f4167782a73c tempest-ProjectMemberTests-475949430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-5045a1c9-b061-4abb-a112-d84657e90f6a.a9166ff5-1034-46b5-ab73-8a50aa0d7077 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:31:25 devstack sudo[108903]: pam_unix(sudo:session): session closed for user root Aug 05 06:31:25 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-98ac2f81-cfe0-4d39-a752-3f6291debcb8 tempest-ProjectReaderTests-1983688842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-ce4d1b72-0e58-489c-9297-18cdd46b1e7b 1073741824" returned: 0 in 0.642s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:31:25 devstack sudo[108906]: pam_unix(sudo:session): session closed for user root Aug 05 06:31:25 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-d0a477fc-4a91-4f4d-8c0a-4be6c1ad82e6 tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-67b37c58-d702-4d8c-b7d4-e705b19b202f" returned: 0 in 0.555s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:31:25 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-d0a477fc-4a91-4f4d-8c0a-4be6c1ad82e6 tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-67b37c58-d702-4d8c-b7d4-e705b19b202f {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:31:25 devstack sudo[108916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-67b37c58-d702-4d8c-b7d4-e705b19b202f Aug 05 06:31:25 devstack sudo[108916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:31:25 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-98ac2f81-cfe0-4d39-a752-3f6291debcb8 tempest-ProjectReaderTests-1983688842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-ce4d1b72-0e58-489c-9297-18cdd46b1e7b {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:31:25 devstack sudo[108915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-5045a1c9-b061-4abb-a112-d84657e90f6a.a9166ff5-1034-46b5-ab73-8a50aa0d7077 Aug 05 06:31:25 devstack sudo[108915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:31:25 devstack sudo[108918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-ce4d1b72-0e58-489c-9297-18cdd46b1e7b Aug 05 06:31:25 devstack sudo[108918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:31:25 devstack sudo[108916]: pam_unix(sudo:session): session closed for user root Aug 05 06:31:25 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-d0a477fc-4a91-4f4d-8c0a-4be6c1ad82e6 tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-67b37c58-d702-4d8c-b7d4-e705b19b202f" returned: 0 in 0.357s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:31:25 devstack sudo[108918]: pam_unix(sudo:session): session closed for user root Aug 05 06:31:25 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-d0a477fc-4a91-4f4d-8c0a-4be6c1ad82e6 tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Lock "cinder-quobyte-67b37c58-d702-4d8c-b7d4-e705b19b202f" released by "delete_volume" :: held 0.995s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:31:25 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-98ac2f81-cfe0-4d39-a752-3f6291debcb8 tempest-ProjectReaderTests-1983688842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-ce4d1b72-0e58-489c-9297-18cdd46b1e7b" returned: 0 in 0.346s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:31:25 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-98ac2f81-cfe0-4d39-a752-3f6291debcb8 tempest-ProjectReaderTests-1983688842 None] <== create_volume: return (1090ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'} {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 06:31:25 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-98ac2f81-cfe0-4d39-a752-3f6291debcb8 tempest-ProjectReaderTests-1983688842 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.092s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:31:25 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-98ac2f81-cfe0-4d39-a752-3f6291debcb8 tempest-ProjectReaderTests-1983688842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e8efc81-a463-4263-80f4-1d3a412afb94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce4d1b72-0e58-489c-9297-18cdd46b1e7b', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:31:25 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-98ac2f81-cfe0-4d39-a752-3f6291debcb8 tempest-ProjectReaderTests-1983688842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f926002a-b97e-4b9b-baec-c6dd95bb9073) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:31:25 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-98ac2f81-cfe0-4d39-a752-3f6291debcb8 tempest-ProjectReaderTests-1983688842 None] Volume volume-ce4d1b72-0e58-489c-9297-18cdd46b1e7b (ce4d1b72-0e58-489c-9297-18cdd46b1e7b): created successfully Aug 05 06:31:25 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-98ac2f81-cfe0-4d39-a752-3f6291debcb8 tempest-ProjectReaderTests-1983688842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f926002a-b97e-4b9b-baec-c6dd95bb9073) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:31:25 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-98ac2f81-cfe0-4d39-a752-3f6291debcb8 tempest-ProjectReaderTests-1983688842 None] Flow 'volume_create_manager' (c4f3f127-c070-4c3b-a8ea-39561aa79988) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:31:25 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-98ac2f81-cfe0-4d39-a752-3f6291debcb8 tempest-ProjectReaderTests-1983688842 None] Created volume successfully. Aug 05 06:31:25 devstack sudo[108915]: pam_unix(sudo:session): session closed for user root Aug 05 06:31:25 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-de54e0c7-f52d-49e5-84e4-f4167782a73c tempest-ProjectMemberTests-475949430 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-5045a1c9-b061-4abb-a112-d84657e90f6a.a9166ff5-1034-46b5-ab73-8a50aa0d7077" returned: 0 in 0.532s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:31:25 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-de54e0c7-f52d-49e5-84e4-f4167782a73c tempest-ProjectMemberTests-475949430 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5045a1c9-b061-4abb-a112-d84657e90f6a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88695) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 06:31:25 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7a0e1b5-2ba3-4668-9141-4b1b0bfd6ffe]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:31:25 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-de54e0c7-f52d-49e5-84e4-f4167782a73c tempest-ProjectMemberTests-475949430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-5045a1c9-b061-4abb-a112-d84657e90f6a {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:31:25 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-d0a477fc-4a91-4f4d-8c0a-4be6c1ad82e6 tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Created reservations ['5ccf60b2-e4b3-4231-84ae-de11978445fb', 'd00280f4-04a1-4e8a-aa82-e238ea18e13b', 'ae2457bb-e936-4176-b331-a0cb0ac403b5', '1492f2b2-6ba2-4b8a-b1c4-89b917b8e2df'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:31:26 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-d0a477fc-4a91-4f4d-8c0a-4be6c1ad82e6 tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:31:26 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-d0a477fc-4a91-4f4d-8c0a-4be6c1ad82e6 tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:31:26 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-d0a477fc-4a91-4f4d-8c0a-4be6c1ad82e6 tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:31:26 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-d0a477fc-4a91-4f4d-8c0a-4be6c1ad82e6 tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:31:26 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-d0a477fc-4a91-4f4d-8c0a-4be6c1ad82e6 tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:31:26 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-d0a477fc-4a91-4f4d-8c0a-4be6c1ad82e6 tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:31:26 devstack sudo[108927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce Aug 05 06:31:26 devstack sudo[108927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:31:26 devstack sudo[108926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-5045a1c9-b061-4abb-a112-d84657e90f6a Aug 05 06:31:26 devstack sudo[108926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:31:26 devstack sudo[108927]: pam_unix(sudo:session): session closed for user root Aug 05 06:31:26 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-d0a477fc-4a91-4f4d-8c0a-4be6c1ad82e6 tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce" returned: 0 in 0.339s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:31:26 devstack cinder-volume[88695]: DEBUG cinder.manager [None req-d0a477fc-4a91-4f4d-8c0a-4be6c1ad82e6 tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Notifying Schedulers of capabilities ... {{(pid=88695) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 06:31:26 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-d0a477fc-4a91-4f4d-8c0a-4be6c1ad82e6 tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Deleted volume successfully. Aug 05 06:31:26 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-d0a477fc-4a91-4f4d-8c0a-4be6c1ad82e6 tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Lock "cinder-67b37c58-d702-4d8c-b7d4-e705b19b202f-delete_volume" released by "delete_volume" :: held 1.770s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:31:26 devstack sudo[108926]: pam_unix(sudo:session): session closed for user root Aug 05 06:31:26 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-de54e0c7-f52d-49e5-84e4-f4167782a73c tempest-ProjectMemberTests-475949430 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-5045a1c9-b061-4abb-a112-d84657e90f6a" returned: 0 in 0.495s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:31:26 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-de54e0c7-f52d-49e5-84e4-f4167782a73c tempest-ProjectMemberTests-475949430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-5045a1c9-b061-4abb-a112-d84657e90f6a.a9166ff5-1034-46b5-ab73-8a50aa0d7077 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:31:26 devstack sudo[108934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-5045a1c9-b061-4abb-a112-d84657e90f6a.a9166ff5-1034-46b5-ab73-8a50aa0d7077 Aug 05 06:31:26 devstack sudo[108934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:31:26 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-4021f7d2-d0b4-4011-bbdb-96c8cd2bc384 tempest-ProjectReaderTests-1983688842 None] Acquiring lock "cinder-ce4d1b72-0e58-489c-9297-18cdd46b1e7b-delete_volume" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:31:26 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-4021f7d2-d0b4-4011-bbdb-96c8cd2bc384 tempest-ProjectReaderTests-1983688842 None] Lock "cinder-ce4d1b72-0e58-489c-9297-18cdd46b1e7b-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:31:26 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-4021f7d2-d0b4-4011-bbdb-96c8cd2bc384 tempest-ProjectReaderTests-1983688842 None] Acquiring lock "cinder-quobyte-ce4d1b72-0e58-489c-9297-18cdd46b1e7b" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:31:26 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-4021f7d2-d0b4-4011-bbdb-96c8cd2bc384 tempest-ProjectReaderTests-1983688842 None] Lock "cinder-quobyte-ce4d1b72-0e58-489c-9297-18cdd46b1e7b" acquired by "delete_volume" :: waited 0.019s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:31:26 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e6a3a54-4ede-4f8e-b65c-f44a1d2ade67]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:31:26 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-4021f7d2-d0b4-4011-bbdb-96c8cd2bc384 tempest-ProjectReaderTests-1983688842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-ce4d1b72-0e58-489c-9297-18cdd46b1e7b {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:31:26 devstack sudo[108934]: pam_unix(sudo:session): session closed for user root Aug 05 06:31:26 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-de54e0c7-f52d-49e5-84e4-f4167782a73c tempest-ProjectMemberTests-475949430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-5045a1c9-b061-4abb-a112-d84657e90f6a.a9166ff5-1034-46b5-ab73-8a50aa0d7077" returned: 0 in 0.404s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:31:26 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-de54e0c7-f52d-49e5-84e4-f4167782a73c tempest-ProjectMemberTests-475949430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-5045a1c9-b061-4abb-a112-d84657e90f6a.a9166ff5-1034-46b5-ab73-8a50aa0d7077 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:31:26 devstack sudo[108940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-5045a1c9-b061-4abb-a112-d84657e90f6a.a9166ff5-1034-46b5-ab73-8a50aa0d7077 Aug 05 06:31:26 devstack sudo[108940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:31:26 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-c805e753-fe25-4d6e-8d11-8216b8ab479f tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Acquiring lock "cinder-44b1149a-b640-4a3b-b3db-97ba5c97fd29-delete_volume" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:31:26 devstack sudo[108939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-ce4d1b72-0e58-489c-9297-18cdd46b1e7b Aug 05 06:31:26 devstack sudo[108939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:31:27 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-c805e753-fe25-4d6e-8d11-8216b8ab479f tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Lock "cinder-44b1149a-b640-4a3b-b3db-97ba5c97fd29-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:31:27 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-c805e753-fe25-4d6e-8d11-8216b8ab479f tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Acquiring lock "cinder-quobyte-44b1149a-b640-4a3b-b3db-97ba5c97fd29" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:31:27 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-c805e753-fe25-4d6e-8d11-8216b8ab479f tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Lock "cinder-quobyte-44b1149a-b640-4a3b-b3db-97ba5c97fd29" acquired by "delete_volume" :: waited 0.020s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:31:27 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d9b60db-05bb-438e-a66c-759a6b3da1da]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:31:27 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-c805e753-fe25-4d6e-8d11-8216b8ab479f tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-44b1149a-b640-4a3b-b3db-97ba5c97fd29 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:31:27 devstack sudo[108940]: pam_unix(sudo:session): session closed for user root Aug 05 06:31:27 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-de54e0c7-f52d-49e5-84e4-f4167782a73c tempest-ProjectMemberTests-475949430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-5045a1c9-b061-4abb-a112-d84657e90f6a.a9166ff5-1034-46b5-ab73-8a50aa0d7077" returned: 0 in 0.283s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:31:27 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-de54e0c7-f52d-49e5-84e4-f4167782a73c tempest-ProjectMemberTests-475949430 None] Lock "cinder-quobyte-a9166ff5-1034-46b5-ab73-8a50aa0d7077" released by "_delete_snapshot" :: held 1.847s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:31:27 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-de54e0c7-f52d-49e5-84e4-f4167782a73c tempest-ProjectMemberTests-475949430 None] Lock "cinder-quobyte-5045a1c9-b061-4abb-a112-d84657e90f6a" released by "delete_snapshot" :: held 1.888s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:31:27 devstack sudo[108944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-44b1149a-b640-4a3b-b3db-97ba5c97fd29 Aug 05 06:31:27 devstack sudo[108944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:31:27 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-de54e0c7-f52d-49e5-84e4-f4167782a73c tempest-ProjectMemberTests-475949430 None] Created reservations ['c3e246b5-e7cc-45c3-993a-381a977a8b94', '11366e1c-f0e4-4376-8ff2-97bb0c4a80d3', '20c62a6c-4381-4ac8-84a3-c286b279e99d', 'f0e4ee33-382f-4d88-bc57-209e852b132e'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:31:27 devstack sudo[108939]: pam_unix(sudo:session): session closed for user root Aug 05 06:31:27 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-4021f7d2-d0b4-4011-bbdb-96c8cd2bc384 tempest-ProjectReaderTests-1983688842 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-ce4d1b72-0e58-489c-9297-18cdd46b1e7b" returned: 0 in 0.501s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:31:27 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-4021f7d2-d0b4-4011-bbdb-96c8cd2bc384 tempest-ProjectReaderTests-1983688842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-ce4d1b72-0e58-489c-9297-18cdd46b1e7b {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:31:27 devstack sudo[108949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-ce4d1b72-0e58-489c-9297-18cdd46b1e7b Aug 05 06:31:27 devstack sudo[108949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:31:27 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-de54e0c7-f52d-49e5-84e4-f4167782a73c tempest-ProjectMemberTests-475949430 None] Delete snapshot completed successfully. Aug 05 06:31:27 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-de54e0c7-f52d-49e5-84e4-f4167782a73c tempest-ProjectMemberTests-475949430 None] Lock "cinder-a9166ff5-1034-46b5-ab73-8a50aa0d7077-delete_snapshot" released by "delete_snapshot" :: held 2.112s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:31:27 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-8c6e501e-be20-4235-80a8-124443f874d5 tempest-ProjectMemberTests-475949430 None] Acquiring lock "cinder-5045a1c9-b061-4abb-a112-d84657e90f6a-delete_volume" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:31:27 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-8c6e501e-be20-4235-80a8-124443f874d5 tempest-ProjectMemberTests-475949430 None] Lock "cinder-5045a1c9-b061-4abb-a112-d84657e90f6a-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:31:27 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-8c6e501e-be20-4235-80a8-124443f874d5 tempest-ProjectMemberTests-475949430 None] Acquiring lock "cinder-quobyte-5045a1c9-b061-4abb-a112-d84657e90f6a" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:31:27 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-8c6e501e-be20-4235-80a8-124443f874d5 tempest-ProjectMemberTests-475949430 None] Lock "cinder-quobyte-5045a1c9-b061-4abb-a112-d84657e90f6a" acquired by "delete_volume" :: waited 0.023s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:31:27 devstack sudo[108944]: pam_unix(sudo:session): session closed for user root Aug 05 06:31:27 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-c805e753-fe25-4d6e-8d11-8216b8ab479f tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-44b1149a-b640-4a3b-b3db-97ba5c97fd29" returned: 0 in 0.516s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:31:27 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-c805e753-fe25-4d6e-8d11-8216b8ab479f tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-44b1149a-b640-4a3b-b3db-97ba5c97fd29 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:31:27 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7f59c7f-09c3-46df-85d2-d8122a48d43b]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:31:27 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-8c6e501e-be20-4235-80a8-124443f874d5 tempest-ProjectMemberTests-475949430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-5045a1c9-b061-4abb-a112-d84657e90f6a {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:31:27 devstack sudo[108955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-44b1149a-b640-4a3b-b3db-97ba5c97fd29 Aug 05 06:31:27 devstack sudo[108955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:31:27 devstack sudo[108949]: pam_unix(sudo:session): session closed for user root Aug 05 06:31:27 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-4021f7d2-d0b4-4011-bbdb-96c8cd2bc384 tempest-ProjectReaderTests-1983688842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-ce4d1b72-0e58-489c-9297-18cdd46b1e7b" returned: 0 in 0.383s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:31:27 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-4021f7d2-d0b4-4011-bbdb-96c8cd2bc384 tempest-ProjectReaderTests-1983688842 None] Lock "cinder-quobyte-ce4d1b72-0e58-489c-9297-18cdd46b1e7b" released by "delete_volume" :: held 0.936s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:31:27 devstack sudo[108957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-5045a1c9-b061-4abb-a112-d84657e90f6a Aug 05 06:31:27 devstack sudo[108957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:31:27 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-4021f7d2-d0b4-4011-bbdb-96c8cd2bc384 tempest-ProjectReaderTests-1983688842 None] Created reservations ['4b3d2a71-c031-4861-b2b9-701207766b22', '125e34db-4abc-4411-be18-652eeca56318', 'd7ed016f-d7e7-4f9f-b3e3-d1bcfe989eb2', 'ab89bac4-0d62-4ad8-9164-37869d2a8808'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:31:27 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-4021f7d2-d0b4-4011-bbdb-96c8cd2bc384 tempest-ProjectReaderTests-1983688842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:31:27 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-4021f7d2-d0b4-4011-bbdb-96c8cd2bc384 tempest-ProjectReaderTests-1983688842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:31:27 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-4021f7d2-d0b4-4011-bbdb-96c8cd2bc384 tempest-ProjectReaderTests-1983688842 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:31:27 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-4021f7d2-d0b4-4011-bbdb-96c8cd2bc384 tempest-ProjectReaderTests-1983688842 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:31:27 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-4021f7d2-d0b4-4011-bbdb-96c8cd2bc384 tempest-ProjectReaderTests-1983688842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:31:27 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-4021f7d2-d0b4-4011-bbdb-96c8cd2bc384 tempest-ProjectReaderTests-1983688842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:31:27 devstack sudo[108955]: pam_unix(sudo:session): session closed for user root Aug 05 06:31:27 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-c805e753-fe25-4d6e-8d11-8216b8ab479f tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-44b1149a-b640-4a3b-b3db-97ba5c97fd29" returned: 0 in 0.328s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:31:27 devstack sudo[108961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce Aug 05 06:31:27 devstack sudo[108961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:31:27 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-c805e753-fe25-4d6e-8d11-8216b8ab479f tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Lock "cinder-quobyte-44b1149a-b640-4a3b-b3db-97ba5c97fd29" released by "delete_volume" :: held 0.909s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:31:28 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-c805e753-fe25-4d6e-8d11-8216b8ab479f tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Created reservations ['5c7ce106-ba51-4c6a-984d-78b524ae9d31', 'a5e12654-1a8b-4a1b-b4e5-5d6082d3f2bc', '53f9ba06-eb1d-4f8e-b1cc-447133c0faf4', '9b36183f-8131-4bb8-a6b3-9ff899fd7465'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:31:28 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-c805e753-fe25-4d6e-8d11-8216b8ab479f tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:31:28 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-c805e753-fe25-4d6e-8d11-8216b8ab479f tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:31:28 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-c805e753-fe25-4d6e-8d11-8216b8ab479f tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:31:28 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-c805e753-fe25-4d6e-8d11-8216b8ab479f tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:31:28 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-c805e753-fe25-4d6e-8d11-8216b8ab479f tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:31:28 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-c805e753-fe25-4d6e-8d11-8216b8ab479f tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:31:28 devstack sudo[108957]: pam_unix(sudo:session): session closed for user root Aug 05 06:31:28 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-8c6e501e-be20-4235-80a8-124443f874d5 tempest-ProjectMemberTests-475949430 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-5045a1c9-b061-4abb-a112-d84657e90f6a" returned: 0 in 0.526s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:31:28 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-8c6e501e-be20-4235-80a8-124443f874d5 tempest-ProjectMemberTests-475949430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-5045a1c9-b061-4abb-a112-d84657e90f6a {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:31:28 devstack sudo[108966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce Aug 05 06:31:28 devstack sudo[108966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:31:28 devstack sudo[108967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-5045a1c9-b061-4abb-a112-d84657e90f6a Aug 05 06:31:28 devstack sudo[108967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:31:28 devstack sudo[108961]: pam_unix(sudo:session): session closed for user root Aug 05 06:31:28 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-4021f7d2-d0b4-4011-bbdb-96c8cd2bc384 tempest-ProjectReaderTests-1983688842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce" returned: 0 in 0.375s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:31:28 devstack cinder-volume[88695]: DEBUG cinder.manager [None req-4021f7d2-d0b4-4011-bbdb-96c8cd2bc384 tempest-ProjectReaderTests-1983688842 None] Notifying Schedulers of capabilities ... {{(pid=88695) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 06:31:28 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-4021f7d2-d0b4-4011-bbdb-96c8cd2bc384 tempest-ProjectReaderTests-1983688842 None] Deleted volume successfully. Aug 05 06:31:28 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-4021f7d2-d0b4-4011-bbdb-96c8cd2bc384 tempest-ProjectReaderTests-1983688842 None] Lock "cinder-ce4d1b72-0e58-489c-9297-18cdd46b1e7b-delete_volume" released by "delete_volume" :: held 1.638s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:31:28 devstack sudo[108966]: pam_unix(sudo:session): session closed for user root Aug 05 06:31:28 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-c805e753-fe25-4d6e-8d11-8216b8ab479f tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce" returned: 0 in 0.332s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:31:28 devstack cinder-volume[88695]: DEBUG cinder.manager [None req-c805e753-fe25-4d6e-8d11-8216b8ab479f tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Notifying Schedulers of capabilities ... {{(pid=88695) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 06:31:28 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-c805e753-fe25-4d6e-8d11-8216b8ab479f tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Deleted volume successfully. Aug 05 06:31:28 devstack sudo[108967]: pam_unix(sudo:session): session closed for user root Aug 05 06:31:28 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-8c6e501e-be20-4235-80a8-124443f874d5 tempest-ProjectMemberTests-475949430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-5045a1c9-b061-4abb-a112-d84657e90f6a" returned: 0 in 0.355s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:31:28 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-c805e753-fe25-4d6e-8d11-8216b8ab479f tempest-CreateVolumesFromSourceVolumeTest-1310190826 None] Lock "cinder-44b1149a-b640-4a3b-b3db-97ba5c97fd29-delete_volume" released by "delete_volume" :: held 1.563s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:31:28 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-8c6e501e-be20-4235-80a8-124443f874d5 tempest-ProjectMemberTests-475949430 None] Lock "cinder-quobyte-5045a1c9-b061-4abb-a112-d84657e90f6a" released by "delete_volume" :: held 0.968s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:31:28 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-8c6e501e-be20-4235-80a8-124443f874d5 tempest-ProjectMemberTests-475949430 None] Created reservations ['db5ff68b-e1b1-4b46-96ac-d0904e94dbcf', '4803612f-d67e-4174-a9e0-5bec10ace59d', 'aec92c6f-41d0-4699-9b90-dc3ad3fd4137', '49133b29-32dc-408f-8d14-7d6085a4d57b'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:31:28 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-8c6e501e-be20-4235-80a8-124443f874d5 tempest-ProjectMemberTests-475949430 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:31:28 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-8c6e501e-be20-4235-80a8-124443f874d5 tempest-ProjectMemberTests-475949430 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:31:28 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-8c6e501e-be20-4235-80a8-124443f874d5 tempest-ProjectMemberTests-475949430 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:31:28 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-8c6e501e-be20-4235-80a8-124443f874d5 tempest-ProjectMemberTests-475949430 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:31:28 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-8c6e501e-be20-4235-80a8-124443f874d5 tempest-ProjectMemberTests-475949430 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:31:28 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-8c6e501e-be20-4235-80a8-124443f874d5 tempest-ProjectMemberTests-475949430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:31:28 devstack sudo[108974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce Aug 05 06:31:28 devstack sudo[108974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:31:29 devstack sudo[108974]: pam_unix(sudo:session): session closed for user root Aug 05 06:31:29 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-8c6e501e-be20-4235-80a8-124443f874d5 tempest-ProjectMemberTests-475949430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce" returned: 0 in 0.289s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:31:29 devstack cinder-volume[88695]: DEBUG cinder.manager [None req-8c6e501e-be20-4235-80a8-124443f874d5 tempest-ProjectMemberTests-475949430 None] Notifying Schedulers of capabilities ... {{(pid=88695) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 06:31:29 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-8c6e501e-be20-4235-80a8-124443f874d5 tempest-ProjectMemberTests-475949430 None] Deleted volume successfully. Aug 05 06:31:29 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-8c6e501e-be20-4235-80a8-124443f874d5 tempest-ProjectMemberTests-475949430 None] Lock "cinder-5045a1c9-b061-4abb-a112-d84657e90f6a-delete_volume" released by "delete_volume" :: held 1.586s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:31:29 devstack cinder-volume[88695]: DEBUG cinder.volume.flows.manager.create_volume [None req-54cb3668-4b17-404d-96b1-6e08f10bbf65 tempest-ProjectReaderTests-1983688842 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88695) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 06:31:29 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-54cb3668-4b17-404d-96b1-6e08f10bbf65 tempest-ProjectReaderTests-1983688842 None] Flow 'volume_create_manager' (b6ce61c2-51fd-4bad-b1a7-9c8a639371c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:31:29 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-54cb3668-4b17-404d-96b1-6e08f10bbf65 tempest-ProjectReaderTests-1983688842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9f1c03c-e470-4b29-befa-34885709d5c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:31:29 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-54cb3668-4b17-404d-96b1-6e08f10bbf65 tempest-ProjectReaderTests-1983688842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9f1c03c-e470-4b29-befa-34885709d5c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:31:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-590356332',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b714c9d-59bf-48b7-a485-a4e2583f4939,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7b53be6a57a458f9adb84f514f8d4da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:31:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:31:30Z,use_quota=True,user_id='9099d583e3aa47ef81997420b42f60f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:31:29 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-54cb3668-4b17-404d-96b1-6e08f10bbf65 tempest-ProjectReaderTests-1983688842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea674b85-5d5b-47f8-bc27-6453e2cffcee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:31:29 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-54cb3668-4b17-404d-96b1-6e08f10bbf65 tempest-ProjectReaderTests-1983688842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea674b85-5d5b-47f8-bc27-6453e2cffcee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:31:29 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-54cb3668-4b17-404d-96b1-6e08f10bbf65 tempest-ProjectReaderTests-1983688842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d41f65ce-d0f8-4b97-8b3a-76901bd3aa80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:31:29 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-54cb3668-4b17-404d-96b1-6e08f10bbf65 tempest-ProjectReaderTests-1983688842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d41f65ce-d0f8-4b97-8b3a-76901bd3aa80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b714c9d-59bf-48b7-a485-a4e2583f4939', 'volume_name': 'volume-1b714c9d-59bf-48b7-a485-a4e2583f4939', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:31:29 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-54cb3668-4b17-404d-96b1-6e08f10bbf65 tempest-ProjectReaderTests-1983688842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e84e012a-cc6c-447c-b930-0ddc2c175885) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:31:29 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-54cb3668-4b17-404d-96b1-6e08f10bbf65 tempest-ProjectReaderTests-1983688842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e84e012a-cc6c-447c-b930-0ddc2c175885) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:31:29 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-54cb3668-4b17-404d-96b1-6e08f10bbf65 tempest-ProjectReaderTests-1983688842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08aef129-3468-490d-903d-8df0f890ac4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:31:29 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-54cb3668-4b17-404d-96b1-6e08f10bbf65 tempest-ProjectReaderTests-1983688842 None] Volume 1b714c9d-59bf-48b7-a485-a4e2583f4939: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b714c9d-59bf-48b7-a485-a4e2583f4939', 'volume_size': 1} Aug 05 06:31:29 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-54cb3668-4b17-404d-96b1-6e08f10bbf65 tempest-ProjectReaderTests-1983688842 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:31:29 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-54cb3668-4b17-404d-96b1-6e08f10bbf65 tempest-ProjectReaderTests-1983688842 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:31:29 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-54cb3668-4b17-404d-96b1-6e08f10bbf65 tempest-ProjectReaderTests-1983688842 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:31:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-590356332',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b714c9d-59bf-48b7-a485-a4e2583f4939,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7b53be6a57a458f9adb84f514f8d4da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:31:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:31:30Z,use_quota=True,user_id='9099d583e3aa47ef81997420b42f60f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)}" {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 06:31:29 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-54cb3668-4b17-404d-96b1-6e08f10bbf65 tempest-ProjectReaderTests-1983688842 None] Creating volume 1b714c9d-59bf-48b7-a485-a4e2583f4939 {{(pid=88695) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 06:31:29 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-54cb3668-4b17-404d-96b1-6e08f10bbf65 tempest-ProjectReaderTests-1983688842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:31:29 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-54cb3668-4b17-404d-96b1-6e08f10bbf65 tempest-ProjectReaderTests-1983688842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:31:29 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-54cb3668-4b17-404d-96b1-6e08f10bbf65 tempest-ProjectReaderTests-1983688842 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:31:29 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-54cb3668-4b17-404d-96b1-6e08f10bbf65 tempest-ProjectReaderTests-1983688842 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:31:29 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-54cb3668-4b17-404d-96b1-6e08f10bbf65 tempest-ProjectReaderTests-1983688842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:31:29 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-54cb3668-4b17-404d-96b1-6e08f10bbf65 tempest-ProjectReaderTests-1983688842 None] Selected osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 as target Quobyte volume. {{(pid=88695) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 06:31:29 devstack cinder-volume[88695]: INFO cinder.volume.drivers.remotefs [None req-54cb3668-4b17-404d-96b1-6e08f10bbf65 tempest-ProjectReaderTests-1983688842 None] casted to osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 Aug 05 06:31:29 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-54cb3668-4b17-404d-96b1-6e08f10bbf65 tempest-ProjectReaderTests-1983688842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-1b714c9d-59bf-48b7-a485-a4e2583f4939 1073741824 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:31:29 devstack sudo[108978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-1b714c9d-59bf-48b7-a485-a4e2583f4939 1073741824 Aug 05 06:31:29 devstack sudo[108978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:31:30 devstack sudo[108978]: pam_unix(sudo:session): session closed for user root Aug 05 06:31:30 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-54cb3668-4b17-404d-96b1-6e08f10bbf65 tempest-ProjectReaderTests-1983688842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-1b714c9d-59bf-48b7-a485-a4e2583f4939 1073741824" returned: 0 in 0.708s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:31:30 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-54cb3668-4b17-404d-96b1-6e08f10bbf65 tempest-ProjectReaderTests-1983688842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-1b714c9d-59bf-48b7-a485-a4e2583f4939 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:31:30 devstack sudo[108984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-1b714c9d-59bf-48b7-a485-a4e2583f4939 Aug 05 06:31:30 devstack sudo[108984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:31:30 devstack cinder-volume[88695]: DEBUG cinder.volume.flows.manager.create_volume [None req-435604c1-973c-4225-b07a-7f43b961aa6f tempest-ProjectMemberTests-475949430 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88695) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 06:31:30 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-435604c1-973c-4225-b07a-7f43b961aa6f tempest-ProjectMemberTests-475949430 None] Flow 'volume_create_manager' (eba72f90-48c8-4839-a300-d833867ffca3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:31:30 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-435604c1-973c-4225-b07a-7f43b961aa6f tempest-ProjectMemberTests-475949430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05f4d3c0-9233-4c2c-8d8f-5a99034ee3b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:31:30 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-435604c1-973c-4225-b07a-7f43b961aa6f tempest-ProjectMemberTests-475949430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05f4d3c0-9233-4c2c-8d8f-5a99034ee3b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:31:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1415842408',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fe7afe0-1942-4b91-87cf-817a659b515a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe85d705f6434b70a55dac31b79c0714',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:31:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:31:30Z,use_quota=True,user_id='a9de9bccd062450c95c9f7f6cf4317f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:31:30 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-435604c1-973c-4225-b07a-7f43b961aa6f tempest-ProjectMemberTests-475949430 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a71a026-1a4b-4e62-8bd6-c8f10ca4e8d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:31:30 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-435604c1-973c-4225-b07a-7f43b961aa6f tempest-ProjectMemberTests-475949430 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a71a026-1a4b-4e62-8bd6-c8f10ca4e8d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:31:30 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-435604c1-973c-4225-b07a-7f43b961aa6f tempest-ProjectMemberTests-475949430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5cf5f5d-ed29-433e-a3db-c89f3020f67c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:31:30 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-435604c1-973c-4225-b07a-7f43b961aa6f tempest-ProjectMemberTests-475949430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5cf5f5d-ed29-433e-a3db-c89f3020f67c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7fe7afe0-1942-4b91-87cf-817a659b515a', 'volume_name': 'volume-7fe7afe0-1942-4b91-87cf-817a659b515a', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:31:30 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-435604c1-973c-4225-b07a-7f43b961aa6f tempest-ProjectMemberTests-475949430 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2645f01-4e1b-4daf-a63e-723efb17dade) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:31:30 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-435604c1-973c-4225-b07a-7f43b961aa6f tempest-ProjectMemberTests-475949430 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2645f01-4e1b-4daf-a63e-723efb17dade) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:31:30 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-435604c1-973c-4225-b07a-7f43b961aa6f tempest-ProjectMemberTests-475949430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1459895a-17a7-4db9-88c8-9f5637a4af63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:31:30 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-435604c1-973c-4225-b07a-7f43b961aa6f tempest-ProjectMemberTests-475949430 None] Volume 7fe7afe0-1942-4b91-87cf-817a659b515a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7fe7afe0-1942-4b91-87cf-817a659b515a', 'volume_size': 1} Aug 05 06:31:30 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-435604c1-973c-4225-b07a-7f43b961aa6f tempest-ProjectMemberTests-475949430 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:31:30 devstack sudo[108984]: pam_unix(sudo:session): session closed for user root Aug 05 06:31:30 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-54cb3668-4b17-404d-96b1-6e08f10bbf65 tempest-ProjectReaderTests-1983688842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-1b714c9d-59bf-48b7-a485-a4e2583f4939" returned: 0 in 0.332s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:31:30 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-54cb3668-4b17-404d-96b1-6e08f10bbf65 tempest-ProjectReaderTests-1983688842 None] <== create_volume: return (1114ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'} {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 06:31:30 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-54cb3668-4b17-404d-96b1-6e08f10bbf65 tempest-ProjectReaderTests-1983688842 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.117s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:31:30 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-435604c1-973c-4225-b07a-7f43b961aa6f tempest-ProjectMemberTests-475949430 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.103s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:31:30 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-435604c1-973c-4225-b07a-7f43b961aa6f tempest-ProjectMemberTests-475949430 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:31:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1415842408',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fe7afe0-1942-4b91-87cf-817a659b515a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe85d705f6434b70a55dac31b79c0714',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:31:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:31:30Z,use_quota=True,user_id='a9de9bccd062450c95c9f7f6cf4317f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)}" {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 06:31:30 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-435604c1-973c-4225-b07a-7f43b961aa6f tempest-ProjectMemberTests-475949430 None] Creating volume 7fe7afe0-1942-4b91-87cf-817a659b515a {{(pid=88695) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 06:31:30 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-435604c1-973c-4225-b07a-7f43b961aa6f tempest-ProjectMemberTests-475949430 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:31:30 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-435604c1-973c-4225-b07a-7f43b961aa6f tempest-ProjectMemberTests-475949430 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:31:30 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-435604c1-973c-4225-b07a-7f43b961aa6f tempest-ProjectMemberTests-475949430 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:31:30 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-435604c1-973c-4225-b07a-7f43b961aa6f tempest-ProjectMemberTests-475949430 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:31:30 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-435604c1-973c-4225-b07a-7f43b961aa6f tempest-ProjectMemberTests-475949430 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:31:30 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-435604c1-973c-4225-b07a-7f43b961aa6f tempest-ProjectMemberTests-475949430 None] Selected osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 as target Quobyte volume. {{(pid=88695) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 06:31:30 devstack cinder-volume[88695]: INFO cinder.volume.drivers.remotefs [None req-435604c1-973c-4225-b07a-7f43b961aa6f tempest-ProjectMemberTests-475949430 None] casted to osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 Aug 05 06:31:30 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-435604c1-973c-4225-b07a-7f43b961aa6f tempest-ProjectMemberTests-475949430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7fe7afe0-1942-4b91-87cf-817a659b515a 1073741824 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:31:30 devstack sudo[108987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7fe7afe0-1942-4b91-87cf-817a659b515a 1073741824 Aug 05 06:31:30 devstack sudo[108987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:31:30 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-54cb3668-4b17-404d-96b1-6e08f10bbf65 tempest-ProjectReaderTests-1983688842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08aef129-3468-490d-903d-8df0f890ac4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b714c9d-59bf-48b7-a485-a4e2583f4939', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:31:30 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-54cb3668-4b17-404d-96b1-6e08f10bbf65 tempest-ProjectReaderTests-1983688842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc570d60-66bc-49d4-b8af-fd3598f906c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:31:30 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-54cb3668-4b17-404d-96b1-6e08f10bbf65 tempest-ProjectReaderTests-1983688842 None] Volume volume-1b714c9d-59bf-48b7-a485-a4e2583f4939 (1b714c9d-59bf-48b7-a485-a4e2583f4939): created successfully Aug 05 06:31:30 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-54cb3668-4b17-404d-96b1-6e08f10bbf65 tempest-ProjectReaderTests-1983688842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc570d60-66bc-49d4-b8af-fd3598f906c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:31:30 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-54cb3668-4b17-404d-96b1-6e08f10bbf65 tempest-ProjectReaderTests-1983688842 None] Flow 'volume_create_manager' (b6ce61c2-51fd-4bad-b1a7-9c8a639371c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:31:30 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-54cb3668-4b17-404d-96b1-6e08f10bbf65 tempest-ProjectReaderTests-1983688842 None] Created volume successfully. Aug 05 06:31:31 devstack sudo[108987]: pam_unix(sudo:session): session closed for user root Aug 05 06:31:31 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-435604c1-973c-4225-b07a-7f43b961aa6f tempest-ProjectMemberTests-475949430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7fe7afe0-1942-4b91-87cf-817a659b515a 1073741824" returned: 0 in 0.552s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:31:31 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-435604c1-973c-4225-b07a-7f43b961aa6f tempest-ProjectMemberTests-475949430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7fe7afe0-1942-4b91-87cf-817a659b515a {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:31:31 devstack sudo[108993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7fe7afe0-1942-4b91-87cf-817a659b515a Aug 05 06:31:31 devstack sudo[108993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:31:31 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-61a946ae-6f62-46bb-bf62-0bdfcea3f57c tempest-ProjectReaderTests-1983688842 None] Acquiring lock "cinder-1b714c9d-59bf-48b7-a485-a4e2583f4939-delete_volume" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:31:31 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-61a946ae-6f62-46bb-bf62-0bdfcea3f57c tempest-ProjectReaderTests-1983688842 None] Lock "cinder-1b714c9d-59bf-48b7-a485-a4e2583f4939-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:31:31 devstack sudo[108993]: pam_unix(sudo:session): session closed for user root Aug 05 06:31:31 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-435604c1-973c-4225-b07a-7f43b961aa6f tempest-ProjectMemberTests-475949430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7fe7afe0-1942-4b91-87cf-817a659b515a" returned: 0 in 0.333s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:31:31 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-435604c1-973c-4225-b07a-7f43b961aa6f tempest-ProjectMemberTests-475949430 None] <== create_volume: return (981ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'} {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 06:31:31 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-435604c1-973c-4225-b07a-7f43b961aa6f tempest-ProjectMemberTests-475949430 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.984s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:31:31 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-435604c1-973c-4225-b07a-7f43b961aa6f tempest-ProjectMemberTests-475949430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1459895a-17a7-4db9-88c8-9f5637a4af63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7fe7afe0-1942-4b91-87cf-817a659b515a', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:31:31 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-435604c1-973c-4225-b07a-7f43b961aa6f tempest-ProjectMemberTests-475949430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89bea376-6cc6-493c-aa45-adc5aa08bf2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:31:31 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-61a946ae-6f62-46bb-bf62-0bdfcea3f57c tempest-ProjectReaderTests-1983688842 None] Acquiring lock "cinder-quobyte-1b714c9d-59bf-48b7-a485-a4e2583f4939" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:31:31 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-435604c1-973c-4225-b07a-7f43b961aa6f tempest-ProjectMemberTests-475949430 None] Volume volume-7fe7afe0-1942-4b91-87cf-817a659b515a (7fe7afe0-1942-4b91-87cf-817a659b515a): created successfully Aug 05 06:31:31 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-435604c1-973c-4225-b07a-7f43b961aa6f tempest-ProjectMemberTests-475949430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89bea376-6cc6-493c-aa45-adc5aa08bf2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:31:31 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-435604c1-973c-4225-b07a-7f43b961aa6f tempest-ProjectMemberTests-475949430 None] Flow 'volume_create_manager' (eba72f90-48c8-4839-a300-d833867ffca3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:31:31 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-61a946ae-6f62-46bb-bf62-0bdfcea3f57c tempest-ProjectReaderTests-1983688842 None] Lock "cinder-quobyte-1b714c9d-59bf-48b7-a485-a4e2583f4939" acquired by "delete_volume" :: waited 0.042s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:31:31 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-435604c1-973c-4225-b07a-7f43b961aa6f tempest-ProjectMemberTests-475949430 None] Created volume successfully. Aug 05 06:31:31 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[922d4c08-c4bf-473a-bb08-5790b78c746c]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:31:31 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-61a946ae-6f62-46bb-bf62-0bdfcea3f57c tempest-ProjectReaderTests-1983688842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-1b714c9d-59bf-48b7-a485-a4e2583f4939 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:31:32 devstack sudo[108996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-1b714c9d-59bf-48b7-a485-a4e2583f4939 Aug 05 06:31:32 devstack sudo[108996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:31:32 devstack cinder-volume[88695]: DEBUG cinder.volume.flows.manager.create_volume [None req-37b8d9c6-a039-4bca-bd55-0f52a2fbcaaa tempest-VolumeDependencyTests-1089559550 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88695) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 06:31:32 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-37b8d9c6-a039-4bca-bd55-0f52a2fbcaaa tempest-VolumeDependencyTests-1089559550 None] Flow 'volume_create_manager' (cbe7e3ae-7565-4a24-aec2-87b388e4a50b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:31:32 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-37b8d9c6-a039-4bca-bd55-0f52a2fbcaaa tempest-VolumeDependencyTests-1089559550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4ad536d-47f9-425b-b764-0edc7af58e85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:31:32 devstack sudo[108996]: pam_unix(sudo:session): session closed for user root Aug 05 06:31:32 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-61a946ae-6f62-46bb-bf62-0bdfcea3f57c tempest-ProjectReaderTests-1983688842 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-1b714c9d-59bf-48b7-a485-a4e2583f4939" returned: 0 in 0.455s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:31:32 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-61a946ae-6f62-46bb-bf62-0bdfcea3f57c tempest-ProjectReaderTests-1983688842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-1b714c9d-59bf-48b7-a485-a4e2583f4939 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:31:32 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-37b8d9c6-a039-4bca-bd55-0f52a2fbcaaa tempest-VolumeDependencyTests-1089559550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4ad536d-47f9-425b-b764-0edc7af58e85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:31:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-436269858',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8542f074-6908-4f24-9d40-821e096b7124,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ac35009f4a54de8b6a29f67c3a608cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:31:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:31:32Z,use_quota=True,user_id='c1b8d80c6a1a4c2ca1cc145c74959a64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:31:32 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-37b8d9c6-a039-4bca-bd55-0f52a2fbcaaa tempest-VolumeDependencyTests-1089559550 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b87294c1-3bdd-4e67-a96f-33913e2bddf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:31:32 devstack sudo[109001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-1b714c9d-59bf-48b7-a485-a4e2583f4939 Aug 05 06:31:32 devstack sudo[109001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:31:32 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-37b8d9c6-a039-4bca-bd55-0f52a2fbcaaa tempest-VolumeDependencyTests-1089559550 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b87294c1-3bdd-4e67-a96f-33913e2bddf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:31:32 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-37b8d9c6-a039-4bca-bd55-0f52a2fbcaaa tempest-VolumeDependencyTests-1089559550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b6221a3-d992-4e53-a6d3-65105dd2e018) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:31:32 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-37b8d9c6-a039-4bca-bd55-0f52a2fbcaaa tempest-VolumeDependencyTests-1089559550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b6221a3-d992-4e53-a6d3-65105dd2e018) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8542f074-6908-4f24-9d40-821e096b7124', 'volume_name': 'volume-8542f074-6908-4f24-9d40-821e096b7124', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:31:32 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-37b8d9c6-a039-4bca-bd55-0f52a2fbcaaa tempest-VolumeDependencyTests-1089559550 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca63eb0a-c98c-4491-8f05-b7d21b6b6059) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:31:32 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-37b8d9c6-a039-4bca-bd55-0f52a2fbcaaa tempest-VolumeDependencyTests-1089559550 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca63eb0a-c98c-4491-8f05-b7d21b6b6059) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:31:32 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-37b8d9c6-a039-4bca-bd55-0f52a2fbcaaa tempest-VolumeDependencyTests-1089559550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02b2821d-afe2-4764-b78b-e06a2808f601) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:31:32 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-37b8d9c6-a039-4bca-bd55-0f52a2fbcaaa tempest-VolumeDependencyTests-1089559550 None] Volume 8542f074-6908-4f24-9d40-821e096b7124: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8542f074-6908-4f24-9d40-821e096b7124', 'volume_size': 1} Aug 05 06:31:32 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-37b8d9c6-a039-4bca-bd55-0f52a2fbcaaa tempest-VolumeDependencyTests-1089559550 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:31:32 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-37b8d9c6-a039-4bca-bd55-0f52a2fbcaaa tempest-VolumeDependencyTests-1089559550 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:31:32 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-37b8d9c6-a039-4bca-bd55-0f52a2fbcaaa tempest-VolumeDependencyTests-1089559550 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:31:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-436269858',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8542f074-6908-4f24-9d40-821e096b7124,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ac35009f4a54de8b6a29f67c3a608cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:31:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:31:32Z,use_quota=True,user_id='c1b8d80c6a1a4c2ca1cc145c74959a64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)}" {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 06:31:32 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-37b8d9c6-a039-4bca-bd55-0f52a2fbcaaa tempest-VolumeDependencyTests-1089559550 None] Creating volume 8542f074-6908-4f24-9d40-821e096b7124 {{(pid=88695) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 06:31:32 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-37b8d9c6-a039-4bca-bd55-0f52a2fbcaaa tempest-VolumeDependencyTests-1089559550 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:31:32 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-37b8d9c6-a039-4bca-bd55-0f52a2fbcaaa tempest-VolumeDependencyTests-1089559550 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:31:32 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-37b8d9c6-a039-4bca-bd55-0f52a2fbcaaa tempest-VolumeDependencyTests-1089559550 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:31:32 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-37b8d9c6-a039-4bca-bd55-0f52a2fbcaaa tempest-VolumeDependencyTests-1089559550 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:31:32 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-37b8d9c6-a039-4bca-bd55-0f52a2fbcaaa tempest-VolumeDependencyTests-1089559550 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:31:32 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-37b8d9c6-a039-4bca-bd55-0f52a2fbcaaa tempest-VolumeDependencyTests-1089559550 None] Selected osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 as target Quobyte volume. {{(pid=88695) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 06:31:32 devstack cinder-volume[88695]: INFO cinder.volume.drivers.remotefs [None req-37b8d9c6-a039-4bca-bd55-0f52a2fbcaaa tempest-VolumeDependencyTests-1089559550 None] casted to osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 Aug 05 06:31:32 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-37b8d9c6-a039-4bca-bd55-0f52a2fbcaaa tempest-VolumeDependencyTests-1089559550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8542f074-6908-4f24-9d40-821e096b7124 1073741824 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:31:32 devstack sudo[109003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8542f074-6908-4f24-9d40-821e096b7124 1073741824 Aug 05 06:31:32 devstack sudo[109003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:31:32 devstack sudo[109001]: pam_unix(sudo:session): session closed for user root Aug 05 06:31:32 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-61a946ae-6f62-46bb-bf62-0bdfcea3f57c tempest-ProjectReaderTests-1983688842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-1b714c9d-59bf-48b7-a485-a4e2583f4939" returned: 0 in 0.332s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:31:32 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-61a946ae-6f62-46bb-bf62-0bdfcea3f57c tempest-ProjectReaderTests-1983688842 None] Lock "cinder-quobyte-1b714c9d-59bf-48b7-a485-a4e2583f4939" released by "delete_volume" :: held 0.843s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:31:32 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-61a946ae-6f62-46bb-bf62-0bdfcea3f57c tempest-ProjectReaderTests-1983688842 None] Created reservations ['d0c5c76a-123d-44b5-bf32-b9149032e1cf', '90cc067b-c103-4265-a229-8d2563732ee6', 'cb95cf5d-3376-4657-8ad6-25a45176602b', '292b27c3-1892-40dd-a66b-60841d7e009f'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:31:32 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-61a946ae-6f62-46bb-bf62-0bdfcea3f57c tempest-ProjectReaderTests-1983688842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:31:32 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-61a946ae-6f62-46bb-bf62-0bdfcea3f57c tempest-ProjectReaderTests-1983688842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:31:32 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-61a946ae-6f62-46bb-bf62-0bdfcea3f57c tempest-ProjectReaderTests-1983688842 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:31:32 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-61a946ae-6f62-46bb-bf62-0bdfcea3f57c tempest-ProjectReaderTests-1983688842 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:31:32 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-61a946ae-6f62-46bb-bf62-0bdfcea3f57c tempest-ProjectReaderTests-1983688842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:31:32 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-61a946ae-6f62-46bb-bf62-0bdfcea3f57c tempest-ProjectReaderTests-1983688842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:31:33 devstack sudo[109009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce Aug 05 06:31:33 devstack sudo[109009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:31:33 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-612d3bcb-05a0-4e0d-bf00-154ce9dfc692 tempest-ProjectMemberTests-475949430 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:31:33 devstack sudo[109003]: pam_unix(sudo:session): session closed for user root Aug 05 06:31:33 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-37b8d9c6-a039-4bca-bd55-0f52a2fbcaaa tempest-VolumeDependencyTests-1089559550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8542f074-6908-4f24-9d40-821e096b7124 1073741824" returned: 0 in 0.683s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:31:33 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-37b8d9c6-a039-4bca-bd55-0f52a2fbcaaa tempest-VolumeDependencyTests-1089559550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8542f074-6908-4f24-9d40-821e096b7124 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:31:33 devstack sudo[109012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8542f074-6908-4f24-9d40-821e096b7124 Aug 05 06:31:33 devstack sudo[109012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:31:33 devstack sudo[109009]: pam_unix(sudo:session): session closed for user root Aug 05 06:31:33 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-61a946ae-6f62-46bb-bf62-0bdfcea3f57c tempest-ProjectReaderTests-1983688842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce" returned: 0 in 0.352s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:31:33 devstack cinder-volume[88695]: DEBUG cinder.manager [None req-61a946ae-6f62-46bb-bf62-0bdfcea3f57c tempest-ProjectReaderTests-1983688842 None] Notifying Schedulers of capabilities ... {{(pid=88695) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 06:31:33 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-61a946ae-6f62-46bb-bf62-0bdfcea3f57c tempest-ProjectReaderTests-1983688842 None] Deleted volume successfully. Aug 05 06:31:33 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-61a946ae-6f62-46bb-bf62-0bdfcea3f57c tempest-ProjectReaderTests-1983688842 None] Lock "cinder-1b714c9d-59bf-48b7-a485-a4e2583f4939-delete_volume" released by "delete_volume" :: held 1.633s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:31:33 devstack sudo[109012]: pam_unix(sudo:session): session closed for user root Aug 05 06:31:33 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-37b8d9c6-a039-4bca-bd55-0f52a2fbcaaa tempest-VolumeDependencyTests-1089559550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8542f074-6908-4f24-9d40-821e096b7124" returned: 0 in 0.367s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:31:33 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-37b8d9c6-a039-4bca-bd55-0f52a2fbcaaa tempest-VolumeDependencyTests-1089559550 None] <== create_volume: return (1135ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'} {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 06:31:33 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-37b8d9c6-a039-4bca-bd55-0f52a2fbcaaa tempest-VolumeDependencyTests-1089559550 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.138s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:31:33 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-612d3bcb-05a0-4e0d-bf00-154ce9dfc692 tempest-ProjectMemberTests-475949430 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.507s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:31:33 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-37b8d9c6-a039-4bca-bd55-0f52a2fbcaaa tempest-VolumeDependencyTests-1089559550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02b2821d-afe2-4764-b78b-e06a2808f601) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8542f074-6908-4f24-9d40-821e096b7124', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:31:33 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-37b8d9c6-a039-4bca-bd55-0f52a2fbcaaa tempest-VolumeDependencyTests-1089559550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (648117dc-2fd0-4495-a166-80680b0526bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:31:33 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-612d3bcb-05a0-4e0d-bf00-154ce9dfc692 tempest-ProjectMemberTests-475949430 None] Creating offline snapshot 9cd735b0-1b2b-45e0-98d4-acb0494071f1 of volume 7fe7afe0-1942-4b91-87cf-817a659b515a {{(pid=88695) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 06:31:33 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-37b8d9c6-a039-4bca-bd55-0f52a2fbcaaa tempest-VolumeDependencyTests-1089559550 None] Volume volume-8542f074-6908-4f24-9d40-821e096b7124 (8542f074-6908-4f24-9d40-821e096b7124): created successfully Aug 05 06:31:33 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-37b8d9c6-a039-4bca-bd55-0f52a2fbcaaa tempest-VolumeDependencyTests-1089559550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (648117dc-2fd0-4495-a166-80680b0526bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:31:33 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-37b8d9c6-a039-4bca-bd55-0f52a2fbcaaa tempest-VolumeDependencyTests-1089559550 None] Flow 'volume_create_manager' (cbe7e3ae-7565-4a24-aec2-87b388e4a50b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:31:33 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a6b821c-ef5d-423a-81ed-e304921fcda0]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:31:33 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-612d3bcb-05a0-4e0d-bf00-154ce9dfc692 tempest-ProjectMemberTests-475949430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7fe7afe0-1942-4b91-87cf-817a659b515a {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:31:33 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-37b8d9c6-a039-4bca-bd55-0f52a2fbcaaa tempest-VolumeDependencyTests-1089559550 None] Created volume successfully. Aug 05 06:31:33 devstack cinder-volume[88695]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed8030c8-a067-4919-b372-18bd0dbc0d05 tempest-ProjectReaderTests-1983688842 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88695) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 06:31:33 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-ed8030c8-a067-4919-b372-18bd0dbc0d05 tempest-ProjectReaderTests-1983688842 None] Flow 'volume_create_manager' (d3c841df-0ba5-45ff-b399-d5a44bb47d3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:31:33 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-ed8030c8-a067-4919-b372-18bd0dbc0d05 tempest-ProjectReaderTests-1983688842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (853d6cfb-4059-4a39-a215-cc25de0744da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:31:33 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-ed8030c8-a067-4919-b372-18bd0dbc0d05 tempest-ProjectReaderTests-1983688842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (853d6cfb-4059-4a39-a215-cc25de0744da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:31:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1074291196',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59b947ea-9f34-4cd2-bab2-ec78c62b3731,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7b53be6a57a458f9adb84f514f8d4da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:31:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:31:34Z,use_quota=True,user_id='9099d583e3aa47ef81997420b42f60f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:31:33 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-ed8030c8-a067-4919-b372-18bd0dbc0d05 tempest-ProjectReaderTests-1983688842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07f02619-55ab-4e1a-a6ce-d5af26e20469) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:31:33 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-ed8030c8-a067-4919-b372-18bd0dbc0d05 tempest-ProjectReaderTests-1983688842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07f02619-55ab-4e1a-a6ce-d5af26e20469) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:31:33 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-ed8030c8-a067-4919-b372-18bd0dbc0d05 tempest-ProjectReaderTests-1983688842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39976fd2-b9c1-4d65-adc5-f84d03bc8ba1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:31:33 devstack sudo[109016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7fe7afe0-1942-4b91-87cf-817a659b515a Aug 05 06:31:33 devstack sudo[109016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:31:33 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-ed8030c8-a067-4919-b372-18bd0dbc0d05 tempest-ProjectReaderTests-1983688842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39976fd2-b9c1-4d65-adc5-f84d03bc8ba1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '59b947ea-9f34-4cd2-bab2-ec78c62b3731', 'volume_name': 'volume-59b947ea-9f34-4cd2-bab2-ec78c62b3731', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:31:33 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-ed8030c8-a067-4919-b372-18bd0dbc0d05 tempest-ProjectReaderTests-1983688842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3bf9102-7308-4118-a47f-902f691a3e9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:31:33 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-ed8030c8-a067-4919-b372-18bd0dbc0d05 tempest-ProjectReaderTests-1983688842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3bf9102-7308-4118-a47f-902f691a3e9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:31:33 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-ed8030c8-a067-4919-b372-18bd0dbc0d05 tempest-ProjectReaderTests-1983688842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a479143-699a-428d-8297-4ccbc5124f7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:31:33 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-ed8030c8-a067-4919-b372-18bd0dbc0d05 tempest-ProjectReaderTests-1983688842 None] Volume 59b947ea-9f34-4cd2-bab2-ec78c62b3731: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-59b947ea-9f34-4cd2-bab2-ec78c62b3731', 'volume_size': 1} Aug 05 06:31:33 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-ed8030c8-a067-4919-b372-18bd0dbc0d05 tempest-ProjectReaderTests-1983688842 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:31:34 devstack sudo[109016]: pam_unix(sudo:session): session closed for user root Aug 05 06:31:34 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-612d3bcb-05a0-4e0d-bf00-154ce9dfc692 tempest-ProjectMemberTests-475949430 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7fe7afe0-1942-4b91-87cf-817a659b515a" returned: 0 in 0.420s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:31:34 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-612d3bcb-05a0-4e0d-bf00-154ce9dfc692 tempest-ProjectMemberTests-475949430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7fe7afe0-1942-4b91-87cf-817a659b515a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7fe7afe0-1942-4b91-87cf-817a659b515a.9cd735b0-1b2b-45e0-98d4-acb0494071f1 1G {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:31:34 devstack sudo[109021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7fe7afe0-1942-4b91-87cf-817a659b515a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7fe7afe0-1942-4b91-87cf-817a659b515a.9cd735b0-1b2b-45e0-98d4-acb0494071f1 1G Aug 05 06:31:34 devstack sudo[109021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:31:34 devstack sudo[109021]: pam_unix(sudo:session): session closed for user root Aug 05 06:31:34 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-612d3bcb-05a0-4e0d-bf00-154ce9dfc692 tempest-ProjectMemberTests-475949430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7fe7afe0-1942-4b91-87cf-817a659b515a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7fe7afe0-1942-4b91-87cf-817a659b515a.9cd735b0-1b2b-45e0-98d4-acb0494071f1 1G" returned: 0 in 0.591s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:31:34 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-612d3bcb-05a0-4e0d-bf00-154ce9dfc692 tempest-ProjectMemberTests-475949430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7fe7afe0-1942-4b91-87cf-817a659b515a -F qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7fe7afe0-1942-4b91-87cf-817a659b515a.9cd735b0-1b2b-45e0-98d4-acb0494071f1 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:31:34 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-f3976597-6029-4a5b-b15a-1f001eae31ed tempest-VolumeDependencyTests-1089559550 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:31:34 devstack sudo[109027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7fe7afe0-1942-4b91-87cf-817a659b515a -F qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7fe7afe0-1942-4b91-87cf-817a659b515a.9cd735b0-1b2b-45e0-98d4-acb0494071f1 Aug 05 06:31:34 devstack sudo[109027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:31:34 devstack sudo[109027]: pam_unix(sudo:session): session closed for user root Aug 05 06:31:34 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-612d3bcb-05a0-4e0d-bf00-154ce9dfc692 tempest-ProjectMemberTests-475949430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7fe7afe0-1942-4b91-87cf-817a659b515a -F qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7fe7afe0-1942-4b91-87cf-817a659b515a.9cd735b0-1b2b-45e0-98d4-acb0494071f1" returned: 0 in 0.323s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:31:34 devstack cinder-volume[88695]: WARNING cinder.volume.drivers.remotefs [None req-612d3bcb-05a0-4e0d-bf00-154ce9dfc692 tempest-ProjectMemberTests-475949430 None] /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7fe7afe0-1942-4b91-87cf-817a659b515a.9cd735b0-1b2b-45e0-98d4-acb0494071f1 is being set with open permissions: ugo+rw Aug 05 06:31:34 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-612d3bcb-05a0-4e0d-bf00-154ce9dfc692 tempest-ProjectMemberTests-475949430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7fe7afe0-1942-4b91-87cf-817a659b515a.9cd735b0-1b2b-45e0-98d4-acb0494071f1 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:31:35 devstack sudo[109032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7fe7afe0-1942-4b91-87cf-817a659b515a.9cd735b0-1b2b-45e0-98d4-acb0494071f1 Aug 05 06:31:35 devstack sudo[109032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:31:35 devstack sudo[109032]: pam_unix(sudo:session): session closed for user root Aug 05 06:31:35 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-612d3bcb-05a0-4e0d-bf00-154ce9dfc692 tempest-ProjectMemberTests-475949430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7fe7afe0-1942-4b91-87cf-817a659b515a.9cd735b0-1b2b-45e0-98d4-acb0494071f1" returned: 0 in 0.264s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:31:35 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-612d3bcb-05a0-4e0d-bf00-154ce9dfc692 tempest-ProjectMemberTests-475949430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7fe7afe0-1942-4b91-87cf-817a659b515a.info {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:31:35 devstack sudo[109035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7fe7afe0-1942-4b91-87cf-817a659b515a.info Aug 05 06:31:35 devstack sudo[109035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:31:35 devstack sudo[109035]: pam_unix(sudo:session): session closed for user root Aug 05 06:31:35 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-612d3bcb-05a0-4e0d-bf00-154ce9dfc692 tempest-ProjectMemberTests-475949430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7fe7afe0-1942-4b91-87cf-817a659b515a.info" returned: 0 in 0.312s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:31:35 devstack cinder-volume[88695]: WARNING cinder.volume.drivers.remotefs [None req-612d3bcb-05a0-4e0d-bf00-154ce9dfc692 tempest-ProjectMemberTests-475949430 None] /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7fe7afe0-1942-4b91-87cf-817a659b515a.info is being set with open permissions: ugo+rw Aug 05 06:31:35 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-612d3bcb-05a0-4e0d-bf00-154ce9dfc692 tempest-ProjectMemberTests-475949430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7fe7afe0-1942-4b91-87cf-817a659b515a.info {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:31:35 devstack sudo[109038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7fe7afe0-1942-4b91-87cf-817a659b515a.info Aug 05 06:31:35 devstack sudo[109038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:31:35 devstack sudo[109038]: pam_unix(sudo:session): session closed for user root Aug 05 06:31:35 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-612d3bcb-05a0-4e0d-bf00-154ce9dfc692 tempest-ProjectMemberTests-475949430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7fe7afe0-1942-4b91-87cf-817a659b515a.info" returned: 0 in 0.271s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:31:35 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-612d3bcb-05a0-4e0d-bf00-154ce9dfc692 tempest-ProjectMemberTests-475949430 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.338s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:31:35 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-ed8030c8-a067-4919-b372-18bd0dbc0d05 tempest-ProjectReaderTests-1983688842 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.108s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:31:35 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-ed8030c8-a067-4919-b372-18bd0dbc0d05 tempest-ProjectReaderTests-1983688842 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:31:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1074291196',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59b947ea-9f34-4cd2-bab2-ec78c62b3731,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7b53be6a57a458f9adb84f514f8d4da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:31:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:31:34Z,use_quota=True,user_id='9099d583e3aa47ef81997420b42f60f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)}" {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 06:31:35 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-ed8030c8-a067-4919-b372-18bd0dbc0d05 tempest-ProjectReaderTests-1983688842 None] Creating volume 59b947ea-9f34-4cd2-bab2-ec78c62b3731 {{(pid=88695) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 06:31:35 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-ed8030c8-a067-4919-b372-18bd0dbc0d05 tempest-ProjectReaderTests-1983688842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:31:35 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-ed8030c8-a067-4919-b372-18bd0dbc0d05 tempest-ProjectReaderTests-1983688842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:31:35 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-ed8030c8-a067-4919-b372-18bd0dbc0d05 tempest-ProjectReaderTests-1983688842 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:31:35 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-ed8030c8-a067-4919-b372-18bd0dbc0d05 tempest-ProjectReaderTests-1983688842 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:31:35 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-ed8030c8-a067-4919-b372-18bd0dbc0d05 tempest-ProjectReaderTests-1983688842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:31:35 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-ed8030c8-a067-4919-b372-18bd0dbc0d05 tempest-ProjectReaderTests-1983688842 None] Selected osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 as target Quobyte volume. {{(pid=88695) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 06:31:35 devstack cinder-volume[88695]: INFO cinder.volume.drivers.remotefs [None req-ed8030c8-a067-4919-b372-18bd0dbc0d05 tempest-ProjectReaderTests-1983688842 None] casted to osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 Aug 05 06:31:35 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-ed8030c8-a067-4919-b372-18bd0dbc0d05 tempest-ProjectReaderTests-1983688842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-59b947ea-9f34-4cd2-bab2-ec78c62b3731 1073741824 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:31:35 devstack sudo[109041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-59b947ea-9f34-4cd2-bab2-ec78c62b3731 1073741824 Aug 05 06:31:35 devstack sudo[109041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:31:35 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-612d3bcb-05a0-4e0d-bf00-154ce9dfc692 tempest-ProjectMemberTests-475949430 None] Create snapshot completed successfully Aug 05 06:31:36 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-fbc1f104-8ecd-4049-a8b0-56cae327b45b tempest-ProjectMemberTests-475949430 None] Acquiring lock "cinder-9cd735b0-1b2b-45e0-98d4-acb0494071f1-delete_snapshot" by "delete_snapshot" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:31:36 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-fbc1f104-8ecd-4049-a8b0-56cae327b45b tempest-ProjectMemberTests-475949430 None] Lock "cinder-9cd735b0-1b2b-45e0-98d4-acb0494071f1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:31:36 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-fbc1f104-8ecd-4049-a8b0-56cae327b45b tempest-ProjectMemberTests-475949430 None] Acquiring lock "cinder-quobyte-7fe7afe0-1942-4b91-87cf-817a659b515a" by "delete_snapshot" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:31:36 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-fbc1f104-8ecd-4049-a8b0-56cae327b45b tempest-ProjectMemberTests-475949430 None] Lock "cinder-quobyte-7fe7afe0-1942-4b91-87cf-817a659b515a" acquired by "delete_snapshot" :: waited 0.015s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:31:36 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-fbc1f104-8ecd-4049-a8b0-56cae327b45b tempest-ProjectMemberTests-475949430 None] Acquiring lock "cinder-quobyte-9cd735b0-1b2b-45e0-98d4-acb0494071f1" by "_delete_snapshot" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:31:36 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-fbc1f104-8ecd-4049-a8b0-56cae327b45b tempest-ProjectMemberTests-475949430 None] Lock "cinder-quobyte-9cd735b0-1b2b-45e0-98d4-acb0494071f1" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:31:36 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-fbc1f104-8ecd-4049-a8b0-56cae327b45b tempest-ProjectMemberTests-475949430 None] Deleting offline snapshot 9cd735b0-1b2b-45e0-98d4-acb0494071f1 of volume 7fe7afe0-1942-4b91-87cf-817a659b515a {{(pid=88695) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 06:31:36 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-fbc1f104-8ecd-4049-a8b0-56cae327b45b tempest-ProjectMemberTests-475949430 None] snapshot_file for this snap is: volume-7fe7afe0-1942-4b91-87cf-817a659b515a.9cd735b0-1b2b-45e0-98d4-acb0494071f1 {{(pid=88695) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 06:31:36 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[31086766-aec3-4ad1-aee1-8c26772338cf]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:31:36 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-fbc1f104-8ecd-4049-a8b0-56cae327b45b tempest-ProjectMemberTests-475949430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7fe7afe0-1942-4b91-87cf-817a659b515a.9cd735b0-1b2b-45e0-98d4-acb0494071f1 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:31:36 devstack sudo[109046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7fe7afe0-1942-4b91-87cf-817a659b515a.9cd735b0-1b2b-45e0-98d4-acb0494071f1 Aug 05 06:31:36 devstack sudo[109046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:31:36 devstack sudo[109041]: pam_unix(sudo:session): session closed for user root Aug 05 06:31:36 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-ed8030c8-a067-4919-b372-18bd0dbc0d05 tempest-ProjectReaderTests-1983688842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-59b947ea-9f34-4cd2-bab2-ec78c62b3731 1073741824" returned: 0 in 0.537s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:31:36 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-ed8030c8-a067-4919-b372-18bd0dbc0d05 tempest-ProjectReaderTests-1983688842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-59b947ea-9f34-4cd2-bab2-ec78c62b3731 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:31:36 devstack sudo[109049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-59b947ea-9f34-4cd2-bab2-ec78c62b3731 Aug 05 06:31:36 devstack sudo[109049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:31:36 devstack sudo[109046]: pam_unix(sudo:session): session closed for user root Aug 05 06:31:36 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-fbc1f104-8ecd-4049-a8b0-56cae327b45b tempest-ProjectMemberTests-475949430 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7fe7afe0-1942-4b91-87cf-817a659b515a.9cd735b0-1b2b-45e0-98d4-acb0494071f1" returned: 0 in 0.446s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:31:36 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-fbc1f104-8ecd-4049-a8b0-56cae327b45b tempest-ProjectMemberTests-475949430 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7fe7afe0-1942-4b91-87cf-817a659b515a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88695) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 06:31:36 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e34efff-b6c8-491d-acbc-1ccb04a8d77c]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:31:36 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-fbc1f104-8ecd-4049-a8b0-56cae327b45b tempest-ProjectMemberTests-475949430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7fe7afe0-1942-4b91-87cf-817a659b515a {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:31:36 devstack sudo[109049]: pam_unix(sudo:session): session closed for user root Aug 05 06:31:36 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-ed8030c8-a067-4919-b372-18bd0dbc0d05 tempest-ProjectReaderTests-1983688842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-59b947ea-9f34-4cd2-bab2-ec78c62b3731" returned: 0 in 0.329s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:31:36 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-ed8030c8-a067-4919-b372-18bd0dbc0d05 tempest-ProjectReaderTests-1983688842 None] <== create_volume: return (913ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'} {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 06:31:36 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-ed8030c8-a067-4919-b372-18bd0dbc0d05 tempest-ProjectReaderTests-1983688842 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.916s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:31:36 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-f3976597-6029-4a5b-b15a-1f001eae31ed tempest-VolumeDependencyTests-1089559550 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.127s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:31:36 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-f3976597-6029-4a5b-b15a-1f001eae31ed tempest-VolumeDependencyTests-1089559550 None] Creating offline snapshot 043f6927-7f46-43bc-8b8c-c85a9796adc0 of volume 8542f074-6908-4f24-9d40-821e096b7124 {{(pid=88695) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 06:31:36 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-ed8030c8-a067-4919-b372-18bd0dbc0d05 tempest-ProjectReaderTests-1983688842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a479143-699a-428d-8297-4ccbc5124f7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-59b947ea-9f34-4cd2-bab2-ec78c62b3731', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:31:36 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-ed8030c8-a067-4919-b372-18bd0dbc0d05 tempest-ProjectReaderTests-1983688842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01924c59-b38d-48b1-9e9a-03f03ce92d74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:31:36 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a006982-e6e8-4f0e-862f-342d6d401b11]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:31:36 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-f3976597-6029-4a5b-b15a-1f001eae31ed tempest-VolumeDependencyTests-1089559550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8542f074-6908-4f24-9d40-821e096b7124 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:31:36 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-ed8030c8-a067-4919-b372-18bd0dbc0d05 tempest-ProjectReaderTests-1983688842 None] Volume volume-59b947ea-9f34-4cd2-bab2-ec78c62b3731 (59b947ea-9f34-4cd2-bab2-ec78c62b3731): created successfully Aug 05 06:31:36 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-ed8030c8-a067-4919-b372-18bd0dbc0d05 tempest-ProjectReaderTests-1983688842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01924c59-b38d-48b1-9e9a-03f03ce92d74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:31:36 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-ed8030c8-a067-4919-b372-18bd0dbc0d05 tempest-ProjectReaderTests-1983688842 None] Flow 'volume_create_manager' (d3c841df-0ba5-45ff-b399-d5a44bb47d3d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:31:36 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-ed8030c8-a067-4919-b372-18bd0dbc0d05 tempest-ProjectReaderTests-1983688842 None] Created volume successfully. Aug 05 06:31:36 devstack sudo[109055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7fe7afe0-1942-4b91-87cf-817a659b515a Aug 05 06:31:36 devstack sudo[109055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:31:37 devstack sudo[109056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8542f074-6908-4f24-9d40-821e096b7124 Aug 05 06:31:37 devstack sudo[109056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:31:37 devstack sudo[109055]: pam_unix(sudo:session): session closed for user root Aug 05 06:31:37 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-fbc1f104-8ecd-4049-a8b0-56cae327b45b tempest-ProjectMemberTests-475949430 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7fe7afe0-1942-4b91-87cf-817a659b515a" returned: 0 in 0.466s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:31:37 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-fbc1f104-8ecd-4049-a8b0-56cae327b45b tempest-ProjectMemberTests-475949430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7fe7afe0-1942-4b91-87cf-817a659b515a.9cd735b0-1b2b-45e0-98d4-acb0494071f1 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:31:37 devstack sudo[109065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7fe7afe0-1942-4b91-87cf-817a659b515a.9cd735b0-1b2b-45e0-98d4-acb0494071f1 Aug 05 06:31:37 devstack sudo[109065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:31:37 devstack sudo[109056]: pam_unix(sudo:session): session closed for user root Aug 05 06:31:37 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-f3976597-6029-4a5b-b15a-1f001eae31ed tempest-VolumeDependencyTests-1089559550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8542f074-6908-4f24-9d40-821e096b7124" returned: 0 in 0.480s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:31:37 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-f3976597-6029-4a5b-b15a-1f001eae31ed tempest-VolumeDependencyTests-1089559550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8542f074-6908-4f24-9d40-821e096b7124,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8542f074-6908-4f24-9d40-821e096b7124.043f6927-7f46-43bc-8b8c-c85a9796adc0 1G {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:31:37 devstack sudo[109067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8542f074-6908-4f24-9d40-821e096b7124,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8542f074-6908-4f24-9d40-821e096b7124.043f6927-7f46-43bc-8b8c-c85a9796adc0 1G Aug 05 06:31:37 devstack sudo[109067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:31:37 devstack sudo[109065]: pam_unix(sudo:session): session closed for user root Aug 05 06:31:37 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-fbc1f104-8ecd-4049-a8b0-56cae327b45b tempest-ProjectMemberTests-475949430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7fe7afe0-1942-4b91-87cf-817a659b515a.9cd735b0-1b2b-45e0-98d4-acb0494071f1" returned: 0 in 0.407s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:31:37 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-fbc1f104-8ecd-4049-a8b0-56cae327b45b tempest-ProjectMemberTests-475949430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7fe7afe0-1942-4b91-87cf-817a659b515a.9cd735b0-1b2b-45e0-98d4-acb0494071f1 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:31:37 devstack sudo[109076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7fe7afe0-1942-4b91-87cf-817a659b515a.9cd735b0-1b2b-45e0-98d4-acb0494071f1 Aug 05 06:31:37 devstack sudo[109076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:31:37 devstack sudo[109067]: pam_unix(sudo:session): session closed for user root Aug 05 06:31:37 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-f3976597-6029-4a5b-b15a-1f001eae31ed tempest-VolumeDependencyTests-1089559550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8542f074-6908-4f24-9d40-821e096b7124,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8542f074-6908-4f24-9d40-821e096b7124.043f6927-7f46-43bc-8b8c-c85a9796adc0 1G" returned: 0 in 0.551s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:31:37 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-f3976597-6029-4a5b-b15a-1f001eae31ed tempest-VolumeDependencyTests-1089559550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8542f074-6908-4f24-9d40-821e096b7124 -F qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8542f074-6908-4f24-9d40-821e096b7124.043f6927-7f46-43bc-8b8c-c85a9796adc0 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:31:37 devstack sudo[109079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8542f074-6908-4f24-9d40-821e096b7124 -F qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8542f074-6908-4f24-9d40-821e096b7124.043f6927-7f46-43bc-8b8c-c85a9796adc0 Aug 05 06:31:37 devstack sudo[109079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:31:37 devstack sudo[109076]: pam_unix(sudo:session): session closed for user root Aug 05 06:31:38 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-fbc1f104-8ecd-4049-a8b0-56cae327b45b tempest-ProjectMemberTests-475949430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7fe7afe0-1942-4b91-87cf-817a659b515a.9cd735b0-1b2b-45e0-98d4-acb0494071f1" returned: 0 in 0.342s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:31:38 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-fbc1f104-8ecd-4049-a8b0-56cae327b45b tempest-ProjectMemberTests-475949430 None] Lock "cinder-quobyte-9cd735b0-1b2b-45e0-98d4-acb0494071f1" released by "_delete_snapshot" :: held 1.827s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:31:38 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-deb3c7cf-a52c-4621-85b5-f4239aa22ffe tempest-ProjectReaderTests-1983688842 None] Acquiring lock "cinder-59b947ea-9f34-4cd2-bab2-ec78c62b3731-delete_volume" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:31:38 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-fbc1f104-8ecd-4049-a8b0-56cae327b45b tempest-ProjectMemberTests-475949430 None] Lock "cinder-quobyte-7fe7afe0-1942-4b91-87cf-817a659b515a" released by "delete_snapshot" :: held 1.859s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:31:38 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-deb3c7cf-a52c-4621-85b5-f4239aa22ffe tempest-ProjectReaderTests-1983688842 None] Lock "cinder-59b947ea-9f34-4cd2-bab2-ec78c62b3731-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:31:38 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-deb3c7cf-a52c-4621-85b5-f4239aa22ffe tempest-ProjectReaderTests-1983688842 None] Acquiring lock "cinder-quobyte-59b947ea-9f34-4cd2-bab2-ec78c62b3731" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:31:38 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-deb3c7cf-a52c-4621-85b5-f4239aa22ffe tempest-ProjectReaderTests-1983688842 None] Lock "cinder-quobyte-59b947ea-9f34-4cd2-bab2-ec78c62b3731" acquired by "delete_volume" :: waited 0.026s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:31:38 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-fbc1f104-8ecd-4049-a8b0-56cae327b45b tempest-ProjectMemberTests-475949430 None] Created reservations ['b20a601d-97f5-4c5e-8d28-3c32404a9926', 'c6b93b4c-7e50-4a50-8c82-2df0c54ce79c', 'a92f7c6e-f6dc-4f62-9b9c-959f706b76b2', '950cdeef-7094-4ae8-acb8-60f0ed1ab9f1'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:31:38 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba84ef62-8cd9-4029-b2fd-61b9f751580a]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:31:38 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-deb3c7cf-a52c-4621-85b5-f4239aa22ffe tempest-ProjectReaderTests-1983688842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-59b947ea-9f34-4cd2-bab2-ec78c62b3731 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:31:38 devstack cinder-volume[88695]: DEBUG dbcounter [-] [88695] Writing DB stats cinder:SELECT=247,cinder:UPDATE=283,cinder:DELETE=34,cinder:INSERT=73 {{(pid=88695) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 06:31:38 devstack sudo[109079]: pam_unix(sudo:session): session closed for user root Aug 05 06:31:38 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-f3976597-6029-4a5b-b15a-1f001eae31ed tempest-VolumeDependencyTests-1089559550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8542f074-6908-4f24-9d40-821e096b7124 -F qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8542f074-6908-4f24-9d40-821e096b7124.043f6927-7f46-43bc-8b8c-c85a9796adc0" returned: 0 in 0.381s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:31:38 devstack cinder-volume[88695]: WARNING cinder.volume.drivers.remotefs [None req-f3976597-6029-4a5b-b15a-1f001eae31ed tempest-VolumeDependencyTests-1089559550 None] /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8542f074-6908-4f24-9d40-821e096b7124.043f6927-7f46-43bc-8b8c-c85a9796adc0 is being set with open permissions: ugo+rw Aug 05 06:31:38 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-f3976597-6029-4a5b-b15a-1f001eae31ed tempest-VolumeDependencyTests-1089559550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8542f074-6908-4f24-9d40-821e096b7124.043f6927-7f46-43bc-8b8c-c85a9796adc0 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:31:38 devstack sudo[109086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8542f074-6908-4f24-9d40-821e096b7124.043f6927-7f46-43bc-8b8c-c85a9796adc0 Aug 05 06:31:38 devstack sudo[109086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:31:38 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-fbc1f104-8ecd-4049-a8b0-56cae327b45b tempest-ProjectMemberTests-475949430 None] Delete snapshot completed successfully. Aug 05 06:31:38 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-fbc1f104-8ecd-4049-a8b0-56cae327b45b tempest-ProjectMemberTests-475949430 None] Lock "cinder-9cd735b0-1b2b-45e0-98d4-acb0494071f1-delete_snapshot" released by "delete_snapshot" :: held 2.171s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:31:38 devstack sudo[109085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-59b947ea-9f34-4cd2-bab2-ec78c62b3731 Aug 05 06:31:38 devstack sudo[109085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:31:38 devstack sudo[109086]: pam_unix(sudo:session): session closed for user root Aug 05 06:31:38 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-f3976597-6029-4a5b-b15a-1f001eae31ed tempest-VolumeDependencyTests-1089559550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8542f074-6908-4f24-9d40-821e096b7124.043f6927-7f46-43bc-8b8c-c85a9796adc0" returned: 0 in 0.346s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:31:38 devstack cinder-volume[88695]: DEBUG dbcounter [-] [88695] Writing DB stats cinder:UPDATE=327,cinder:SELECT=199,cinder:INSERT=89,cinder:DELETE=21 {{(pid=88695) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 06:31:38 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-f3976597-6029-4a5b-b15a-1f001eae31ed tempest-VolumeDependencyTests-1089559550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8542f074-6908-4f24-9d40-821e096b7124.info {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:31:38 devstack sudo[109093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8542f074-6908-4f24-9d40-821e096b7124.info Aug 05 06:31:38 devstack sudo[109093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:31:38 devstack sudo[109085]: pam_unix(sudo:session): session closed for user root Aug 05 06:31:38 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-deb3c7cf-a52c-4621-85b5-f4239aa22ffe tempest-ProjectReaderTests-1983688842 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-59b947ea-9f34-4cd2-bab2-ec78c62b3731" returned: 0 in 0.521s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:31:38 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-deb3c7cf-a52c-4621-85b5-f4239aa22ffe tempest-ProjectReaderTests-1983688842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-59b947ea-9f34-4cd2-bab2-ec78c62b3731 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:31:38 devstack sudo[109097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-59b947ea-9f34-4cd2-bab2-ec78c62b3731 Aug 05 06:31:38 devstack sudo[109097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:31:38 devstack sudo[109093]: pam_unix(sudo:session): session closed for user root Aug 05 06:31:38 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-f3976597-6029-4a5b-b15a-1f001eae31ed tempest-VolumeDependencyTests-1089559550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8542f074-6908-4f24-9d40-821e096b7124.info" returned: 0 in 0.300s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:31:38 devstack cinder-volume[88695]: WARNING cinder.volume.drivers.remotefs [None req-f3976597-6029-4a5b-b15a-1f001eae31ed tempest-VolumeDependencyTests-1089559550 None] /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8542f074-6908-4f24-9d40-821e096b7124.info is being set with open permissions: ugo+rw Aug 05 06:31:38 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-f3976597-6029-4a5b-b15a-1f001eae31ed tempest-VolumeDependencyTests-1089559550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8542f074-6908-4f24-9d40-821e096b7124.info {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:31:39 devstack sudo[109100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8542f074-6908-4f24-9d40-821e096b7124.info Aug 05 06:31:39 devstack sudo[109100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:31:39 devstack sudo[109097]: pam_unix(sudo:session): session closed for user root Aug 05 06:31:39 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-deb3c7cf-a52c-4621-85b5-f4239aa22ffe tempest-ProjectReaderTests-1983688842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-59b947ea-9f34-4cd2-bab2-ec78c62b3731" returned: 0 in 0.283s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:31:39 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-deb3c7cf-a52c-4621-85b5-f4239aa22ffe tempest-ProjectReaderTests-1983688842 None] Lock "cinder-quobyte-59b947ea-9f34-4cd2-bab2-ec78c62b3731" released by "delete_volume" :: held 0.857s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:31:39 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-deb3c7cf-a52c-4621-85b5-f4239aa22ffe tempest-ProjectReaderTests-1983688842 None] Created reservations ['fc510bd1-8daf-4c95-99c5-7cbb41ef2c0c', 'f64771ff-1eb8-4c6f-89ac-3284c883c00a', 'f6dd96a9-cf22-447c-819f-23379813fb30', '9f45186a-9be7-4980-9d10-67da3d741e0f'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:31:39 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-deb3c7cf-a52c-4621-85b5-f4239aa22ffe tempest-ProjectReaderTests-1983688842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:31:39 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-deb3c7cf-a52c-4621-85b5-f4239aa22ffe tempest-ProjectReaderTests-1983688842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:31:39 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-deb3c7cf-a52c-4621-85b5-f4239aa22ffe tempest-ProjectReaderTests-1983688842 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:31:39 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-deb3c7cf-a52c-4621-85b5-f4239aa22ffe tempest-ProjectReaderTests-1983688842 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:31:39 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-deb3c7cf-a52c-4621-85b5-f4239aa22ffe tempest-ProjectReaderTests-1983688842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:31:39 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-deb3c7cf-a52c-4621-85b5-f4239aa22ffe tempest-ProjectReaderTests-1983688842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:31:39 devstack sudo[109103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce Aug 05 06:31:39 devstack sudo[109103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:31:39 devstack sudo[109100]: pam_unix(sudo:session): session closed for user root Aug 05 06:31:39 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-f3976597-6029-4a5b-b15a-1f001eae31ed tempest-VolumeDependencyTests-1089559550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8542f074-6908-4f24-9d40-821e096b7124.info" returned: 0 in 0.312s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:31:39 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-f3976597-6029-4a5b-b15a-1f001eae31ed tempest-VolumeDependencyTests-1089559550 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.528s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:31:39 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-f3976597-6029-4a5b-b15a-1f001eae31ed tempest-VolumeDependencyTests-1089559550 None] Create snapshot completed successfully Aug 05 06:31:39 devstack sudo[109103]: pam_unix(sudo:session): session closed for user root Aug 05 06:31:39 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-deb3c7cf-a52c-4621-85b5-f4239aa22ffe tempest-ProjectReaderTests-1983688842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce" returned: 0 in 0.339s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:31:39 devstack cinder-volume[88695]: DEBUG cinder.manager [None req-deb3c7cf-a52c-4621-85b5-f4239aa22ffe tempest-ProjectReaderTests-1983688842 None] Notifying Schedulers of capabilities ... {{(pid=88695) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 06:31:39 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-deb3c7cf-a52c-4621-85b5-f4239aa22ffe tempest-ProjectReaderTests-1983688842 None] Deleted volume successfully. Aug 05 06:31:39 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-deb3c7cf-a52c-4621-85b5-f4239aa22ffe tempest-ProjectReaderTests-1983688842 None] Lock "cinder-59b947ea-9f34-4cd2-bab2-ec78c62b3731-delete_volume" released by "delete_volume" :: held 1.486s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:31:39 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-d51b22e1-0d75-4466-9f1a-3643b9f6dc27 tempest-ProjectMemberTests-475949430 None] Acquiring lock "cinder-7fe7afe0-1942-4b91-87cf-817a659b515a-delete_volume" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:31:39 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-d51b22e1-0d75-4466-9f1a-3643b9f6dc27 tempest-ProjectMemberTests-475949430 None] Lock "cinder-7fe7afe0-1942-4b91-87cf-817a659b515a-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:31:39 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-d51b22e1-0d75-4466-9f1a-3643b9f6dc27 tempest-ProjectMemberTests-475949430 None] Acquiring lock "cinder-quobyte-7fe7afe0-1942-4b91-87cf-817a659b515a" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:31:39 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-d51b22e1-0d75-4466-9f1a-3643b9f6dc27 tempest-ProjectMemberTests-475949430 None] Lock "cinder-quobyte-7fe7afe0-1942-4b91-87cf-817a659b515a" acquired by "delete_volume" :: waited 0.026s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:31:39 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[e00fb59a-1161-435d-9e37-0d84446969ad]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:31:39 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-d51b22e1-0d75-4466-9f1a-3643b9f6dc27 tempest-ProjectMemberTests-475949430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7fe7afe0-1942-4b91-87cf-817a659b515a {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:31:39 devstack cinder-volume[88695]: DEBUG cinder.volume.flows.manager.create_volume [None req-8542b5c1-1a04-4918-b042-dbd627d0187a tempest-ProjectReaderTests-1983688842 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88695) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 06:31:39 devstack sudo[109107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7fe7afe0-1942-4b91-87cf-817a659b515a Aug 05 06:31:39 devstack sudo[109107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:31:40 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-8542b5c1-1a04-4918-b042-dbd627d0187a tempest-ProjectReaderTests-1983688842 None] Flow 'volume_create_manager' (7a415509-164c-4ac8-a0eb-24c33b10b2ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:31:40 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-8542b5c1-1a04-4918-b042-dbd627d0187a tempest-ProjectReaderTests-1983688842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea4f0c09-23fe-4c70-ad15-eb54d887c939) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:31:40 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-8542b5c1-1a04-4918-b042-dbd627d0187a tempest-ProjectReaderTests-1983688842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea4f0c09-23fe-4c70-ad15-eb54d887c939) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:31:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1473913126',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39d80081-b0e7-4587-8659-1ef2171d3037,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7b53be6a57a458f9adb84f514f8d4da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:31:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:31:40Z,use_quota=True,user_id='9099d583e3aa47ef81997420b42f60f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:31:40 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-8542b5c1-1a04-4918-b042-dbd627d0187a tempest-ProjectReaderTests-1983688842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (921da0c0-01c1-4ae1-b127-c56aafd91a00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:31:40 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-8542b5c1-1a04-4918-b042-dbd627d0187a tempest-ProjectReaderTests-1983688842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (921da0c0-01c1-4ae1-b127-c56aafd91a00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:31:40 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-8542b5c1-1a04-4918-b042-dbd627d0187a tempest-ProjectReaderTests-1983688842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73db8669-1ed8-4c7e-9f87-a8bb589a07b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:31:40 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-8542b5c1-1a04-4918-b042-dbd627d0187a tempest-ProjectReaderTests-1983688842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73db8669-1ed8-4c7e-9f87-a8bb589a07b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '39d80081-b0e7-4587-8659-1ef2171d3037', 'volume_name': 'volume-39d80081-b0e7-4587-8659-1ef2171d3037', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:31:40 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-8542b5c1-1a04-4918-b042-dbd627d0187a tempest-ProjectReaderTests-1983688842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25ccdf20-f24f-45b3-be84-77df7859b4f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:31:40 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-8542b5c1-1a04-4918-b042-dbd627d0187a tempest-ProjectReaderTests-1983688842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25ccdf20-f24f-45b3-be84-77df7859b4f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:31:40 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-8542b5c1-1a04-4918-b042-dbd627d0187a tempest-ProjectReaderTests-1983688842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a506a2f1-0bba-426d-b3a1-3515baf1cdc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:31:40 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-8542b5c1-1a04-4918-b042-dbd627d0187a tempest-ProjectReaderTests-1983688842 None] Volume 39d80081-b0e7-4587-8659-1ef2171d3037: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-39d80081-b0e7-4587-8659-1ef2171d3037', 'volume_size': 1} Aug 05 06:31:40 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-8542b5c1-1a04-4918-b042-dbd627d0187a tempest-ProjectReaderTests-1983688842 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:31:40 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-8542b5c1-1a04-4918-b042-dbd627d0187a tempest-ProjectReaderTests-1983688842 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:31:40 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-8542b5c1-1a04-4918-b042-dbd627d0187a tempest-ProjectReaderTests-1983688842 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:31:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1473913126',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39d80081-b0e7-4587-8659-1ef2171d3037,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7b53be6a57a458f9adb84f514f8d4da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:31:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:31:40Z,use_quota=True,user_id='9099d583e3aa47ef81997420b42f60f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)}" {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 06:31:40 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-8542b5c1-1a04-4918-b042-dbd627d0187a tempest-ProjectReaderTests-1983688842 None] Creating volume 39d80081-b0e7-4587-8659-1ef2171d3037 {{(pid=88695) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 06:31:40 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-8542b5c1-1a04-4918-b042-dbd627d0187a tempest-ProjectReaderTests-1983688842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:31:40 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-8542b5c1-1a04-4918-b042-dbd627d0187a tempest-ProjectReaderTests-1983688842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:31:40 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-8542b5c1-1a04-4918-b042-dbd627d0187a tempest-ProjectReaderTests-1983688842 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:31:40 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-8542b5c1-1a04-4918-b042-dbd627d0187a tempest-ProjectReaderTests-1983688842 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:31:40 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-8542b5c1-1a04-4918-b042-dbd627d0187a tempest-ProjectReaderTests-1983688842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:31:40 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-8542b5c1-1a04-4918-b042-dbd627d0187a tempest-ProjectReaderTests-1983688842 None] Selected osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 as target Quobyte volume. {{(pid=88695) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 06:31:40 devstack cinder-volume[88695]: INFO cinder.volume.drivers.remotefs [None req-8542b5c1-1a04-4918-b042-dbd627d0187a tempest-ProjectReaderTests-1983688842 None] casted to osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 Aug 05 06:31:40 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-8542b5c1-1a04-4918-b042-dbd627d0187a tempest-ProjectReaderTests-1983688842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-39d80081-b0e7-4587-8659-1ef2171d3037 1073741824 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:31:40 devstack sudo[109109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-39d80081-b0e7-4587-8659-1ef2171d3037 1073741824 Aug 05 06:31:40 devstack sudo[109109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:31:40 devstack sudo[109107]: pam_unix(sudo:session): session closed for user root Aug 05 06:31:40 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-d51b22e1-0d75-4466-9f1a-3643b9f6dc27 tempest-ProjectMemberTests-475949430 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7fe7afe0-1942-4b91-87cf-817a659b515a" returned: 0 in 0.615s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:31:40 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-d51b22e1-0d75-4466-9f1a-3643b9f6dc27 tempest-ProjectMemberTests-475949430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7fe7afe0-1942-4b91-87cf-817a659b515a {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:31:40 devstack sudo[109115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7fe7afe0-1942-4b91-87cf-817a659b515a Aug 05 06:31:40 devstack sudo[109115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:31:40 devstack cinder-volume[88695]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2bdc31b-d071-40e6-b1aa-d622dc3578f7 tempest-VolumeDependencyTests-1089559550 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88695) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 06:31:40 devstack sudo[109115]: pam_unix(sudo:session): session closed for user root Aug 05 06:31:40 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-c2bdc31b-d071-40e6-b1aa-d622dc3578f7 tempest-VolumeDependencyTests-1089559550 None] Flow 'volume_create_manager' (843c2d17-96bd-4809-bcf5-01edb9323639) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:31:40 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-c2bdc31b-d071-40e6-b1aa-d622dc3578f7 tempest-VolumeDependencyTests-1089559550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (421b08f3-c344-40b4-be12-d300a85e101c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:31:40 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-d51b22e1-0d75-4466-9f1a-3643b9f6dc27 tempest-ProjectMemberTests-475949430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-7fe7afe0-1942-4b91-87cf-817a659b515a" returned: 0 in 0.331s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:31:40 devstack sudo[109109]: pam_unix(sudo:session): session closed for user root Aug 05 06:31:40 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-8542b5c1-1a04-4918-b042-dbd627d0187a tempest-ProjectReaderTests-1983688842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-39d80081-b0e7-4587-8659-1ef2171d3037 1073741824" returned: 0 in 0.703s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:31:40 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-d51b22e1-0d75-4466-9f1a-3643b9f6dc27 tempest-ProjectMemberTests-475949430 None] Lock "cinder-quobyte-7fe7afe0-1942-4b91-87cf-817a659b515a" released by "delete_volume" :: held 1.041s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:31:40 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-c2bdc31b-d071-40e6-b1aa-d622dc3578f7 tempest-VolumeDependencyTests-1089559550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (421b08f3-c344-40b4-be12-d300a85e101c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:31:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2048073051',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9cd5b75-19a2-4927-a4cc-ae393b8d124b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ac35009f4a54de8b6a29f67c3a608cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:31:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=043f6927-7f46-43bc-8b8c-c85a9796adc0,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:31:41Z,use_quota=True,user_id='c1b8d80c6a1a4c2ca1cc145c74959a64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:31:40 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-c2bdc31b-d071-40e6-b1aa-d622dc3578f7 tempest-VolumeDependencyTests-1089559550 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39d37cf7-ea51-46a5-95d4-7ea0ab1211bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:31:40 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-c2bdc31b-d071-40e6-b1aa-d622dc3578f7 tempest-VolumeDependencyTests-1089559550 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39d37cf7-ea51-46a5-95d4-7ea0ab1211bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:31:40 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-c2bdc31b-d071-40e6-b1aa-d622dc3578f7 tempest-VolumeDependencyTests-1089559550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2bfa36d-721e-423f-8998-d267ff122788) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:31:40 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-c2bdc31b-d071-40e6-b1aa-d622dc3578f7 tempest-VolumeDependencyTests-1089559550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2bfa36d-721e-423f-8998-d267ff122788) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'b9cd5b75-19a2-4927-a4cc-ae393b8d124b', 'volume_name': 'volume-b9cd5b75-19a2-4927-a4cc-ae393b8d124b', 'volume_size': 1, 'snapshot_id': '043f6927-7f46-43bc-8b8c-c85a9796adc0'}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:31:40 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-c2bdc31b-d071-40e6-b1aa-d622dc3578f7 tempest-VolumeDependencyTests-1089559550 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a57294f6-4c87-4a93-89bf-1974dd69b2bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:31:40 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-c2bdc31b-d071-40e6-b1aa-d622dc3578f7 tempest-VolumeDependencyTests-1089559550 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a57294f6-4c87-4a93-89bf-1974dd69b2bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:31:40 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-c2bdc31b-d071-40e6-b1aa-d622dc3578f7 tempest-VolumeDependencyTests-1089559550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5a86f47-e090-490e-b7ca-dc5522ab858e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:31:40 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-c2bdc31b-d071-40e6-b1aa-d622dc3578f7 tempest-VolumeDependencyTests-1089559550 None] Volume b9cd5b75-19a2-4927-a4cc-ae393b8d124b: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-b9cd5b75-19a2-4927-a4cc-ae393b8d124b', 'volume_size': 1, 'snapshot_id': '043f6927-7f46-43bc-8b8c-c85a9796adc0'} Aug 05 06:31:40 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-c2bdc31b-d071-40e6-b1aa-d622dc3578f7 tempest-VolumeDependencyTests-1089559550 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:31:40 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-8542b5c1-1a04-4918-b042-dbd627d0187a tempest-ProjectReaderTests-1983688842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-39d80081-b0e7-4587-8659-1ef2171d3037 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:31:40 devstack sudo[109124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-39d80081-b0e7-4587-8659-1ef2171d3037 Aug 05 06:31:40 devstack sudo[109124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:31:40 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-d51b22e1-0d75-4466-9f1a-3643b9f6dc27 tempest-ProjectMemberTests-475949430 None] Created reservations ['f3b75ec0-b904-4e35-890c-8d51e2c54dfe', 'c056f817-7d6a-4f16-8930-3fec09269369', '932e769e-f67a-4fbc-9a24-7aed63470b20', '8854b9b5-f4a2-44ff-a80a-1d723118448c'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:31:40 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-d51b22e1-0d75-4466-9f1a-3643b9f6dc27 tempest-ProjectMemberTests-475949430 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:31:40 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-d51b22e1-0d75-4466-9f1a-3643b9f6dc27 tempest-ProjectMemberTests-475949430 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:31:40 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-d51b22e1-0d75-4466-9f1a-3643b9f6dc27 tempest-ProjectMemberTests-475949430 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:31:41 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-d51b22e1-0d75-4466-9f1a-3643b9f6dc27 tempest-ProjectMemberTests-475949430 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:31:41 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-d51b22e1-0d75-4466-9f1a-3643b9f6dc27 tempest-ProjectMemberTests-475949430 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:31:41 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-d51b22e1-0d75-4466-9f1a-3643b9f6dc27 tempest-ProjectMemberTests-475949430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:31:41 devstack sudo[109126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce Aug 05 06:31:41 devstack sudo[109126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:31:41 devstack sudo[109124]: pam_unix(sudo:session): session closed for user root Aug 05 06:31:41 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-8542b5c1-1a04-4918-b042-dbd627d0187a tempest-ProjectReaderTests-1983688842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-39d80081-b0e7-4587-8659-1ef2171d3037" returned: 0 in 0.268s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:31:41 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-8542b5c1-1a04-4918-b042-dbd627d0187a tempest-ProjectReaderTests-1983688842 None] <== create_volume: return (1073ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'} {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 06:31:41 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-8542b5c1-1a04-4918-b042-dbd627d0187a tempest-ProjectReaderTests-1983688842 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.075s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:31:41 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-c2bdc31b-d071-40e6-b1aa-d622dc3578f7 tempest-VolumeDependencyTests-1089559550 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.300s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:31:41 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-c2bdc31b-d071-40e6-b1aa-d622dc3578f7 tempest-VolumeDependencyTests-1089559550 None] Acquiring lock "cinder-quobyte-043f6927-7f46-43bc-8b8c-c85a9796adc0-b9cd5b75-19a2-4927-a4cc-ae393b8d124b" by "_create_volume_from_snapshot" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:31:41 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-8542b5c1-1a04-4918-b042-dbd627d0187a tempest-ProjectReaderTests-1983688842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a506a2f1-0bba-426d-b3a1-3515baf1cdc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-39d80081-b0e7-4587-8659-1ef2171d3037', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:31:41 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-8542b5c1-1a04-4918-b042-dbd627d0187a tempest-ProjectReaderTests-1983688842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83464ab6-dd5b-4872-8222-38686ce8f209) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:31:41 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-c2bdc31b-d071-40e6-b1aa-d622dc3578f7 tempest-VolumeDependencyTests-1089559550 None] Lock "cinder-quobyte-043f6927-7f46-43bc-8b8c-c85a9796adc0-b9cd5b75-19a2-4927-a4cc-ae393b8d124b" acquired by "_create_volume_from_snapshot" :: waited 0.035s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:31:41 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-c2bdc31b-d071-40e6-b1aa-d622dc3578f7 tempest-VolumeDependencyTests-1089559550 None] Creating volume b9cd5b75-19a2-4927-a4cc-ae393b8d124b from snapshot 043f6927-7f46-43bc-8b8c-c85a9796adc0 {{(pid=88695) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 05 06:31:41 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-c2bdc31b-d071-40e6-b1aa-d622dc3578f7 tempest-VolumeDependencyTests-1089559550 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:31:41 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-c2bdc31b-d071-40e6-b1aa-d622dc3578f7 tempest-VolumeDependencyTests-1089559550 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:31:41 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-c2bdc31b-d071-40e6-b1aa-d622dc3578f7 tempest-VolumeDependencyTests-1089559550 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:31:41 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-c2bdc31b-d071-40e6-b1aa-d622dc3578f7 tempest-VolumeDependencyTests-1089559550 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:31:41 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-c2bdc31b-d071-40e6-b1aa-d622dc3578f7 tempest-VolumeDependencyTests-1089559550 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:31:41 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-c2bdc31b-d071-40e6-b1aa-d622dc3578f7 tempest-VolumeDependencyTests-1089559550 None] Selected osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 as target Quobyte volume. {{(pid=88695) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 06:31:41 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-c2bdc31b-d071-40e6-b1aa-d622dc3578f7 tempest-VolumeDependencyTests-1089559550 None] Acquiring lock "cinder-quobyte-b9cd5b75-19a2-4927-a4cc-ae393b8d124b" by "_copy_volume_from_snapshot" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:31:41 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-8542b5c1-1a04-4918-b042-dbd627d0187a tempest-ProjectReaderTests-1983688842 None] Volume volume-39d80081-b0e7-4587-8659-1ef2171d3037 (39d80081-b0e7-4587-8659-1ef2171d3037): created successfully Aug 05 06:31:41 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-8542b5c1-1a04-4918-b042-dbd627d0187a tempest-ProjectReaderTests-1983688842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83464ab6-dd5b-4872-8222-38686ce8f209) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:31:41 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-8542b5c1-1a04-4918-b042-dbd627d0187a tempest-ProjectReaderTests-1983688842 None] Flow 'volume_create_manager' (7a415509-164c-4ac8-a0eb-24c33b10b2ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:31:41 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-c2bdc31b-d071-40e6-b1aa-d622dc3578f7 tempest-VolumeDependencyTests-1089559550 None] Lock "cinder-quobyte-b9cd5b75-19a2-4927-a4cc-ae393b8d124b" acquired by "_copy_volume_from_snapshot" :: waited 0.035s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:31:41 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-c2bdc31b-d071-40e6-b1aa-d622dc3578f7 tempest-VolumeDependencyTests-1089559550 None] snapshot: 043f6927-7f46-43bc-8b8c-c85a9796adc0, volume: b9cd5b75-19a2-4927-a4cc-ae393b8d124b, {{(pid=88695) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 05 06:31:41 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-8542b5c1-1a04-4918-b042-dbd627d0187a tempest-ProjectReaderTests-1983688842 None] Created volume successfully. Aug 05 06:31:41 devstack sudo[109126]: pam_unix(sudo:session): session closed for user root Aug 05 06:31:41 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-c2bdc31b-d071-40e6-b1aa-d622dc3578f7 tempest-VolumeDependencyTests-1089559550 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:31:41 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-c2bdc31b-d071-40e6-b1aa-d622dc3578f7 tempest-VolumeDependencyTests-1089559550 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:31:41 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-c2bdc31b-d071-40e6-b1aa-d622dc3578f7 tempest-VolumeDependencyTests-1089559550 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:31:41 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-c2bdc31b-d071-40e6-b1aa-d622dc3578f7 tempest-VolumeDependencyTests-1089559550 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:31:41 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-c2bdc31b-d071-40e6-b1aa-d622dc3578f7 tempest-VolumeDependencyTests-1089559550 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:31:41 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-d51b22e1-0d75-4466-9f1a-3643b9f6dc27 tempest-ProjectMemberTests-475949430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce" returned: 0 in 0.296s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:31:41 devstack cinder-volume[88695]: DEBUG cinder.manager [None req-d51b22e1-0d75-4466-9f1a-3643b9f6dc27 tempest-ProjectMemberTests-475949430 None] Notifying Schedulers of capabilities ... {{(pid=88695) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 06:31:41 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[196d928d-b14e-40ea-9deb-cf3a928339a6]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:31:41 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-d51b22e1-0d75-4466-9f1a-3643b9f6dc27 tempest-ProjectMemberTests-475949430 None] Deleted volume successfully. Aug 05 06:31:41 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-c2bdc31b-d071-40e6-b1aa-d622dc3578f7 tempest-VolumeDependencyTests-1089559550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8542f074-6908-4f24-9d40-821e096b7124.043f6927-7f46-43bc-8b8c-c85a9796adc0 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:31:41 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-d51b22e1-0d75-4466-9f1a-3643b9f6dc27 tempest-ProjectMemberTests-475949430 None] Lock "cinder-7fe7afe0-1942-4b91-87cf-817a659b515a-delete_volume" released by "delete_volume" :: held 1.680s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:31:41 devstack sudo[109130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8542f074-6908-4f24-9d40-821e096b7124.043f6927-7f46-43bc-8b8c-c85a9796adc0 Aug 05 06:31:41 devstack sudo[109130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:31:41 devstack sudo[109130]: pam_unix(sudo:session): session closed for user root Aug 05 06:31:41 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-c2bdc31b-d071-40e6-b1aa-d622dc3578f7 tempest-VolumeDependencyTests-1089559550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8542f074-6908-4f24-9d40-821e096b7124.043f6927-7f46-43bc-8b8c-c85a9796adc0" returned: 0 in 0.441s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:31:41 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-c2bdc31b-d071-40e6-b1aa-d622dc3578f7 tempest-VolumeDependencyTests-1089559550 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8542f074-6908-4f24-9d40-821e096b7124(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88695) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 06:31:41 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7fa7a45-4a2c-4195-ae25-0569c265ea0a]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:31:41 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-c2bdc31b-d071-40e6-b1aa-d622dc3578f7 tempest-VolumeDependencyTests-1089559550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8542f074-6908-4f24-9d40-821e096b7124 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:31:41 devstack sudo[109135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8542f074-6908-4f24-9d40-821e096b7124 Aug 05 06:31:41 devstack sudo[109135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:31:42 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-8e859f9f-5bd6-420e-9eac-98cb3640db22 tempest-ProjectReaderTests-1983688842 None] Acquiring lock "cinder-39d80081-b0e7-4587-8659-1ef2171d3037-delete_volume" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:31:42 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-8e859f9f-5bd6-420e-9eac-98cb3640db22 tempest-ProjectReaderTests-1983688842 None] Lock "cinder-39d80081-b0e7-4587-8659-1ef2171d3037-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:31:42 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-8e859f9f-5bd6-420e-9eac-98cb3640db22 tempest-ProjectReaderTests-1983688842 None] Acquiring lock "cinder-quobyte-39d80081-b0e7-4587-8659-1ef2171d3037" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:31:42 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-8e859f9f-5bd6-420e-9eac-98cb3640db22 tempest-ProjectReaderTests-1983688842 None] Lock "cinder-quobyte-39d80081-b0e7-4587-8659-1ef2171d3037" acquired by "delete_volume" :: waited 0.016s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:31:42 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbca2372-b43e-4900-b255-97825797a128]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:31:42 devstack sudo[109135]: pam_unix(sudo:session): session closed for user root Aug 05 06:31:42 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-8e859f9f-5bd6-420e-9eac-98cb3640db22 tempest-ProjectReaderTests-1983688842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-39d80081-b0e7-4587-8659-1ef2171d3037 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:31:42 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-c2bdc31b-d071-40e6-b1aa-d622dc3578f7 tempest-VolumeDependencyTests-1089559550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8542f074-6908-4f24-9d40-821e096b7124" returned: 0 in 0.493s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:31:42 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-c2bdc31b-d071-40e6-b1aa-d622dc3578f7 tempest-VolumeDependencyTests-1089559550 None] will copy from snapshot at /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8542f074-6908-4f24-9d40-821e096b7124 {{(pid=88695) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 05 06:31:42 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-c2bdc31b-d071-40e6-b1aa-d622dc3578f7 tempest-VolumeDependencyTests-1089559550 None] Creating direct copy from snapshot {{(pid=88695) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 05 06:31:42 devstack cinder-volume[88695]: DEBUG cinder.utils [None req-c2bdc31b-d071-40e6-b1aa-d622dc3578f7 tempest-VolumeDependencyTests-1089559550 None] Path /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-b9cd5b75-19a2-4927-a4cc-ae393b8d124b not found in is_blk_device check {{(pid=88695) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 05 06:31:42 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-c2bdc31b-d071-40e6-b1aa-d622dc3578f7 tempest-VolumeDependencyTests-1089559550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8542f074-6908-4f24-9d40-821e096b7124 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-b9cd5b75-19a2-4927-a4cc-ae393b8d124b {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:31:42 devstack sudo[109141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8542f074-6908-4f24-9d40-821e096b7124 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-b9cd5b75-19a2-4927-a4cc-ae393b8d124b Aug 05 06:31:42 devstack sudo[109141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:31:42 devstack sudo[109140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-39d80081-b0e7-4587-8659-1ef2171d3037 Aug 05 06:31:42 devstack sudo[109140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:31:42 devstack cinder-volume[88695]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4a09118-c7d9-46ca-996b-22e30cdd63d6 tempest-ProjectMemberTests-475949430 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88695) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 06:31:42 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-a4a09118-c7d9-46ca-996b-22e30cdd63d6 tempest-ProjectMemberTests-475949430 None] Flow 'volume_create_manager' (9113d6b2-78d5-4c27-98ff-ced2fb10c117) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:31:42 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-a4a09118-c7d9-46ca-996b-22e30cdd63d6 tempest-ProjectMemberTests-475949430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f757550-12b9-4e6a-9c4d-12fa45984edb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:31:42 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-a4a09118-c7d9-46ca-996b-22e30cdd63d6 tempest-ProjectMemberTests-475949430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f757550-12b9-4e6a-9c4d-12fa45984edb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:31:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-43681552',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bfe8fa7-7cc1-4e1a-88a8-d24da5d0f8c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe85d705f6434b70a55dac31b79c0714',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:31:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:31:43Z,use_quota=True,user_id='a9de9bccd062450c95c9f7f6cf4317f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:31:42 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-a4a09118-c7d9-46ca-996b-22e30cdd63d6 tempest-ProjectMemberTests-475949430 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55d3b36f-eb93-47cd-a9a5-bc3e811b7b3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:31:42 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-a4a09118-c7d9-46ca-996b-22e30cdd63d6 tempest-ProjectMemberTests-475949430 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55d3b36f-eb93-47cd-a9a5-bc3e811b7b3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:31:42 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-a4a09118-c7d9-46ca-996b-22e30cdd63d6 tempest-ProjectMemberTests-475949430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae4863aa-1fca-43d1-8ebe-f240e236ba03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:31:42 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-a4a09118-c7d9-46ca-996b-22e30cdd63d6 tempest-ProjectMemberTests-475949430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae4863aa-1fca-43d1-8ebe-f240e236ba03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8bfe8fa7-7cc1-4e1a-88a8-d24da5d0f8c0', 'volume_name': 'volume-8bfe8fa7-7cc1-4e1a-88a8-d24da5d0f8c0', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:31:42 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-a4a09118-c7d9-46ca-996b-22e30cdd63d6 tempest-ProjectMemberTests-475949430 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4080aa45-1343-4183-997e-a778181d434f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:31:42 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-a4a09118-c7d9-46ca-996b-22e30cdd63d6 tempest-ProjectMemberTests-475949430 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4080aa45-1343-4183-997e-a778181d434f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:31:42 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-a4a09118-c7d9-46ca-996b-22e30cdd63d6 tempest-ProjectMemberTests-475949430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39603bc1-7923-48db-879c-09b1894d70ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:31:42 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-a4a09118-c7d9-46ca-996b-22e30cdd63d6 tempest-ProjectMemberTests-475949430 None] Volume 8bfe8fa7-7cc1-4e1a-88a8-d24da5d0f8c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8bfe8fa7-7cc1-4e1a-88a8-d24da5d0f8c0', 'volume_size': 1} Aug 05 06:31:42 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-a4a09118-c7d9-46ca-996b-22e30cdd63d6 tempest-ProjectMemberTests-475949430 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:31:42 devstack sudo[109140]: pam_unix(sudo:session): session closed for user root Aug 05 06:31:42 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-8e859f9f-5bd6-420e-9eac-98cb3640db22 tempest-ProjectReaderTests-1983688842 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-39d80081-b0e7-4587-8659-1ef2171d3037" returned: 0 in 0.603s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:31:42 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-8e859f9f-5bd6-420e-9eac-98cb3640db22 tempest-ProjectReaderTests-1983688842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-39d80081-b0e7-4587-8659-1ef2171d3037 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:31:42 devstack sudo[109151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-39d80081-b0e7-4587-8659-1ef2171d3037 Aug 05 06:31:42 devstack sudo[109151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:31:43 devstack sudo[109151]: pam_unix(sudo:session): session closed for user root Aug 05 06:31:43 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-8e859f9f-5bd6-420e-9eac-98cb3640db22 tempest-ProjectReaderTests-1983688842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-39d80081-b0e7-4587-8659-1ef2171d3037" returned: 0 in 0.929s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:31:43 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-8e859f9f-5bd6-420e-9eac-98cb3640db22 tempest-ProjectReaderTests-1983688842 None] Lock "cinder-quobyte-39d80081-b0e7-4587-8659-1ef2171d3037" released by "delete_volume" :: held 1.627s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:31:44 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-8e859f9f-5bd6-420e-9eac-98cb3640db22 tempest-ProjectReaderTests-1983688842 None] Created reservations ['0289e47f-ddb7-4c92-8023-dd5d5efe094a', '9ac7887d-789d-4b80-a673-ea81f60db468', '9c2cc8ee-a6e2-4609-b53a-c6940ac2690d', '24b60d0f-32d4-44f8-ab14-379e3987200f'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:31:44 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-8e859f9f-5bd6-420e-9eac-98cb3640db22 tempest-ProjectReaderTests-1983688842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:31:44 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-8e859f9f-5bd6-420e-9eac-98cb3640db22 tempest-ProjectReaderTests-1983688842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:31:44 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-8e859f9f-5bd6-420e-9eac-98cb3640db22 tempest-ProjectReaderTests-1983688842 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:31:44 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-8e859f9f-5bd6-420e-9eac-98cb3640db22 tempest-ProjectReaderTests-1983688842 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:31:44 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-8e859f9f-5bd6-420e-9eac-98cb3640db22 tempest-ProjectReaderTests-1983688842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:31:44 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-8e859f9f-5bd6-420e-9eac-98cb3640db22 tempest-ProjectReaderTests-1983688842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:31:44 devstack sudo[109195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce Aug 05 06:31:44 devstack sudo[109195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:31:45 devstack sudo[109195]: pam_unix(sudo:session): session closed for user root Aug 05 06:31:45 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-8e859f9f-5bd6-420e-9eac-98cb3640db22 tempest-ProjectReaderTests-1983688842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce" returned: 0 in 1.107s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:31:45 devstack cinder-volume[88695]: DEBUG cinder.manager [None req-8e859f9f-5bd6-420e-9eac-98cb3640db22 tempest-ProjectReaderTests-1983688842 None] Notifying Schedulers of capabilities ... {{(pid=88695) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 06:31:45 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-8e859f9f-5bd6-420e-9eac-98cb3640db22 tempest-ProjectReaderTests-1983688842 None] Deleted volume successfully. Aug 05 06:31:45 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-8e859f9f-5bd6-420e-9eac-98cb3640db22 tempest-ProjectReaderTests-1983688842 None] Lock "cinder-39d80081-b0e7-4587-8659-1ef2171d3037-delete_volume" released by "delete_volume" :: held 3.392s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:31:48 devstack sudo[109141]: pam_unix(sudo:session): session closed for user root Aug 05 06:31:48 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-c2bdc31b-d071-40e6-b1aa-d622dc3578f7 tempest-VolumeDependencyTests-1089559550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8542f074-6908-4f24-9d40-821e096b7124 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-b9cd5b75-19a2-4927-a4cc-ae393b8d124b" returned: 0 in 6.175s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:31:48 devstack cinder-volume[88695]: DEBUG cinder.image.image_utils [None req-c2bdc31b-d071-40e6-b1aa-d622dc3578f7 tempest-VolumeDependencyTests-1089559550 None] Image conversion details: src /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8542f074-6908-4f24-9d40-821e096b7124, size 1024.00 MB, duration 6.18 sec, destination /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-b9cd5b75-19a2-4927-a4cc-ae393b8d124b {{(pid=88695) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 05 06:31:48 devstack cinder-volume[88695]: INFO cinder.image.image_utils [None req-c2bdc31b-d071-40e6-b1aa-d622dc3578f7 tempest-VolumeDependencyTests-1089559550 None] Converted 1024.00 MB image at 165.80 MB/s Aug 05 06:31:48 devstack cinder-volume[88695]: WARNING cinder.volume.drivers.remotefs [None req-c2bdc31b-d071-40e6-b1aa-d622dc3578f7 tempest-VolumeDependencyTests-1089559550 None] /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-b9cd5b75-19a2-4927-a4cc-ae393b8d124b is being set with open permissions: ugo+rw Aug 05 06:31:48 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-c2bdc31b-d071-40e6-b1aa-d622dc3578f7 tempest-VolumeDependencyTests-1089559550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-b9cd5b75-19a2-4927-a4cc-ae393b8d124b {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:31:48 devstack sudo[109201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-b9cd5b75-19a2-4927-a4cc-ae393b8d124b Aug 05 06:31:48 devstack sudo[109201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:31:48 devstack sudo[109201]: pam_unix(sudo:session): session closed for user root Aug 05 06:31:48 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-c2bdc31b-d071-40e6-b1aa-d622dc3578f7 tempest-VolumeDependencyTests-1089559550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-b9cd5b75-19a2-4927-a4cc-ae393b8d124b" returned: 0 in 0.317s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:31:48 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-c2bdc31b-d071-40e6-b1aa-d622dc3578f7 tempest-VolumeDependencyTests-1089559550 None] Lock "cinder-quobyte-b9cd5b75-19a2-4927-a4cc-ae393b8d124b" released by "_copy_volume_from_snapshot" :: held 7.576s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:31:48 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-c2bdc31b-d071-40e6-b1aa-d622dc3578f7 tempest-VolumeDependencyTests-1089559550 None] Lock "cinder-quobyte-043f6927-7f46-43bc-8b8c-c85a9796adc0-b9cd5b75-19a2-4927-a4cc-ae393b8d124b" released by "_create_volume_from_snapshot" :: held 7.668s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:31:48 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-c2bdc31b-d071-40e6-b1aa-d622dc3578f7 tempest-VolumeDependencyTests-1089559550 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.705s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:31:48 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-a4a09118-c7d9-46ca-996b-22e30cdd63d6 tempest-ProjectMemberTests-475949430 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.157s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:31:48 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-a4a09118-c7d9-46ca-996b-22e30cdd63d6 tempest-ProjectMemberTests-475949430 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:31:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-43681552',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bfe8fa7-7cc1-4e1a-88a8-d24da5d0f8c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe85d705f6434b70a55dac31b79c0714',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:31:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:31:43Z,use_quota=True,user_id='a9de9bccd062450c95c9f7f6cf4317f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)}" {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 06:31:48 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-a4a09118-c7d9-46ca-996b-22e30cdd63d6 tempest-ProjectMemberTests-475949430 None] Creating volume 8bfe8fa7-7cc1-4e1a-88a8-d24da5d0f8c0 {{(pid=88695) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 06:31:48 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-a4a09118-c7d9-46ca-996b-22e30cdd63d6 tempest-ProjectMemberTests-475949430 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:31:48 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-a4a09118-c7d9-46ca-996b-22e30cdd63d6 tempest-ProjectMemberTests-475949430 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:31:48 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-a4a09118-c7d9-46ca-996b-22e30cdd63d6 tempest-ProjectMemberTests-475949430 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:31:48 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-a4a09118-c7d9-46ca-996b-22e30cdd63d6 tempest-ProjectMemberTests-475949430 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:31:48 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-a4a09118-c7d9-46ca-996b-22e30cdd63d6 tempest-ProjectMemberTests-475949430 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:31:48 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-a4a09118-c7d9-46ca-996b-22e30cdd63d6 tempest-ProjectMemberTests-475949430 None] Selected osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 as target Quobyte volume. {{(pid=88695) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 06:31:48 devstack cinder-volume[88695]: INFO cinder.volume.drivers.remotefs [None req-a4a09118-c7d9-46ca-996b-22e30cdd63d6 tempest-ProjectMemberTests-475949430 None] casted to osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 Aug 05 06:31:48 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-a4a09118-c7d9-46ca-996b-22e30cdd63d6 tempest-ProjectMemberTests-475949430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8bfe8fa7-7cc1-4e1a-88a8-d24da5d0f8c0 1073741824 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:31:48 devstack sudo[109204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8bfe8fa7-7cc1-4e1a-88a8-d24da5d0f8c0 1073741824 Aug 05 06:31:48 devstack sudo[109204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:31:48 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-c2bdc31b-d071-40e6-b1aa-d622dc3578f7 tempest-VolumeDependencyTests-1089559550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5a86f47-e090-490e-b7ca-dc5522ab858e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9cd5b75-19a2-4927-a4cc-ae393b8d124b', 'volume_size': 1, 'snapshot_id': '043f6927-7f46-43bc-8b8c-c85a9796adc0'}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:31:48 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-c2bdc31b-d071-40e6-b1aa-d622dc3578f7 tempest-VolumeDependencyTests-1089559550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17e021af-3d65-428b-8229-0cca9ff49e01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:31:48 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-c2bdc31b-d071-40e6-b1aa-d622dc3578f7 tempest-VolumeDependencyTests-1089559550 None] Volume volume-b9cd5b75-19a2-4927-a4cc-ae393b8d124b (b9cd5b75-19a2-4927-a4cc-ae393b8d124b): created successfully Aug 05 06:31:48 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-c2bdc31b-d071-40e6-b1aa-d622dc3578f7 tempest-VolumeDependencyTests-1089559550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17e021af-3d65-428b-8229-0cca9ff49e01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:31:48 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-c2bdc31b-d071-40e6-b1aa-d622dc3578f7 tempest-VolumeDependencyTests-1089559550 None] Flow 'volume_create_manager' (843c2d17-96bd-4809-bcf5-01edb9323639) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:31:48 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-c2bdc31b-d071-40e6-b1aa-d622dc3578f7 tempest-VolumeDependencyTests-1089559550 None] Created volume successfully. Aug 05 06:31:49 devstack sudo[109204]: pam_unix(sudo:session): session closed for user root Aug 05 06:31:49 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-a4a09118-c7d9-46ca-996b-22e30cdd63d6 tempest-ProjectMemberTests-475949430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8bfe8fa7-7cc1-4e1a-88a8-d24da5d0f8c0 1073741824" returned: 0 in 0.598s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:31:49 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-a4a09118-c7d9-46ca-996b-22e30cdd63d6 tempest-ProjectMemberTests-475949430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8bfe8fa7-7cc1-4e1a-88a8-d24da5d0f8c0 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:31:49 devstack sudo[109209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8bfe8fa7-7cc1-4e1a-88a8-d24da5d0f8c0 Aug 05 06:31:49 devstack sudo[109209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:31:49 devstack sudo[109209]: pam_unix(sudo:session): session closed for user root Aug 05 06:31:49 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-1e43cb7d-2848-4941-a251-06d0dd1b450b tempest-VolumeDependencyTests-1089559550 None] Acquiring lock "cinder-043f6927-7f46-43bc-8b8c-c85a9796adc0-delete_snapshot" by "delete_snapshot" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:31:49 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-a4a09118-c7d9-46ca-996b-22e30cdd63d6 tempest-ProjectMemberTests-475949430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8bfe8fa7-7cc1-4e1a-88a8-d24da5d0f8c0" returned: 0 in 0.325s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:31:49 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-a4a09118-c7d9-46ca-996b-22e30cdd63d6 tempest-ProjectMemberTests-475949430 None] <== create_volume: return (986ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'} {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 06:31:49 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-a4a09118-c7d9-46ca-996b-22e30cdd63d6 tempest-ProjectMemberTests-475949430 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.990s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:31:49 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-a4a09118-c7d9-46ca-996b-22e30cdd63d6 tempest-ProjectMemberTests-475949430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39603bc1-7923-48db-879c-09b1894d70ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8bfe8fa7-7cc1-4e1a-88a8-d24da5d0f8c0', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:31:49 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-a4a09118-c7d9-46ca-996b-22e30cdd63d6 tempest-ProjectMemberTests-475949430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (514e1e16-878b-48e6-88e9-f96369e53358) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:31:49 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-1e43cb7d-2848-4941-a251-06d0dd1b450b tempest-VolumeDependencyTests-1089559550 None] Lock "cinder-043f6927-7f46-43bc-8b8c-c85a9796adc0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:31:49 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-1e43cb7d-2848-4941-a251-06d0dd1b450b tempest-VolumeDependencyTests-1089559550 None] Acquiring lock "cinder-quobyte-8542f074-6908-4f24-9d40-821e096b7124" by "delete_snapshot" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:31:49 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-a4a09118-c7d9-46ca-996b-22e30cdd63d6 tempest-ProjectMemberTests-475949430 None] Volume volume-8bfe8fa7-7cc1-4e1a-88a8-d24da5d0f8c0 (8bfe8fa7-7cc1-4e1a-88a8-d24da5d0f8c0): created successfully Aug 05 06:31:49 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-a4a09118-c7d9-46ca-996b-22e30cdd63d6 tempest-ProjectMemberTests-475949430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (514e1e16-878b-48e6-88e9-f96369e53358) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:31:49 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-a4a09118-c7d9-46ca-996b-22e30cdd63d6 tempest-ProjectMemberTests-475949430 None] Flow 'volume_create_manager' (9113d6b2-78d5-4c27-98ff-ced2fb10c117) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:31:49 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-1e43cb7d-2848-4941-a251-06d0dd1b450b tempest-VolumeDependencyTests-1089559550 None] Lock "cinder-quobyte-8542f074-6908-4f24-9d40-821e096b7124" acquired by "delete_snapshot" :: waited 0.033s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:31:49 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-1e43cb7d-2848-4941-a251-06d0dd1b450b tempest-VolumeDependencyTests-1089559550 None] Acquiring lock "cinder-quobyte-043f6927-7f46-43bc-8b8c-c85a9796adc0" by "_delete_snapshot" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:31:49 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-a4a09118-c7d9-46ca-996b-22e30cdd63d6 tempest-ProjectMemberTests-475949430 None] Created volume successfully. Aug 05 06:31:49 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-1e43cb7d-2848-4941-a251-06d0dd1b450b tempest-VolumeDependencyTests-1089559550 None] Lock "cinder-quobyte-043f6927-7f46-43bc-8b8c-c85a9796adc0" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:31:49 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-1e43cb7d-2848-4941-a251-06d0dd1b450b tempest-VolumeDependencyTests-1089559550 None] Deleting offline snapshot 043f6927-7f46-43bc-8b8c-c85a9796adc0 of volume 8542f074-6908-4f24-9d40-821e096b7124 {{(pid=88695) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 06:31:49 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-1e43cb7d-2848-4941-a251-06d0dd1b450b tempest-VolumeDependencyTests-1089559550 None] snapshot_file for this snap is: volume-8542f074-6908-4f24-9d40-821e096b7124.043f6927-7f46-43bc-8b8c-c85a9796adc0 {{(pid=88695) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 06:31:49 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[36748e18-71ef-48d3-97e9-b4fea4f4d65d]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:31:49 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-1e43cb7d-2848-4941-a251-06d0dd1b450b tempest-VolumeDependencyTests-1089559550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8542f074-6908-4f24-9d40-821e096b7124.043f6927-7f46-43bc-8b8c-c85a9796adc0 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:31:50 devstack sudo[109212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8542f074-6908-4f24-9d40-821e096b7124.043f6927-7f46-43bc-8b8c-c85a9796adc0 Aug 05 06:31:50 devstack sudo[109212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:31:50 devstack sudo[109212]: pam_unix(sudo:session): session closed for user root Aug 05 06:31:50 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-1e43cb7d-2848-4941-a251-06d0dd1b450b tempest-VolumeDependencyTests-1089559550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8542f074-6908-4f24-9d40-821e096b7124.043f6927-7f46-43bc-8b8c-c85a9796adc0" returned: 0 in 0.366s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:31:50 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-1e43cb7d-2848-4941-a251-06d0dd1b450b tempest-VolumeDependencyTests-1089559550 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8542f074-6908-4f24-9d40-821e096b7124(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88695) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 06:31:50 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[da6c7bd2-ece0-44ed-adbd-e4bb927cfc2d]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:31:50 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-1e43cb7d-2848-4941-a251-06d0dd1b450b tempest-VolumeDependencyTests-1089559550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8542f074-6908-4f24-9d40-821e096b7124 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:31:50 devstack sudo[109217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8542f074-6908-4f24-9d40-821e096b7124 Aug 05 06:31:50 devstack sudo[109217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:31:51 devstack sudo[109217]: pam_unix(sudo:session): session closed for user root Aug 05 06:31:51 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-1e43cb7d-2848-4941-a251-06d0dd1b450b tempest-VolumeDependencyTests-1089559550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8542f074-6908-4f24-9d40-821e096b7124" returned: 0 in 0.728s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:31:51 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-1e43cb7d-2848-4941-a251-06d0dd1b450b tempest-VolumeDependencyTests-1089559550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8542f074-6908-4f24-9d40-821e096b7124.043f6927-7f46-43bc-8b8c-c85a9796adc0 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:31:51 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-4b79be2e-0f2e-4520-ad42-58f5e08a4139 tempest-ProjectMemberTests-475949430 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:31:51 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-4b79be2e-0f2e-4520-ad42-58f5e08a4139 tempest-ProjectMemberTests-475949430 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:31:51 devstack sudo[109222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8542f074-6908-4f24-9d40-821e096b7124.043f6927-7f46-43bc-8b8c-c85a9796adc0 Aug 05 06:31:51 devstack sudo[109222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:31:51 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-4b79be2e-0f2e-4520-ad42-58f5e08a4139 tempest-ProjectMemberTests-475949430 None] Creating offline snapshot 9cc0c870-4f4d-4eea-8941-1e79f6e77091 of volume 8bfe8fa7-7cc1-4e1a-88a8-d24da5d0f8c0 {{(pid=88695) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 06:31:51 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec56144b-0931-4344-958e-f1c7392aa55c]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:31:51 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-4b79be2e-0f2e-4520-ad42-58f5e08a4139 tempest-ProjectMemberTests-475949430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8bfe8fa7-7cc1-4e1a-88a8-d24da5d0f8c0 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:31:51 devstack sudo[109224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8bfe8fa7-7cc1-4e1a-88a8-d24da5d0f8c0 Aug 05 06:31:51 devstack sudo[109224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:31:51 devstack sudo[109222]: pam_unix(sudo:session): session closed for user root Aug 05 06:31:51 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-1e43cb7d-2848-4941-a251-06d0dd1b450b tempest-VolumeDependencyTests-1089559550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8542f074-6908-4f24-9d40-821e096b7124.043f6927-7f46-43bc-8b8c-c85a9796adc0" returned: 0 in 0.504s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:31:51 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-1e43cb7d-2848-4941-a251-06d0dd1b450b tempest-VolumeDependencyTests-1089559550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8542f074-6908-4f24-9d40-821e096b7124.043f6927-7f46-43bc-8b8c-c85a9796adc0 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:31:51 devstack sudo[109229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8542f074-6908-4f24-9d40-821e096b7124.043f6927-7f46-43bc-8b8c-c85a9796adc0 Aug 05 06:31:51 devstack sudo[109229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:31:51 devstack sudo[109224]: pam_unix(sudo:session): session closed for user root Aug 05 06:31:51 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-4b79be2e-0f2e-4520-ad42-58f5e08a4139 tempest-ProjectMemberTests-475949430 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8bfe8fa7-7cc1-4e1a-88a8-d24da5d0f8c0" returned: 0 in 0.601s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:31:51 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-4b79be2e-0f2e-4520-ad42-58f5e08a4139 tempest-ProjectMemberTests-475949430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8bfe8fa7-7cc1-4e1a-88a8-d24da5d0f8c0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8bfe8fa7-7cc1-4e1a-88a8-d24da5d0f8c0.9cc0c870-4f4d-4eea-8941-1e79f6e77091 1G {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:31:51 devstack sudo[109240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8bfe8fa7-7cc1-4e1a-88a8-d24da5d0f8c0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8bfe8fa7-7cc1-4e1a-88a8-d24da5d0f8c0.9cc0c870-4f4d-4eea-8941-1e79f6e77091 1G Aug 05 06:31:51 devstack sudo[109240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:31:51 devstack sudo[109229]: pam_unix(sudo:session): session closed for user root Aug 05 06:31:51 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-1e43cb7d-2848-4941-a251-06d0dd1b450b tempest-VolumeDependencyTests-1089559550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8542f074-6908-4f24-9d40-821e096b7124.043f6927-7f46-43bc-8b8c-c85a9796adc0" returned: 0 in 0.324s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:31:51 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-1e43cb7d-2848-4941-a251-06d0dd1b450b tempest-VolumeDependencyTests-1089559550 None] Lock "cinder-quobyte-043f6927-7f46-43bc-8b8c-c85a9796adc0" released by "_delete_snapshot" :: held 2.053s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:31:52 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-1e43cb7d-2848-4941-a251-06d0dd1b450b tempest-VolumeDependencyTests-1089559550 None] Lock "cinder-quobyte-8542f074-6908-4f24-9d40-821e096b7124" released by "delete_snapshot" :: held 2.087s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:31:52 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-1e43cb7d-2848-4941-a251-06d0dd1b450b tempest-VolumeDependencyTests-1089559550 None] Created reservations ['dd6287a1-c92a-4cff-8bae-4f1b87c3b077', '88feb227-d964-4d1c-b946-c54c53b8df06', '5e9e0abb-9690-4d96-9316-ef155079d72d', '5e86e804-ff20-4d05-8891-1429ff648bf7'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:31:52 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-1e43cb7d-2848-4941-a251-06d0dd1b450b tempest-VolumeDependencyTests-1089559550 None] Delete snapshot completed successfully. Aug 05 06:31:52 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-1e43cb7d-2848-4941-a251-06d0dd1b450b tempest-VolumeDependencyTests-1089559550 None] Lock "cinder-043f6927-7f46-43bc-8b8c-c85a9796adc0-delete_snapshot" released by "delete_snapshot" :: held 2.303s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:31:52 devstack sudo[109240]: pam_unix(sudo:session): session closed for user root Aug 05 06:31:52 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-4b79be2e-0f2e-4520-ad42-58f5e08a4139 tempest-ProjectMemberTests-475949430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8bfe8fa7-7cc1-4e1a-88a8-d24da5d0f8c0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8bfe8fa7-7cc1-4e1a-88a8-d24da5d0f8c0.9cc0c870-4f4d-4eea-8941-1e79f6e77091 1G" returned: 0 in 0.536s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:31:52 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-4b79be2e-0f2e-4520-ad42-58f5e08a4139 tempest-ProjectMemberTests-475949430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8bfe8fa7-7cc1-4e1a-88a8-d24da5d0f8c0 -F qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8bfe8fa7-7cc1-4e1a-88a8-d24da5d0f8c0.9cc0c870-4f4d-4eea-8941-1e79f6e77091 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:31:52 devstack sudo[109247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8bfe8fa7-7cc1-4e1a-88a8-d24da5d0f8c0 -F qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8bfe8fa7-7cc1-4e1a-88a8-d24da5d0f8c0.9cc0c870-4f4d-4eea-8941-1e79f6e77091 Aug 05 06:31:52 devstack sudo[109247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:31:52 devstack sudo[109247]: pam_unix(sudo:session): session closed for user root Aug 05 06:31:52 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-4b79be2e-0f2e-4520-ad42-58f5e08a4139 tempest-ProjectMemberTests-475949430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8bfe8fa7-7cc1-4e1a-88a8-d24da5d0f8c0 -F qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8bfe8fa7-7cc1-4e1a-88a8-d24da5d0f8c0.9cc0c870-4f4d-4eea-8941-1e79f6e77091" returned: 0 in 0.344s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:31:52 devstack cinder-volume[88695]: WARNING cinder.volume.drivers.remotefs [None req-4b79be2e-0f2e-4520-ad42-58f5e08a4139 tempest-ProjectMemberTests-475949430 None] /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8bfe8fa7-7cc1-4e1a-88a8-d24da5d0f8c0.9cc0c870-4f4d-4eea-8941-1e79f6e77091 is being set with open permissions: ugo+rw Aug 05 06:31:52 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-4b79be2e-0f2e-4520-ad42-58f5e08a4139 tempest-ProjectMemberTests-475949430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8bfe8fa7-7cc1-4e1a-88a8-d24da5d0f8c0.9cc0c870-4f4d-4eea-8941-1e79f6e77091 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:31:52 devstack sudo[109252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8bfe8fa7-7cc1-4e1a-88a8-d24da5d0f8c0.9cc0c870-4f4d-4eea-8941-1e79f6e77091 Aug 05 06:31:52 devstack sudo[109252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:31:52 devstack sudo[109252]: pam_unix(sudo:session): session closed for user root Aug 05 06:31:52 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-4b79be2e-0f2e-4520-ad42-58f5e08a4139 tempest-ProjectMemberTests-475949430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8bfe8fa7-7cc1-4e1a-88a8-d24da5d0f8c0.9cc0c870-4f4d-4eea-8941-1e79f6e77091" returned: 0 in 0.268s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:31:52 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-4b79be2e-0f2e-4520-ad42-58f5e08a4139 tempest-ProjectMemberTests-475949430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8bfe8fa7-7cc1-4e1a-88a8-d24da5d0f8c0.info {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:31:52 devstack sudo[109255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8bfe8fa7-7cc1-4e1a-88a8-d24da5d0f8c0.info Aug 05 06:31:52 devstack sudo[109255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:31:53 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-4c14afe2-8d63-4f84-ac13-2360b1a5a025 tempest-VolumeDependencyTests-1089559550 None] Acquiring lock "cinder-8542f074-6908-4f24-9d40-821e096b7124-delete_volume" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:31:53 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-4c14afe2-8d63-4f84-ac13-2360b1a5a025 tempest-VolumeDependencyTests-1089559550 None] Lock "cinder-8542f074-6908-4f24-9d40-821e096b7124-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:31:53 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-4c14afe2-8d63-4f84-ac13-2360b1a5a025 tempest-VolumeDependencyTests-1089559550 None] Acquiring lock "cinder-quobyte-8542f074-6908-4f24-9d40-821e096b7124" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:31:53 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-4c14afe2-8d63-4f84-ac13-2360b1a5a025 tempest-VolumeDependencyTests-1089559550 None] Lock "cinder-quobyte-8542f074-6908-4f24-9d40-821e096b7124" acquired by "delete_volume" :: waited 0.026s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:31:53 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[59e18e2d-df5a-4b5c-9822-472bf2d303cd]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:31:53 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-4c14afe2-8d63-4f84-ac13-2360b1a5a025 tempest-VolumeDependencyTests-1089559550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8542f074-6908-4f24-9d40-821e096b7124 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:31:53 devstack sudo[109255]: pam_unix(sudo:session): session closed for user root Aug 05 06:31:53 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-4b79be2e-0f2e-4520-ad42-58f5e08a4139 tempest-ProjectMemberTests-475949430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8bfe8fa7-7cc1-4e1a-88a8-d24da5d0f8c0.info" returned: 0 in 0.320s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:31:53 devstack cinder-volume[88695]: WARNING cinder.volume.drivers.remotefs [None req-4b79be2e-0f2e-4520-ad42-58f5e08a4139 tempest-ProjectMemberTests-475949430 None] /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8bfe8fa7-7cc1-4e1a-88a8-d24da5d0f8c0.info is being set with open permissions: ugo+rw Aug 05 06:31:53 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-4b79be2e-0f2e-4520-ad42-58f5e08a4139 tempest-ProjectMemberTests-475949430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8bfe8fa7-7cc1-4e1a-88a8-d24da5d0f8c0.info {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:31:53 devstack sudo[109259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8bfe8fa7-7cc1-4e1a-88a8-d24da5d0f8c0.info Aug 05 06:31:53 devstack sudo[109259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:31:53 devstack sudo[109258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8542f074-6908-4f24-9d40-821e096b7124 Aug 05 06:31:53 devstack sudo[109258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:31:53 devstack sudo[109259]: pam_unix(sudo:session): session closed for user root Aug 05 06:31:53 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-4b79be2e-0f2e-4520-ad42-58f5e08a4139 tempest-ProjectMemberTests-475949430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8bfe8fa7-7cc1-4e1a-88a8-d24da5d0f8c0.info" returned: 0 in 0.310s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:31:53 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-4b79be2e-0f2e-4520-ad42-58f5e08a4139 tempest-ProjectMemberTests-475949430 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.493s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:31:53 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-4b79be2e-0f2e-4520-ad42-58f5e08a4139 tempest-ProjectMemberTests-475949430 None] Create snapshot completed successfully Aug 05 06:31:53 devstack sudo[109258]: pam_unix(sudo:session): session closed for user root Aug 05 06:31:53 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-4c14afe2-8d63-4f84-ac13-2360b1a5a025 tempest-VolumeDependencyTests-1089559550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8542f074-6908-4f24-9d40-821e096b7124" returned: 0 in 0.445s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:31:53 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-4c14afe2-8d63-4f84-ac13-2360b1a5a025 tempest-VolumeDependencyTests-1089559550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8542f074-6908-4f24-9d40-821e096b7124 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:31:53 devstack sudo[109266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8542f074-6908-4f24-9d40-821e096b7124 Aug 05 06:31:53 devstack sudo[109266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:31:54 devstack sudo[109266]: pam_unix(sudo:session): session closed for user root Aug 05 06:31:54 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-4c14afe2-8d63-4f84-ac13-2360b1a5a025 tempest-VolumeDependencyTests-1089559550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8542f074-6908-4f24-9d40-821e096b7124" returned: 0 in 0.313s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:31:54 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-4c14afe2-8d63-4f84-ac13-2360b1a5a025 tempest-VolumeDependencyTests-1089559550 None] Lock "cinder-quobyte-8542f074-6908-4f24-9d40-821e096b7124" released by "delete_volume" :: held 0.834s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:31:54 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-4c14afe2-8d63-4f84-ac13-2360b1a5a025 tempest-VolumeDependencyTests-1089559550 None] Created reservations ['a7ebe109-5956-4b38-8377-0de251bdac2c', 'ceee3d0a-f618-43a3-9625-3c13aadd4290', 'f4288ee5-d928-47ec-9a1d-76c8b1623e67', '91d87510-e9aa-43ee-a4d4-2493b50bc029'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:31:54 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-4c14afe2-8d63-4f84-ac13-2360b1a5a025 tempest-VolumeDependencyTests-1089559550 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:31:54 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-4c14afe2-8d63-4f84-ac13-2360b1a5a025 tempest-VolumeDependencyTests-1089559550 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:31:54 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-4c14afe2-8d63-4f84-ac13-2360b1a5a025 tempest-VolumeDependencyTests-1089559550 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:31:54 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-4c14afe2-8d63-4f84-ac13-2360b1a5a025 tempest-VolumeDependencyTests-1089559550 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:31:54 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-4c14afe2-8d63-4f84-ac13-2360b1a5a025 tempest-VolumeDependencyTests-1089559550 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:31:54 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-4c14afe2-8d63-4f84-ac13-2360b1a5a025 tempest-VolumeDependencyTests-1089559550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:31:54 devstack sudo[109269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce Aug 05 06:31:54 devstack sudo[109269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:31:54 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-6677a475-ce57-496e-8443-7d394b2b360c tempest-ProjectMemberTests-475949430 None] Acquiring lock "cinder-9cc0c870-4f4d-4eea-8941-1e79f6e77091-delete_snapshot" by "delete_snapshot" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:31:54 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-9aebdfa1-2cf0-4d31-b77c-2fdcafe50e53 tempest-VolumeDependencyTests-1089559550 None] Acquiring lock "cinder-b9cd5b75-19a2-4927-a4cc-ae393b8d124b-delete_volume" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:31:54 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-6677a475-ce57-496e-8443-7d394b2b360c tempest-ProjectMemberTests-475949430 None] Lock "cinder-9cc0c870-4f4d-4eea-8941-1e79f6e77091-delete_snapshot" acquired by "delete_snapshot" :: waited 0.062s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:31:54 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-6677a475-ce57-496e-8443-7d394b2b360c tempest-ProjectMemberTests-475949430 None] Acquiring lock "cinder-quobyte-8bfe8fa7-7cc1-4e1a-88a8-d24da5d0f8c0" by "delete_snapshot" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:31:54 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-9aebdfa1-2cf0-4d31-b77c-2fdcafe50e53 tempest-VolumeDependencyTests-1089559550 None] Lock "cinder-b9cd5b75-19a2-4927-a4cc-ae393b8d124b-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:31:54 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-6677a475-ce57-496e-8443-7d394b2b360c tempest-ProjectMemberTests-475949430 None] Lock "cinder-quobyte-8bfe8fa7-7cc1-4e1a-88a8-d24da5d0f8c0" acquired by "delete_snapshot" :: waited 0.025s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:31:54 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-6677a475-ce57-496e-8443-7d394b2b360c tempest-ProjectMemberTests-475949430 None] Acquiring lock "cinder-quobyte-9cc0c870-4f4d-4eea-8941-1e79f6e77091" by "_delete_snapshot" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:31:54 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-6677a475-ce57-496e-8443-7d394b2b360c tempest-ProjectMemberTests-475949430 None] Lock "cinder-quobyte-9cc0c870-4f4d-4eea-8941-1e79f6e77091" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:31:54 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-6677a475-ce57-496e-8443-7d394b2b360c tempest-ProjectMemberTests-475949430 None] Deleting offline snapshot 9cc0c870-4f4d-4eea-8941-1e79f6e77091 of volume 8bfe8fa7-7cc1-4e1a-88a8-d24da5d0f8c0 {{(pid=88695) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 06:31:54 devstack sudo[109269]: pam_unix(sudo:session): session closed for user root Aug 05 06:31:54 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-6677a475-ce57-496e-8443-7d394b2b360c tempest-ProjectMemberTests-475949430 None] snapshot_file for this snap is: volume-8bfe8fa7-7cc1-4e1a-88a8-d24da5d0f8c0.9cc0c870-4f4d-4eea-8941-1e79f6e77091 {{(pid=88695) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 06:31:54 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-4c14afe2-8d63-4f84-ac13-2360b1a5a025 tempest-VolumeDependencyTests-1089559550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce" returned: 0 in 0.337s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:31:54 devstack cinder-volume[88695]: DEBUG cinder.manager [None req-4c14afe2-8d63-4f84-ac13-2360b1a5a025 tempest-VolumeDependencyTests-1089559550 None] Notifying Schedulers of capabilities ... {{(pid=88695) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 06:31:54 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f0da9de-9ef8-4351-8239-61c3c3365ee3]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:31:54 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-6677a475-ce57-496e-8443-7d394b2b360c tempest-ProjectMemberTests-475949430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8bfe8fa7-7cc1-4e1a-88a8-d24da5d0f8c0.9cc0c870-4f4d-4eea-8941-1e79f6e77091 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:31:54 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-4c14afe2-8d63-4f84-ac13-2360b1a5a025 tempest-VolumeDependencyTests-1089559550 None] Deleted volume successfully. Aug 05 06:31:54 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-9aebdfa1-2cf0-4d31-b77c-2fdcafe50e53 tempest-VolumeDependencyTests-1089559550 None] Acquiring lock "cinder-quobyte-b9cd5b75-19a2-4927-a4cc-ae393b8d124b" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:31:54 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-9aebdfa1-2cf0-4d31-b77c-2fdcafe50e53 tempest-VolumeDependencyTests-1089559550 None] Lock "cinder-quobyte-b9cd5b75-19a2-4927-a4cc-ae393b8d124b" acquired by "delete_volume" :: waited 0.026s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:31:54 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-4c14afe2-8d63-4f84-ac13-2360b1a5a025 tempest-VolumeDependencyTests-1089559550 None] Lock "cinder-8542f074-6908-4f24-9d40-821e096b7124-delete_volume" released by "delete_volume" :: held 1.466s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:31:54 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dcbc2be-81f7-42f3-8890-76e89de6564d]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:31:54 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-9aebdfa1-2cf0-4d31-b77c-2fdcafe50e53 tempest-VolumeDependencyTests-1089559550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-b9cd5b75-19a2-4927-a4cc-ae393b8d124b {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:31:54 devstack sudo[109272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8bfe8fa7-7cc1-4e1a-88a8-d24da5d0f8c0.9cc0c870-4f4d-4eea-8941-1e79f6e77091 Aug 05 06:31:54 devstack sudo[109272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:31:54 devstack sudo[109273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-b9cd5b75-19a2-4927-a4cc-ae393b8d124b Aug 05 06:31:54 devstack sudo[109273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:31:54 devstack sudo[109272]: pam_unix(sudo:session): session closed for user root Aug 05 06:31:54 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-6677a475-ce57-496e-8443-7d394b2b360c tempest-ProjectMemberTests-475949430 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8bfe8fa7-7cc1-4e1a-88a8-d24da5d0f8c0.9cc0c870-4f4d-4eea-8941-1e79f6e77091" returned: 0 in 0.450s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:31:54 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-6677a475-ce57-496e-8443-7d394b2b360c tempest-ProjectMemberTests-475949430 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8bfe8fa7-7cc1-4e1a-88a8-d24da5d0f8c0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88695) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 06:31:55 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[4217ec6e-140f-4d9b-b7a5-98a3a1eee98d]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:31:55 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-6677a475-ce57-496e-8443-7d394b2b360c tempest-ProjectMemberTests-475949430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8bfe8fa7-7cc1-4e1a-88a8-d24da5d0f8c0 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:31:55 devstack sudo[109273]: pam_unix(sudo:session): session closed for user root Aug 05 06:31:55 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-9aebdfa1-2cf0-4d31-b77c-2fdcafe50e53 tempest-VolumeDependencyTests-1089559550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-b9cd5b75-19a2-4927-a4cc-ae393b8d124b" returned: 0 in 0.449s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:31:55 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-9aebdfa1-2cf0-4d31-b77c-2fdcafe50e53 tempest-VolumeDependencyTests-1089559550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-b9cd5b75-19a2-4927-a4cc-ae393b8d124b {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:31:55 devstack sudo[109283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-b9cd5b75-19a2-4927-a4cc-ae393b8d124b Aug 05 06:31:55 devstack sudo[109283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:31:55 devstack sudo[109282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8bfe8fa7-7cc1-4e1a-88a8-d24da5d0f8c0 Aug 05 06:31:55 devstack sudo[109282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:31:55 devstack sudo[109283]: pam_unix(sudo:session): session closed for user root Aug 05 06:31:55 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-9aebdfa1-2cf0-4d31-b77c-2fdcafe50e53 tempest-VolumeDependencyTests-1089559550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-b9cd5b75-19a2-4927-a4cc-ae393b8d124b" returned: 0 in 0.272s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:31:55 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-9aebdfa1-2cf0-4d31-b77c-2fdcafe50e53 tempest-VolumeDependencyTests-1089559550 None] Lock "cinder-quobyte-b9cd5b75-19a2-4927-a4cc-ae393b8d124b" released by "delete_volume" :: held 0.769s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:31:55 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-9aebdfa1-2cf0-4d31-b77c-2fdcafe50e53 tempest-VolumeDependencyTests-1089559550 None] Created reservations ['ba0dafbb-3ef6-43e4-985b-567f41958950', '513b5b3d-56c2-45f3-b021-aae67000f046', 'f2c1e17a-680a-400f-984f-0a3800392e14', '408ce990-0306-439c-95e0-89559aafc542'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:31:55 devstack sudo[109282]: pam_unix(sudo:session): session closed for user root Aug 05 06:31:55 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-6677a475-ce57-496e-8443-7d394b2b360c tempest-ProjectMemberTests-475949430 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8bfe8fa7-7cc1-4e1a-88a8-d24da5d0f8c0" returned: 0 in 0.440s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:31:55 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-6677a475-ce57-496e-8443-7d394b2b360c tempest-ProjectMemberTests-475949430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8bfe8fa7-7cc1-4e1a-88a8-d24da5d0f8c0.9cc0c870-4f4d-4eea-8941-1e79f6e77091 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:31:55 devstack sudo[109290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8bfe8fa7-7cc1-4e1a-88a8-d24da5d0f8c0.9cc0c870-4f4d-4eea-8941-1e79f6e77091 Aug 05 06:31:55 devstack sudo[109290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:31:55 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-9aebdfa1-2cf0-4d31-b77c-2fdcafe50e53 tempest-VolumeDependencyTests-1089559550 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:31:55 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-9aebdfa1-2cf0-4d31-b77c-2fdcafe50e53 tempest-VolumeDependencyTests-1089559550 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:31:55 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-9aebdfa1-2cf0-4d31-b77c-2fdcafe50e53 tempest-VolumeDependencyTests-1089559550 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:31:55 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-9aebdfa1-2cf0-4d31-b77c-2fdcafe50e53 tempest-VolumeDependencyTests-1089559550 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:31:55 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-9aebdfa1-2cf0-4d31-b77c-2fdcafe50e53 tempest-VolumeDependencyTests-1089559550 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:31:55 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-9aebdfa1-2cf0-4d31-b77c-2fdcafe50e53 tempest-VolumeDependencyTests-1089559550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:31:55 devstack sudo[109292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce Aug 05 06:31:55 devstack sudo[109292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:31:55 devstack sudo[109292]: pam_unix(sudo:session): session closed for user root Aug 05 06:31:55 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-9aebdfa1-2cf0-4d31-b77c-2fdcafe50e53 tempest-VolumeDependencyTests-1089559550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce" returned: 0 in 0.284s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:31:55 devstack cinder-volume[88695]: DEBUG cinder.manager [None req-9aebdfa1-2cf0-4d31-b77c-2fdcafe50e53 tempest-VolumeDependencyTests-1089559550 None] Notifying Schedulers of capabilities ... {{(pid=88695) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 06:31:55 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-9aebdfa1-2cf0-4d31-b77c-2fdcafe50e53 tempest-VolumeDependencyTests-1089559550 None] Deleted volume successfully. Aug 05 06:31:55 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-9aebdfa1-2cf0-4d31-b77c-2fdcafe50e53 tempest-VolumeDependencyTests-1089559550 None] Lock "cinder-b9cd5b75-19a2-4927-a4cc-ae393b8d124b-delete_volume" released by "delete_volume" :: held 1.412s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:31:55 devstack sudo[109290]: pam_unix(sudo:session): session closed for user root Aug 05 06:31:55 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-6677a475-ce57-496e-8443-7d394b2b360c tempest-ProjectMemberTests-475949430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8bfe8fa7-7cc1-4e1a-88a8-d24da5d0f8c0.9cc0c870-4f4d-4eea-8941-1e79f6e77091" returned: 0 in 0.489s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:31:55 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-6677a475-ce57-496e-8443-7d394b2b360c tempest-ProjectMemberTests-475949430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8bfe8fa7-7cc1-4e1a-88a8-d24da5d0f8c0.9cc0c870-4f4d-4eea-8941-1e79f6e77091 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:31:55 devstack sudo[109299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8bfe8fa7-7cc1-4e1a-88a8-d24da5d0f8c0.9cc0c870-4f4d-4eea-8941-1e79f6e77091 Aug 05 06:31:55 devstack sudo[109299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:31:56 devstack sudo[109299]: pam_unix(sudo:session): session closed for user root Aug 05 06:31:56 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-6677a475-ce57-496e-8443-7d394b2b360c tempest-ProjectMemberTests-475949430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8bfe8fa7-7cc1-4e1a-88a8-d24da5d0f8c0.9cc0c870-4f4d-4eea-8941-1e79f6e77091" returned: 0 in 0.279s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:31:56 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-6677a475-ce57-496e-8443-7d394b2b360c tempest-ProjectMemberTests-475949430 None] Lock "cinder-quobyte-9cc0c870-4f4d-4eea-8941-1e79f6e77091" released by "_delete_snapshot" :: held 1.789s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:31:56 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-6677a475-ce57-496e-8443-7d394b2b360c tempest-ProjectMemberTests-475949430 None] Lock "cinder-quobyte-8bfe8fa7-7cc1-4e1a-88a8-d24da5d0f8c0" released by "delete_snapshot" :: held 1.827s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:31:56 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-6677a475-ce57-496e-8443-7d394b2b360c tempest-ProjectMemberTests-475949430 None] Created reservations ['3dc011d7-9bba-46e4-8dbd-4c7ade696bc4', 'cfbdddf7-3316-40b0-8f05-9ac4d6d7553c', 'a73717dd-91ba-48b5-82ea-be857048620a', '5da566ce-ad23-4a3d-8bea-d860879f7b77'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:31:56 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-6677a475-ce57-496e-8443-7d394b2b360c tempest-ProjectMemberTests-475949430 None] Delete snapshot completed successfully. Aug 05 06:31:56 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-6677a475-ce57-496e-8443-7d394b2b360c tempest-ProjectMemberTests-475949430 None] Lock "cinder-9cc0c870-4f4d-4eea-8941-1e79f6e77091-delete_snapshot" released by "delete_snapshot" :: held 2.034s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:31:56 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-f51bbbf3-52c4-4e23-9442-fa797674e316 tempest-ProjectMemberTests-475949430 None] Acquiring lock "cinder-8bfe8fa7-7cc1-4e1a-88a8-d24da5d0f8c0-delete_volume" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:31:56 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-f51bbbf3-52c4-4e23-9442-fa797674e316 tempest-ProjectMemberTests-475949430 None] Lock "cinder-8bfe8fa7-7cc1-4e1a-88a8-d24da5d0f8c0-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:31:56 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-f51bbbf3-52c4-4e23-9442-fa797674e316 tempest-ProjectMemberTests-475949430 None] Acquiring lock "cinder-quobyte-8bfe8fa7-7cc1-4e1a-88a8-d24da5d0f8c0" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:31:56 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-f51bbbf3-52c4-4e23-9442-fa797674e316 tempest-ProjectMemberTests-475949430 None] Lock "cinder-quobyte-8bfe8fa7-7cc1-4e1a-88a8-d24da5d0f8c0" acquired by "delete_volume" :: waited 0.019s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:31:56 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d40c190-e57a-4511-80e8-04ef3a2c5855]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:31:56 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-f51bbbf3-52c4-4e23-9442-fa797674e316 tempest-ProjectMemberTests-475949430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8bfe8fa7-7cc1-4e1a-88a8-d24da5d0f8c0 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:31:56 devstack sudo[109302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8bfe8fa7-7cc1-4e1a-88a8-d24da5d0f8c0 Aug 05 06:31:56 devstack sudo[109302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:31:57 devstack sudo[109302]: pam_unix(sudo:session): session closed for user root Aug 05 06:31:57 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-f51bbbf3-52c4-4e23-9442-fa797674e316 tempest-ProjectMemberTests-475949430 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8bfe8fa7-7cc1-4e1a-88a8-d24da5d0f8c0" returned: 0 in 0.413s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:31:57 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-f51bbbf3-52c4-4e23-9442-fa797674e316 tempest-ProjectMemberTests-475949430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8bfe8fa7-7cc1-4e1a-88a8-d24da5d0f8c0 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:31:57 devstack sudo[109307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8bfe8fa7-7cc1-4e1a-88a8-d24da5d0f8c0 Aug 05 06:31:57 devstack sudo[109307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:31:57 devstack sudo[109307]: pam_unix(sudo:session): session closed for user root Aug 05 06:31:57 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-f51bbbf3-52c4-4e23-9442-fa797674e316 tempest-ProjectMemberTests-475949430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-8bfe8fa7-7cc1-4e1a-88a8-d24da5d0f8c0" returned: 0 in 0.326s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:31:57 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-f51bbbf3-52c4-4e23-9442-fa797674e316 tempest-ProjectMemberTests-475949430 None] Lock "cinder-quobyte-8bfe8fa7-7cc1-4e1a-88a8-d24da5d0f8c0" released by "delete_volume" :: held 0.824s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:31:57 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-f51bbbf3-52c4-4e23-9442-fa797674e316 tempest-ProjectMemberTests-475949430 None] Created reservations ['59769a6f-6e07-4057-8e79-8212ac7ac7de', '09ea1296-1363-4de8-942b-bf0329351955', '6187b8cc-0ba9-4c8f-8e7b-3aed70774627', 'd63c7674-8611-4e45-a9dc-50b39f5f8ace'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:31:57 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-f51bbbf3-52c4-4e23-9442-fa797674e316 tempest-ProjectMemberTests-475949430 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:31:57 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-f51bbbf3-52c4-4e23-9442-fa797674e316 tempest-ProjectMemberTests-475949430 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:31:57 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-f51bbbf3-52c4-4e23-9442-fa797674e316 tempest-ProjectMemberTests-475949430 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:31:57 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-f51bbbf3-52c4-4e23-9442-fa797674e316 tempest-ProjectMemberTests-475949430 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:31:57 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-f51bbbf3-52c4-4e23-9442-fa797674e316 tempest-ProjectMemberTests-475949430 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:31:57 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-f51bbbf3-52c4-4e23-9442-fa797674e316 tempest-ProjectMemberTests-475949430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:31:57 devstack sudo[109310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce Aug 05 06:31:57 devstack sudo[109310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:31:58 devstack sudo[109310]: pam_unix(sudo:session): session closed for user root Aug 05 06:31:58 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-f51bbbf3-52c4-4e23-9442-fa797674e316 tempest-ProjectMemberTests-475949430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce" returned: 0 in 0.444s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:31:58 devstack cinder-volume[88695]: DEBUG cinder.manager [None req-f51bbbf3-52c4-4e23-9442-fa797674e316 tempest-ProjectMemberTests-475949430 None] Notifying Schedulers of capabilities ... {{(pid=88695) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 06:31:58 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-f51bbbf3-52c4-4e23-9442-fa797674e316 tempest-ProjectMemberTests-475949430 None] Deleted volume successfully. Aug 05 06:31:58 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-f51bbbf3-52c4-4e23-9442-fa797674e316 tempest-ProjectMemberTests-475949430 None] Lock "cinder-8bfe8fa7-7cc1-4e1a-88a8-d24da5d0f8c0-delete_volume" released by "delete_volume" :: held 1.593s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:31:58 devstack cinder-volume[88695]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c89174d-23a0-40fb-a567-ebdc6d325545 tempest-ProjectMemberTests-475949430 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88695) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 06:31:58 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-0c89174d-23a0-40fb-a567-ebdc6d325545 tempest-ProjectMemberTests-475949430 None] Flow 'volume_create_manager' (7e746dda-1890-4e6b-92ca-39f63c46dd23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:31:58 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-0c89174d-23a0-40fb-a567-ebdc6d325545 tempest-ProjectMemberTests-475949430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (185e795a-3ff1-47eb-bc31-0464a6659953) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:31:58 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-0c89174d-23a0-40fb-a567-ebdc6d325545 tempest-ProjectMemberTests-475949430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (185e795a-3ff1-47eb-bc31-0464a6659953) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:31:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1731423507',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea1f5403-b9fb-477a-8317-285b99bd1b87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe85d705f6434b70a55dac31b79c0714',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:31:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:31:59Z,use_quota=True,user_id='a9de9bccd062450c95c9f7f6cf4317f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:31:58 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-0c89174d-23a0-40fb-a567-ebdc6d325545 tempest-ProjectMemberTests-475949430 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f8a09ea-3d5b-4d93-9dd1-de92238ed314) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:31:58 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-0c89174d-23a0-40fb-a567-ebdc6d325545 tempest-ProjectMemberTests-475949430 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f8a09ea-3d5b-4d93-9dd1-de92238ed314) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:31:58 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-0c89174d-23a0-40fb-a567-ebdc6d325545 tempest-ProjectMemberTests-475949430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74e4c847-4dbb-49e6-b976-0a5a23eda269) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:31:58 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-0c89174d-23a0-40fb-a567-ebdc6d325545 tempest-ProjectMemberTests-475949430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74e4c847-4dbb-49e6-b976-0a5a23eda269) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea1f5403-b9fb-477a-8317-285b99bd1b87', 'volume_name': 'volume-ea1f5403-b9fb-477a-8317-285b99bd1b87', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:31:58 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-0c89174d-23a0-40fb-a567-ebdc6d325545 tempest-ProjectMemberTests-475949430 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eefa73c9-1367-4af6-9e51-e98e8b7f5b77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:31:58 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-0c89174d-23a0-40fb-a567-ebdc6d325545 tempest-ProjectMemberTests-475949430 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eefa73c9-1367-4af6-9e51-e98e8b7f5b77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:31:58 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-0c89174d-23a0-40fb-a567-ebdc6d325545 tempest-ProjectMemberTests-475949430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4347a365-9dee-4e55-b15b-297138f8eb11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:31:58 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-0c89174d-23a0-40fb-a567-ebdc6d325545 tempest-ProjectMemberTests-475949430 None] Volume ea1f5403-b9fb-477a-8317-285b99bd1b87: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea1f5403-b9fb-477a-8317-285b99bd1b87', 'volume_size': 1} Aug 05 06:31:58 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-0c89174d-23a0-40fb-a567-ebdc6d325545 tempest-ProjectMemberTests-475949430 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:31:58 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-0c89174d-23a0-40fb-a567-ebdc6d325545 tempest-ProjectMemberTests-475949430 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:31:58 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-0c89174d-23a0-40fb-a567-ebdc6d325545 tempest-ProjectMemberTests-475949430 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:31:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1731423507',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea1f5403-b9fb-477a-8317-285b99bd1b87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe85d705f6434b70a55dac31b79c0714',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:31:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:31:59Z,use_quota=True,user_id='a9de9bccd062450c95c9f7f6cf4317f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)}" {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 06:31:58 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-0c89174d-23a0-40fb-a567-ebdc6d325545 tempest-ProjectMemberTests-475949430 None] Creating volume ea1f5403-b9fb-477a-8317-285b99bd1b87 {{(pid=88695) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 06:31:58 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-0c89174d-23a0-40fb-a567-ebdc6d325545 tempest-ProjectMemberTests-475949430 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:31:58 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-0c89174d-23a0-40fb-a567-ebdc6d325545 tempest-ProjectMemberTests-475949430 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:31:58 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-0c89174d-23a0-40fb-a567-ebdc6d325545 tempest-ProjectMemberTests-475949430 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:31:58 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-0c89174d-23a0-40fb-a567-ebdc6d325545 tempest-ProjectMemberTests-475949430 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:31:58 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-0c89174d-23a0-40fb-a567-ebdc6d325545 tempest-ProjectMemberTests-475949430 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:31:58 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-0c89174d-23a0-40fb-a567-ebdc6d325545 tempest-ProjectMemberTests-475949430 None] Selected osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 as target Quobyte volume. {{(pid=88695) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 06:31:58 devstack cinder-volume[88695]: INFO cinder.volume.drivers.remotefs [None req-0c89174d-23a0-40fb-a567-ebdc6d325545 tempest-ProjectMemberTests-475949430 None] casted to osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 Aug 05 06:31:58 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-0c89174d-23a0-40fb-a567-ebdc6d325545 tempest-ProjectMemberTests-475949430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-ea1f5403-b9fb-477a-8317-285b99bd1b87 1073741824 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:31:58 devstack sudo[109314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-ea1f5403-b9fb-477a-8317-285b99bd1b87 1073741824 Aug 05 06:31:58 devstack sudo[109314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:31:59 devstack sudo[109314]: pam_unix(sudo:session): session closed for user root Aug 05 06:31:59 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-0c89174d-23a0-40fb-a567-ebdc6d325545 tempest-ProjectMemberTests-475949430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-ea1f5403-b9fb-477a-8317-285b99bd1b87 1073741824" returned: 0 in 0.599s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:31:59 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-0c89174d-23a0-40fb-a567-ebdc6d325545 tempest-ProjectMemberTests-475949430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-ea1f5403-b9fb-477a-8317-285b99bd1b87 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:31:59 devstack sudo[109320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-ea1f5403-b9fb-477a-8317-285b99bd1b87 Aug 05 06:31:59 devstack sudo[109320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:31:59 devstack sudo[109320]: pam_unix(sudo:session): session closed for user root Aug 05 06:31:59 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-0c89174d-23a0-40fb-a567-ebdc6d325545 tempest-ProjectMemberTests-475949430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-ea1f5403-b9fb-477a-8317-285b99bd1b87" returned: 0 in 0.353s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:31:59 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-0c89174d-23a0-40fb-a567-ebdc6d325545 tempest-ProjectMemberTests-475949430 None] <== create_volume: return (1019ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'} {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 06:31:59 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-0c89174d-23a0-40fb-a567-ebdc6d325545 tempest-ProjectMemberTests-475949430 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.022s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:31:59 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-0c89174d-23a0-40fb-a567-ebdc6d325545 tempest-ProjectMemberTests-475949430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4347a365-9dee-4e55-b15b-297138f8eb11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea1f5403-b9fb-477a-8317-285b99bd1b87', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:31:59 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-0c89174d-23a0-40fb-a567-ebdc6d325545 tempest-ProjectMemberTests-475949430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (509502c5-6b05-4c4b-997e-3df074f7b7c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:31:59 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-0c89174d-23a0-40fb-a567-ebdc6d325545 tempest-ProjectMemberTests-475949430 None] Volume volume-ea1f5403-b9fb-477a-8317-285b99bd1b87 (ea1f5403-b9fb-477a-8317-285b99bd1b87): created successfully Aug 05 06:31:59 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-0c89174d-23a0-40fb-a567-ebdc6d325545 tempest-ProjectMemberTests-475949430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (509502c5-6b05-4c4b-997e-3df074f7b7c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:31:59 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-0c89174d-23a0-40fb-a567-ebdc6d325545 tempest-ProjectMemberTests-475949430 None] Flow 'volume_create_manager' (7e746dda-1890-4e6b-92ca-39f63c46dd23) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:31:59 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-0c89174d-23a0-40fb-a567-ebdc6d325545 tempest-ProjectMemberTests-475949430 None] Created volume successfully. Aug 05 06:32:00 devstack cinder-volume[88695]: DEBUG oslo_service.periodic_task [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88695) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 06:32:00 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:32:00 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:32:00 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:32:00 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:32:00 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:32:00 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:32:00 devstack sudo[109323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce Aug 05 06:32:00 devstack sudo[109323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:32:00 devstack sudo[109323]: pam_unix(sudo:session): session closed for user root Aug 05 06:32:00 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce" returned: 0 in 0.368s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:32:00 devstack cinder-volume[88695]: DEBUG cinder.manager [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] Notifying Schedulers of capabilities ... {{(pid=88695) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 06:32:00 devstack cinder-volume[88695]: DEBUG oslo_service.periodic_task [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] Running periodic task VolumeManager._thread_info {{(pid=88695) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 06:32:00 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] thread count: 28 {{(pid=88695) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 05 06:32:00 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] thread info: [<_MainThread(MainThread, started 134469211893888)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88695) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 05 06:32:01 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-0843209a-2f4a-4bd6-8493-26baccc88a0c tempest-ProjectMemberTests-475949430 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:32:01 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-0843209a-2f4a-4bd6-8493-26baccc88a0c tempest-ProjectMemberTests-475949430 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:32:01 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-0843209a-2f4a-4bd6-8493-26baccc88a0c tempest-ProjectMemberTests-475949430 None] Creating offline snapshot dc602969-e9d5-49fb-876b-61e059b94c9c of volume ea1f5403-b9fb-477a-8317-285b99bd1b87 {{(pid=88695) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 06:32:01 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2478b4d-124a-4a83-8b08-81b2c53c6ac9]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:32:01 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-0843209a-2f4a-4bd6-8493-26baccc88a0c tempest-ProjectMemberTests-475949430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-ea1f5403-b9fb-477a-8317-285b99bd1b87 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:32:01 devstack sudo[109326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-ea1f5403-b9fb-477a-8317-285b99bd1b87 Aug 05 06:32:01 devstack sudo[109326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:32:01 devstack sudo[109326]: pam_unix(sudo:session): session closed for user root Aug 05 06:32:01 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-0843209a-2f4a-4bd6-8493-26baccc88a0c tempest-ProjectMemberTests-475949430 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-ea1f5403-b9fb-477a-8317-285b99bd1b87" returned: 0 in 0.443s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:32:01 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-0843209a-2f4a-4bd6-8493-26baccc88a0c tempest-ProjectMemberTests-475949430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-ea1f5403-b9fb-477a-8317-285b99bd1b87,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-ea1f5403-b9fb-477a-8317-285b99bd1b87.dc602969-e9d5-49fb-876b-61e059b94c9c 1G {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:32:01 devstack sudo[109331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-ea1f5403-b9fb-477a-8317-285b99bd1b87,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-ea1f5403-b9fb-477a-8317-285b99bd1b87.dc602969-e9d5-49fb-876b-61e059b94c9c 1G Aug 05 06:32:01 devstack sudo[109331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:32:02 devstack sudo[109331]: pam_unix(sudo:session): session closed for user root Aug 05 06:32:02 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-0843209a-2f4a-4bd6-8493-26baccc88a0c tempest-ProjectMemberTests-475949430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-ea1f5403-b9fb-477a-8317-285b99bd1b87,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-ea1f5403-b9fb-477a-8317-285b99bd1b87.dc602969-e9d5-49fb-876b-61e059b94c9c 1G" returned: 0 in 0.493s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:32:02 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-0843209a-2f4a-4bd6-8493-26baccc88a0c tempest-ProjectMemberTests-475949430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ea1f5403-b9fb-477a-8317-285b99bd1b87 -F qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-ea1f5403-b9fb-477a-8317-285b99bd1b87.dc602969-e9d5-49fb-876b-61e059b94c9c {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:32:02 devstack sudo[109337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ea1f5403-b9fb-477a-8317-285b99bd1b87 -F qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-ea1f5403-b9fb-477a-8317-285b99bd1b87.dc602969-e9d5-49fb-876b-61e059b94c9c Aug 05 06:32:02 devstack sudo[109337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:32:02 devstack sudo[109337]: pam_unix(sudo:session): session closed for user root Aug 05 06:32:02 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-0843209a-2f4a-4bd6-8493-26baccc88a0c tempest-ProjectMemberTests-475949430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ea1f5403-b9fb-477a-8317-285b99bd1b87 -F qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-ea1f5403-b9fb-477a-8317-285b99bd1b87.dc602969-e9d5-49fb-876b-61e059b94c9c" returned: 0 in 0.350s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:32:02 devstack cinder-volume[88695]: WARNING cinder.volume.drivers.remotefs [None req-0843209a-2f4a-4bd6-8493-26baccc88a0c tempest-ProjectMemberTests-475949430 None] /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-ea1f5403-b9fb-477a-8317-285b99bd1b87.dc602969-e9d5-49fb-876b-61e059b94c9c is being set with open permissions: ugo+rw Aug 05 06:32:02 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-0843209a-2f4a-4bd6-8493-26baccc88a0c tempest-ProjectMemberTests-475949430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-ea1f5403-b9fb-477a-8317-285b99bd1b87.dc602969-e9d5-49fb-876b-61e059b94c9c {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:32:02 devstack sudo[109342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-ea1f5403-b9fb-477a-8317-285b99bd1b87.dc602969-e9d5-49fb-876b-61e059b94c9c Aug 05 06:32:02 devstack sudo[109342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:32:02 devstack sudo[109342]: pam_unix(sudo:session): session closed for user root Aug 05 06:32:02 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-0843209a-2f4a-4bd6-8493-26baccc88a0c tempest-ProjectMemberTests-475949430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-ea1f5403-b9fb-477a-8317-285b99bd1b87.dc602969-e9d5-49fb-876b-61e059b94c9c" returned: 0 in 0.267s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:32:02 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-0843209a-2f4a-4bd6-8493-26baccc88a0c tempest-ProjectMemberTests-475949430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-ea1f5403-b9fb-477a-8317-285b99bd1b87.info {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:32:02 devstack sudo[109345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-ea1f5403-b9fb-477a-8317-285b99bd1b87.info Aug 05 06:32:02 devstack sudo[109345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:32:03 devstack sudo[109345]: pam_unix(sudo:session): session closed for user root Aug 05 06:32:03 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-0843209a-2f4a-4bd6-8493-26baccc88a0c tempest-ProjectMemberTests-475949430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-ea1f5403-b9fb-477a-8317-285b99bd1b87.info" returned: 0 in 0.357s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:32:03 devstack cinder-volume[88695]: WARNING cinder.volume.drivers.remotefs [None req-0843209a-2f4a-4bd6-8493-26baccc88a0c tempest-ProjectMemberTests-475949430 None] /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-ea1f5403-b9fb-477a-8317-285b99bd1b87.info is being set with open permissions: ugo+rw Aug 05 06:32:03 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-0843209a-2f4a-4bd6-8493-26baccc88a0c tempest-ProjectMemberTests-475949430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-ea1f5403-b9fb-477a-8317-285b99bd1b87.info {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:32:03 devstack sudo[109348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-ea1f5403-b9fb-477a-8317-285b99bd1b87.info Aug 05 06:32:03 devstack sudo[109348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:32:03 devstack sudo[109348]: pam_unix(sudo:session): session closed for user root Aug 05 06:32:03 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-0843209a-2f4a-4bd6-8493-26baccc88a0c tempest-ProjectMemberTests-475949430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-ea1f5403-b9fb-477a-8317-285b99bd1b87.info" returned: 0 in 0.350s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:32:03 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-0843209a-2f4a-4bd6-8493-26baccc88a0c tempest-ProjectMemberTests-475949430 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.368s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:32:03 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-0843209a-2f4a-4bd6-8493-26baccc88a0c tempest-ProjectMemberTests-475949430 None] Create snapshot completed successfully Aug 05 06:32:04 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-daa1c1ff-817a-4f2c-a6ad-f91dd2ba8b82 tempest-ProjectMemberTests-475949430 None] Acquiring lock "cinder-dc602969-e9d5-49fb-876b-61e059b94c9c-delete_snapshot" by "delete_snapshot" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:32:04 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-daa1c1ff-817a-4f2c-a6ad-f91dd2ba8b82 tempest-ProjectMemberTests-475949430 None] Lock "cinder-dc602969-e9d5-49fb-876b-61e059b94c9c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:32:04 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-daa1c1ff-817a-4f2c-a6ad-f91dd2ba8b82 tempest-ProjectMemberTests-475949430 None] Acquiring lock "cinder-quobyte-ea1f5403-b9fb-477a-8317-285b99bd1b87" by "delete_snapshot" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:32:04 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-daa1c1ff-817a-4f2c-a6ad-f91dd2ba8b82 tempest-ProjectMemberTests-475949430 None] Lock "cinder-quobyte-ea1f5403-b9fb-477a-8317-285b99bd1b87" acquired by "delete_snapshot" :: waited 0.040s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:32:04 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-daa1c1ff-817a-4f2c-a6ad-f91dd2ba8b82 tempest-ProjectMemberTests-475949430 None] Acquiring lock "cinder-quobyte-dc602969-e9d5-49fb-876b-61e059b94c9c" by "_delete_snapshot" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:32:04 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-daa1c1ff-817a-4f2c-a6ad-f91dd2ba8b82 tempest-ProjectMemberTests-475949430 None] Lock "cinder-quobyte-dc602969-e9d5-49fb-876b-61e059b94c9c" acquired by "_delete_snapshot" :: waited 0.037s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:32:04 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-daa1c1ff-817a-4f2c-a6ad-f91dd2ba8b82 tempest-ProjectMemberTests-475949430 None] Deleting offline snapshot dc602969-e9d5-49fb-876b-61e059b94c9c of volume ea1f5403-b9fb-477a-8317-285b99bd1b87 {{(pid=88695) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 06:32:04 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-daa1c1ff-817a-4f2c-a6ad-f91dd2ba8b82 tempest-ProjectMemberTests-475949430 None] snapshot_file for this snap is: volume-ea1f5403-b9fb-477a-8317-285b99bd1b87.dc602969-e9d5-49fb-876b-61e059b94c9c {{(pid=88695) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 06:32:04 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[89482b1e-fd9f-44ac-95bf-df322ba75754]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:32:04 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-daa1c1ff-817a-4f2c-a6ad-f91dd2ba8b82 tempest-ProjectMemberTests-475949430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-ea1f5403-b9fb-477a-8317-285b99bd1b87.dc602969-e9d5-49fb-876b-61e059b94c9c {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:32:04 devstack sudo[109353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-ea1f5403-b9fb-477a-8317-285b99bd1b87.dc602969-e9d5-49fb-876b-61e059b94c9c Aug 05 06:32:04 devstack sudo[109353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:32:04 devstack cinder-volume[88695]: DEBUG cinder.volume.flows.manager.create_volume [None req-67031ddb-f423-4f82-8733-c14552461381 tempest-SnapshotDependencyTests-404532457 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88695) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 06:32:04 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-67031ddb-f423-4f82-8733-c14552461381 tempest-SnapshotDependencyTests-404532457 None] Flow 'volume_create_manager' (8f64a7d4-9cd3-4877-bb47-4cf856648926) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:32:04 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-67031ddb-f423-4f82-8733-c14552461381 tempest-SnapshotDependencyTests-404532457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c9cc143-4a70-4e93-8a64-0fe2ee5c8fa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:32:04 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-67031ddb-f423-4f82-8733-c14552461381 tempest-SnapshotDependencyTests-404532457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c9cc143-4a70-4e93-8a64-0fe2ee5c8fa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:32:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-579250238',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85394345-0f6b-4ccf-b749-3b74f4099bd6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c2a5c360b0f4337ba04f9cd3307d826',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:32:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:32:05Z,use_quota=True,user_id='bbb20844033146008fca284921936f91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:32:04 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-67031ddb-f423-4f82-8733-c14552461381 tempest-SnapshotDependencyTests-404532457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07a379f3-d5c7-4e90-83f9-524364c739f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:32:04 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-67031ddb-f423-4f82-8733-c14552461381 tempest-SnapshotDependencyTests-404532457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07a379f3-d5c7-4e90-83f9-524364c739f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:32:04 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-67031ddb-f423-4f82-8733-c14552461381 tempest-SnapshotDependencyTests-404532457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82734fa3-f3a5-4496-b0f6-8e3113701f86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:32:04 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-67031ddb-f423-4f82-8733-c14552461381 tempest-SnapshotDependencyTests-404532457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82734fa3-f3a5-4496-b0f6-8e3113701f86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '85394345-0f6b-4ccf-b749-3b74f4099bd6', 'volume_name': 'volume-85394345-0f6b-4ccf-b749-3b74f4099bd6', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:32:04 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-67031ddb-f423-4f82-8733-c14552461381 tempest-SnapshotDependencyTests-404532457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20e7d449-d27c-411b-86c4-8106aa224988) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:32:04 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-67031ddb-f423-4f82-8733-c14552461381 tempest-SnapshotDependencyTests-404532457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20e7d449-d27c-411b-86c4-8106aa224988) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:32:04 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-67031ddb-f423-4f82-8733-c14552461381 tempest-SnapshotDependencyTests-404532457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (413ab707-ce16-4865-aacb-2d3c28b534c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:32:04 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-67031ddb-f423-4f82-8733-c14552461381 tempest-SnapshotDependencyTests-404532457 None] Volume 85394345-0f6b-4ccf-b749-3b74f4099bd6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-85394345-0f6b-4ccf-b749-3b74f4099bd6', 'volume_size': 1} Aug 05 06:32:04 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-67031ddb-f423-4f82-8733-c14552461381 tempest-SnapshotDependencyTests-404532457 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:32:04 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-67031ddb-f423-4f82-8733-c14552461381 tempest-SnapshotDependencyTests-404532457 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:32:04 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-67031ddb-f423-4f82-8733-c14552461381 tempest-SnapshotDependencyTests-404532457 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:32:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-579250238',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85394345-0f6b-4ccf-b749-3b74f4099bd6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c2a5c360b0f4337ba04f9cd3307d826',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:32:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:32:05Z,use_quota=True,user_id='bbb20844033146008fca284921936f91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)}" {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 06:32:04 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-67031ddb-f423-4f82-8733-c14552461381 tempest-SnapshotDependencyTests-404532457 None] Creating volume 85394345-0f6b-4ccf-b749-3b74f4099bd6 {{(pid=88695) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 06:32:04 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-67031ddb-f423-4f82-8733-c14552461381 tempest-SnapshotDependencyTests-404532457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:32:04 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-67031ddb-f423-4f82-8733-c14552461381 tempest-SnapshotDependencyTests-404532457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:32:04 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-67031ddb-f423-4f82-8733-c14552461381 tempest-SnapshotDependencyTests-404532457 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:32:04 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-67031ddb-f423-4f82-8733-c14552461381 tempest-SnapshotDependencyTests-404532457 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:32:04 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-67031ddb-f423-4f82-8733-c14552461381 tempest-SnapshotDependencyTests-404532457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:32:04 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-67031ddb-f423-4f82-8733-c14552461381 tempest-SnapshotDependencyTests-404532457 None] Selected osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 as target Quobyte volume. {{(pid=88695) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 06:32:04 devstack cinder-volume[88695]: INFO cinder.volume.drivers.remotefs [None req-67031ddb-f423-4f82-8733-c14552461381 tempest-SnapshotDependencyTests-404532457 None] casted to osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 Aug 05 06:32:04 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-67031ddb-f423-4f82-8733-c14552461381 tempest-SnapshotDependencyTests-404532457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-85394345-0f6b-4ccf-b749-3b74f4099bd6 1073741824 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:32:04 devstack sudo[109355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-85394345-0f6b-4ccf-b749-3b74f4099bd6 1073741824 Aug 05 06:32:04 devstack sudo[109355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:32:04 devstack sudo[109353]: pam_unix(sudo:session): session closed for user root Aug 05 06:32:04 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-daa1c1ff-817a-4f2c-a6ad-f91dd2ba8b82 tempest-ProjectMemberTests-475949430 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-ea1f5403-b9fb-477a-8317-285b99bd1b87.dc602969-e9d5-49fb-876b-61e059b94c9c" returned: 0 in 0.515s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:32:04 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-daa1c1ff-817a-4f2c-a6ad-f91dd2ba8b82 tempest-ProjectMemberTests-475949430 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ea1f5403-b9fb-477a-8317-285b99bd1b87(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88695) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 06:32:05 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bbc2ec6-6912-47f7-b962-94a5a831c9c4]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:32:05 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-daa1c1ff-817a-4f2c-a6ad-f91dd2ba8b82 tempest-ProjectMemberTests-475949430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-ea1f5403-b9fb-477a-8317-285b99bd1b87 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:32:05 devstack sudo[109360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-ea1f5403-b9fb-477a-8317-285b99bd1b87 Aug 05 06:32:05 devstack sudo[109360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:32:05 devstack sudo[109355]: pam_unix(sudo:session): session closed for user root Aug 05 06:32:05 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-67031ddb-f423-4f82-8733-c14552461381 tempest-SnapshotDependencyTests-404532457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-85394345-0f6b-4ccf-b749-3b74f4099bd6 1073741824" returned: 0 in 0.478s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:32:05 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-67031ddb-f423-4f82-8733-c14552461381 tempest-SnapshotDependencyTests-404532457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-85394345-0f6b-4ccf-b749-3b74f4099bd6 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:32:05 devstack sudo[109365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-85394345-0f6b-4ccf-b749-3b74f4099bd6 Aug 05 06:32:05 devstack sudo[109365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:32:05 devstack sudo[109360]: pam_unix(sudo:session): session closed for user root Aug 05 06:32:05 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-daa1c1ff-817a-4f2c-a6ad-f91dd2ba8b82 tempest-ProjectMemberTests-475949430 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-ea1f5403-b9fb-477a-8317-285b99bd1b87" returned: 0 in 0.422s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:32:05 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-daa1c1ff-817a-4f2c-a6ad-f91dd2ba8b82 tempest-ProjectMemberTests-475949430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-ea1f5403-b9fb-477a-8317-285b99bd1b87.dc602969-e9d5-49fb-876b-61e059b94c9c {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:32:05 devstack sudo[109370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-ea1f5403-b9fb-477a-8317-285b99bd1b87.dc602969-e9d5-49fb-876b-61e059b94c9c Aug 05 06:32:05 devstack sudo[109370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:32:05 devstack sudo[109365]: pam_unix(sudo:session): session closed for user root Aug 05 06:32:05 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-67031ddb-f423-4f82-8733-c14552461381 tempest-SnapshotDependencyTests-404532457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-85394345-0f6b-4ccf-b749-3b74f4099bd6" returned: 0 in 0.296s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:32:05 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-67031ddb-f423-4f82-8733-c14552461381 tempest-SnapshotDependencyTests-404532457 None] <== create_volume: return (842ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'} {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 06:32:05 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-67031ddb-f423-4f82-8733-c14552461381 tempest-SnapshotDependencyTests-404532457 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.846s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:32:05 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-67031ddb-f423-4f82-8733-c14552461381 tempest-SnapshotDependencyTests-404532457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (413ab707-ce16-4865-aacb-2d3c28b534c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-85394345-0f6b-4ccf-b749-3b74f4099bd6', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:32:05 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-67031ddb-f423-4f82-8733-c14552461381 tempest-SnapshotDependencyTests-404532457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24c319c2-b9be-4cd4-93bd-f572cf488f9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:32:05 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-67031ddb-f423-4f82-8733-c14552461381 tempest-SnapshotDependencyTests-404532457 None] Volume volume-85394345-0f6b-4ccf-b749-3b74f4099bd6 (85394345-0f6b-4ccf-b749-3b74f4099bd6): created successfully Aug 05 06:32:05 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-67031ddb-f423-4f82-8733-c14552461381 tempest-SnapshotDependencyTests-404532457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24c319c2-b9be-4cd4-93bd-f572cf488f9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:32:05 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-67031ddb-f423-4f82-8733-c14552461381 tempest-SnapshotDependencyTests-404532457 None] Flow 'volume_create_manager' (8f64a7d4-9cd3-4877-bb47-4cf856648926) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:32:05 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-67031ddb-f423-4f82-8733-c14552461381 tempest-SnapshotDependencyTests-404532457 None] Created volume successfully. Aug 05 06:32:05 devstack sudo[109370]: pam_unix(sudo:session): session closed for user root Aug 05 06:32:05 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-daa1c1ff-817a-4f2c-a6ad-f91dd2ba8b82 tempest-ProjectMemberTests-475949430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-ea1f5403-b9fb-477a-8317-285b99bd1b87.dc602969-e9d5-49fb-876b-61e059b94c9c" returned: 0 in 0.391s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:32:05 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-daa1c1ff-817a-4f2c-a6ad-f91dd2ba8b82 tempest-ProjectMemberTests-475949430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-ea1f5403-b9fb-477a-8317-285b99bd1b87.dc602969-e9d5-49fb-876b-61e059b94c9c {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:32:05 devstack sudo[109376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-ea1f5403-b9fb-477a-8317-285b99bd1b87.dc602969-e9d5-49fb-876b-61e059b94c9c Aug 05 06:32:05 devstack sudo[109376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:32:06 devstack sudo[109376]: pam_unix(sudo:session): session closed for user root Aug 05 06:32:06 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-daa1c1ff-817a-4f2c-a6ad-f91dd2ba8b82 tempest-ProjectMemberTests-475949430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-ea1f5403-b9fb-477a-8317-285b99bd1b87.dc602969-e9d5-49fb-876b-61e059b94c9c" returned: 0 in 0.282s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:32:06 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-daa1c1ff-817a-4f2c-a6ad-f91dd2ba8b82 tempest-ProjectMemberTests-475949430 None] Lock "cinder-quobyte-dc602969-e9d5-49fb-876b-61e059b94c9c" released by "_delete_snapshot" :: held 1.745s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:32:06 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-daa1c1ff-817a-4f2c-a6ad-f91dd2ba8b82 tempest-ProjectMemberTests-475949430 None] Lock "cinder-quobyte-ea1f5403-b9fb-477a-8317-285b99bd1b87" released by "delete_snapshot" :: held 1.792s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:32:06 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-daa1c1ff-817a-4f2c-a6ad-f91dd2ba8b82 tempest-ProjectMemberTests-475949430 None] Created reservations ['ff031f0c-c22d-4642-9a99-894b69559783', '721a5190-f7a5-4e49-a3ba-29a128b2d625', '1ec8e3c9-6ee9-413f-a141-e55ce109726b', '248053ff-e01c-4342-917d-3cfcc5f385ae'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:32:06 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-daa1c1ff-817a-4f2c-a6ad-f91dd2ba8b82 tempest-ProjectMemberTests-475949430 None] Delete snapshot completed successfully. Aug 05 06:32:06 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-daa1c1ff-817a-4f2c-a6ad-f91dd2ba8b82 tempest-ProjectMemberTests-475949430 None] Lock "cinder-dc602969-e9d5-49fb-876b-61e059b94c9c-delete_snapshot" released by "delete_snapshot" :: held 1.977s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:32:06 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-eeb2621c-f60a-47bb-920c-07faa4644ef6 tempest-ProjectMemberTests-475949430 None] Acquiring lock "cinder-ea1f5403-b9fb-477a-8317-285b99bd1b87-delete_volume" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:32:06 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-eeb2621c-f60a-47bb-920c-07faa4644ef6 tempest-ProjectMemberTests-475949430 None] Lock "cinder-ea1f5403-b9fb-477a-8317-285b99bd1b87-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:32:06 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-eeb2621c-f60a-47bb-920c-07faa4644ef6 tempest-ProjectMemberTests-475949430 None] Acquiring lock "cinder-quobyte-ea1f5403-b9fb-477a-8317-285b99bd1b87" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:32:06 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-eeb2621c-f60a-47bb-920c-07faa4644ef6 tempest-ProjectMemberTests-475949430 None] Lock "cinder-quobyte-ea1f5403-b9fb-477a-8317-285b99bd1b87" acquired by "delete_volume" :: waited 0.016s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:32:06 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9c386f5-4f36-4dd9-af2f-10c0ec6f9a6c]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:32:06 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-eeb2621c-f60a-47bb-920c-07faa4644ef6 tempest-ProjectMemberTests-475949430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-ea1f5403-b9fb-477a-8317-285b99bd1b87 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:32:06 devstack sudo[109379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-ea1f5403-b9fb-477a-8317-285b99bd1b87 Aug 05 06:32:06 devstack sudo[109379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:32:06 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-ad36b753-9edd-489c-bae7-3930e75179c9 tempest-SnapshotDependencyTests-404532457 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:32:06 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-ad36b753-9edd-489c-bae7-3930e75179c9 tempest-SnapshotDependencyTests-404532457 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:32:06 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-ad36b753-9edd-489c-bae7-3930e75179c9 tempest-SnapshotDependencyTests-404532457 None] Creating offline snapshot f9f42d1c-5686-4c52-9479-7a784588a4dc of volume 85394345-0f6b-4ccf-b749-3b74f4099bd6 {{(pid=88695) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 06:32:06 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[7abb0d03-18fb-41b5-ab00-87abb5db49bb]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:32:06 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-ad36b753-9edd-489c-bae7-3930e75179c9 tempest-SnapshotDependencyTests-404532457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-85394345-0f6b-4ccf-b749-3b74f4099bd6 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:32:06 devstack sudo[109379]: pam_unix(sudo:session): session closed for user root Aug 05 06:32:06 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-eeb2621c-f60a-47bb-920c-07faa4644ef6 tempest-ProjectMemberTests-475949430 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-ea1f5403-b9fb-477a-8317-285b99bd1b87" returned: 0 in 0.412s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:32:06 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-eeb2621c-f60a-47bb-920c-07faa4644ef6 tempest-ProjectMemberTests-475949430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-ea1f5403-b9fb-477a-8317-285b99bd1b87 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:32:07 devstack sudo[109385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-ea1f5403-b9fb-477a-8317-285b99bd1b87 Aug 05 06:32:07 devstack sudo[109385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:32:07 devstack sudo[109384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-85394345-0f6b-4ccf-b749-3b74f4099bd6 Aug 05 06:32:07 devstack sudo[109384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:32:07 devstack sudo[109385]: pam_unix(sudo:session): session closed for user root Aug 05 06:32:07 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-eeb2621c-f60a-47bb-920c-07faa4644ef6 tempest-ProjectMemberTests-475949430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-ea1f5403-b9fb-477a-8317-285b99bd1b87" returned: 0 in 0.261s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:32:07 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-eeb2621c-f60a-47bb-920c-07faa4644ef6 tempest-ProjectMemberTests-475949430 None] Lock "cinder-quobyte-ea1f5403-b9fb-477a-8317-285b99bd1b87" released by "delete_volume" :: held 0.738s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:32:07 devstack sudo[109384]: pam_unix(sudo:session): session closed for user root Aug 05 06:32:07 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-ad36b753-9edd-489c-bae7-3930e75179c9 tempest-SnapshotDependencyTests-404532457 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-85394345-0f6b-4ccf-b749-3b74f4099bd6" returned: 0 in 0.411s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:32:07 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-ad36b753-9edd-489c-bae7-3930e75179c9 tempest-SnapshotDependencyTests-404532457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-85394345-0f6b-4ccf-b749-3b74f4099bd6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-85394345-0f6b-4ccf-b749-3b74f4099bd6.f9f42d1c-5686-4c52-9479-7a784588a4dc 1G {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:32:07 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-eeb2621c-f60a-47bb-920c-07faa4644ef6 tempest-ProjectMemberTests-475949430 None] Created reservations ['dd23a301-77bc-47e0-a591-838178cc8b0b', '60fc4f59-9d28-4899-b817-951efd60f1c8', '72de9b97-c508-4613-89c5-046f0001b72f', '40789eae-5568-4a1b-bd76-b7cb455c8ee5'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:32:07 devstack sudo[109392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-85394345-0f6b-4ccf-b749-3b74f4099bd6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-85394345-0f6b-4ccf-b749-3b74f4099bd6.f9f42d1c-5686-4c52-9479-7a784588a4dc 1G Aug 05 06:32:07 devstack sudo[109392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:32:07 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-eeb2621c-f60a-47bb-920c-07faa4644ef6 tempest-ProjectMemberTests-475949430 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:32:07 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-eeb2621c-f60a-47bb-920c-07faa4644ef6 tempest-ProjectMemberTests-475949430 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:32:07 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-eeb2621c-f60a-47bb-920c-07faa4644ef6 tempest-ProjectMemberTests-475949430 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:32:07 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-eeb2621c-f60a-47bb-920c-07faa4644ef6 tempest-ProjectMemberTests-475949430 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:32:07 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-eeb2621c-f60a-47bb-920c-07faa4644ef6 tempest-ProjectMemberTests-475949430 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:32:07 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-eeb2621c-f60a-47bb-920c-07faa4644ef6 tempest-ProjectMemberTests-475949430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:32:07 devstack sudo[109394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce Aug 05 06:32:07 devstack sudo[109394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:32:07 devstack sudo[109394]: pam_unix(sudo:session): session closed for user root Aug 05 06:32:07 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-eeb2621c-f60a-47bb-920c-07faa4644ef6 tempest-ProjectMemberTests-475949430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce" returned: 0 in 0.416s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:32:07 devstack cinder-volume[88695]: DEBUG cinder.manager [None req-eeb2621c-f60a-47bb-920c-07faa4644ef6 tempest-ProjectMemberTests-475949430 None] Notifying Schedulers of capabilities ... {{(pid=88695) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 06:32:07 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-eeb2621c-f60a-47bb-920c-07faa4644ef6 tempest-ProjectMemberTests-475949430 None] Deleted volume successfully. Aug 05 06:32:07 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-eeb2621c-f60a-47bb-920c-07faa4644ef6 tempest-ProjectMemberTests-475949430 None] Lock "cinder-ea1f5403-b9fb-477a-8317-285b99bd1b87-delete_volume" released by "delete_volume" :: held 1.484s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:32:08 devstack sudo[109392]: pam_unix(sudo:session): session closed for user root Aug 05 06:32:08 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-ad36b753-9edd-489c-bae7-3930e75179c9 tempest-SnapshotDependencyTests-404532457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-85394345-0f6b-4ccf-b749-3b74f4099bd6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-85394345-0f6b-4ccf-b749-3b74f4099bd6.f9f42d1c-5686-4c52-9479-7a784588a4dc 1G" returned: 0 in 0.638s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:32:08 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-ad36b753-9edd-489c-bae7-3930e75179c9 tempest-SnapshotDependencyTests-404532457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-85394345-0f6b-4ccf-b749-3b74f4099bd6 -F qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-85394345-0f6b-4ccf-b749-3b74f4099bd6.f9f42d1c-5686-4c52-9479-7a784588a4dc {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:32:08 devstack sudo[109401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-85394345-0f6b-4ccf-b749-3b74f4099bd6 -F qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-85394345-0f6b-4ccf-b749-3b74f4099bd6.f9f42d1c-5686-4c52-9479-7a784588a4dc Aug 05 06:32:08 devstack sudo[109401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:32:08 devstack cinder-volume[88695]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb99ea26-a0ac-42d0-8bb3-5129e01f7dac tempest-ProjectMemberTests-475949430 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88695) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 06:32:08 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-eb99ea26-a0ac-42d0-8bb3-5129e01f7dac tempest-ProjectMemberTests-475949430 None] Flow 'volume_create_manager' (5c8b6035-e5c1-4f31-b745-4682b46b8ad9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:32:08 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-eb99ea26-a0ac-42d0-8bb3-5129e01f7dac tempest-ProjectMemberTests-475949430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (269f3dba-84d8-487f-b953-0110c34aa7dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:32:08 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-eb99ea26-a0ac-42d0-8bb3-5129e01f7dac tempest-ProjectMemberTests-475949430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (269f3dba-84d8-487f-b953-0110c34aa7dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:32:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1260953105',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=663cfe5e-57f1-4e3c-8256-820a0f6b39f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe85d705f6434b70a55dac31b79c0714',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:32:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:32:08Z,use_quota=True,user_id='a9de9bccd062450c95c9f7f6cf4317f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:32:08 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-eb99ea26-a0ac-42d0-8bb3-5129e01f7dac tempest-ProjectMemberTests-475949430 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ac3b827-0ec5-429b-904d-747b26406c57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:32:08 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-eb99ea26-a0ac-42d0-8bb3-5129e01f7dac tempest-ProjectMemberTests-475949430 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ac3b827-0ec5-429b-904d-747b26406c57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:32:08 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-eb99ea26-a0ac-42d0-8bb3-5129e01f7dac tempest-ProjectMemberTests-475949430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f44ee319-9ee5-4455-ad88-2377d0a3d3b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:32:08 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-eb99ea26-a0ac-42d0-8bb3-5129e01f7dac tempest-ProjectMemberTests-475949430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f44ee319-9ee5-4455-ad88-2377d0a3d3b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '663cfe5e-57f1-4e3c-8256-820a0f6b39f6', 'volume_name': 'volume-663cfe5e-57f1-4e3c-8256-820a0f6b39f6', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:32:08 devstack sudo[109401]: pam_unix(sudo:session): session closed for user root Aug 05 06:32:08 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-eb99ea26-a0ac-42d0-8bb3-5129e01f7dac tempest-ProjectMemberTests-475949430 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03f54418-8591-412a-80cb-978b22696095) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:32:08 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-eb99ea26-a0ac-42d0-8bb3-5129e01f7dac tempest-ProjectMemberTests-475949430 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03f54418-8591-412a-80cb-978b22696095) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:32:08 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-eb99ea26-a0ac-42d0-8bb3-5129e01f7dac tempest-ProjectMemberTests-475949430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0237d021-43e3-483a-8d09-9c902c564b95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:32:08 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-eb99ea26-a0ac-42d0-8bb3-5129e01f7dac tempest-ProjectMemberTests-475949430 None] Volume 663cfe5e-57f1-4e3c-8256-820a0f6b39f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-663cfe5e-57f1-4e3c-8256-820a0f6b39f6', 'volume_size': 1} Aug 05 06:32:08 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-eb99ea26-a0ac-42d0-8bb3-5129e01f7dac tempest-ProjectMemberTests-475949430 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:32:08 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-ad36b753-9edd-489c-bae7-3930e75179c9 tempest-SnapshotDependencyTests-404532457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-85394345-0f6b-4ccf-b749-3b74f4099bd6 -F qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-85394345-0f6b-4ccf-b749-3b74f4099bd6.f9f42d1c-5686-4c52-9479-7a784588a4dc" returned: 0 in 0.458s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:32:08 devstack cinder-volume[88695]: WARNING cinder.volume.drivers.remotefs [None req-ad36b753-9edd-489c-bae7-3930e75179c9 tempest-SnapshotDependencyTests-404532457 None] /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-85394345-0f6b-4ccf-b749-3b74f4099bd6.f9f42d1c-5686-4c52-9479-7a784588a4dc is being set with open permissions: ugo+rw Aug 05 06:32:08 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-ad36b753-9edd-489c-bae7-3930e75179c9 tempest-SnapshotDependencyTests-404532457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-85394345-0f6b-4ccf-b749-3b74f4099bd6.f9f42d1c-5686-4c52-9479-7a784588a4dc {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:32:08 devstack sudo[109408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-85394345-0f6b-4ccf-b749-3b74f4099bd6.f9f42d1c-5686-4c52-9479-7a784588a4dc Aug 05 06:32:08 devstack sudo[109408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:32:08 devstack sudo[109408]: pam_unix(sudo:session): session closed for user root Aug 05 06:32:08 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-ad36b753-9edd-489c-bae7-3930e75179c9 tempest-SnapshotDependencyTests-404532457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-85394345-0f6b-4ccf-b749-3b74f4099bd6.f9f42d1c-5686-4c52-9479-7a784588a4dc" returned: 0 in 0.264s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:32:08 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-ad36b753-9edd-489c-bae7-3930e75179c9 tempest-SnapshotDependencyTests-404532457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-85394345-0f6b-4ccf-b749-3b74f4099bd6.info {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:32:08 devstack sudo[109411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-85394345-0f6b-4ccf-b749-3b74f4099bd6.info Aug 05 06:32:08 devstack sudo[109411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:32:09 devstack sudo[109411]: pam_unix(sudo:session): session closed for user root Aug 05 06:32:09 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-ad36b753-9edd-489c-bae7-3930e75179c9 tempest-SnapshotDependencyTests-404532457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-85394345-0f6b-4ccf-b749-3b74f4099bd6.info" returned: 0 in 0.271s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:32:09 devstack cinder-volume[88695]: WARNING cinder.volume.drivers.remotefs [None req-ad36b753-9edd-489c-bae7-3930e75179c9 tempest-SnapshotDependencyTests-404532457 None] /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-85394345-0f6b-4ccf-b749-3b74f4099bd6.info is being set with open permissions: ugo+rw Aug 05 06:32:09 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-ad36b753-9edd-489c-bae7-3930e75179c9 tempest-SnapshotDependencyTests-404532457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-85394345-0f6b-4ccf-b749-3b74f4099bd6.info {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:32:09 devstack sudo[109414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-85394345-0f6b-4ccf-b749-3b74f4099bd6.info Aug 05 06:32:09 devstack sudo[109414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:32:09 devstack sudo[109414]: pam_unix(sudo:session): session closed for user root Aug 05 06:32:09 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-ad36b753-9edd-489c-bae7-3930e75179c9 tempest-SnapshotDependencyTests-404532457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-85394345-0f6b-4ccf-b749-3b74f4099bd6.info" returned: 0 in 0.251s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:32:09 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-ad36b753-9edd-489c-bae7-3930e75179c9 tempest-SnapshotDependencyTests-404532457 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.381s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:32:09 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-eb99ea26-a0ac-42d0-8bb3-5129e01f7dac tempest-ProjectMemberTests-475949430 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.845s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:32:09 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-eb99ea26-a0ac-42d0-8bb3-5129e01f7dac tempest-ProjectMemberTests-475949430 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:32:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1260953105',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=663cfe5e-57f1-4e3c-8256-820a0f6b39f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe85d705f6434b70a55dac31b79c0714',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:32:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:32:08Z,use_quota=True,user_id='a9de9bccd062450c95c9f7f6cf4317f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)}" {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 06:32:09 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-eb99ea26-a0ac-42d0-8bb3-5129e01f7dac tempest-ProjectMemberTests-475949430 None] Creating volume 663cfe5e-57f1-4e3c-8256-820a0f6b39f6 {{(pid=88695) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 06:32:09 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-eb99ea26-a0ac-42d0-8bb3-5129e01f7dac tempest-ProjectMemberTests-475949430 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:32:09 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-eb99ea26-a0ac-42d0-8bb3-5129e01f7dac tempest-ProjectMemberTests-475949430 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:32:09 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-eb99ea26-a0ac-42d0-8bb3-5129e01f7dac tempest-ProjectMemberTests-475949430 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:32:09 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-eb99ea26-a0ac-42d0-8bb3-5129e01f7dac tempest-ProjectMemberTests-475949430 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:32:09 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-eb99ea26-a0ac-42d0-8bb3-5129e01f7dac tempest-ProjectMemberTests-475949430 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:32:09 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-eb99ea26-a0ac-42d0-8bb3-5129e01f7dac tempest-ProjectMemberTests-475949430 None] Selected osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 as target Quobyte volume. {{(pid=88695) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 06:32:09 devstack cinder-volume[88695]: INFO cinder.volume.drivers.remotefs [None req-eb99ea26-a0ac-42d0-8bb3-5129e01f7dac tempest-ProjectMemberTests-475949430 None] casted to osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 Aug 05 06:32:09 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-eb99ea26-a0ac-42d0-8bb3-5129e01f7dac tempest-ProjectMemberTests-475949430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-663cfe5e-57f1-4e3c-8256-820a0f6b39f6 1073741824 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:32:09 devstack sudo[109417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-663cfe5e-57f1-4e3c-8256-820a0f6b39f6 1073741824 Aug 05 06:32:09 devstack sudo[109417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:32:09 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-ad36b753-9edd-489c-bae7-3930e75179c9 tempest-SnapshotDependencyTests-404532457 None] Create snapshot completed successfully Aug 05 06:32:09 devstack sudo[109417]: pam_unix(sudo:session): session closed for user root Aug 05 06:32:09 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-eb99ea26-a0ac-42d0-8bb3-5129e01f7dac tempest-ProjectMemberTests-475949430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-663cfe5e-57f1-4e3c-8256-820a0f6b39f6 1073741824" returned: 0 in 0.451s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:32:09 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-eb99ea26-a0ac-42d0-8bb3-5129e01f7dac tempest-ProjectMemberTests-475949430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-663cfe5e-57f1-4e3c-8256-820a0f6b39f6 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:32:09 devstack sudo[109423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-663cfe5e-57f1-4e3c-8256-820a0f6b39f6 Aug 05 06:32:09 devstack sudo[109423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:32:10 devstack sudo[109423]: pam_unix(sudo:session): session closed for user root Aug 05 06:32:10 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-eb99ea26-a0ac-42d0-8bb3-5129e01f7dac tempest-ProjectMemberTests-475949430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-663cfe5e-57f1-4e3c-8256-820a0f6b39f6" returned: 0 in 0.287s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:32:10 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-eb99ea26-a0ac-42d0-8bb3-5129e01f7dac tempest-ProjectMemberTests-475949430 None] <== create_volume: return (786ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'} {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 06:32:10 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-eb99ea26-a0ac-42d0-8bb3-5129e01f7dac tempest-ProjectMemberTests-475949430 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.789s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:32:10 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-eb99ea26-a0ac-42d0-8bb3-5129e01f7dac tempest-ProjectMemberTests-475949430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0237d021-43e3-483a-8d09-9c902c564b95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-663cfe5e-57f1-4e3c-8256-820a0f6b39f6', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:32:10 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-eb99ea26-a0ac-42d0-8bb3-5129e01f7dac tempest-ProjectMemberTests-475949430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fdadcb5-8a82-4641-bcbe-a200bbdaf98c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:32:10 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-eb99ea26-a0ac-42d0-8bb3-5129e01f7dac tempest-ProjectMemberTests-475949430 None] Volume volume-663cfe5e-57f1-4e3c-8256-820a0f6b39f6 (663cfe5e-57f1-4e3c-8256-820a0f6b39f6): created successfully Aug 05 06:32:10 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-eb99ea26-a0ac-42d0-8bb3-5129e01f7dac tempest-ProjectMemberTests-475949430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fdadcb5-8a82-4641-bcbe-a200bbdaf98c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:32:10 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-eb99ea26-a0ac-42d0-8bb3-5129e01f7dac tempest-ProjectMemberTests-475949430 None] Flow 'volume_create_manager' (5c8b6035-e5c1-4f31-b745-4682b46b8ad9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:32:10 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-eb99ea26-a0ac-42d0-8bb3-5129e01f7dac tempest-ProjectMemberTests-475949430 None] Created volume successfully. Aug 05 06:32:10 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-2147fba0-f770-44e0-b3a1-34d449457194 tempest-ProjectMemberTests-475949430 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:32:10 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-2147fba0-f770-44e0-b3a1-34d449457194 tempest-ProjectMemberTests-475949430 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:32:10 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-2147fba0-f770-44e0-b3a1-34d449457194 tempest-ProjectMemberTests-475949430 None] Creating offline snapshot 42ea92f7-be54-4a02-ad97-2444b7abeb43 of volume 663cfe5e-57f1-4e3c-8256-820a0f6b39f6 {{(pid=88695) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 06:32:10 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc4d159c-34c5-47b2-89c9-2dcdf2ef91bf]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:32:10 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-2147fba0-f770-44e0-b3a1-34d449457194 tempest-ProjectMemberTests-475949430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-663cfe5e-57f1-4e3c-8256-820a0f6b39f6 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:32:10 devstack sudo[109427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-663cfe5e-57f1-4e3c-8256-820a0f6b39f6 Aug 05 06:32:10 devstack sudo[109427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:32:11 devstack cinder-volume[88695]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ce8fe77-c049-473b-8296-49949910a30c tempest-SnapshotDependencyTests-404532457 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88695) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 06:32:11 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-5ce8fe77-c049-473b-8296-49949910a30c tempest-SnapshotDependencyTests-404532457 None] Flow 'volume_create_manager' (aa84dce5-d0e7-4c89-aaa7-43dddd31f0c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:32:11 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-5ce8fe77-c049-473b-8296-49949910a30c tempest-SnapshotDependencyTests-404532457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (234981e1-224b-4f1b-b9ba-960bd4fae93d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:32:11 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-5ce8fe77-c049-473b-8296-49949910a30c tempest-SnapshotDependencyTests-404532457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (234981e1-224b-4f1b-b9ba-960bd4fae93d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:32:11Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47ce036f-3ed2-4a1d-af1d-98643e2e5ca2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c2a5c360b0f4337ba04f9cd3307d826',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:32:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=f9f42d1c-5686-4c52-9479-7a784588a4dc,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:32:11Z,use_quota=True,user_id='bbb20844033146008fca284921936f91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:32:11 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-5ce8fe77-c049-473b-8296-49949910a30c tempest-SnapshotDependencyTests-404532457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4d7c37c-c27e-4962-9a2c-090ae6b244ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:32:11 devstack sudo[109427]: pam_unix(sudo:session): session closed for user root Aug 05 06:32:11 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-5ce8fe77-c049-473b-8296-49949910a30c tempest-SnapshotDependencyTests-404532457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4d7c37c-c27e-4962-9a2c-090ae6b244ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:32:11 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-5ce8fe77-c049-473b-8296-49949910a30c tempest-SnapshotDependencyTests-404532457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d0d38dc-1bf1-443d-9cd9-57c9339db756) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:32:11 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-5ce8fe77-c049-473b-8296-49949910a30c tempest-SnapshotDependencyTests-404532457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d0d38dc-1bf1-443d-9cd9-57c9339db756) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '47ce036f-3ed2-4a1d-af1d-98643e2e5ca2', 'volume_name': 'volume-47ce036f-3ed2-4a1d-af1d-98643e2e5ca2', 'volume_size': 1, 'snapshot_id': 'f9f42d1c-5686-4c52-9479-7a784588a4dc'}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:32:11 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-5ce8fe77-c049-473b-8296-49949910a30c tempest-SnapshotDependencyTests-404532457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dffa7b82-5bcf-45ed-9b30-a7244eb4e24c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:32:11 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-5ce8fe77-c049-473b-8296-49949910a30c tempest-SnapshotDependencyTests-404532457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dffa7b82-5bcf-45ed-9b30-a7244eb4e24c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:32:11 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-5ce8fe77-c049-473b-8296-49949910a30c tempest-SnapshotDependencyTests-404532457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64c43966-5555-4205-b5f6-4461adb2c009) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:32:11 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-5ce8fe77-c049-473b-8296-49949910a30c tempest-SnapshotDependencyTests-404532457 None] Volume 47ce036f-3ed2-4a1d-af1d-98643e2e5ca2: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-47ce036f-3ed2-4a1d-af1d-98643e2e5ca2', 'volume_size': 1, 'snapshot_id': 'f9f42d1c-5686-4c52-9479-7a784588a4dc'} Aug 05 06:32:11 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-2147fba0-f770-44e0-b3a1-34d449457194 tempest-ProjectMemberTests-475949430 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-663cfe5e-57f1-4e3c-8256-820a0f6b39f6" returned: 0 in 0.434s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:32:11 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-2147fba0-f770-44e0-b3a1-34d449457194 tempest-ProjectMemberTests-475949430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-663cfe5e-57f1-4e3c-8256-820a0f6b39f6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-663cfe5e-57f1-4e3c-8256-820a0f6b39f6.42ea92f7-be54-4a02-ad97-2444b7abeb43 1G {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:32:11 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-5ce8fe77-c049-473b-8296-49949910a30c tempest-SnapshotDependencyTests-404532457 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:32:11 devstack sudo[109432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-663cfe5e-57f1-4e3c-8256-820a0f6b39f6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-663cfe5e-57f1-4e3c-8256-820a0f6b39f6.42ea92f7-be54-4a02-ad97-2444b7abeb43 1G Aug 05 06:32:11 devstack sudo[109432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:32:11 devstack sudo[109432]: pam_unix(sudo:session): session closed for user root Aug 05 06:32:11 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-2147fba0-f770-44e0-b3a1-34d449457194 tempest-ProjectMemberTests-475949430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-663cfe5e-57f1-4e3c-8256-820a0f6b39f6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-663cfe5e-57f1-4e3c-8256-820a0f6b39f6.42ea92f7-be54-4a02-ad97-2444b7abeb43 1G" returned: 0 in 0.426s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:32:11 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-2147fba0-f770-44e0-b3a1-34d449457194 tempest-ProjectMemberTests-475949430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-663cfe5e-57f1-4e3c-8256-820a0f6b39f6 -F qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-663cfe5e-57f1-4e3c-8256-820a0f6b39f6.42ea92f7-be54-4a02-ad97-2444b7abeb43 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:32:11 devstack sudo[109437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-663cfe5e-57f1-4e3c-8256-820a0f6b39f6 -F qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-663cfe5e-57f1-4e3c-8256-820a0f6b39f6.42ea92f7-be54-4a02-ad97-2444b7abeb43 Aug 05 06:32:11 devstack sudo[109437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:32:11 devstack sudo[109437]: pam_unix(sudo:session): session closed for user root Aug 05 06:32:11 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-2147fba0-f770-44e0-b3a1-34d449457194 tempest-ProjectMemberTests-475949430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-663cfe5e-57f1-4e3c-8256-820a0f6b39f6 -F qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-663cfe5e-57f1-4e3c-8256-820a0f6b39f6.42ea92f7-be54-4a02-ad97-2444b7abeb43" returned: 0 in 0.334s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:32:11 devstack cinder-volume[88695]: WARNING cinder.volume.drivers.remotefs [None req-2147fba0-f770-44e0-b3a1-34d449457194 tempest-ProjectMemberTests-475949430 None] /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-663cfe5e-57f1-4e3c-8256-820a0f6b39f6.42ea92f7-be54-4a02-ad97-2444b7abeb43 is being set with open permissions: ugo+rw Aug 05 06:32:11 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-2147fba0-f770-44e0-b3a1-34d449457194 tempest-ProjectMemberTests-475949430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-663cfe5e-57f1-4e3c-8256-820a0f6b39f6.42ea92f7-be54-4a02-ad97-2444b7abeb43 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:32:11 devstack sudo[109443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-663cfe5e-57f1-4e3c-8256-820a0f6b39f6.42ea92f7-be54-4a02-ad97-2444b7abeb43 Aug 05 06:32:11 devstack sudo[109443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:32:12 devstack sudo[109443]: pam_unix(sudo:session): session closed for user root Aug 05 06:32:12 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-2147fba0-f770-44e0-b3a1-34d449457194 tempest-ProjectMemberTests-475949430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-663cfe5e-57f1-4e3c-8256-820a0f6b39f6.42ea92f7-be54-4a02-ad97-2444b7abeb43" returned: 0 in 0.245s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:32:12 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-2147fba0-f770-44e0-b3a1-34d449457194 tempest-ProjectMemberTests-475949430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-663cfe5e-57f1-4e3c-8256-820a0f6b39f6.info {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:32:12 devstack sudo[109446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-663cfe5e-57f1-4e3c-8256-820a0f6b39f6.info Aug 05 06:32:12 devstack sudo[109446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:32:12 devstack sudo[109446]: pam_unix(sudo:session): session closed for user root Aug 05 06:32:12 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-2147fba0-f770-44e0-b3a1-34d449457194 tempest-ProjectMemberTests-475949430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-663cfe5e-57f1-4e3c-8256-820a0f6b39f6.info" returned: 0 in 0.287s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:32:12 devstack cinder-volume[88695]: WARNING cinder.volume.drivers.remotefs [None req-2147fba0-f770-44e0-b3a1-34d449457194 tempest-ProjectMemberTests-475949430 None] /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-663cfe5e-57f1-4e3c-8256-820a0f6b39f6.info is being set with open permissions: ugo+rw Aug 05 06:32:12 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-2147fba0-f770-44e0-b3a1-34d449457194 tempest-ProjectMemberTests-475949430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-663cfe5e-57f1-4e3c-8256-820a0f6b39f6.info {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:32:12 devstack sudo[109449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-663cfe5e-57f1-4e3c-8256-820a0f6b39f6.info Aug 05 06:32:12 devstack sudo[109449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:32:12 devstack sudo[109449]: pam_unix(sudo:session): session closed for user root Aug 05 06:32:12 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-2147fba0-f770-44e0-b3a1-34d449457194 tempest-ProjectMemberTests-475949430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-663cfe5e-57f1-4e3c-8256-820a0f6b39f6.info" returned: 0 in 0.274s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:32:12 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-2147fba0-f770-44e0-b3a1-34d449457194 tempest-ProjectMemberTests-475949430 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.084s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:32:12 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-5ce8fe77-c049-473b-8296-49949910a30c tempest-SnapshotDependencyTests-404532457 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.602s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:32:12 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-5ce8fe77-c049-473b-8296-49949910a30c tempest-SnapshotDependencyTests-404532457 None] Acquiring lock "cinder-quobyte-f9f42d1c-5686-4c52-9479-7a784588a4dc-47ce036f-3ed2-4a1d-af1d-98643e2e5ca2" by "_create_volume_from_snapshot" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:32:12 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-5ce8fe77-c049-473b-8296-49949910a30c tempest-SnapshotDependencyTests-404532457 None] Lock "cinder-quobyte-f9f42d1c-5686-4c52-9479-7a784588a4dc-47ce036f-3ed2-4a1d-af1d-98643e2e5ca2" acquired by "_create_volume_from_snapshot" :: waited 0.037s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:32:12 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-5ce8fe77-c049-473b-8296-49949910a30c tempest-SnapshotDependencyTests-404532457 None] Creating volume 47ce036f-3ed2-4a1d-af1d-98643e2e5ca2 from snapshot f9f42d1c-5686-4c52-9479-7a784588a4dc {{(pid=88695) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 05 06:32:12 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-5ce8fe77-c049-473b-8296-49949910a30c tempest-SnapshotDependencyTests-404532457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:32:12 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-5ce8fe77-c049-473b-8296-49949910a30c tempest-SnapshotDependencyTests-404532457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:32:12 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-5ce8fe77-c049-473b-8296-49949910a30c tempest-SnapshotDependencyTests-404532457 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:32:12 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-5ce8fe77-c049-473b-8296-49949910a30c tempest-SnapshotDependencyTests-404532457 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:32:12 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-5ce8fe77-c049-473b-8296-49949910a30c tempest-SnapshotDependencyTests-404532457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:32:12 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-5ce8fe77-c049-473b-8296-49949910a30c tempest-SnapshotDependencyTests-404532457 None] Selected osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 as target Quobyte volume. {{(pid=88695) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 06:32:12 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-5ce8fe77-c049-473b-8296-49949910a30c tempest-SnapshotDependencyTests-404532457 None] Acquiring lock "cinder-quobyte-47ce036f-3ed2-4a1d-af1d-98643e2e5ca2" by "_copy_volume_from_snapshot" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:32:12 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-2147fba0-f770-44e0-b3a1-34d449457194 tempest-ProjectMemberTests-475949430 None] Create snapshot completed successfully Aug 05 06:32:12 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-5ce8fe77-c049-473b-8296-49949910a30c tempest-SnapshotDependencyTests-404532457 None] Lock "cinder-quobyte-47ce036f-3ed2-4a1d-af1d-98643e2e5ca2" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:32:12 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-5ce8fe77-c049-473b-8296-49949910a30c tempest-SnapshotDependencyTests-404532457 None] snapshot: f9f42d1c-5686-4c52-9479-7a784588a4dc, volume: 47ce036f-3ed2-4a1d-af1d-98643e2e5ca2, {{(pid=88695) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 05 06:32:12 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-5ce8fe77-c049-473b-8296-49949910a30c tempest-SnapshotDependencyTests-404532457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:32:12 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-5ce8fe77-c049-473b-8296-49949910a30c tempest-SnapshotDependencyTests-404532457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:32:12 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-5ce8fe77-c049-473b-8296-49949910a30c tempest-SnapshotDependencyTests-404532457 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:32:12 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-5ce8fe77-c049-473b-8296-49949910a30c tempest-SnapshotDependencyTests-404532457 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:32:12 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-5ce8fe77-c049-473b-8296-49949910a30c tempest-SnapshotDependencyTests-404532457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:32:12 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcb24c5a-6118-46ab-966a-a39283309540]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:32:12 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-5ce8fe77-c049-473b-8296-49949910a30c tempest-SnapshotDependencyTests-404532457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-85394345-0f6b-4ccf-b749-3b74f4099bd6.f9f42d1c-5686-4c52-9479-7a784588a4dc {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:32:12 devstack sudo[109452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-85394345-0f6b-4ccf-b749-3b74f4099bd6.f9f42d1c-5686-4c52-9479-7a784588a4dc Aug 05 06:32:12 devstack sudo[109452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:32:13 devstack sudo[109452]: pam_unix(sudo:session): session closed for user root Aug 05 06:32:13 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-5ce8fe77-c049-473b-8296-49949910a30c tempest-SnapshotDependencyTests-404532457 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-85394345-0f6b-4ccf-b749-3b74f4099bd6.f9f42d1c-5686-4c52-9479-7a784588a4dc" returned: 0 in 0.417s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:32:13 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-5ce8fe77-c049-473b-8296-49949910a30c tempest-SnapshotDependencyTests-404532457 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-85394345-0f6b-4ccf-b749-3b74f4099bd6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88695) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 06:32:13 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[d61e4370-64c2-444b-abe0-62fc8167f8d2]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:32:13 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-5ce8fe77-c049-473b-8296-49949910a30c tempest-SnapshotDependencyTests-404532457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-85394345-0f6b-4ccf-b749-3b74f4099bd6 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:32:13 devstack sudo[109457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-85394345-0f6b-4ccf-b749-3b74f4099bd6 Aug 05 06:32:13 devstack sudo[109457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:32:13 devstack sudo[109457]: pam_unix(sudo:session): session closed for user root Aug 05 06:32:13 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-5ce8fe77-c049-473b-8296-49949910a30c tempest-SnapshotDependencyTests-404532457 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-85394345-0f6b-4ccf-b749-3b74f4099bd6" returned: 0 in 0.389s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:32:13 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-5ce8fe77-c049-473b-8296-49949910a30c tempest-SnapshotDependencyTests-404532457 None] will copy from snapshot at /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-85394345-0f6b-4ccf-b749-3b74f4099bd6 {{(pid=88695) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 05 06:32:13 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-5ce8fe77-c049-473b-8296-49949910a30c tempest-SnapshotDependencyTests-404532457 None] Creating direct copy from snapshot {{(pid=88695) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 05 06:32:13 devstack cinder-volume[88695]: DEBUG cinder.utils [None req-5ce8fe77-c049-473b-8296-49949910a30c tempest-SnapshotDependencyTests-404532457 None] Path /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-47ce036f-3ed2-4a1d-af1d-98643e2e5ca2 not found in is_blk_device check {{(pid=88695) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 05 06:32:13 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-5ce8fe77-c049-473b-8296-49949910a30c tempest-SnapshotDependencyTests-404532457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-85394345-0f6b-4ccf-b749-3b74f4099bd6 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-47ce036f-3ed2-4a1d-af1d-98643e2e5ca2 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:32:13 devstack sudo[109462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-85394345-0f6b-4ccf-b749-3b74f4099bd6 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-47ce036f-3ed2-4a1d-af1d-98643e2e5ca2 Aug 05 06:32:13 devstack sudo[109462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:32:13 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-c844af3c-0d4d-464b-86fe-92f534d08e69 tempest-ProjectMemberTests-475949430 None] Acquiring lock "cinder-42ea92f7-be54-4a02-ad97-2444b7abeb43-delete_snapshot" by "delete_snapshot" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:32:13 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-c844af3c-0d4d-464b-86fe-92f534d08e69 tempest-ProjectMemberTests-475949430 None] Lock "cinder-42ea92f7-be54-4a02-ad97-2444b7abeb43-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:32:13 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-c844af3c-0d4d-464b-86fe-92f534d08e69 tempest-ProjectMemberTests-475949430 None] Acquiring lock "cinder-quobyte-663cfe5e-57f1-4e3c-8256-820a0f6b39f6" by "delete_snapshot" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:32:13 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-c844af3c-0d4d-464b-86fe-92f534d08e69 tempest-ProjectMemberTests-475949430 None] Lock "cinder-quobyte-663cfe5e-57f1-4e3c-8256-820a0f6b39f6" acquired by "delete_snapshot" :: waited 0.016s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:32:13 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-c844af3c-0d4d-464b-86fe-92f534d08e69 tempest-ProjectMemberTests-475949430 None] Acquiring lock "cinder-quobyte-42ea92f7-be54-4a02-ad97-2444b7abeb43" by "_delete_snapshot" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:32:13 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-c844af3c-0d4d-464b-86fe-92f534d08e69 tempest-ProjectMemberTests-475949430 None] Lock "cinder-quobyte-42ea92f7-be54-4a02-ad97-2444b7abeb43" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:32:13 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-c844af3c-0d4d-464b-86fe-92f534d08e69 tempest-ProjectMemberTests-475949430 None] Deleting offline snapshot 42ea92f7-be54-4a02-ad97-2444b7abeb43 of volume 663cfe5e-57f1-4e3c-8256-820a0f6b39f6 {{(pid=88695) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 06:32:13 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-c844af3c-0d4d-464b-86fe-92f534d08e69 tempest-ProjectMemberTests-475949430 None] snapshot_file for this snap is: volume-663cfe5e-57f1-4e3c-8256-820a0f6b39f6.42ea92f7-be54-4a02-ad97-2444b7abeb43 {{(pid=88695) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 06:32:13 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e1add7b-d387-46d2-89d3-6f88ef968881]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:32:13 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-c844af3c-0d4d-464b-86fe-92f534d08e69 tempest-ProjectMemberTests-475949430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-663cfe5e-57f1-4e3c-8256-820a0f6b39f6.42ea92f7-be54-4a02-ad97-2444b7abeb43 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:32:14 devstack sudo[109467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-663cfe5e-57f1-4e3c-8256-820a0f6b39f6.42ea92f7-be54-4a02-ad97-2444b7abeb43 Aug 05 06:32:14 devstack sudo[109467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:32:14 devstack sudo[109467]: pam_unix(sudo:session): session closed for user root Aug 05 06:32:14 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-c844af3c-0d4d-464b-86fe-92f534d08e69 tempest-ProjectMemberTests-475949430 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-663cfe5e-57f1-4e3c-8256-820a0f6b39f6.42ea92f7-be54-4a02-ad97-2444b7abeb43" returned: 0 in 0.515s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:32:14 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-c844af3c-0d4d-464b-86fe-92f534d08e69 tempest-ProjectMemberTests-475949430 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-663cfe5e-57f1-4e3c-8256-820a0f6b39f6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88695) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 06:32:14 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[3300f8f0-1de5-46a7-93cc-138346313d5e]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:32:14 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-c844af3c-0d4d-464b-86fe-92f534d08e69 tempest-ProjectMemberTests-475949430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-663cfe5e-57f1-4e3c-8256-820a0f6b39f6 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:32:14 devstack sudo[109479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-663cfe5e-57f1-4e3c-8256-820a0f6b39f6 Aug 05 06:32:14 devstack sudo[109479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:32:15 devstack sudo[109479]: pam_unix(sudo:session): session closed for user root Aug 05 06:32:15 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-c844af3c-0d4d-464b-86fe-92f534d08e69 tempest-ProjectMemberTests-475949430 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-663cfe5e-57f1-4e3c-8256-820a0f6b39f6" returned: 0 in 0.703s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:32:15 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-c844af3c-0d4d-464b-86fe-92f534d08e69 tempest-ProjectMemberTests-475949430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-663cfe5e-57f1-4e3c-8256-820a0f6b39f6.42ea92f7-be54-4a02-ad97-2444b7abeb43 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:32:15 devstack sudo[109485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-663cfe5e-57f1-4e3c-8256-820a0f6b39f6.42ea92f7-be54-4a02-ad97-2444b7abeb43 Aug 05 06:32:15 devstack sudo[109485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:32:15 devstack sudo[109485]: pam_unix(sudo:session): session closed for user root Aug 05 06:32:15 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-c844af3c-0d4d-464b-86fe-92f534d08e69 tempest-ProjectMemberTests-475949430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-663cfe5e-57f1-4e3c-8256-820a0f6b39f6.42ea92f7-be54-4a02-ad97-2444b7abeb43" returned: 0 in 0.689s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:32:15 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-c844af3c-0d4d-464b-86fe-92f534d08e69 tempest-ProjectMemberTests-475949430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-663cfe5e-57f1-4e3c-8256-820a0f6b39f6.42ea92f7-be54-4a02-ad97-2444b7abeb43 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:32:16 devstack sudo[109491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-663cfe5e-57f1-4e3c-8256-820a0f6b39f6.42ea92f7-be54-4a02-ad97-2444b7abeb43 Aug 05 06:32:16 devstack sudo[109491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:32:16 devstack sudo[109491]: pam_unix(sudo:session): session closed for user root Aug 05 06:32:16 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-c844af3c-0d4d-464b-86fe-92f534d08e69 tempest-ProjectMemberTests-475949430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-663cfe5e-57f1-4e3c-8256-820a0f6b39f6.42ea92f7-be54-4a02-ad97-2444b7abeb43" returned: 0 in 0.612s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:32:16 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-c844af3c-0d4d-464b-86fe-92f534d08e69 tempest-ProjectMemberTests-475949430 None] Lock "cinder-quobyte-42ea92f7-be54-4a02-ad97-2444b7abeb43" released by "_delete_snapshot" :: held 2.682s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:32:16 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-c844af3c-0d4d-464b-86fe-92f534d08e69 tempest-ProjectMemberTests-475949430 None] Lock "cinder-quobyte-663cfe5e-57f1-4e3c-8256-820a0f6b39f6" released by "delete_snapshot" :: held 2.722s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:32:16 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-c844af3c-0d4d-464b-86fe-92f534d08e69 tempest-ProjectMemberTests-475949430 None] Created reservations ['b9e8f305-1ef6-4ccc-88d8-2b72e7ba9769', 'a3de8668-709c-4271-82f6-27efba69aa0a', '85361826-272f-4f61-95ca-4639947d1a46', '32194376-928f-4542-b9ce-671118ec3c16'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:32:16 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-c844af3c-0d4d-464b-86fe-92f534d08e69 tempest-ProjectMemberTests-475949430 None] Delete snapshot completed successfully. Aug 05 06:32:16 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-c844af3c-0d4d-464b-86fe-92f534d08e69 tempest-ProjectMemberTests-475949430 None] Lock "cinder-42ea92f7-be54-4a02-ad97-2444b7abeb43-delete_snapshot" released by "delete_snapshot" :: held 3.061s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:32:17 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-afafd73a-4b43-4a14-8c1c-a7faa143baf7 tempest-ProjectMemberTests-475949430 None] Acquiring lock "cinder-663cfe5e-57f1-4e3c-8256-820a0f6b39f6-delete_volume" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:32:17 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-afafd73a-4b43-4a14-8c1c-a7faa143baf7 tempest-ProjectMemberTests-475949430 None] Lock "cinder-663cfe5e-57f1-4e3c-8256-820a0f6b39f6-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:32:17 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-afafd73a-4b43-4a14-8c1c-a7faa143baf7 tempest-ProjectMemberTests-475949430 None] Acquiring lock "cinder-quobyte-663cfe5e-57f1-4e3c-8256-820a0f6b39f6" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:32:17 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-afafd73a-4b43-4a14-8c1c-a7faa143baf7 tempest-ProjectMemberTests-475949430 None] Lock "cinder-quobyte-663cfe5e-57f1-4e3c-8256-820a0f6b39f6" acquired by "delete_volume" :: waited 0.023s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:32:17 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[61e2e765-58e9-4b65-9ff4-deaa7da70cbc]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:32:17 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-afafd73a-4b43-4a14-8c1c-a7faa143baf7 tempest-ProjectMemberTests-475949430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-663cfe5e-57f1-4e3c-8256-820a0f6b39f6 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:32:17 devstack sudo[109494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-663cfe5e-57f1-4e3c-8256-820a0f6b39f6 Aug 05 06:32:17 devstack sudo[109494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:32:18 devstack sudo[109494]: pam_unix(sudo:session): session closed for user root Aug 05 06:32:18 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-afafd73a-4b43-4a14-8c1c-a7faa143baf7 tempest-ProjectMemberTests-475949430 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-663cfe5e-57f1-4e3c-8256-820a0f6b39f6" returned: 0 in 0.704s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:32:18 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-afafd73a-4b43-4a14-8c1c-a7faa143baf7 tempest-ProjectMemberTests-475949430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-663cfe5e-57f1-4e3c-8256-820a0f6b39f6 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:32:18 devstack sudo[109499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-663cfe5e-57f1-4e3c-8256-820a0f6b39f6 Aug 05 06:32:18 devstack sudo[109499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:32:18 devstack sudo[109462]: pam_unix(sudo:session): session closed for user root Aug 05 06:32:18 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-5ce8fe77-c049-473b-8296-49949910a30c tempest-SnapshotDependencyTests-404532457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-85394345-0f6b-4ccf-b749-3b74f4099bd6 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-47ce036f-3ed2-4a1d-af1d-98643e2e5ca2" returned: 0 in 4.615s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:32:18 devstack cinder-volume[88695]: DEBUG cinder.image.image_utils [None req-5ce8fe77-c049-473b-8296-49949910a30c tempest-SnapshotDependencyTests-404532457 None] Image conversion details: src /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-85394345-0f6b-4ccf-b749-3b74f4099bd6, size 1024.00 MB, duration 4.62 sec, destination /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-47ce036f-3ed2-4a1d-af1d-98643e2e5ca2 {{(pid=88695) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 05 06:32:18 devstack cinder-volume[88695]: INFO cinder.image.image_utils [None req-5ce8fe77-c049-473b-8296-49949910a30c tempest-SnapshotDependencyTests-404532457 None] Converted 1024.00 MB image at 221.81 MB/s Aug 05 06:32:18 devstack cinder-volume[88695]: WARNING cinder.volume.drivers.remotefs [None req-5ce8fe77-c049-473b-8296-49949910a30c tempest-SnapshotDependencyTests-404532457 None] /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-47ce036f-3ed2-4a1d-af1d-98643e2e5ca2 is being set with open permissions: ugo+rw Aug 05 06:32:18 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-5ce8fe77-c049-473b-8296-49949910a30c tempest-SnapshotDependencyTests-404532457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-47ce036f-3ed2-4a1d-af1d-98643e2e5ca2 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:32:18 devstack sudo[109501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-47ce036f-3ed2-4a1d-af1d-98643e2e5ca2 Aug 05 06:32:18 devstack sudo[109501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:32:18 devstack sudo[109499]: pam_unix(sudo:session): session closed for user root Aug 05 06:32:18 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-afafd73a-4b43-4a14-8c1c-a7faa143baf7 tempest-ProjectMemberTests-475949430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-663cfe5e-57f1-4e3c-8256-820a0f6b39f6" returned: 0 in 0.307s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:32:18 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-afafd73a-4b43-4a14-8c1c-a7faa143baf7 tempest-ProjectMemberTests-475949430 None] Lock "cinder-quobyte-663cfe5e-57f1-4e3c-8256-820a0f6b39f6" released by "delete_volume" :: held 1.135s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:32:18 devstack sudo[109501]: pam_unix(sudo:session): session closed for user root Aug 05 06:32:18 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-5ce8fe77-c049-473b-8296-49949910a30c tempest-SnapshotDependencyTests-404532457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-47ce036f-3ed2-4a1d-af1d-98643e2e5ca2" returned: 0 in 0.251s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:32:18 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-5ce8fe77-c049-473b-8296-49949910a30c tempest-SnapshotDependencyTests-404532457 None] Lock "cinder-quobyte-47ce036f-3ed2-4a1d-af1d-98643e2e5ca2" released by "_copy_volume_from_snapshot" :: held 5.768s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:32:18 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-afafd73a-4b43-4a14-8c1c-a7faa143baf7 tempest-ProjectMemberTests-475949430 None] Created reservations ['fad87929-05fa-4467-a9b0-eb993f9b9cb5', 'ca624422-b327-4c95-9a4d-d834a979e325', 'a16b772a-3fae-40d3-8d75-cdb999dcc44b', 'be24bc0d-83ae-4a02-aecf-b74a0f3ac6f3'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:32:18 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-5ce8fe77-c049-473b-8296-49949910a30c tempest-SnapshotDependencyTests-404532457 None] Lock "cinder-quobyte-f9f42d1c-5686-4c52-9479-7a784588a4dc-47ce036f-3ed2-4a1d-af1d-98643e2e5ca2" released by "_create_volume_from_snapshot" :: held 5.863s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:32:18 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-5ce8fe77-c049-473b-8296-49949910a30c tempest-SnapshotDependencyTests-404532457 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.902s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:32:18 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-5ce8fe77-c049-473b-8296-49949910a30c tempest-SnapshotDependencyTests-404532457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64c43966-5555-4205-b5f6-4461adb2c009) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47ce036f-3ed2-4a1d-af1d-98643e2e5ca2', 'volume_size': 1, 'snapshot_id': 'f9f42d1c-5686-4c52-9479-7a784588a4dc'}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:32:18 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-5ce8fe77-c049-473b-8296-49949910a30c tempest-SnapshotDependencyTests-404532457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6efac88c-392b-473d-9e0a-3d35ec88f3c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:32:18 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-afafd73a-4b43-4a14-8c1c-a7faa143baf7 tempest-ProjectMemberTests-475949430 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:32:18 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-afafd73a-4b43-4a14-8c1c-a7faa143baf7 tempest-ProjectMemberTests-475949430 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:32:18 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-afafd73a-4b43-4a14-8c1c-a7faa143baf7 tempest-ProjectMemberTests-475949430 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:32:18 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-afafd73a-4b43-4a14-8c1c-a7faa143baf7 tempest-ProjectMemberTests-475949430 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:32:18 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-afafd73a-4b43-4a14-8c1c-a7faa143baf7 tempest-ProjectMemberTests-475949430 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:32:18 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-afafd73a-4b43-4a14-8c1c-a7faa143baf7 tempest-ProjectMemberTests-475949430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:32:18 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-5ce8fe77-c049-473b-8296-49949910a30c tempest-SnapshotDependencyTests-404532457 None] Volume volume-47ce036f-3ed2-4a1d-af1d-98643e2e5ca2 (47ce036f-3ed2-4a1d-af1d-98643e2e5ca2): created successfully Aug 05 06:32:18 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-5ce8fe77-c049-473b-8296-49949910a30c tempest-SnapshotDependencyTests-404532457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6efac88c-392b-473d-9e0a-3d35ec88f3c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:32:18 devstack sudo[109506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce Aug 05 06:32:18 devstack sudo[109506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:32:18 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-5ce8fe77-c049-473b-8296-49949910a30c tempest-SnapshotDependencyTests-404532457 None] Flow 'volume_create_manager' (aa84dce5-d0e7-4c89-aaa7-43dddd31f0c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:32:18 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-5ce8fe77-c049-473b-8296-49949910a30c tempest-SnapshotDependencyTests-404532457 None] Created volume successfully. Aug 05 06:32:18 devstack sudo[109506]: pam_unix(sudo:session): session closed for user root Aug 05 06:32:18 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-afafd73a-4b43-4a14-8c1c-a7faa143baf7 tempest-ProjectMemberTests-475949430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce" returned: 0 in 0.257s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:32:18 devstack cinder-volume[88695]: DEBUG cinder.manager [None req-afafd73a-4b43-4a14-8c1c-a7faa143baf7 tempest-ProjectMemberTests-475949430 None] Notifying Schedulers of capabilities ... {{(pid=88695) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 06:32:18 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-afafd73a-4b43-4a14-8c1c-a7faa143baf7 tempest-ProjectMemberTests-475949430 None] Deleted volume successfully. Aug 05 06:32:18 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-afafd73a-4b43-4a14-8c1c-a7faa143baf7 tempest-ProjectMemberTests-475949430 None] Lock "cinder-663cfe5e-57f1-4e3c-8256-820a0f6b39f6-delete_volume" released by "delete_volume" :: held 1.704s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:32:19 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-28849151-ef30-435f-a6c5-5db6216a2be3 tempest-SnapshotDependencyTests-404532457 None] Acquiring lock "cinder-f9f42d1c-5686-4c52-9479-7a784588a4dc-delete_snapshot" by "delete_snapshot" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:32:19 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-28849151-ef30-435f-a6c5-5db6216a2be3 tempest-SnapshotDependencyTests-404532457 None] Lock "cinder-f9f42d1c-5686-4c52-9479-7a784588a4dc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:32:19 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-28849151-ef30-435f-a6c5-5db6216a2be3 tempest-SnapshotDependencyTests-404532457 None] Acquiring lock "cinder-quobyte-85394345-0f6b-4ccf-b749-3b74f4099bd6" by "delete_snapshot" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:32:19 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-28849151-ef30-435f-a6c5-5db6216a2be3 tempest-SnapshotDependencyTests-404532457 None] Lock "cinder-quobyte-85394345-0f6b-4ccf-b749-3b74f4099bd6" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:32:19 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-28849151-ef30-435f-a6c5-5db6216a2be3 tempest-SnapshotDependencyTests-404532457 None] Acquiring lock "cinder-quobyte-f9f42d1c-5686-4c52-9479-7a784588a4dc" by "_delete_snapshot" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:32:19 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-28849151-ef30-435f-a6c5-5db6216a2be3 tempest-SnapshotDependencyTests-404532457 None] Lock "cinder-quobyte-f9f42d1c-5686-4c52-9479-7a784588a4dc" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:32:19 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-28849151-ef30-435f-a6c5-5db6216a2be3 tempest-SnapshotDependencyTests-404532457 None] Deleting offline snapshot f9f42d1c-5686-4c52-9479-7a784588a4dc of volume 85394345-0f6b-4ccf-b749-3b74f4099bd6 {{(pid=88695) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 06:32:19 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-28849151-ef30-435f-a6c5-5db6216a2be3 tempest-SnapshotDependencyTests-404532457 None] snapshot_file for this snap is: volume-85394345-0f6b-4ccf-b749-3b74f4099bd6.f9f42d1c-5686-4c52-9479-7a784588a4dc {{(pid=88695) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 06:32:19 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c3157ae-5b95-4610-b182-fdb1278c1ea7]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:32:19 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-28849151-ef30-435f-a6c5-5db6216a2be3 tempest-SnapshotDependencyTests-404532457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-85394345-0f6b-4ccf-b749-3b74f4099bd6.f9f42d1c-5686-4c52-9479-7a784588a4dc {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:32:20 devstack cinder-volume[88695]: DEBUG cinder.volume.flows.manager.create_volume [None req-84808a61-9c84-46fe-bbe5-81667343f2ca tempest-ProjectMemberTests-475949430 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88695) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 06:32:20 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-84808a61-9c84-46fe-bbe5-81667343f2ca tempest-ProjectMemberTests-475949430 None] Flow 'volume_create_manager' (75587951-7148-4d1a-9986-11a42b2edb4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:32:20 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-84808a61-9c84-46fe-bbe5-81667343f2ca tempest-ProjectMemberTests-475949430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b095ff0d-6843-4705-ba7f-b6bdd3b7931f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:32:20 devstack sudo[109509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-85394345-0f6b-4ccf-b749-3b74f4099bd6.f9f42d1c-5686-4c52-9479-7a784588a4dc Aug 05 06:32:20 devstack sudo[109509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:32:20 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-84808a61-9c84-46fe-bbe5-81667343f2ca tempest-ProjectMemberTests-475949430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b095ff0d-6843-4705-ba7f-b6bdd3b7931f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:32:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2115588092',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52103eae-e24a-4b86-a2d4-7e249a70b0a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe85d705f6434b70a55dac31b79c0714',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:32:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:32:20Z,use_quota=True,user_id='a9de9bccd062450c95c9f7f6cf4317f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:32:20 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-84808a61-9c84-46fe-bbe5-81667343f2ca tempest-ProjectMemberTests-475949430 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca005515-e9b9-4922-ac4c-59130774029d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:32:20 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-84808a61-9c84-46fe-bbe5-81667343f2ca tempest-ProjectMemberTests-475949430 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca005515-e9b9-4922-ac4c-59130774029d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:32:20 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-84808a61-9c84-46fe-bbe5-81667343f2ca tempest-ProjectMemberTests-475949430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aeeddf4a-1196-473e-809e-aa458631cd51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:32:20 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-84808a61-9c84-46fe-bbe5-81667343f2ca tempest-ProjectMemberTests-475949430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aeeddf4a-1196-473e-809e-aa458631cd51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '52103eae-e24a-4b86-a2d4-7e249a70b0a3', 'volume_name': 'volume-52103eae-e24a-4b86-a2d4-7e249a70b0a3', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:32:20 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-84808a61-9c84-46fe-bbe5-81667343f2ca tempest-ProjectMemberTests-475949430 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a1b0bcd-84e9-4c61-85f2-15b9f428f81a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:32:20 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-84808a61-9c84-46fe-bbe5-81667343f2ca tempest-ProjectMemberTests-475949430 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a1b0bcd-84e9-4c61-85f2-15b9f428f81a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:32:20 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-84808a61-9c84-46fe-bbe5-81667343f2ca tempest-ProjectMemberTests-475949430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51a05ec7-53ef-4ef3-871d-e0a7e7ba9fa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:32:20 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-84808a61-9c84-46fe-bbe5-81667343f2ca tempest-ProjectMemberTests-475949430 None] Volume 52103eae-e24a-4b86-a2d4-7e249a70b0a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-52103eae-e24a-4b86-a2d4-7e249a70b0a3', 'volume_size': 1} Aug 05 06:32:20 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-84808a61-9c84-46fe-bbe5-81667343f2ca tempest-ProjectMemberTests-475949430 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:32:20 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-84808a61-9c84-46fe-bbe5-81667343f2ca tempest-ProjectMemberTests-475949430 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:32:20 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-84808a61-9c84-46fe-bbe5-81667343f2ca tempest-ProjectMemberTests-475949430 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:32:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2115588092',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52103eae-e24a-4b86-a2d4-7e249a70b0a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe85d705f6434b70a55dac31b79c0714',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:32:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:32:20Z,use_quota=True,user_id='a9de9bccd062450c95c9f7f6cf4317f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)}" {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 06:32:20 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-84808a61-9c84-46fe-bbe5-81667343f2ca tempest-ProjectMemberTests-475949430 None] Creating volume 52103eae-e24a-4b86-a2d4-7e249a70b0a3 {{(pid=88695) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 06:32:20 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-84808a61-9c84-46fe-bbe5-81667343f2ca tempest-ProjectMemberTests-475949430 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:32:20 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-84808a61-9c84-46fe-bbe5-81667343f2ca tempest-ProjectMemberTests-475949430 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:32:20 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-84808a61-9c84-46fe-bbe5-81667343f2ca tempest-ProjectMemberTests-475949430 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:32:20 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-84808a61-9c84-46fe-bbe5-81667343f2ca tempest-ProjectMemberTests-475949430 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:32:20 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-84808a61-9c84-46fe-bbe5-81667343f2ca tempest-ProjectMemberTests-475949430 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:32:20 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-84808a61-9c84-46fe-bbe5-81667343f2ca tempest-ProjectMemberTests-475949430 None] Selected osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 as target Quobyte volume. {{(pid=88695) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 06:32:20 devstack cinder-volume[88695]: INFO cinder.volume.drivers.remotefs [None req-84808a61-9c84-46fe-bbe5-81667343f2ca tempest-ProjectMemberTests-475949430 None] casted to osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 Aug 05 06:32:20 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-84808a61-9c84-46fe-bbe5-81667343f2ca tempest-ProjectMemberTests-475949430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-52103eae-e24a-4b86-a2d4-7e249a70b0a3 1073741824 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:32:20 devstack sudo[109511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-52103eae-e24a-4b86-a2d4-7e249a70b0a3 1073741824 Aug 05 06:32:20 devstack sudo[109511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:32:20 devstack sudo[109509]: pam_unix(sudo:session): session closed for user root Aug 05 06:32:20 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-28849151-ef30-435f-a6c5-5db6216a2be3 tempest-SnapshotDependencyTests-404532457 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-85394345-0f6b-4ccf-b749-3b74f4099bd6.f9f42d1c-5686-4c52-9479-7a784588a4dc" returned: 0 in 0.418s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:32:20 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-28849151-ef30-435f-a6c5-5db6216a2be3 tempest-SnapshotDependencyTests-404532457 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-85394345-0f6b-4ccf-b749-3b74f4099bd6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88695) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 06:32:20 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[67c77c6e-99ee-4981-b65b-63c91d99d8ce]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:32:20 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-28849151-ef30-435f-a6c5-5db6216a2be3 tempest-SnapshotDependencyTests-404532457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-85394345-0f6b-4ccf-b749-3b74f4099bd6 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:32:20 devstack sudo[109518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-85394345-0f6b-4ccf-b749-3b74f4099bd6 Aug 05 06:32:20 devstack sudo[109518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:32:20 devstack sudo[109511]: pam_unix(sudo:session): session closed for user root Aug 05 06:32:20 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-84808a61-9c84-46fe-bbe5-81667343f2ca tempest-ProjectMemberTests-475949430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-52103eae-e24a-4b86-a2d4-7e249a70b0a3 1073741824" returned: 0 in 0.457s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:32:20 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-84808a61-9c84-46fe-bbe5-81667343f2ca tempest-ProjectMemberTests-475949430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-52103eae-e24a-4b86-a2d4-7e249a70b0a3 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:32:20 devstack sudo[109522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-52103eae-e24a-4b86-a2d4-7e249a70b0a3 Aug 05 06:32:20 devstack sudo[109522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:32:20 devstack sudo[109522]: pam_unix(sudo:session): session closed for user root Aug 05 06:32:20 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-84808a61-9c84-46fe-bbe5-81667343f2ca tempest-ProjectMemberTests-475949430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-52103eae-e24a-4b86-a2d4-7e249a70b0a3" returned: 0 in 0.257s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:32:20 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-84808a61-9c84-46fe-bbe5-81667343f2ca tempest-ProjectMemberTests-475949430 None] <== create_volume: return (759ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'} {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 06:32:20 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-84808a61-9c84-46fe-bbe5-81667343f2ca tempest-ProjectMemberTests-475949430 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.762s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:32:20 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-84808a61-9c84-46fe-bbe5-81667343f2ca tempest-ProjectMemberTests-475949430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51a05ec7-53ef-4ef3-871d-e0a7e7ba9fa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-52103eae-e24a-4b86-a2d4-7e249a70b0a3', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:32:20 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-84808a61-9c84-46fe-bbe5-81667343f2ca tempest-ProjectMemberTests-475949430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b58277ff-43ab-4854-a9e6-29d566de2f92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:32:20 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-84808a61-9c84-46fe-bbe5-81667343f2ca tempest-ProjectMemberTests-475949430 None] Volume volume-52103eae-e24a-4b86-a2d4-7e249a70b0a3 (52103eae-e24a-4b86-a2d4-7e249a70b0a3): created successfully Aug 05 06:32:20 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-84808a61-9c84-46fe-bbe5-81667343f2ca tempest-ProjectMemberTests-475949430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b58277ff-43ab-4854-a9e6-29d566de2f92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:32:20 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-84808a61-9c84-46fe-bbe5-81667343f2ca tempest-ProjectMemberTests-475949430 None] Flow 'volume_create_manager' (75587951-7148-4d1a-9986-11a42b2edb4f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:32:20 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-84808a61-9c84-46fe-bbe5-81667343f2ca tempest-ProjectMemberTests-475949430 None] Created volume successfully. Aug 05 06:32:20 devstack sudo[109518]: pam_unix(sudo:session): session closed for user root Aug 05 06:32:20 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-28849151-ef30-435f-a6c5-5db6216a2be3 tempest-SnapshotDependencyTests-404532457 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-85394345-0f6b-4ccf-b749-3b74f4099bd6" returned: 0 in 0.582s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:32:20 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-28849151-ef30-435f-a6c5-5db6216a2be3 tempest-SnapshotDependencyTests-404532457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-85394345-0f6b-4ccf-b749-3b74f4099bd6.f9f42d1c-5686-4c52-9479-7a784588a4dc {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:32:21 devstack sudo[109528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-85394345-0f6b-4ccf-b749-3b74f4099bd6.f9f42d1c-5686-4c52-9479-7a784588a4dc Aug 05 06:32:21 devstack sudo[109528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:32:21 devstack sudo[109528]: pam_unix(sudo:session): session closed for user root Aug 05 06:32:21 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-28849151-ef30-435f-a6c5-5db6216a2be3 tempest-SnapshotDependencyTests-404532457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-85394345-0f6b-4ccf-b749-3b74f4099bd6.f9f42d1c-5686-4c52-9479-7a784588a4dc" returned: 0 in 0.320s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:32:21 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-28849151-ef30-435f-a6c5-5db6216a2be3 tempest-SnapshotDependencyTests-404532457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-85394345-0f6b-4ccf-b749-3b74f4099bd6.f9f42d1c-5686-4c52-9479-7a784588a4dc {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:32:21 devstack sudo[109533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-85394345-0f6b-4ccf-b749-3b74f4099bd6.f9f42d1c-5686-4c52-9479-7a784588a4dc Aug 05 06:32:21 devstack sudo[109533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:32:21 devstack sudo[109533]: pam_unix(sudo:session): session closed for user root Aug 05 06:32:21 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-28849151-ef30-435f-a6c5-5db6216a2be3 tempest-SnapshotDependencyTests-404532457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-85394345-0f6b-4ccf-b749-3b74f4099bd6.f9f42d1c-5686-4c52-9479-7a784588a4dc" returned: 0 in 0.240s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:32:21 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-28849151-ef30-435f-a6c5-5db6216a2be3 tempest-SnapshotDependencyTests-404532457 None] Lock "cinder-quobyte-f9f42d1c-5686-4c52-9479-7a784588a4dc" released by "_delete_snapshot" :: held 1.664s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:32:21 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-28849151-ef30-435f-a6c5-5db6216a2be3 tempest-SnapshotDependencyTests-404532457 None] Lock "cinder-quobyte-85394345-0f6b-4ccf-b749-3b74f4099bd6" released by "delete_snapshot" :: held 1.687s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:32:21 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-28849151-ef30-435f-a6c5-5db6216a2be3 tempest-SnapshotDependencyTests-404532457 None] Created reservations ['4999d2ee-61f9-43b8-b8f0-080a04eb1453', 'cc73d423-6768-4763-bfdb-8dede76c77d0', '95d2a775-aaea-4b24-961b-7e85afdbdf67', '4cbc2d94-e15e-42c5-9e3f-adf164793d1e'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:32:21 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-28849151-ef30-435f-a6c5-5db6216a2be3 tempest-SnapshotDependencyTests-404532457 None] Delete snapshot completed successfully. Aug 05 06:32:21 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-28849151-ef30-435f-a6c5-5db6216a2be3 tempest-SnapshotDependencyTests-404532457 None] Lock "cinder-f9f42d1c-5686-4c52-9479-7a784588a4dc-delete_snapshot" released by "delete_snapshot" :: held 1.823s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:32:22 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-3ecbf347-2172-40df-a789-5b29326dae4a tempest-SnapshotDependencyTests-404532457 None] Acquiring lock "cinder-85394345-0f6b-4ccf-b749-3b74f4099bd6-delete_volume" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:32:22 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-3ecbf347-2172-40df-a789-5b29326dae4a tempest-SnapshotDependencyTests-404532457 None] Lock "cinder-85394345-0f6b-4ccf-b749-3b74f4099bd6-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:32:22 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-3ecbf347-2172-40df-a789-5b29326dae4a tempest-SnapshotDependencyTests-404532457 None] Acquiring lock "cinder-quobyte-85394345-0f6b-4ccf-b749-3b74f4099bd6" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:32:22 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-3ecbf347-2172-40df-a789-5b29326dae4a tempest-SnapshotDependencyTests-404532457 None] Lock "cinder-quobyte-85394345-0f6b-4ccf-b749-3b74f4099bd6" acquired by "delete_volume" :: waited 0.015s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:32:22 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[82d1a62c-feca-4bfc-82da-9df49c52aaa2]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:32:22 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-3ecbf347-2172-40df-a789-5b29326dae4a tempest-SnapshotDependencyTests-404532457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-85394345-0f6b-4ccf-b749-3b74f4099bd6 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:32:22 devstack sudo[109536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-85394345-0f6b-4ccf-b749-3b74f4099bd6 Aug 05 06:32:22 devstack sudo[109536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:32:22 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-7b7ae5b4-1447-48e3-aefa-49a9bca0ee31 tempest-ProjectMemberTests-475949430 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:32:22 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-7b7ae5b4-1447-48e3-aefa-49a9bca0ee31 tempest-ProjectMemberTests-475949430 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:32:22 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-7b7ae5b4-1447-48e3-aefa-49a9bca0ee31 tempest-ProjectMemberTests-475949430 None] Creating offline snapshot aeb70364-ff41-4e3c-81c5-ff2dc4aaf00b of volume 52103eae-e24a-4b86-a2d4-7e249a70b0a3 {{(pid=88695) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 06:32:22 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ad9ea26-c127-47fd-8c50-f7eb060e42d2]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:32:22 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-7b7ae5b4-1447-48e3-aefa-49a9bca0ee31 tempest-ProjectMemberTests-475949430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-52103eae-e24a-4b86-a2d4-7e249a70b0a3 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:32:22 devstack sudo[109538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-52103eae-e24a-4b86-a2d4-7e249a70b0a3 Aug 05 06:32:22 devstack sudo[109538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:32:22 devstack sudo[109536]: pam_unix(sudo:session): session closed for user root Aug 05 06:32:22 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-3ecbf347-2172-40df-a789-5b29326dae4a tempest-SnapshotDependencyTests-404532457 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-85394345-0f6b-4ccf-b749-3b74f4099bd6" returned: 0 in 0.403s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:32:22 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-3ecbf347-2172-40df-a789-5b29326dae4a tempest-SnapshotDependencyTests-404532457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-85394345-0f6b-4ccf-b749-3b74f4099bd6 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:32:22 devstack sudo[109543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-85394345-0f6b-4ccf-b749-3b74f4099bd6 Aug 05 06:32:22 devstack sudo[109543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:32:22 devstack sudo[109538]: pam_unix(sudo:session): session closed for user root Aug 05 06:32:22 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-7b7ae5b4-1447-48e3-aefa-49a9bca0ee31 tempest-ProjectMemberTests-475949430 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-52103eae-e24a-4b86-a2d4-7e249a70b0a3" returned: 0 in 0.376s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:32:22 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-7b7ae5b4-1447-48e3-aefa-49a9bca0ee31 tempest-ProjectMemberTests-475949430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-52103eae-e24a-4b86-a2d4-7e249a70b0a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-52103eae-e24a-4b86-a2d4-7e249a70b0a3.aeb70364-ff41-4e3c-81c5-ff2dc4aaf00b 1G {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:32:22 devstack sudo[109548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-52103eae-e24a-4b86-a2d4-7e249a70b0a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-52103eae-e24a-4b86-a2d4-7e249a70b0a3.aeb70364-ff41-4e3c-81c5-ff2dc4aaf00b 1G Aug 05 06:32:22 devstack sudo[109548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:32:22 devstack sudo[109543]: pam_unix(sudo:session): session closed for user root Aug 05 06:32:22 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-3ecbf347-2172-40df-a789-5b29326dae4a tempest-SnapshotDependencyTests-404532457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-85394345-0f6b-4ccf-b749-3b74f4099bd6" returned: 0 in 0.268s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:32:22 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-3ecbf347-2172-40df-a789-5b29326dae4a tempest-SnapshotDependencyTests-404532457 None] Lock "cinder-quobyte-85394345-0f6b-4ccf-b749-3b74f4099bd6" released by "delete_volume" :: held 0.739s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:32:22 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-3ecbf347-2172-40df-a789-5b29326dae4a tempest-SnapshotDependencyTests-404532457 None] Created reservations ['d54b27d4-7bef-489b-a383-a7225997bf85', '0fb968da-cae3-4d19-90b9-be7800b16886', '99b0ef9a-422b-44c3-87c8-632e4d9db73c', 'f177cb3d-2758-4cee-b3de-8d18742778bd'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:32:22 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-3ecbf347-2172-40df-a789-5b29326dae4a tempest-SnapshotDependencyTests-404532457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:32:22 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-3ecbf347-2172-40df-a789-5b29326dae4a tempest-SnapshotDependencyTests-404532457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:32:22 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-3ecbf347-2172-40df-a789-5b29326dae4a tempest-SnapshotDependencyTests-404532457 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:32:22 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-3ecbf347-2172-40df-a789-5b29326dae4a tempest-SnapshotDependencyTests-404532457 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:32:22 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-3ecbf347-2172-40df-a789-5b29326dae4a tempest-SnapshotDependencyTests-404532457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:32:22 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-3ecbf347-2172-40df-a789-5b29326dae4a tempest-SnapshotDependencyTests-404532457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:32:23 devstack sudo[109554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce Aug 05 06:32:23 devstack sudo[109554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:32:23 devstack sudo[109548]: pam_unix(sudo:session): session closed for user root Aug 05 06:32:23 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-7b7ae5b4-1447-48e3-aefa-49a9bca0ee31 tempest-ProjectMemberTests-475949430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-52103eae-e24a-4b86-a2d4-7e249a70b0a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-52103eae-e24a-4b86-a2d4-7e249a70b0a3.aeb70364-ff41-4e3c-81c5-ff2dc4aaf00b 1G" returned: 0 in 0.429s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:32:23 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-7b7ae5b4-1447-48e3-aefa-49a9bca0ee31 tempest-ProjectMemberTests-475949430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-52103eae-e24a-4b86-a2d4-7e249a70b0a3 -F qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-52103eae-e24a-4b86-a2d4-7e249a70b0a3.aeb70364-ff41-4e3c-81c5-ff2dc4aaf00b {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:32:23 devstack sudo[109556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-52103eae-e24a-4b86-a2d4-7e249a70b0a3 -F qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-52103eae-e24a-4b86-a2d4-7e249a70b0a3.aeb70364-ff41-4e3c-81c5-ff2dc4aaf00b Aug 05 06:32:23 devstack sudo[109556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:32:23 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-50855756-1300-4dc7-937f-6d7c8a46fc0c tempest-SnapshotDependencyTests-404532457 None] Acquiring lock "cinder-47ce036f-3ed2-4a1d-af1d-98643e2e5ca2-delete_volume" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:32:23 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-50855756-1300-4dc7-937f-6d7c8a46fc0c tempest-SnapshotDependencyTests-404532457 None] Lock "cinder-47ce036f-3ed2-4a1d-af1d-98643e2e5ca2-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:32:23 devstack sudo[109554]: pam_unix(sudo:session): session closed for user root Aug 05 06:32:23 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-3ecbf347-2172-40df-a789-5b29326dae4a tempest-SnapshotDependencyTests-404532457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce" returned: 0 in 0.305s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:32:23 devstack cinder-volume[88695]: DEBUG cinder.manager [None req-3ecbf347-2172-40df-a789-5b29326dae4a tempest-SnapshotDependencyTests-404532457 None] Notifying Schedulers of capabilities ... {{(pid=88695) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 06:32:23 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-3ecbf347-2172-40df-a789-5b29326dae4a tempest-SnapshotDependencyTests-404532457 None] Deleted volume successfully. Aug 05 06:32:23 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-50855756-1300-4dc7-937f-6d7c8a46fc0c tempest-SnapshotDependencyTests-404532457 None] Acquiring lock "cinder-quobyte-47ce036f-3ed2-4a1d-af1d-98643e2e5ca2" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:32:23 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-3ecbf347-2172-40df-a789-5b29326dae4a tempest-SnapshotDependencyTests-404532457 None] Lock "cinder-85394345-0f6b-4ccf-b749-3b74f4099bd6-delete_volume" released by "delete_volume" :: held 1.272s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:32:23 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-50855756-1300-4dc7-937f-6d7c8a46fc0c tempest-SnapshotDependencyTests-404532457 None] Lock "cinder-quobyte-47ce036f-3ed2-4a1d-af1d-98643e2e5ca2" acquired by "delete_volume" :: waited 0.017s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:32:23 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f108168-3cd7-4e98-a3df-b9f917a64b41]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:32:23 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-50855756-1300-4dc7-937f-6d7c8a46fc0c tempest-SnapshotDependencyTests-404532457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-47ce036f-3ed2-4a1d-af1d-98643e2e5ca2 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:32:23 devstack sudo[109559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-47ce036f-3ed2-4a1d-af1d-98643e2e5ca2 Aug 05 06:32:23 devstack sudo[109559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:32:23 devstack sudo[109556]: pam_unix(sudo:session): session closed for user root Aug 05 06:32:23 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-7b7ae5b4-1447-48e3-aefa-49a9bca0ee31 tempest-ProjectMemberTests-475949430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-52103eae-e24a-4b86-a2d4-7e249a70b0a3 -F qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-52103eae-e24a-4b86-a2d4-7e249a70b0a3.aeb70364-ff41-4e3c-81c5-ff2dc4aaf00b" returned: 0 in 0.360s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:32:23 devstack cinder-volume[88695]: WARNING cinder.volume.drivers.remotefs [None req-7b7ae5b4-1447-48e3-aefa-49a9bca0ee31 tempest-ProjectMemberTests-475949430 None] /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-52103eae-e24a-4b86-a2d4-7e249a70b0a3.aeb70364-ff41-4e3c-81c5-ff2dc4aaf00b is being set with open permissions: ugo+rw Aug 05 06:32:23 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-7b7ae5b4-1447-48e3-aefa-49a9bca0ee31 tempest-ProjectMemberTests-475949430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-52103eae-e24a-4b86-a2d4-7e249a70b0a3.aeb70364-ff41-4e3c-81c5-ff2dc4aaf00b {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:32:23 devstack sudo[109564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-52103eae-e24a-4b86-a2d4-7e249a70b0a3.aeb70364-ff41-4e3c-81c5-ff2dc4aaf00b Aug 05 06:32:23 devstack sudo[109564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:32:23 devstack sudo[109559]: pam_unix(sudo:session): session closed for user root Aug 05 06:32:23 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-50855756-1300-4dc7-937f-6d7c8a46fc0c tempest-SnapshotDependencyTests-404532457 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-47ce036f-3ed2-4a1d-af1d-98643e2e5ca2" returned: 0 in 0.372s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:32:23 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-50855756-1300-4dc7-937f-6d7c8a46fc0c tempest-SnapshotDependencyTests-404532457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-47ce036f-3ed2-4a1d-af1d-98643e2e5ca2 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:32:23 devstack sudo[109564]: pam_unix(sudo:session): session closed for user root Aug 05 06:32:23 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-7b7ae5b4-1447-48e3-aefa-49a9bca0ee31 tempest-ProjectMemberTests-475949430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-52103eae-e24a-4b86-a2d4-7e249a70b0a3.aeb70364-ff41-4e3c-81c5-ff2dc4aaf00b" returned: 0 in 0.262s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:32:23 devstack sudo[109570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-47ce036f-3ed2-4a1d-af1d-98643e2e5ca2 Aug 05 06:32:23 devstack sudo[109570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:32:23 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-7b7ae5b4-1447-48e3-aefa-49a9bca0ee31 tempest-ProjectMemberTests-475949430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-52103eae-e24a-4b86-a2d4-7e249a70b0a3.info {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:32:23 devstack sudo[109572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-52103eae-e24a-4b86-a2d4-7e249a70b0a3.info Aug 05 06:32:23 devstack sudo[109572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:32:23 devstack sudo[109570]: pam_unix(sudo:session): session closed for user root Aug 05 06:32:23 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-50855756-1300-4dc7-937f-6d7c8a46fc0c tempest-SnapshotDependencyTests-404532457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-47ce036f-3ed2-4a1d-af1d-98643e2e5ca2" returned: 0 in 0.249s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:32:24 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-50855756-1300-4dc7-937f-6d7c8a46fc0c tempest-SnapshotDependencyTests-404532457 None] Lock "cinder-quobyte-47ce036f-3ed2-4a1d-af1d-98643e2e5ca2" released by "delete_volume" :: held 0.663s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:32:24 devstack sudo[109572]: pam_unix(sudo:session): session closed for user root Aug 05 06:32:24 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-7b7ae5b4-1447-48e3-aefa-49a9bca0ee31 tempest-ProjectMemberTests-475949430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-52103eae-e24a-4b86-a2d4-7e249a70b0a3.info" returned: 0 in 0.260s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:32:24 devstack cinder-volume[88695]: WARNING cinder.volume.drivers.remotefs [None req-7b7ae5b4-1447-48e3-aefa-49a9bca0ee31 tempest-ProjectMemberTests-475949430 None] /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-52103eae-e24a-4b86-a2d4-7e249a70b0a3.info is being set with open permissions: ugo+rw Aug 05 06:32:24 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-7b7ae5b4-1447-48e3-aefa-49a9bca0ee31 tempest-ProjectMemberTests-475949430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-52103eae-e24a-4b86-a2d4-7e249a70b0a3.info {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:32:24 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-50855756-1300-4dc7-937f-6d7c8a46fc0c tempest-SnapshotDependencyTests-404532457 None] Created reservations ['01b7da25-841b-4086-bcec-727e8b270ca0', '711c1d95-4719-4b05-b4d0-b097e1e38a47', 'dee8f420-b399-4a07-beff-ad8fa6fdb357', 'bc523c6a-3956-47cf-b43d-52f4ee746fb1'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:32:24 devstack sudo[109576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-52103eae-e24a-4b86-a2d4-7e249a70b0a3.info Aug 05 06:32:24 devstack sudo[109576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:32:24 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-50855756-1300-4dc7-937f-6d7c8a46fc0c tempest-SnapshotDependencyTests-404532457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:32:24 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-50855756-1300-4dc7-937f-6d7c8a46fc0c tempest-SnapshotDependencyTests-404532457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:32:24 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-50855756-1300-4dc7-937f-6d7c8a46fc0c tempest-SnapshotDependencyTests-404532457 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:32:24 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-50855756-1300-4dc7-937f-6d7c8a46fc0c tempest-SnapshotDependencyTests-404532457 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:32:24 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-50855756-1300-4dc7-937f-6d7c8a46fc0c tempest-SnapshotDependencyTests-404532457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:32:24 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-50855756-1300-4dc7-937f-6d7c8a46fc0c tempest-SnapshotDependencyTests-404532457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:32:24 devstack sudo[109578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce Aug 05 06:32:24 devstack sudo[109578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:32:24 devstack sudo[109576]: pam_unix(sudo:session): session closed for user root Aug 05 06:32:24 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-7b7ae5b4-1447-48e3-aefa-49a9bca0ee31 tempest-ProjectMemberTests-475949430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-52103eae-e24a-4b86-a2d4-7e249a70b0a3.info" returned: 0 in 0.261s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:32:24 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-7b7ae5b4-1447-48e3-aefa-49a9bca0ee31 tempest-ProjectMemberTests-475949430 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.050s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:32:24 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-7b7ae5b4-1447-48e3-aefa-49a9bca0ee31 tempest-ProjectMemberTests-475949430 None] Create snapshot completed successfully Aug 05 06:32:24 devstack sudo[109578]: pam_unix(sudo:session): session closed for user root Aug 05 06:32:24 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-50855756-1300-4dc7-937f-6d7c8a46fc0c tempest-SnapshotDependencyTests-404532457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce" returned: 0 in 0.266s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:32:24 devstack cinder-volume[88695]: DEBUG cinder.manager [None req-50855756-1300-4dc7-937f-6d7c8a46fc0c tempest-SnapshotDependencyTests-404532457 None] Notifying Schedulers of capabilities ... {{(pid=88695) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 06:32:24 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-50855756-1300-4dc7-937f-6d7c8a46fc0c tempest-SnapshotDependencyTests-404532457 None] Deleted volume successfully. Aug 05 06:32:24 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-50855756-1300-4dc7-937f-6d7c8a46fc0c tempest-SnapshotDependencyTests-404532457 None] Lock "cinder-47ce036f-3ed2-4a1d-af1d-98643e2e5ca2-delete_volume" released by "delete_volume" :: held 1.182s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:32:25 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-44422aa9-442a-4888-8527-7d781895273b tempest-ProjectMemberTests-475949430 None] Acquiring lock "cinder-aeb70364-ff41-4e3c-81c5-ff2dc4aaf00b-delete_snapshot" by "delete_snapshot" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:32:25 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-44422aa9-442a-4888-8527-7d781895273b tempest-ProjectMemberTests-475949430 None] Lock "cinder-aeb70364-ff41-4e3c-81c5-ff2dc4aaf00b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:32:25 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-44422aa9-442a-4888-8527-7d781895273b tempest-ProjectMemberTests-475949430 None] Acquiring lock "cinder-quobyte-52103eae-e24a-4b86-a2d4-7e249a70b0a3" by "delete_snapshot" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:32:25 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-44422aa9-442a-4888-8527-7d781895273b tempest-ProjectMemberTests-475949430 None] Lock "cinder-quobyte-52103eae-e24a-4b86-a2d4-7e249a70b0a3" acquired by "delete_snapshot" :: waited 0.021s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:32:25 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-44422aa9-442a-4888-8527-7d781895273b tempest-ProjectMemberTests-475949430 None] Acquiring lock "cinder-quobyte-aeb70364-ff41-4e3c-81c5-ff2dc4aaf00b" by "_delete_snapshot" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:32:25 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-44422aa9-442a-4888-8527-7d781895273b tempest-ProjectMemberTests-475949430 None] Lock "cinder-quobyte-aeb70364-ff41-4e3c-81c5-ff2dc4aaf00b" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:32:25 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-44422aa9-442a-4888-8527-7d781895273b tempest-ProjectMemberTests-475949430 None] Deleting offline snapshot aeb70364-ff41-4e3c-81c5-ff2dc4aaf00b of volume 52103eae-e24a-4b86-a2d4-7e249a70b0a3 {{(pid=88695) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 06:32:25 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-44422aa9-442a-4888-8527-7d781895273b tempest-ProjectMemberTests-475949430 None] snapshot_file for this snap is: volume-52103eae-e24a-4b86-a2d4-7e249a70b0a3.aeb70364-ff41-4e3c-81c5-ff2dc4aaf00b {{(pid=88695) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 06:32:25 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[e95478eb-45cc-49d4-b172-eb4b30bba652]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:32:25 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-44422aa9-442a-4888-8527-7d781895273b tempest-ProjectMemberTests-475949430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-52103eae-e24a-4b86-a2d4-7e249a70b0a3.aeb70364-ff41-4e3c-81c5-ff2dc4aaf00b {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:32:25 devstack sudo[109582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-52103eae-e24a-4b86-a2d4-7e249a70b0a3.aeb70364-ff41-4e3c-81c5-ff2dc4aaf00b Aug 05 06:32:25 devstack sudo[109582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:32:26 devstack sudo[109582]: pam_unix(sudo:session): session closed for user root Aug 05 06:32:26 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-44422aa9-442a-4888-8527-7d781895273b tempest-ProjectMemberTests-475949430 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-52103eae-e24a-4b86-a2d4-7e249a70b0a3.aeb70364-ff41-4e3c-81c5-ff2dc4aaf00b" returned: 0 in 0.399s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:32:26 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-44422aa9-442a-4888-8527-7d781895273b tempest-ProjectMemberTests-475949430 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-52103eae-e24a-4b86-a2d4-7e249a70b0a3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88695) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 06:32:26 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1616c58-cefd-44b9-a478-107cd9183922]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:32:26 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-44422aa9-442a-4888-8527-7d781895273b tempest-ProjectMemberTests-475949430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-52103eae-e24a-4b86-a2d4-7e249a70b0a3 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:32:26 devstack sudo[109588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-52103eae-e24a-4b86-a2d4-7e249a70b0a3 Aug 05 06:32:26 devstack sudo[109588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:32:26 devstack sudo[109588]: pam_unix(sudo:session): session closed for user root Aug 05 06:32:26 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-44422aa9-442a-4888-8527-7d781895273b tempest-ProjectMemberTests-475949430 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-52103eae-e24a-4b86-a2d4-7e249a70b0a3" returned: 0 in 0.376s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:32:26 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-44422aa9-442a-4888-8527-7d781895273b tempest-ProjectMemberTests-475949430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-52103eae-e24a-4b86-a2d4-7e249a70b0a3.aeb70364-ff41-4e3c-81c5-ff2dc4aaf00b {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:32:26 devstack sudo[109594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-52103eae-e24a-4b86-a2d4-7e249a70b0a3.aeb70364-ff41-4e3c-81c5-ff2dc4aaf00b Aug 05 06:32:26 devstack sudo[109594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:32:26 devstack sudo[109594]: pam_unix(sudo:session): session closed for user root Aug 05 06:32:26 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-44422aa9-442a-4888-8527-7d781895273b tempest-ProjectMemberTests-475949430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-52103eae-e24a-4b86-a2d4-7e249a70b0a3.aeb70364-ff41-4e3c-81c5-ff2dc4aaf00b" returned: 0 in 0.407s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:32:26 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-44422aa9-442a-4888-8527-7d781895273b tempest-ProjectMemberTests-475949430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-52103eae-e24a-4b86-a2d4-7e249a70b0a3.aeb70364-ff41-4e3c-81c5-ff2dc4aaf00b {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:32:26 devstack sudo[109599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-52103eae-e24a-4b86-a2d4-7e249a70b0a3.aeb70364-ff41-4e3c-81c5-ff2dc4aaf00b Aug 05 06:32:26 devstack sudo[109599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:32:27 devstack sudo[109599]: pam_unix(sudo:session): session closed for user root Aug 05 06:32:27 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-44422aa9-442a-4888-8527-7d781895273b tempest-ProjectMemberTests-475949430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-52103eae-e24a-4b86-a2d4-7e249a70b0a3.aeb70364-ff41-4e3c-81c5-ff2dc4aaf00b" returned: 0 in 0.281s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:32:27 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-44422aa9-442a-4888-8527-7d781895273b tempest-ProjectMemberTests-475949430 None] Lock "cinder-quobyte-aeb70364-ff41-4e3c-81c5-ff2dc4aaf00b" released by "_delete_snapshot" :: held 1.552s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:32:27 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-44422aa9-442a-4888-8527-7d781895273b tempest-ProjectMemberTests-475949430 None] Lock "cinder-quobyte-52103eae-e24a-4b86-a2d4-7e249a70b0a3" released by "delete_snapshot" :: held 1.577s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:32:27 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-44422aa9-442a-4888-8527-7d781895273b tempest-ProjectMemberTests-475949430 None] Created reservations ['7c8bf92e-9e52-4c20-ac47-e4ca03de76c4', '6ae2d834-f7b9-4575-b5a9-4e42f3d2f24f', 'a3826ca4-5f27-4ace-9520-2f651ae2f0eb', 'eef1bcaa-af71-42d7-b511-b8ae96c08ec9'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:32:27 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-44422aa9-442a-4888-8527-7d781895273b tempest-ProjectMemberTests-475949430 None] Delete snapshot completed successfully. Aug 05 06:32:27 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-44422aa9-442a-4888-8527-7d781895273b tempest-ProjectMemberTests-475949430 None] Lock "cinder-aeb70364-ff41-4e3c-81c5-ff2dc4aaf00b-delete_snapshot" released by "delete_snapshot" :: held 1.731s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:32:27 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-3bd0ab87-d1f2-456d-bc4b-3ea6c57203f4 tempest-ProjectMemberTests-475949430 None] Acquiring lock "cinder-52103eae-e24a-4b86-a2d4-7e249a70b0a3-delete_volume" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:32:27 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-3bd0ab87-d1f2-456d-bc4b-3ea6c57203f4 tempest-ProjectMemberTests-475949430 None] Lock "cinder-52103eae-e24a-4b86-a2d4-7e249a70b0a3-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:32:27 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-3bd0ab87-d1f2-456d-bc4b-3ea6c57203f4 tempest-ProjectMemberTests-475949430 None] Acquiring lock "cinder-quobyte-52103eae-e24a-4b86-a2d4-7e249a70b0a3" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:32:27 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-3bd0ab87-d1f2-456d-bc4b-3ea6c57203f4 tempest-ProjectMemberTests-475949430 None] Lock "cinder-quobyte-52103eae-e24a-4b86-a2d4-7e249a70b0a3" acquired by "delete_volume" :: waited 0.019s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:32:27 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[36ce7b31-0b1f-4640-9ec2-e4005be295a1]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:32:27 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-3bd0ab87-d1f2-456d-bc4b-3ea6c57203f4 tempest-ProjectMemberTests-475949430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-52103eae-e24a-4b86-a2d4-7e249a70b0a3 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:32:27 devstack sudo[109602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-52103eae-e24a-4b86-a2d4-7e249a70b0a3 Aug 05 06:32:27 devstack sudo[109602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:32:28 devstack sudo[109602]: pam_unix(sudo:session): session closed for user root Aug 05 06:32:28 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-3bd0ab87-d1f2-456d-bc4b-3ea6c57203f4 tempest-ProjectMemberTests-475949430 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-52103eae-e24a-4b86-a2d4-7e249a70b0a3" returned: 0 in 0.432s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:32:28 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-3bd0ab87-d1f2-456d-bc4b-3ea6c57203f4 tempest-ProjectMemberTests-475949430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-52103eae-e24a-4b86-a2d4-7e249a70b0a3 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:32:28 devstack sudo[109608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-52103eae-e24a-4b86-a2d4-7e249a70b0a3 Aug 05 06:32:28 devstack sudo[109608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:32:28 devstack sudo[109608]: pam_unix(sudo:session): session closed for user root Aug 05 06:32:28 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-3bd0ab87-d1f2-456d-bc4b-3ea6c57203f4 tempest-ProjectMemberTests-475949430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-52103eae-e24a-4b86-a2d4-7e249a70b0a3" returned: 0 in 0.273s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:32:28 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-3bd0ab87-d1f2-456d-bc4b-3ea6c57203f4 tempest-ProjectMemberTests-475949430 None] Lock "cinder-quobyte-52103eae-e24a-4b86-a2d4-7e249a70b0a3" released by "delete_volume" :: held 0.767s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:32:28 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-3bd0ab87-d1f2-456d-bc4b-3ea6c57203f4 tempest-ProjectMemberTests-475949430 None] Created reservations ['e4bb628f-9092-4680-a408-da1213da13d4', 'c28ea3cd-f4da-411f-938e-2149adc2831d', 'd434a165-647e-4920-8547-983da1b5bd56', 'a27f98b5-79da-4811-ad93-c0f0da573f74'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:32:28 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-3bd0ab87-d1f2-456d-bc4b-3ea6c57203f4 tempest-ProjectMemberTests-475949430 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:32:28 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-3bd0ab87-d1f2-456d-bc4b-3ea6c57203f4 tempest-ProjectMemberTests-475949430 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:32:28 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-3bd0ab87-d1f2-456d-bc4b-3ea6c57203f4 tempest-ProjectMemberTests-475949430 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:32:28 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-3bd0ab87-d1f2-456d-bc4b-3ea6c57203f4 tempest-ProjectMemberTests-475949430 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:32:28 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-3bd0ab87-d1f2-456d-bc4b-3ea6c57203f4 tempest-ProjectMemberTests-475949430 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:32:28 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-3bd0ab87-d1f2-456d-bc4b-3ea6c57203f4 tempest-ProjectMemberTests-475949430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:32:28 devstack sudo[109612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce Aug 05 06:32:28 devstack sudo[109612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:32:28 devstack sudo[109612]: pam_unix(sudo:session): session closed for user root Aug 05 06:32:28 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-3bd0ab87-d1f2-456d-bc4b-3ea6c57203f4 tempest-ProjectMemberTests-475949430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce" returned: 0 in 0.284s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:32:28 devstack cinder-volume[88695]: DEBUG cinder.manager [None req-3bd0ab87-d1f2-456d-bc4b-3ea6c57203f4 tempest-ProjectMemberTests-475949430 None] Notifying Schedulers of capabilities ... {{(pid=88695) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 06:32:28 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-3bd0ab87-d1f2-456d-bc4b-3ea6c57203f4 tempest-ProjectMemberTests-475949430 None] Deleted volume successfully. Aug 05 06:32:29 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-3bd0ab87-d1f2-456d-bc4b-3ea6c57203f4 tempest-ProjectMemberTests-475949430 None] Lock "cinder-52103eae-e24a-4b86-a2d4-7e249a70b0a3-delete_volume" released by "delete_volume" :: held 1.288s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:32:29 devstack cinder-volume[88695]: DEBUG cinder.volume.flows.manager.create_volume [None req-65bc837c-8d54-4af8-8243-6acecb9ab65c tempest-ProjectMemberTests-475949430 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88695) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 06:32:29 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-65bc837c-8d54-4af8-8243-6acecb9ab65c tempest-ProjectMemberTests-475949430 None] Flow 'volume_create_manager' (0e7084ab-de84-44f6-a90e-159ab79f8549) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:32:29 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-65bc837c-8d54-4af8-8243-6acecb9ab65c tempest-ProjectMemberTests-475949430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a979d838-2f9d-478d-b4e7-bb7e3e34f403) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:32:29 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-65bc837c-8d54-4af8-8243-6acecb9ab65c tempest-ProjectMemberTests-475949430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a979d838-2f9d-478d-b4e7-bb7e3e34f403) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:32:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-919323193',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1ffeb12-61db-4275-ad7c-9b3b4e6d2e3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe85d705f6434b70a55dac31b79c0714',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:32:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:32:29Z,use_quota=True,user_id='a9de9bccd062450c95c9f7f6cf4317f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:32:29 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-65bc837c-8d54-4af8-8243-6acecb9ab65c tempest-ProjectMemberTests-475949430 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3be3bf9a-2466-4346-a75e-79c31f776e93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:32:29 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-65bc837c-8d54-4af8-8243-6acecb9ab65c tempest-ProjectMemberTests-475949430 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3be3bf9a-2466-4346-a75e-79c31f776e93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:32:29 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-65bc837c-8d54-4af8-8243-6acecb9ab65c tempest-ProjectMemberTests-475949430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4de8f1c6-e761-41e1-b308-be1460db3c5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:32:29 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-65bc837c-8d54-4af8-8243-6acecb9ab65c tempest-ProjectMemberTests-475949430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4de8f1c6-e761-41e1-b308-be1460db3c5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b1ffeb12-61db-4275-ad7c-9b3b4e6d2e3e', 'volume_name': 'volume-b1ffeb12-61db-4275-ad7c-9b3b4e6d2e3e', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:32:29 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-65bc837c-8d54-4af8-8243-6acecb9ab65c tempest-ProjectMemberTests-475949430 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5e955f9-5fff-4a27-932c-4789b899b283) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:32:29 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-65bc837c-8d54-4af8-8243-6acecb9ab65c tempest-ProjectMemberTests-475949430 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5e955f9-5fff-4a27-932c-4789b899b283) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:32:29 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-65bc837c-8d54-4af8-8243-6acecb9ab65c tempest-ProjectMemberTests-475949430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86e35edd-0583-463b-a3eb-b73cbeb6c2e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:32:29 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-65bc837c-8d54-4af8-8243-6acecb9ab65c tempest-ProjectMemberTests-475949430 None] Volume b1ffeb12-61db-4275-ad7c-9b3b4e6d2e3e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b1ffeb12-61db-4275-ad7c-9b3b4e6d2e3e', 'volume_size': 1} Aug 05 06:32:29 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-65bc837c-8d54-4af8-8243-6acecb9ab65c tempest-ProjectMemberTests-475949430 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:32:29 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-65bc837c-8d54-4af8-8243-6acecb9ab65c tempest-ProjectMemberTests-475949430 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:32:29 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-65bc837c-8d54-4af8-8243-6acecb9ab65c tempest-ProjectMemberTests-475949430 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:32:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-919323193',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1ffeb12-61db-4275-ad7c-9b3b4e6d2e3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe85d705f6434b70a55dac31b79c0714',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:32:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:32:29Z,use_quota=True,user_id='a9de9bccd062450c95c9f7f6cf4317f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)}" {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 06:32:29 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-65bc837c-8d54-4af8-8243-6acecb9ab65c tempest-ProjectMemberTests-475949430 None] Creating volume b1ffeb12-61db-4275-ad7c-9b3b4e6d2e3e {{(pid=88695) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 06:32:29 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-65bc837c-8d54-4af8-8243-6acecb9ab65c tempest-ProjectMemberTests-475949430 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:32:29 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-65bc837c-8d54-4af8-8243-6acecb9ab65c tempest-ProjectMemberTests-475949430 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:32:29 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-65bc837c-8d54-4af8-8243-6acecb9ab65c tempest-ProjectMemberTests-475949430 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:32:29 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-65bc837c-8d54-4af8-8243-6acecb9ab65c tempest-ProjectMemberTests-475949430 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:32:29 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-65bc837c-8d54-4af8-8243-6acecb9ab65c tempest-ProjectMemberTests-475949430 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:32:29 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-65bc837c-8d54-4af8-8243-6acecb9ab65c tempest-ProjectMemberTests-475949430 None] Selected osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 as target Quobyte volume. {{(pid=88695) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 06:32:29 devstack cinder-volume[88695]: INFO cinder.volume.drivers.remotefs [None req-65bc837c-8d54-4af8-8243-6acecb9ab65c tempest-ProjectMemberTests-475949430 None] casted to osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 Aug 05 06:32:29 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-65bc837c-8d54-4af8-8243-6acecb9ab65c tempest-ProjectMemberTests-475949430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-b1ffeb12-61db-4275-ad7c-9b3b4e6d2e3e 1073741824 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:32:29 devstack sudo[109615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-b1ffeb12-61db-4275-ad7c-9b3b4e6d2e3e 1073741824 Aug 05 06:32:29 devstack sudo[109615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:32:29 devstack sudo[109615]: pam_unix(sudo:session): session closed for user root Aug 05 06:32:29 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-65bc837c-8d54-4af8-8243-6acecb9ab65c tempest-ProjectMemberTests-475949430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-b1ffeb12-61db-4275-ad7c-9b3b4e6d2e3e 1073741824" returned: 0 in 0.484s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:32:30 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-65bc837c-8d54-4af8-8243-6acecb9ab65c tempest-ProjectMemberTests-475949430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-b1ffeb12-61db-4275-ad7c-9b3b4e6d2e3e {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:32:30 devstack sudo[109622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-b1ffeb12-61db-4275-ad7c-9b3b4e6d2e3e Aug 05 06:32:30 devstack sudo[109622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:32:30 devstack sudo[109622]: pam_unix(sudo:session): session closed for user root Aug 05 06:32:30 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-65bc837c-8d54-4af8-8243-6acecb9ab65c tempest-ProjectMemberTests-475949430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-b1ffeb12-61db-4275-ad7c-9b3b4e6d2e3e" returned: 0 in 0.265s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:32:30 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-65bc837c-8d54-4af8-8243-6acecb9ab65c tempest-ProjectMemberTests-475949430 None] <== create_volume: return (791ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'} {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 06:32:30 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-65bc837c-8d54-4af8-8243-6acecb9ab65c tempest-ProjectMemberTests-475949430 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.793s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:32:30 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-65bc837c-8d54-4af8-8243-6acecb9ab65c tempest-ProjectMemberTests-475949430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86e35edd-0583-463b-a3eb-b73cbeb6c2e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1ffeb12-61db-4275-ad7c-9b3b4e6d2e3e', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:32:30 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-65bc837c-8d54-4af8-8243-6acecb9ab65c tempest-ProjectMemberTests-475949430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (078b7885-b14b-424b-832d-8c24856ffb02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:32:30 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-65bc837c-8d54-4af8-8243-6acecb9ab65c tempest-ProjectMemberTests-475949430 None] Volume volume-b1ffeb12-61db-4275-ad7c-9b3b4e6d2e3e (b1ffeb12-61db-4275-ad7c-9b3b4e6d2e3e): created successfully Aug 05 06:32:30 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-65bc837c-8d54-4af8-8243-6acecb9ab65c tempest-ProjectMemberTests-475949430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (078b7885-b14b-424b-832d-8c24856ffb02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:32:30 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-65bc837c-8d54-4af8-8243-6acecb9ab65c tempest-ProjectMemberTests-475949430 None] Flow 'volume_create_manager' (0e7084ab-de84-44f6-a90e-159ab79f8549) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:32:30 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-65bc837c-8d54-4af8-8243-6acecb9ab65c tempest-ProjectMemberTests-475949430 None] Created volume successfully. Aug 05 06:32:31 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-40ef0bbe-dbf5-4f36-9272-d882732e7ea8 tempest-ProjectMemberTests-475949430 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:32:31 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-40ef0bbe-dbf5-4f36-9272-d882732e7ea8 tempest-ProjectMemberTests-475949430 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:32:31 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-40ef0bbe-dbf5-4f36-9272-d882732e7ea8 tempest-ProjectMemberTests-475949430 None] Creating offline snapshot 2d2f4df1-e7f5-4f15-bc6e-0b30caee171d of volume b1ffeb12-61db-4275-ad7c-9b3b4e6d2e3e {{(pid=88695) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 06:32:31 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b9492e9-62e0-4afa-96c3-b14c1b081a0e]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:32:31 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-40ef0bbe-dbf5-4f36-9272-d882732e7ea8 tempest-ProjectMemberTests-475949430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-b1ffeb12-61db-4275-ad7c-9b3b4e6d2e3e {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:32:31 devstack sudo[109627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-b1ffeb12-61db-4275-ad7c-9b3b4e6d2e3e Aug 05 06:32:31 devstack sudo[109627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:32:32 devstack sudo[109627]: pam_unix(sudo:session): session closed for user root Aug 05 06:32:32 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-40ef0bbe-dbf5-4f36-9272-d882732e7ea8 tempest-ProjectMemberTests-475949430 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-b1ffeb12-61db-4275-ad7c-9b3b4e6d2e3e" returned: 0 in 0.371s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:32:32 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-40ef0bbe-dbf5-4f36-9272-d882732e7ea8 tempest-ProjectMemberTests-475949430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-b1ffeb12-61db-4275-ad7c-9b3b4e6d2e3e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-b1ffeb12-61db-4275-ad7c-9b3b4e6d2e3e.2d2f4df1-e7f5-4f15-bc6e-0b30caee171d 1G {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:32:32 devstack sudo[109632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-b1ffeb12-61db-4275-ad7c-9b3b4e6d2e3e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-b1ffeb12-61db-4275-ad7c-9b3b4e6d2e3e.2d2f4df1-e7f5-4f15-bc6e-0b30caee171d 1G Aug 05 06:32:32 devstack sudo[109632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:32:32 devstack sudo[109632]: pam_unix(sudo:session): session closed for user root Aug 05 06:32:32 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-40ef0bbe-dbf5-4f36-9272-d882732e7ea8 tempest-ProjectMemberTests-475949430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-b1ffeb12-61db-4275-ad7c-9b3b4e6d2e3e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-b1ffeb12-61db-4275-ad7c-9b3b4e6d2e3e.2d2f4df1-e7f5-4f15-bc6e-0b30caee171d 1G" returned: 0 in 0.473s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:32:32 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-40ef0bbe-dbf5-4f36-9272-d882732e7ea8 tempest-ProjectMemberTests-475949430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b1ffeb12-61db-4275-ad7c-9b3b4e6d2e3e -F qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-b1ffeb12-61db-4275-ad7c-9b3b4e6d2e3e.2d2f4df1-e7f5-4f15-bc6e-0b30caee171d {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:32:32 devstack sudo[109637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b1ffeb12-61db-4275-ad7c-9b3b4e6d2e3e -F qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-b1ffeb12-61db-4275-ad7c-9b3b4e6d2e3e.2d2f4df1-e7f5-4f15-bc6e-0b30caee171d Aug 05 06:32:32 devstack sudo[109637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:32:32 devstack sudo[109637]: pam_unix(sudo:session): session closed for user root Aug 05 06:32:32 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-40ef0bbe-dbf5-4f36-9272-d882732e7ea8 tempest-ProjectMemberTests-475949430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b1ffeb12-61db-4275-ad7c-9b3b4e6d2e3e -F qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-b1ffeb12-61db-4275-ad7c-9b3b4e6d2e3e.2d2f4df1-e7f5-4f15-bc6e-0b30caee171d" returned: 0 in 0.326s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:32:32 devstack cinder-volume[88695]: WARNING cinder.volume.drivers.remotefs [None req-40ef0bbe-dbf5-4f36-9272-d882732e7ea8 tempest-ProjectMemberTests-475949430 None] /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-b1ffeb12-61db-4275-ad7c-9b3b4e6d2e3e.2d2f4df1-e7f5-4f15-bc6e-0b30caee171d is being set with open permissions: ugo+rw Aug 05 06:32:32 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-40ef0bbe-dbf5-4f36-9272-d882732e7ea8 tempest-ProjectMemberTests-475949430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-b1ffeb12-61db-4275-ad7c-9b3b4e6d2e3e.2d2f4df1-e7f5-4f15-bc6e-0b30caee171d {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:32:32 devstack sudo[109642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-b1ffeb12-61db-4275-ad7c-9b3b4e6d2e3e.2d2f4df1-e7f5-4f15-bc6e-0b30caee171d Aug 05 06:32:32 devstack sudo[109642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:32:33 devstack sudo[109642]: pam_unix(sudo:session): session closed for user root Aug 05 06:32:33 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-40ef0bbe-dbf5-4f36-9272-d882732e7ea8 tempest-ProjectMemberTests-475949430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-b1ffeb12-61db-4275-ad7c-9b3b4e6d2e3e.2d2f4df1-e7f5-4f15-bc6e-0b30caee171d" returned: 0 in 0.249s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:32:33 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-40ef0bbe-dbf5-4f36-9272-d882732e7ea8 tempest-ProjectMemberTests-475949430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-b1ffeb12-61db-4275-ad7c-9b3b4e6d2e3e.info {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:32:33 devstack sudo[109645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-b1ffeb12-61db-4275-ad7c-9b3b4e6d2e3e.info Aug 05 06:32:33 devstack sudo[109645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:32:33 devstack sudo[109645]: pam_unix(sudo:session): session closed for user root Aug 05 06:32:33 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-40ef0bbe-dbf5-4f36-9272-d882732e7ea8 tempest-ProjectMemberTests-475949430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-b1ffeb12-61db-4275-ad7c-9b3b4e6d2e3e.info" returned: 0 in 0.264s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:32:33 devstack cinder-volume[88695]: WARNING cinder.volume.drivers.remotefs [None req-40ef0bbe-dbf5-4f36-9272-d882732e7ea8 tempest-ProjectMemberTests-475949430 None] /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-b1ffeb12-61db-4275-ad7c-9b3b4e6d2e3e.info is being set with open permissions: ugo+rw Aug 05 06:32:33 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-40ef0bbe-dbf5-4f36-9272-d882732e7ea8 tempest-ProjectMemberTests-475949430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-b1ffeb12-61db-4275-ad7c-9b3b4e6d2e3e.info {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:32:33 devstack sudo[109648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-b1ffeb12-61db-4275-ad7c-9b3b4e6d2e3e.info Aug 05 06:32:33 devstack sudo[109648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:32:33 devstack sudo[109648]: pam_unix(sudo:session): session closed for user root Aug 05 06:32:33 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-40ef0bbe-dbf5-4f36-9272-d882732e7ea8 tempest-ProjectMemberTests-475949430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-b1ffeb12-61db-4275-ad7c-9b3b4e6d2e3e.info" returned: 0 in 0.279s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:32:33 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-40ef0bbe-dbf5-4f36-9272-d882732e7ea8 tempest-ProjectMemberTests-475949430 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.056s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:32:33 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-40ef0bbe-dbf5-4f36-9272-d882732e7ea8 tempest-ProjectMemberTests-475949430 None] Create snapshot completed successfully Aug 05 06:32:34 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-0845356e-52b0-4e37-80a8-d041471c05b5 tempest-ProjectMemberTests-475949430 None] Acquiring lock "cinder-2d2f4df1-e7f5-4f15-bc6e-0b30caee171d-delete_snapshot" by "delete_snapshot" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:32:34 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-0845356e-52b0-4e37-80a8-d041471c05b5 tempest-ProjectMemberTests-475949430 None] Lock "cinder-2d2f4df1-e7f5-4f15-bc6e-0b30caee171d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:32:34 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-0845356e-52b0-4e37-80a8-d041471c05b5 tempest-ProjectMemberTests-475949430 None] Acquiring lock "cinder-quobyte-b1ffeb12-61db-4275-ad7c-9b3b4e6d2e3e" by "delete_snapshot" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:32:34 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-0845356e-52b0-4e37-80a8-d041471c05b5 tempest-ProjectMemberTests-475949430 None] Lock "cinder-quobyte-b1ffeb12-61db-4275-ad7c-9b3b4e6d2e3e" acquired by "delete_snapshot" :: waited 0.015s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:32:34 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-0845356e-52b0-4e37-80a8-d041471c05b5 tempest-ProjectMemberTests-475949430 None] Acquiring lock "cinder-quobyte-2d2f4df1-e7f5-4f15-bc6e-0b30caee171d" by "_delete_snapshot" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:32:34 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-0845356e-52b0-4e37-80a8-d041471c05b5 tempest-ProjectMemberTests-475949430 None] Lock "cinder-quobyte-2d2f4df1-e7f5-4f15-bc6e-0b30caee171d" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:32:34 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-0845356e-52b0-4e37-80a8-d041471c05b5 tempest-ProjectMemberTests-475949430 None] Deleting offline snapshot 2d2f4df1-e7f5-4f15-bc6e-0b30caee171d of volume b1ffeb12-61db-4275-ad7c-9b3b4e6d2e3e {{(pid=88695) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 06:32:34 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-0845356e-52b0-4e37-80a8-d041471c05b5 tempest-ProjectMemberTests-475949430 None] snapshot_file for this snap is: volume-b1ffeb12-61db-4275-ad7c-9b3b4e6d2e3e.2d2f4df1-e7f5-4f15-bc6e-0b30caee171d {{(pid=88695) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 06:32:34 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[b14014f5-15d5-497c-b3e3-6f40c799a84d]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:32:34 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-0845356e-52b0-4e37-80a8-d041471c05b5 tempest-ProjectMemberTests-475949430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-b1ffeb12-61db-4275-ad7c-9b3b4e6d2e3e.2d2f4df1-e7f5-4f15-bc6e-0b30caee171d {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:32:35 devstack sudo[109651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-b1ffeb12-61db-4275-ad7c-9b3b4e6d2e3e.2d2f4df1-e7f5-4f15-bc6e-0b30caee171d Aug 05 06:32:35 devstack sudo[109651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:32:35 devstack sudo[109651]: pam_unix(sudo:session): session closed for user root Aug 05 06:32:35 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-0845356e-52b0-4e37-80a8-d041471c05b5 tempest-ProjectMemberTests-475949430 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-b1ffeb12-61db-4275-ad7c-9b3b4e6d2e3e.2d2f4df1-e7f5-4f15-bc6e-0b30caee171d" returned: 0 in 0.367s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:32:35 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-0845356e-52b0-4e37-80a8-d041471c05b5 tempest-ProjectMemberTests-475949430 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b1ffeb12-61db-4275-ad7c-9b3b4e6d2e3e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88695) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 06:32:35 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[874ee4b1-73ec-4ffc-869c-567861c9c345]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:32:35 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-0845356e-52b0-4e37-80a8-d041471c05b5 tempest-ProjectMemberTests-475949430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-b1ffeb12-61db-4275-ad7c-9b3b4e6d2e3e {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:32:35 devstack sudo[109656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-b1ffeb12-61db-4275-ad7c-9b3b4e6d2e3e Aug 05 06:32:35 devstack sudo[109656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:32:35 devstack sudo[109656]: pam_unix(sudo:session): session closed for user root Aug 05 06:32:35 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-0845356e-52b0-4e37-80a8-d041471c05b5 tempest-ProjectMemberTests-475949430 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-b1ffeb12-61db-4275-ad7c-9b3b4e6d2e3e" returned: 0 in 0.381s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:32:35 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-0845356e-52b0-4e37-80a8-d041471c05b5 tempest-ProjectMemberTests-475949430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-b1ffeb12-61db-4275-ad7c-9b3b4e6d2e3e.2d2f4df1-e7f5-4f15-bc6e-0b30caee171d {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:32:35 devstack sudo[109661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-b1ffeb12-61db-4275-ad7c-9b3b4e6d2e3e.2d2f4df1-e7f5-4f15-bc6e-0b30caee171d Aug 05 06:32:35 devstack sudo[109661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:32:36 devstack sudo[109661]: pam_unix(sudo:session): session closed for user root Aug 05 06:32:36 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-0845356e-52b0-4e37-80a8-d041471c05b5 tempest-ProjectMemberTests-475949430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-b1ffeb12-61db-4275-ad7c-9b3b4e6d2e3e.2d2f4df1-e7f5-4f15-bc6e-0b30caee171d" returned: 0 in 0.357s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:32:36 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-0845356e-52b0-4e37-80a8-d041471c05b5 tempest-ProjectMemberTests-475949430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-b1ffeb12-61db-4275-ad7c-9b3b4e6d2e3e.2d2f4df1-e7f5-4f15-bc6e-0b30caee171d {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:32:36 devstack sudo[109666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-b1ffeb12-61db-4275-ad7c-9b3b4e6d2e3e.2d2f4df1-e7f5-4f15-bc6e-0b30caee171d Aug 05 06:32:36 devstack sudo[109666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:32:36 devstack sudo[109666]: pam_unix(sudo:session): session closed for user root Aug 05 06:32:36 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-0845356e-52b0-4e37-80a8-d041471c05b5 tempest-ProjectMemberTests-475949430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-b1ffeb12-61db-4275-ad7c-9b3b4e6d2e3e.2d2f4df1-e7f5-4f15-bc6e-0b30caee171d" returned: 0 in 0.267s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:32:36 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-0845356e-52b0-4e37-80a8-d041471c05b5 tempest-ProjectMemberTests-475949430 None] Lock "cinder-quobyte-2d2f4df1-e7f5-4f15-bc6e-0b30caee171d" released by "_delete_snapshot" :: held 1.471s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:32:36 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-0845356e-52b0-4e37-80a8-d041471c05b5 tempest-ProjectMemberTests-475949430 None] Lock "cinder-quobyte-b1ffeb12-61db-4275-ad7c-9b3b4e6d2e3e" released by "delete_snapshot" :: held 1.495s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:32:36 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-0845356e-52b0-4e37-80a8-d041471c05b5 tempest-ProjectMemberTests-475949430 None] Created reservations ['61bbaa83-d618-404e-9036-9c64bdb44466', '384473ec-5be5-4e7e-b66e-a0bae982ac18', '9eb06537-a6cf-4c12-a1be-bb38a3be2995', '1c90115f-0dd4-429b-96c6-b1f7c3ac8997'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:32:36 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-0845356e-52b0-4e37-80a8-d041471c05b5 tempest-ProjectMemberTests-475949430 None] Delete snapshot completed successfully. Aug 05 06:32:36 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-0845356e-52b0-4e37-80a8-d041471c05b5 tempest-ProjectMemberTests-475949430 None] Lock "cinder-2d2f4df1-e7f5-4f15-bc6e-0b30caee171d-delete_snapshot" released by "delete_snapshot" :: held 1.636s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:32:37 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-f3a39cea-1240-42f9-a01d-51960f3cf304 tempest-ProjectMemberTests-475949430 None] Acquiring lock "cinder-b1ffeb12-61db-4275-ad7c-9b3b4e6d2e3e-delete_volume" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:32:37 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-f3a39cea-1240-42f9-a01d-51960f3cf304 tempest-ProjectMemberTests-475949430 None] Lock "cinder-b1ffeb12-61db-4275-ad7c-9b3b4e6d2e3e-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:32:37 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-f3a39cea-1240-42f9-a01d-51960f3cf304 tempest-ProjectMemberTests-475949430 None] Acquiring lock "cinder-quobyte-b1ffeb12-61db-4275-ad7c-9b3b4e6d2e3e" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:32:37 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-f3a39cea-1240-42f9-a01d-51960f3cf304 tempest-ProjectMemberTests-475949430 None] Lock "cinder-quobyte-b1ffeb12-61db-4275-ad7c-9b3b4e6d2e3e" acquired by "delete_volume" :: waited 0.016s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:32:37 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a37ef3e-07ec-41a0-b4fd-364328cf0a9e]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:32:37 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-f3a39cea-1240-42f9-a01d-51960f3cf304 tempest-ProjectMemberTests-475949430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-b1ffeb12-61db-4275-ad7c-9b3b4e6d2e3e {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:32:37 devstack sudo[109669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-b1ffeb12-61db-4275-ad7c-9b3b4e6d2e3e Aug 05 06:32:37 devstack sudo[109669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:32:37 devstack sudo[109669]: pam_unix(sudo:session): session closed for user root Aug 05 06:32:37 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-f3a39cea-1240-42f9-a01d-51960f3cf304 tempest-ProjectMemberTests-475949430 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-b1ffeb12-61db-4275-ad7c-9b3b4e6d2e3e" returned: 0 in 0.396s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:32:37 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-f3a39cea-1240-42f9-a01d-51960f3cf304 tempest-ProjectMemberTests-475949430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-b1ffeb12-61db-4275-ad7c-9b3b4e6d2e3e {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:32:37 devstack sudo[109674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-b1ffeb12-61db-4275-ad7c-9b3b4e6d2e3e Aug 05 06:32:37 devstack sudo[109674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:32:37 devstack sudo[109674]: pam_unix(sudo:session): session closed for user root Aug 05 06:32:37 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-f3a39cea-1240-42f9-a01d-51960f3cf304 tempest-ProjectMemberTests-475949430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-b1ffeb12-61db-4275-ad7c-9b3b4e6d2e3e" returned: 0 in 0.252s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:32:37 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-f3a39cea-1240-42f9-a01d-51960f3cf304 tempest-ProjectMemberTests-475949430 None] Lock "cinder-quobyte-b1ffeb12-61db-4275-ad7c-9b3b4e6d2e3e" released by "delete_volume" :: held 0.712s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:32:37 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-f3a39cea-1240-42f9-a01d-51960f3cf304 tempest-ProjectMemberTests-475949430 None] Created reservations ['2aa6147f-fbac-404b-b3e5-81b3db07e222', '42662aeb-529c-4bd1-ade3-ba29d804ba40', 'a30f2779-4a0d-4022-8880-5cfe50fb144b', 'c5c87a45-2862-43b3-85d0-852ce70ebeaf'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:32:37 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-f3a39cea-1240-42f9-a01d-51960f3cf304 tempest-ProjectMemberTests-475949430 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:32:37 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-f3a39cea-1240-42f9-a01d-51960f3cf304 tempest-ProjectMemberTests-475949430 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:32:37 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-f3a39cea-1240-42f9-a01d-51960f3cf304 tempest-ProjectMemberTests-475949430 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:32:37 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-f3a39cea-1240-42f9-a01d-51960f3cf304 tempest-ProjectMemberTests-475949430 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:32:37 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-f3a39cea-1240-42f9-a01d-51960f3cf304 tempest-ProjectMemberTests-475949430 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:32:37 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-f3a39cea-1240-42f9-a01d-51960f3cf304 tempest-ProjectMemberTests-475949430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:32:37 devstack sudo[109678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce Aug 05 06:32:37 devstack sudo[109678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:32:38 devstack sudo[109678]: pam_unix(sudo:session): session closed for user root Aug 05 06:32:38 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-f3a39cea-1240-42f9-a01d-51960f3cf304 tempest-ProjectMemberTests-475949430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce" returned: 0 in 0.298s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:32:38 devstack cinder-volume[88695]: DEBUG cinder.manager [None req-f3a39cea-1240-42f9-a01d-51960f3cf304 tempest-ProjectMemberTests-475949430 None] Notifying Schedulers of capabilities ... {{(pid=88695) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 06:32:38 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-f3a39cea-1240-42f9-a01d-51960f3cf304 tempest-ProjectMemberTests-475949430 None] Deleted volume successfully. Aug 05 06:32:38 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-f3a39cea-1240-42f9-a01d-51960f3cf304 tempest-ProjectMemberTests-475949430 None] Lock "cinder-b1ffeb12-61db-4275-ad7c-9b3b4e6d2e3e-delete_volume" released by "delete_volume" :: held 1.227s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:32:38 devstack cinder-volume[88695]: DEBUG dbcounter [-] [88695] Writing DB stats cinder:SELECT=135,cinder:UPDATE=165,cinder:INSERT=46,cinder:DELETE=17 {{(pid=88695) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 06:32:38 devstack cinder-volume[88695]: DEBUG cinder.volume.flows.manager.create_volume [None req-3180589e-d0db-4bcd-99bf-a3992b356d55 tempest-ProjectMemberTests-475949430 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88695) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 06:32:38 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-3180589e-d0db-4bcd-99bf-a3992b356d55 tempest-ProjectMemberTests-475949430 None] Flow 'volume_create_manager' (bb059e75-9c14-49c5-826c-dbbef16f7519) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:32:38 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-3180589e-d0db-4bcd-99bf-a3992b356d55 tempest-ProjectMemberTests-475949430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24ca3022-4a29-49b3-a483-c283d4a47981) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:32:38 devstack cinder-volume[88695]: DEBUG dbcounter [-] [88695] Writing DB stats cinder:SELECT=131,cinder:INSERT=46,cinder:UPDATE=179,cinder:DELETE=11 {{(pid=88695) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 06:32:38 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-3180589e-d0db-4bcd-99bf-a3992b356d55 tempest-ProjectMemberTests-475949430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24ca3022-4a29-49b3-a483-c283d4a47981) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:32:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1291024178',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9039939e-aa2e-4384-a202-5ee811ca9fc4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe85d705f6434b70a55dac31b79c0714',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:32:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:32:39Z,use_quota=True,user_id='a9de9bccd062450c95c9f7f6cf4317f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:32:38 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-3180589e-d0db-4bcd-99bf-a3992b356d55 tempest-ProjectMemberTests-475949430 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfc36092-c0ad-478a-aecd-7fe523b5d4c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:32:38 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-3180589e-d0db-4bcd-99bf-a3992b356d55 tempest-ProjectMemberTests-475949430 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfc36092-c0ad-478a-aecd-7fe523b5d4c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:32:38 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-3180589e-d0db-4bcd-99bf-a3992b356d55 tempest-ProjectMemberTests-475949430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63c72611-085b-42be-9e99-d72f0f2e23a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:32:38 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-3180589e-d0db-4bcd-99bf-a3992b356d55 tempest-ProjectMemberTests-475949430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63c72611-085b-42be-9e99-d72f0f2e23a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9039939e-aa2e-4384-a202-5ee811ca9fc4', 'volume_name': 'volume-9039939e-aa2e-4384-a202-5ee811ca9fc4', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:32:38 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-3180589e-d0db-4bcd-99bf-a3992b356d55 tempest-ProjectMemberTests-475949430 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5102cc2c-5b17-4742-8be8-d64195f07e79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:32:38 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-3180589e-d0db-4bcd-99bf-a3992b356d55 tempest-ProjectMemberTests-475949430 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5102cc2c-5b17-4742-8be8-d64195f07e79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:32:38 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-3180589e-d0db-4bcd-99bf-a3992b356d55 tempest-ProjectMemberTests-475949430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (653b3eeb-4315-4a17-9431-d6699b4f23dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:32:38 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-3180589e-d0db-4bcd-99bf-a3992b356d55 tempest-ProjectMemberTests-475949430 None] Volume 9039939e-aa2e-4384-a202-5ee811ca9fc4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9039939e-aa2e-4384-a202-5ee811ca9fc4', 'volume_size': 1} Aug 05 06:32:38 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-3180589e-d0db-4bcd-99bf-a3992b356d55 tempest-ProjectMemberTests-475949430 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:32:38 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-3180589e-d0db-4bcd-99bf-a3992b356d55 tempest-ProjectMemberTests-475949430 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:32:38 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-3180589e-d0db-4bcd-99bf-a3992b356d55 tempest-ProjectMemberTests-475949430 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:32:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1291024178',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9039939e-aa2e-4384-a202-5ee811ca9fc4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe85d705f6434b70a55dac31b79c0714',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:32:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:32:39Z,use_quota=True,user_id='a9de9bccd062450c95c9f7f6cf4317f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)}" {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 06:32:38 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-3180589e-d0db-4bcd-99bf-a3992b356d55 tempest-ProjectMemberTests-475949430 None] Creating volume 9039939e-aa2e-4384-a202-5ee811ca9fc4 {{(pid=88695) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 06:32:38 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-3180589e-d0db-4bcd-99bf-a3992b356d55 tempest-ProjectMemberTests-475949430 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:32:38 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-3180589e-d0db-4bcd-99bf-a3992b356d55 tempest-ProjectMemberTests-475949430 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:32:38 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-3180589e-d0db-4bcd-99bf-a3992b356d55 tempest-ProjectMemberTests-475949430 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:32:38 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-3180589e-d0db-4bcd-99bf-a3992b356d55 tempest-ProjectMemberTests-475949430 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:32:38 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-3180589e-d0db-4bcd-99bf-a3992b356d55 tempest-ProjectMemberTests-475949430 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:32:38 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-3180589e-d0db-4bcd-99bf-a3992b356d55 tempest-ProjectMemberTests-475949430 None] Selected osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 as target Quobyte volume. {{(pid=88695) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 06:32:38 devstack cinder-volume[88695]: INFO cinder.volume.drivers.remotefs [None req-3180589e-d0db-4bcd-99bf-a3992b356d55 tempest-ProjectMemberTests-475949430 None] casted to osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 Aug 05 06:32:38 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-3180589e-d0db-4bcd-99bf-a3992b356d55 tempest-ProjectMemberTests-475949430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9039939e-aa2e-4384-a202-5ee811ca9fc4 1073741824 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:32:38 devstack sudo[109682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9039939e-aa2e-4384-a202-5ee811ca9fc4 1073741824 Aug 05 06:32:38 devstack sudo[109682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:32:39 devstack sudo[109682]: pam_unix(sudo:session): session closed for user root Aug 05 06:32:39 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-3180589e-d0db-4bcd-99bf-a3992b356d55 tempest-ProjectMemberTests-475949430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9039939e-aa2e-4384-a202-5ee811ca9fc4 1073741824" returned: 0 in 0.443s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:32:39 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-3180589e-d0db-4bcd-99bf-a3992b356d55 tempest-ProjectMemberTests-475949430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9039939e-aa2e-4384-a202-5ee811ca9fc4 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:32:39 devstack sudo[109688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9039939e-aa2e-4384-a202-5ee811ca9fc4 Aug 05 06:32:39 devstack sudo[109688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:32:39 devstack sudo[109688]: pam_unix(sudo:session): session closed for user root Aug 05 06:32:39 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-3180589e-d0db-4bcd-99bf-a3992b356d55 tempest-ProjectMemberTests-475949430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9039939e-aa2e-4384-a202-5ee811ca9fc4" returned: 0 in 0.281s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:32:39 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-3180589e-d0db-4bcd-99bf-a3992b356d55 tempest-ProjectMemberTests-475949430 None] <== create_volume: return (770ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'} {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 06:32:39 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-3180589e-d0db-4bcd-99bf-a3992b356d55 tempest-ProjectMemberTests-475949430 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.772s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:32:39 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-3180589e-d0db-4bcd-99bf-a3992b356d55 tempest-ProjectMemberTests-475949430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (653b3eeb-4315-4a17-9431-d6699b4f23dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9039939e-aa2e-4384-a202-5ee811ca9fc4', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:32:39 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-3180589e-d0db-4bcd-99bf-a3992b356d55 tempest-ProjectMemberTests-475949430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (763e093c-2a49-41cf-9b3a-ea2d5574e1ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:32:39 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-3180589e-d0db-4bcd-99bf-a3992b356d55 tempest-ProjectMemberTests-475949430 None] Volume volume-9039939e-aa2e-4384-a202-5ee811ca9fc4 (9039939e-aa2e-4384-a202-5ee811ca9fc4): created successfully Aug 05 06:32:39 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-3180589e-d0db-4bcd-99bf-a3992b356d55 tempest-ProjectMemberTests-475949430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (763e093c-2a49-41cf-9b3a-ea2d5574e1ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:32:39 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-3180589e-d0db-4bcd-99bf-a3992b356d55 tempest-ProjectMemberTests-475949430 None] Flow 'volume_create_manager' (bb059e75-9c14-49c5-826c-dbbef16f7519) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:32:39 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-3180589e-d0db-4bcd-99bf-a3992b356d55 tempest-ProjectMemberTests-475949430 None] Created volume successfully. Aug 05 06:32:39 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-99eb73ab-5604-4387-b865-c80c25f4e907 tempest-ProjectMemberTests-475949430 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:32:39 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-99eb73ab-5604-4387-b865-c80c25f4e907 tempest-ProjectMemberTests-475949430 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:32:39 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-99eb73ab-5604-4387-b865-c80c25f4e907 tempest-ProjectMemberTests-475949430 None] Creating offline snapshot d280088c-f8b7-4447-8232-001534e0667c of volume 9039939e-aa2e-4384-a202-5ee811ca9fc4 {{(pid=88695) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 06:32:39 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[17532a8d-33ca-4ce2-a585-8bf85341fc8f]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:32:39 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-99eb73ab-5604-4387-b865-c80c25f4e907 tempest-ProjectMemberTests-475949430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9039939e-aa2e-4384-a202-5ee811ca9fc4 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:32:40 devstack sudo[109691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9039939e-aa2e-4384-a202-5ee811ca9fc4 Aug 05 06:32:40 devstack sudo[109691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:32:40 devstack sudo[109691]: pam_unix(sudo:session): session closed for user root Aug 05 06:32:40 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-99eb73ab-5604-4387-b865-c80c25f4e907 tempest-ProjectMemberTests-475949430 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9039939e-aa2e-4384-a202-5ee811ca9fc4" returned: 0 in 0.369s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:32:40 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-99eb73ab-5604-4387-b865-c80c25f4e907 tempest-ProjectMemberTests-475949430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9039939e-aa2e-4384-a202-5ee811ca9fc4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9039939e-aa2e-4384-a202-5ee811ca9fc4.d280088c-f8b7-4447-8232-001534e0667c 1G {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:32:40 devstack sudo[109696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9039939e-aa2e-4384-a202-5ee811ca9fc4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9039939e-aa2e-4384-a202-5ee811ca9fc4.d280088c-f8b7-4447-8232-001534e0667c 1G Aug 05 06:32:40 devstack sudo[109696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:32:40 devstack sudo[109696]: pam_unix(sudo:session): session closed for user root Aug 05 06:32:40 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-99eb73ab-5604-4387-b865-c80c25f4e907 tempest-ProjectMemberTests-475949430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9039939e-aa2e-4384-a202-5ee811ca9fc4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9039939e-aa2e-4384-a202-5ee811ca9fc4.d280088c-f8b7-4447-8232-001534e0667c 1G" returned: 0 in 0.431s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:32:40 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-99eb73ab-5604-4387-b865-c80c25f4e907 tempest-ProjectMemberTests-475949430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9039939e-aa2e-4384-a202-5ee811ca9fc4 -F qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9039939e-aa2e-4384-a202-5ee811ca9fc4.d280088c-f8b7-4447-8232-001534e0667c {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:32:40 devstack sudo[109704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9039939e-aa2e-4384-a202-5ee811ca9fc4 -F qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9039939e-aa2e-4384-a202-5ee811ca9fc4.d280088c-f8b7-4447-8232-001534e0667c Aug 05 06:32:40 devstack sudo[109704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:32:41 devstack sudo[109704]: pam_unix(sudo:session): session closed for user root Aug 05 06:32:41 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-99eb73ab-5604-4387-b865-c80c25f4e907 tempest-ProjectMemberTests-475949430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9039939e-aa2e-4384-a202-5ee811ca9fc4 -F qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9039939e-aa2e-4384-a202-5ee811ca9fc4.d280088c-f8b7-4447-8232-001534e0667c" returned: 0 in 0.287s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:32:41 devstack cinder-volume[88695]: WARNING cinder.volume.drivers.remotefs [None req-99eb73ab-5604-4387-b865-c80c25f4e907 tempest-ProjectMemberTests-475949430 None] /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9039939e-aa2e-4384-a202-5ee811ca9fc4.d280088c-f8b7-4447-8232-001534e0667c is being set with open permissions: ugo+rw Aug 05 06:32:41 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-99eb73ab-5604-4387-b865-c80c25f4e907 tempest-ProjectMemberTests-475949430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9039939e-aa2e-4384-a202-5ee811ca9fc4.d280088c-f8b7-4447-8232-001534e0667c {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:32:41 devstack sudo[109709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9039939e-aa2e-4384-a202-5ee811ca9fc4.d280088c-f8b7-4447-8232-001534e0667c Aug 05 06:32:41 devstack sudo[109709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:32:41 devstack sudo[109709]: pam_unix(sudo:session): session closed for user root Aug 05 06:32:41 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-99eb73ab-5604-4387-b865-c80c25f4e907 tempest-ProjectMemberTests-475949430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9039939e-aa2e-4384-a202-5ee811ca9fc4.d280088c-f8b7-4447-8232-001534e0667c" returned: 0 in 0.252s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:32:41 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-99eb73ab-5604-4387-b865-c80c25f4e907 tempest-ProjectMemberTests-475949430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9039939e-aa2e-4384-a202-5ee811ca9fc4.info {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:32:41 devstack sudo[109712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9039939e-aa2e-4384-a202-5ee811ca9fc4.info Aug 05 06:32:41 devstack sudo[109712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:32:41 devstack sudo[109712]: pam_unix(sudo:session): session closed for user root Aug 05 06:32:41 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-99eb73ab-5604-4387-b865-c80c25f4e907 tempest-ProjectMemberTests-475949430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9039939e-aa2e-4384-a202-5ee811ca9fc4.info" returned: 0 in 0.249s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:32:41 devstack cinder-volume[88695]: WARNING cinder.volume.drivers.remotefs [None req-99eb73ab-5604-4387-b865-c80c25f4e907 tempest-ProjectMemberTests-475949430 None] /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9039939e-aa2e-4384-a202-5ee811ca9fc4.info is being set with open permissions: ugo+rw Aug 05 06:32:41 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-99eb73ab-5604-4387-b865-c80c25f4e907 tempest-ProjectMemberTests-475949430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9039939e-aa2e-4384-a202-5ee811ca9fc4.info {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:32:41 devstack sudo[109715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9039939e-aa2e-4384-a202-5ee811ca9fc4.info Aug 05 06:32:41 devstack sudo[109715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:32:41 devstack sudo[109715]: pam_unix(sudo:session): session closed for user root Aug 05 06:32:41 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-99eb73ab-5604-4387-b865-c80c25f4e907 tempest-ProjectMemberTests-475949430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9039939e-aa2e-4384-a202-5ee811ca9fc4.info" returned: 0 in 0.238s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:32:41 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-99eb73ab-5604-4387-b865-c80c25f4e907 tempest-ProjectMemberTests-475949430 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.914s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:32:41 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-99eb73ab-5604-4387-b865-c80c25f4e907 tempest-ProjectMemberTests-475949430 None] Create snapshot completed successfully Aug 05 06:32:42 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-ca7aa683-be0f-41fd-80c9-7bf5531102f2 tempest-ProjectMemberTests-475949430 None] Acquiring lock "cinder-d280088c-f8b7-4447-8232-001534e0667c-delete_snapshot" by "delete_snapshot" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:32:42 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-ca7aa683-be0f-41fd-80c9-7bf5531102f2 tempest-ProjectMemberTests-475949430 None] Lock "cinder-d280088c-f8b7-4447-8232-001534e0667c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:32:42 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-ca7aa683-be0f-41fd-80c9-7bf5531102f2 tempest-ProjectMemberTests-475949430 None] Acquiring lock "cinder-quobyte-9039939e-aa2e-4384-a202-5ee811ca9fc4" by "delete_snapshot" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:32:42 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-ca7aa683-be0f-41fd-80c9-7bf5531102f2 tempest-ProjectMemberTests-475949430 None] Lock "cinder-quobyte-9039939e-aa2e-4384-a202-5ee811ca9fc4" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:32:42 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-ca7aa683-be0f-41fd-80c9-7bf5531102f2 tempest-ProjectMemberTests-475949430 None] Acquiring lock "cinder-quobyte-d280088c-f8b7-4447-8232-001534e0667c" by "_delete_snapshot" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:32:42 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-ca7aa683-be0f-41fd-80c9-7bf5531102f2 tempest-ProjectMemberTests-475949430 None] Lock "cinder-quobyte-d280088c-f8b7-4447-8232-001534e0667c" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:32:42 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-ca7aa683-be0f-41fd-80c9-7bf5531102f2 tempest-ProjectMemberTests-475949430 None] Deleting offline snapshot d280088c-f8b7-4447-8232-001534e0667c of volume 9039939e-aa2e-4384-a202-5ee811ca9fc4 {{(pid=88695) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 06:32:42 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-ca7aa683-be0f-41fd-80c9-7bf5531102f2 tempest-ProjectMemberTests-475949430 None] snapshot_file for this snap is: volume-9039939e-aa2e-4384-a202-5ee811ca9fc4.d280088c-f8b7-4447-8232-001534e0667c {{(pid=88695) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 06:32:42 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[40fb36b6-48e4-4ea4-96c9-c7a1a55823b3]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:32:42 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-ca7aa683-be0f-41fd-80c9-7bf5531102f2 tempest-ProjectMemberTests-475949430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9039939e-aa2e-4384-a202-5ee811ca9fc4.d280088c-f8b7-4447-8232-001534e0667c {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:32:42 devstack sudo[109718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9039939e-aa2e-4384-a202-5ee811ca9fc4.d280088c-f8b7-4447-8232-001534e0667c Aug 05 06:32:42 devstack sudo[109718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:32:42 devstack sudo[109718]: pam_unix(sudo:session): session closed for user root Aug 05 06:32:42 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-ca7aa683-be0f-41fd-80c9-7bf5531102f2 tempest-ProjectMemberTests-475949430 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9039939e-aa2e-4384-a202-5ee811ca9fc4.d280088c-f8b7-4447-8232-001534e0667c" returned: 0 in 0.360s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:32:42 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-ca7aa683-be0f-41fd-80c9-7bf5531102f2 tempest-ProjectMemberTests-475949430 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9039939e-aa2e-4384-a202-5ee811ca9fc4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88695) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 06:32:42 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[23e73928-e277-4991-9a4f-dbe17db71670]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:32:42 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-ca7aa683-be0f-41fd-80c9-7bf5531102f2 tempest-ProjectMemberTests-475949430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9039939e-aa2e-4384-a202-5ee811ca9fc4 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:32:42 devstack sudo[109723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9039939e-aa2e-4384-a202-5ee811ca9fc4 Aug 05 06:32:42 devstack sudo[109723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:32:42 devstack sudo[109723]: pam_unix(sudo:session): session closed for user root Aug 05 06:32:42 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-ca7aa683-be0f-41fd-80c9-7bf5531102f2 tempest-ProjectMemberTests-475949430 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9039939e-aa2e-4384-a202-5ee811ca9fc4" returned: 0 in 0.343s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:32:42 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-ca7aa683-be0f-41fd-80c9-7bf5531102f2 tempest-ProjectMemberTests-475949430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9039939e-aa2e-4384-a202-5ee811ca9fc4.d280088c-f8b7-4447-8232-001534e0667c {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:32:42 devstack sudo[109728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9039939e-aa2e-4384-a202-5ee811ca9fc4.d280088c-f8b7-4447-8232-001534e0667c Aug 05 06:32:42 devstack sudo[109728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:32:43 devstack sudo[109728]: pam_unix(sudo:session): session closed for user root Aug 05 06:32:43 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-ca7aa683-be0f-41fd-80c9-7bf5531102f2 tempest-ProjectMemberTests-475949430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9039939e-aa2e-4384-a202-5ee811ca9fc4.d280088c-f8b7-4447-8232-001534e0667c" returned: 0 in 0.365s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:32:43 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-ca7aa683-be0f-41fd-80c9-7bf5531102f2 tempest-ProjectMemberTests-475949430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9039939e-aa2e-4384-a202-5ee811ca9fc4.d280088c-f8b7-4447-8232-001534e0667c {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:32:43 devstack sudo[109734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9039939e-aa2e-4384-a202-5ee811ca9fc4.d280088c-f8b7-4447-8232-001534e0667c Aug 05 06:32:43 devstack sudo[109734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:32:43 devstack sudo[109734]: pam_unix(sudo:session): session closed for user root Aug 05 06:32:43 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-ca7aa683-be0f-41fd-80c9-7bf5531102f2 tempest-ProjectMemberTests-475949430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9039939e-aa2e-4384-a202-5ee811ca9fc4.d280088c-f8b7-4447-8232-001534e0667c" returned: 0 in 0.247s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:32:43 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-ca7aa683-be0f-41fd-80c9-7bf5531102f2 tempest-ProjectMemberTests-475949430 None] Lock "cinder-quobyte-d280088c-f8b7-4447-8232-001534e0667c" released by "_delete_snapshot" :: held 1.410s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:32:43 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-ca7aa683-be0f-41fd-80c9-7bf5531102f2 tempest-ProjectMemberTests-475949430 None] Lock "cinder-quobyte-9039939e-aa2e-4384-a202-5ee811ca9fc4" released by "delete_snapshot" :: held 1.433s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:32:43 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-ca7aa683-be0f-41fd-80c9-7bf5531102f2 tempest-ProjectMemberTests-475949430 None] Created reservations ['116b88ae-16bf-4433-bf51-a9275da5af8e', 'db9d883d-00d9-4650-8a3d-32436c093744', 'f122b1ee-e0a3-4525-8489-064e93a64635', 'dc9c4ca7-0931-4e90-a276-2c98b8d9d675'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:32:43 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-ca7aa683-be0f-41fd-80c9-7bf5531102f2 tempest-ProjectMemberTests-475949430 None] Delete snapshot completed successfully. Aug 05 06:32:43 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-ca7aa683-be0f-41fd-80c9-7bf5531102f2 tempest-ProjectMemberTests-475949430 None] Lock "cinder-d280088c-f8b7-4447-8232-001534e0667c-delete_snapshot" released by "delete_snapshot" :: held 1.573s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:32:44 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-e133a885-1312-41c5-81a7-5bd23c78ff33 tempest-ProjectMemberTests-475949430 None] Acquiring lock "cinder-9039939e-aa2e-4384-a202-5ee811ca9fc4-delete_volume" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:32:44 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-e133a885-1312-41c5-81a7-5bd23c78ff33 tempest-ProjectMemberTests-475949430 None] Lock "cinder-9039939e-aa2e-4384-a202-5ee811ca9fc4-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:32:44 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-e133a885-1312-41c5-81a7-5bd23c78ff33 tempest-ProjectMemberTests-475949430 None] Acquiring lock "cinder-quobyte-9039939e-aa2e-4384-a202-5ee811ca9fc4" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:32:44 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-e133a885-1312-41c5-81a7-5bd23c78ff33 tempest-ProjectMemberTests-475949430 None] Lock "cinder-quobyte-9039939e-aa2e-4384-a202-5ee811ca9fc4" acquired by "delete_volume" :: waited 0.018s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:32:44 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[115857e5-a173-41b9-9e32-a689c858b4f5]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:32:44 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-e133a885-1312-41c5-81a7-5bd23c78ff33 tempest-ProjectMemberTests-475949430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9039939e-aa2e-4384-a202-5ee811ca9fc4 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:32:44 devstack sudo[109737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9039939e-aa2e-4384-a202-5ee811ca9fc4 Aug 05 06:32:44 devstack sudo[109737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:32:44 devstack sudo[109737]: pam_unix(sudo:session): session closed for user root Aug 05 06:32:44 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-e133a885-1312-41c5-81a7-5bd23c78ff33 tempest-ProjectMemberTests-475949430 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9039939e-aa2e-4384-a202-5ee811ca9fc4" returned: 0 in 0.357s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:32:44 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-e133a885-1312-41c5-81a7-5bd23c78ff33 tempest-ProjectMemberTests-475949430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9039939e-aa2e-4384-a202-5ee811ca9fc4 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:32:44 devstack sudo[109742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9039939e-aa2e-4384-a202-5ee811ca9fc4 Aug 05 06:32:44 devstack sudo[109742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:32:44 devstack sudo[109742]: pam_unix(sudo:session): session closed for user root Aug 05 06:32:44 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-e133a885-1312-41c5-81a7-5bd23c78ff33 tempest-ProjectMemberTests-475949430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-9039939e-aa2e-4384-a202-5ee811ca9fc4" returned: 0 in 0.248s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:32:44 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-e133a885-1312-41c5-81a7-5bd23c78ff33 tempest-ProjectMemberTests-475949430 None] Lock "cinder-quobyte-9039939e-aa2e-4384-a202-5ee811ca9fc4" released by "delete_volume" :: held 0.665s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:32:44 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-e133a885-1312-41c5-81a7-5bd23c78ff33 tempest-ProjectMemberTests-475949430 None] Created reservations ['8aef657d-e215-4b4a-8785-55e8636d8c91', '3822bf6a-71ea-4ec4-8025-2a68bc81d549', 'd8dba196-ea33-4fc3-ada5-22ae47e659ae', '4a10c3e8-b74b-465e-8561-1a276d457ac3'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:32:45 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-e133a885-1312-41c5-81a7-5bd23c78ff33 tempest-ProjectMemberTests-475949430 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:32:45 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-e133a885-1312-41c5-81a7-5bd23c78ff33 tempest-ProjectMemberTests-475949430 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:32:45 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-e133a885-1312-41c5-81a7-5bd23c78ff33 tempest-ProjectMemberTests-475949430 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:32:45 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-e133a885-1312-41c5-81a7-5bd23c78ff33 tempest-ProjectMemberTests-475949430 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:32:45 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-e133a885-1312-41c5-81a7-5bd23c78ff33 tempest-ProjectMemberTests-475949430 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:32:45 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-e133a885-1312-41c5-81a7-5bd23c78ff33 tempest-ProjectMemberTests-475949430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:32:45 devstack sudo[109745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce Aug 05 06:32:45 devstack sudo[109745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:32:45 devstack sudo[109745]: pam_unix(sudo:session): session closed for user root Aug 05 06:32:45 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-e133a885-1312-41c5-81a7-5bd23c78ff33 tempest-ProjectMemberTests-475949430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce" returned: 0 in 0.247s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:32:45 devstack cinder-volume[88695]: DEBUG cinder.manager [None req-e133a885-1312-41c5-81a7-5bd23c78ff33 tempest-ProjectMemberTests-475949430 None] Notifying Schedulers of capabilities ... {{(pid=88695) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 06:32:45 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-e133a885-1312-41c5-81a7-5bd23c78ff33 tempest-ProjectMemberTests-475949430 None] Deleted volume successfully. Aug 05 06:32:45 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-e133a885-1312-41c5-81a7-5bd23c78ff33 tempest-ProjectMemberTests-475949430 None] Lock "cinder-9039939e-aa2e-4384-a202-5ee811ca9fc4-delete_volume" released by "delete_volume" :: held 1.116s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:32:45 devstack cinder-volume[88695]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f9933a0-7235-4f2b-92f3-45a52455eff2 tempest-ProjectMemberTests-475949430 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88695) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 06:32:45 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-5f9933a0-7235-4f2b-92f3-45a52455eff2 tempest-ProjectMemberTests-475949430 None] Flow 'volume_create_manager' (33c3b0c0-df86-4fef-adbb-83a353a6afc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:32:45 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-5f9933a0-7235-4f2b-92f3-45a52455eff2 tempest-ProjectMemberTests-475949430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d131661a-d30e-4c89-a16b-6b0a14ff9b89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:32:45 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-5f9933a0-7235-4f2b-92f3-45a52455eff2 tempest-ProjectMemberTests-475949430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d131661a-d30e-4c89-a16b-6b0a14ff9b89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:32:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-363691932',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6aa5c9bd-7943-482f-ada1-f7958e13e1d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe85d705f6434b70a55dac31b79c0714',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:32:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:32:46Z,use_quota=True,user_id='a9de9bccd062450c95c9f7f6cf4317f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:32:45 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-5f9933a0-7235-4f2b-92f3-45a52455eff2 tempest-ProjectMemberTests-475949430 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92da8a48-16cd-4854-82ca-9d6620e5ba65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:32:45 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-5f9933a0-7235-4f2b-92f3-45a52455eff2 tempest-ProjectMemberTests-475949430 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92da8a48-16cd-4854-82ca-9d6620e5ba65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:32:45 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-5f9933a0-7235-4f2b-92f3-45a52455eff2 tempest-ProjectMemberTests-475949430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c9f194b-8889-4d66-86a5-ab94d7fc7171) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:32:45 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-5f9933a0-7235-4f2b-92f3-45a52455eff2 tempest-ProjectMemberTests-475949430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c9f194b-8889-4d66-86a5-ab94d7fc7171) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6aa5c9bd-7943-482f-ada1-f7958e13e1d9', 'volume_name': 'volume-6aa5c9bd-7943-482f-ada1-f7958e13e1d9', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:32:45 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-5f9933a0-7235-4f2b-92f3-45a52455eff2 tempest-ProjectMemberTests-475949430 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a70c1dcb-4068-4c49-be6a-0a178badd488) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:32:45 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-5f9933a0-7235-4f2b-92f3-45a52455eff2 tempest-ProjectMemberTests-475949430 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a70c1dcb-4068-4c49-be6a-0a178badd488) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:32:45 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-5f9933a0-7235-4f2b-92f3-45a52455eff2 tempest-ProjectMemberTests-475949430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8195a681-a200-4b7d-9985-ce9ba3d58ff4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:32:45 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-5f9933a0-7235-4f2b-92f3-45a52455eff2 tempest-ProjectMemberTests-475949430 None] Volume 6aa5c9bd-7943-482f-ada1-f7958e13e1d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6aa5c9bd-7943-482f-ada1-f7958e13e1d9', 'volume_size': 1} Aug 05 06:32:45 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-5f9933a0-7235-4f2b-92f3-45a52455eff2 tempest-ProjectMemberTests-475949430 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:32:45 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-5f9933a0-7235-4f2b-92f3-45a52455eff2 tempest-ProjectMemberTests-475949430 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:32:45 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-5f9933a0-7235-4f2b-92f3-45a52455eff2 tempest-ProjectMemberTests-475949430 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:32:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-363691932',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6aa5c9bd-7943-482f-ada1-f7958e13e1d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe85d705f6434b70a55dac31b79c0714',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:32:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:32:46Z,use_quota=True,user_id='a9de9bccd062450c95c9f7f6cf4317f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)}" {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 06:32:45 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-5f9933a0-7235-4f2b-92f3-45a52455eff2 tempest-ProjectMemberTests-475949430 None] Creating volume 6aa5c9bd-7943-482f-ada1-f7958e13e1d9 {{(pid=88695) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 06:32:45 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-5f9933a0-7235-4f2b-92f3-45a52455eff2 tempest-ProjectMemberTests-475949430 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:32:45 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-5f9933a0-7235-4f2b-92f3-45a52455eff2 tempest-ProjectMemberTests-475949430 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:32:45 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-5f9933a0-7235-4f2b-92f3-45a52455eff2 tempest-ProjectMemberTests-475949430 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:32:45 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-5f9933a0-7235-4f2b-92f3-45a52455eff2 tempest-ProjectMemberTests-475949430 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:32:45 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-5f9933a0-7235-4f2b-92f3-45a52455eff2 tempest-ProjectMemberTests-475949430 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:32:45 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-5f9933a0-7235-4f2b-92f3-45a52455eff2 tempest-ProjectMemberTests-475949430 None] Selected osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 as target Quobyte volume. {{(pid=88695) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 06:32:45 devstack cinder-volume[88695]: INFO cinder.volume.drivers.remotefs [None req-5f9933a0-7235-4f2b-92f3-45a52455eff2 tempest-ProjectMemberTests-475949430 None] casted to osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 Aug 05 06:32:45 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-5f9933a0-7235-4f2b-92f3-45a52455eff2 tempest-ProjectMemberTests-475949430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-6aa5c9bd-7943-482f-ada1-f7958e13e1d9 1073741824 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:32:45 devstack sudo[109784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-6aa5c9bd-7943-482f-ada1-f7958e13e1d9 1073741824 Aug 05 06:32:45 devstack sudo[109784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:32:46 devstack sudo[109784]: pam_unix(sudo:session): session closed for user root Aug 05 06:32:46 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-5f9933a0-7235-4f2b-92f3-45a52455eff2 tempest-ProjectMemberTests-475949430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-6aa5c9bd-7943-482f-ada1-f7958e13e1d9 1073741824" returned: 0 in 0.407s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:32:46 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-5f9933a0-7235-4f2b-92f3-45a52455eff2 tempest-ProjectMemberTests-475949430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-6aa5c9bd-7943-482f-ada1-f7958e13e1d9 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:32:46 devstack sudo[109790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-6aa5c9bd-7943-482f-ada1-f7958e13e1d9 Aug 05 06:32:46 devstack sudo[109790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:32:46 devstack sudo[109790]: pam_unix(sudo:session): session closed for user root Aug 05 06:32:46 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-5f9933a0-7235-4f2b-92f3-45a52455eff2 tempest-ProjectMemberTests-475949430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-6aa5c9bd-7943-482f-ada1-f7958e13e1d9" returned: 0 in 0.275s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:32:46 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-5f9933a0-7235-4f2b-92f3-45a52455eff2 tempest-ProjectMemberTests-475949430 None] <== create_volume: return (728ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'} {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 06:32:46 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-5f9933a0-7235-4f2b-92f3-45a52455eff2 tempest-ProjectMemberTests-475949430 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.731s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:32:46 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-5f9933a0-7235-4f2b-92f3-45a52455eff2 tempest-ProjectMemberTests-475949430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8195a681-a200-4b7d-9985-ce9ba3d58ff4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6aa5c9bd-7943-482f-ada1-f7958e13e1d9', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:32:46 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-5f9933a0-7235-4f2b-92f3-45a52455eff2 tempest-ProjectMemberTests-475949430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb91032c-4dba-4035-8996-9e71126f9682) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:32:46 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-5f9933a0-7235-4f2b-92f3-45a52455eff2 tempest-ProjectMemberTests-475949430 None] Volume volume-6aa5c9bd-7943-482f-ada1-f7958e13e1d9 (6aa5c9bd-7943-482f-ada1-f7958e13e1d9): created successfully Aug 05 06:32:46 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-5f9933a0-7235-4f2b-92f3-45a52455eff2 tempest-ProjectMemberTests-475949430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb91032c-4dba-4035-8996-9e71126f9682) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:32:46 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-5f9933a0-7235-4f2b-92f3-45a52455eff2 tempest-ProjectMemberTests-475949430 None] Flow 'volume_create_manager' (33c3b0c0-df86-4fef-adbb-83a353a6afc6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:32:46 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-5f9933a0-7235-4f2b-92f3-45a52455eff2 tempest-ProjectMemberTests-475949430 None] Created volume successfully. Aug 05 06:32:47 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-aa30ab48-e5ef-4339-b646-31893341373d tempest-ProjectMemberTests-475949430 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:32:47 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-aa30ab48-e5ef-4339-b646-31893341373d tempest-ProjectMemberTests-475949430 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:32:47 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-aa30ab48-e5ef-4339-b646-31893341373d tempest-ProjectMemberTests-475949430 None] Creating offline snapshot 64c51fe0-9323-4854-aa98-0991cd221d6a of volume 6aa5c9bd-7943-482f-ada1-f7958e13e1d9 {{(pid=88695) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 06:32:47 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[605089f4-6107-4e6a-b7b0-cd81df72fb8f]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:32:47 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-aa30ab48-e5ef-4339-b646-31893341373d tempest-ProjectMemberTests-475949430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-6aa5c9bd-7943-482f-ada1-f7958e13e1d9 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:32:47 devstack sudo[109793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-6aa5c9bd-7943-482f-ada1-f7958e13e1d9 Aug 05 06:32:47 devstack sudo[109793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:32:47 devstack sudo[109793]: pam_unix(sudo:session): session closed for user root Aug 05 06:32:47 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-aa30ab48-e5ef-4339-b646-31893341373d tempest-ProjectMemberTests-475949430 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-6aa5c9bd-7943-482f-ada1-f7958e13e1d9" returned: 0 in 0.345s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:32:47 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-aa30ab48-e5ef-4339-b646-31893341373d tempest-ProjectMemberTests-475949430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-6aa5c9bd-7943-482f-ada1-f7958e13e1d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-6aa5c9bd-7943-482f-ada1-f7958e13e1d9.64c51fe0-9323-4854-aa98-0991cd221d6a 1G {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:32:47 devstack sudo[109800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-6aa5c9bd-7943-482f-ada1-f7958e13e1d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-6aa5c9bd-7943-482f-ada1-f7958e13e1d9.64c51fe0-9323-4854-aa98-0991cd221d6a 1G Aug 05 06:32:47 devstack sudo[109800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:32:47 devstack sudo[109800]: pam_unix(sudo:session): session closed for user root Aug 05 06:32:47 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-aa30ab48-e5ef-4339-b646-31893341373d tempest-ProjectMemberTests-475949430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-6aa5c9bd-7943-482f-ada1-f7958e13e1d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-6aa5c9bd-7943-482f-ada1-f7958e13e1d9.64c51fe0-9323-4854-aa98-0991cd221d6a 1G" returned: 0 in 0.404s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:32:47 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-aa30ab48-e5ef-4339-b646-31893341373d tempest-ProjectMemberTests-475949430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6aa5c9bd-7943-482f-ada1-f7958e13e1d9 -F qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-6aa5c9bd-7943-482f-ada1-f7958e13e1d9.64c51fe0-9323-4854-aa98-0991cd221d6a {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:32:47 devstack sudo[109805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6aa5c9bd-7943-482f-ada1-f7958e13e1d9 -F qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-6aa5c9bd-7943-482f-ada1-f7958e13e1d9.64c51fe0-9323-4854-aa98-0991cd221d6a Aug 05 06:32:47 devstack sudo[109805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:32:48 devstack sudo[109805]: pam_unix(sudo:session): session closed for user root Aug 05 06:32:48 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-aa30ab48-e5ef-4339-b646-31893341373d tempest-ProjectMemberTests-475949430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6aa5c9bd-7943-482f-ada1-f7958e13e1d9 -F qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-6aa5c9bd-7943-482f-ada1-f7958e13e1d9.64c51fe0-9323-4854-aa98-0991cd221d6a" returned: 0 in 0.285s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:32:48 devstack cinder-volume[88695]: WARNING cinder.volume.drivers.remotefs [None req-aa30ab48-e5ef-4339-b646-31893341373d tempest-ProjectMemberTests-475949430 None] /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-6aa5c9bd-7943-482f-ada1-f7958e13e1d9.64c51fe0-9323-4854-aa98-0991cd221d6a is being set with open permissions: ugo+rw Aug 05 06:32:48 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-aa30ab48-e5ef-4339-b646-31893341373d tempest-ProjectMemberTests-475949430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-6aa5c9bd-7943-482f-ada1-f7958e13e1d9.64c51fe0-9323-4854-aa98-0991cd221d6a {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:32:48 devstack sudo[109810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-6aa5c9bd-7943-482f-ada1-f7958e13e1d9.64c51fe0-9323-4854-aa98-0991cd221d6a Aug 05 06:32:48 devstack sudo[109810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:32:48 devstack sudo[109810]: pam_unix(sudo:session): session closed for user root Aug 05 06:32:48 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-aa30ab48-e5ef-4339-b646-31893341373d tempest-ProjectMemberTests-475949430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-6aa5c9bd-7943-482f-ada1-f7958e13e1d9.64c51fe0-9323-4854-aa98-0991cd221d6a" returned: 0 in 0.238s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:32:48 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-aa30ab48-e5ef-4339-b646-31893341373d tempest-ProjectMemberTests-475949430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-6aa5c9bd-7943-482f-ada1-f7958e13e1d9.info {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:32:48 devstack sudo[109813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-6aa5c9bd-7943-482f-ada1-f7958e13e1d9.info Aug 05 06:32:48 devstack sudo[109813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:32:48 devstack sudo[109813]: pam_unix(sudo:session): session closed for user root Aug 05 06:32:48 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-aa30ab48-e5ef-4339-b646-31893341373d tempest-ProjectMemberTests-475949430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-6aa5c9bd-7943-482f-ada1-f7958e13e1d9.info" returned: 0 in 0.238s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:32:48 devstack cinder-volume[88695]: WARNING cinder.volume.drivers.remotefs [None req-aa30ab48-e5ef-4339-b646-31893341373d tempest-ProjectMemberTests-475949430 None] /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-6aa5c9bd-7943-482f-ada1-f7958e13e1d9.info is being set with open permissions: ugo+rw Aug 05 06:32:48 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-aa30ab48-e5ef-4339-b646-31893341373d tempest-ProjectMemberTests-475949430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-6aa5c9bd-7943-482f-ada1-f7958e13e1d9.info {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:32:48 devstack sudo[109817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-6aa5c9bd-7943-482f-ada1-f7958e13e1d9.info Aug 05 06:32:48 devstack sudo[109817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:32:48 devstack sudo[109817]: pam_unix(sudo:session): session closed for user root Aug 05 06:32:48 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-aa30ab48-e5ef-4339-b646-31893341373d tempest-ProjectMemberTests-475949430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-6aa5c9bd-7943-482f-ada1-f7958e13e1d9.info" returned: 0 in 0.232s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:32:48 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-aa30ab48-e5ef-4339-b646-31893341373d tempest-ProjectMemberTests-475949430 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.818s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:32:48 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-aa30ab48-e5ef-4339-b646-31893341373d tempest-ProjectMemberTests-475949430 None] Create snapshot completed successfully Aug 05 06:32:49 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-962a057c-4e5a-4a6a-9a95-3150651f1128 tempest-ProjectMemberTests-475949430 None] Acquiring lock "cinder-64c51fe0-9323-4854-aa98-0991cd221d6a-delete_snapshot" by "delete_snapshot" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:32:49 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-962a057c-4e5a-4a6a-9a95-3150651f1128 tempest-ProjectMemberTests-475949430 None] Lock "cinder-64c51fe0-9323-4854-aa98-0991cd221d6a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:32:49 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-962a057c-4e5a-4a6a-9a95-3150651f1128 tempest-ProjectMemberTests-475949430 None] Acquiring lock "cinder-quobyte-6aa5c9bd-7943-482f-ada1-f7958e13e1d9" by "delete_snapshot" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:32:49 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-962a057c-4e5a-4a6a-9a95-3150651f1128 tempest-ProjectMemberTests-475949430 None] Lock "cinder-quobyte-6aa5c9bd-7943-482f-ada1-f7958e13e1d9" acquired by "delete_snapshot" :: waited 0.016s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:32:49 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-962a057c-4e5a-4a6a-9a95-3150651f1128 tempest-ProjectMemberTests-475949430 None] Acquiring lock "cinder-quobyte-64c51fe0-9323-4854-aa98-0991cd221d6a" by "_delete_snapshot" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:32:49 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-962a057c-4e5a-4a6a-9a95-3150651f1128 tempest-ProjectMemberTests-475949430 None] Lock "cinder-quobyte-64c51fe0-9323-4854-aa98-0991cd221d6a" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:32:49 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-962a057c-4e5a-4a6a-9a95-3150651f1128 tempest-ProjectMemberTests-475949430 None] Deleting offline snapshot 64c51fe0-9323-4854-aa98-0991cd221d6a of volume 6aa5c9bd-7943-482f-ada1-f7958e13e1d9 {{(pid=88695) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 06:32:49 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-962a057c-4e5a-4a6a-9a95-3150651f1128 tempest-ProjectMemberTests-475949430 None] snapshot_file for this snap is: volume-6aa5c9bd-7943-482f-ada1-f7958e13e1d9.64c51fe0-9323-4854-aa98-0991cd221d6a {{(pid=88695) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 06:32:49 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fa29903-8b08-4590-8313-e2ea366f41fa]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:32:49 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-962a057c-4e5a-4a6a-9a95-3150651f1128 tempest-ProjectMemberTests-475949430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-6aa5c9bd-7943-482f-ada1-f7958e13e1d9.64c51fe0-9323-4854-aa98-0991cd221d6a {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:32:49 devstack sudo[109820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-6aa5c9bd-7943-482f-ada1-f7958e13e1d9.64c51fe0-9323-4854-aa98-0991cd221d6a Aug 05 06:32:49 devstack sudo[109820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:32:49 devstack sudo[109820]: pam_unix(sudo:session): session closed for user root Aug 05 06:32:49 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-962a057c-4e5a-4a6a-9a95-3150651f1128 tempest-ProjectMemberTests-475949430 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-6aa5c9bd-7943-482f-ada1-f7958e13e1d9.64c51fe0-9323-4854-aa98-0991cd221d6a" returned: 0 in 0.345s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:32:49 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-962a057c-4e5a-4a6a-9a95-3150651f1128 tempest-ProjectMemberTests-475949430 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6aa5c9bd-7943-482f-ada1-f7958e13e1d9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88695) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 06:32:49 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[99f56c89-e6f3-43f3-a27d-ef608216c8c1]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:32:49 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-962a057c-4e5a-4a6a-9a95-3150651f1128 tempest-ProjectMemberTests-475949430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-6aa5c9bd-7943-482f-ada1-f7958e13e1d9 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:32:49 devstack sudo[109825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-6aa5c9bd-7943-482f-ada1-f7958e13e1d9 Aug 05 06:32:49 devstack sudo[109825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:32:50 devstack sudo[109825]: pam_unix(sudo:session): session closed for user root Aug 05 06:32:50 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-962a057c-4e5a-4a6a-9a95-3150651f1128 tempest-ProjectMemberTests-475949430 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-6aa5c9bd-7943-482f-ada1-f7958e13e1d9" returned: 0 in 0.334s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:32:50 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-962a057c-4e5a-4a6a-9a95-3150651f1128 tempest-ProjectMemberTests-475949430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-6aa5c9bd-7943-482f-ada1-f7958e13e1d9.64c51fe0-9323-4854-aa98-0991cd221d6a {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:32:50 devstack sudo[109830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-6aa5c9bd-7943-482f-ada1-f7958e13e1d9.64c51fe0-9323-4854-aa98-0991cd221d6a Aug 05 06:32:50 devstack sudo[109830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:32:50 devstack sudo[109830]: pam_unix(sudo:session): session closed for user root Aug 05 06:32:50 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-962a057c-4e5a-4a6a-9a95-3150651f1128 tempest-ProjectMemberTests-475949430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-6aa5c9bd-7943-482f-ada1-f7958e13e1d9.64c51fe0-9323-4854-aa98-0991cd221d6a" returned: 0 in 0.335s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:32:50 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-962a057c-4e5a-4a6a-9a95-3150651f1128 tempest-ProjectMemberTests-475949430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-6aa5c9bd-7943-482f-ada1-f7958e13e1d9.64c51fe0-9323-4854-aa98-0991cd221d6a {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:32:50 devstack sudo[109835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-6aa5c9bd-7943-482f-ada1-f7958e13e1d9.64c51fe0-9323-4854-aa98-0991cd221d6a Aug 05 06:32:50 devstack sudo[109835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:32:50 devstack sudo[109835]: pam_unix(sudo:session): session closed for user root Aug 05 06:32:50 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-962a057c-4e5a-4a6a-9a95-3150651f1128 tempest-ProjectMemberTests-475949430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-6aa5c9bd-7943-482f-ada1-f7958e13e1d9.64c51fe0-9323-4854-aa98-0991cd221d6a" returned: 0 in 0.242s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:32:50 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-962a057c-4e5a-4a6a-9a95-3150651f1128 tempest-ProjectMemberTests-475949430 None] Lock "cinder-quobyte-64c51fe0-9323-4854-aa98-0991cd221d6a" released by "_delete_snapshot" :: held 1.348s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:32:50 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-962a057c-4e5a-4a6a-9a95-3150651f1128 tempest-ProjectMemberTests-475949430 None] Lock "cinder-quobyte-6aa5c9bd-7943-482f-ada1-f7958e13e1d9" released by "delete_snapshot" :: held 1.374s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:32:50 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-962a057c-4e5a-4a6a-9a95-3150651f1128 tempest-ProjectMemberTests-475949430 None] Created reservations ['2716f466-c6a3-4174-bf96-f7f06718a802', 'ee2ea678-857b-40b7-88c5-d175ec0cbde1', '63162fc4-fa5f-4c60-962d-fe2356ad07ca', 'aa3979bd-26be-4a57-b445-09f106682655'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:32:50 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-962a057c-4e5a-4a6a-9a95-3150651f1128 tempest-ProjectMemberTests-475949430 None] Delete snapshot completed successfully. Aug 05 06:32:50 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-962a057c-4e5a-4a6a-9a95-3150651f1128 tempest-ProjectMemberTests-475949430 None] Lock "cinder-64c51fe0-9323-4854-aa98-0991cd221d6a-delete_snapshot" released by "delete_snapshot" :: held 1.515s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:32:51 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-25573128-8742-4977-9e4c-d67a65ecb4fb tempest-ProjectMemberTests-475949430 None] Acquiring lock "cinder-6aa5c9bd-7943-482f-ada1-f7958e13e1d9-delete_volume" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:32:51 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-25573128-8742-4977-9e4c-d67a65ecb4fb tempest-ProjectMemberTests-475949430 None] Lock "cinder-6aa5c9bd-7943-482f-ada1-f7958e13e1d9-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:32:51 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-25573128-8742-4977-9e4c-d67a65ecb4fb tempest-ProjectMemberTests-475949430 None] Acquiring lock "cinder-quobyte-6aa5c9bd-7943-482f-ada1-f7958e13e1d9" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:32:51 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-25573128-8742-4977-9e4c-d67a65ecb4fb tempest-ProjectMemberTests-475949430 None] Lock "cinder-quobyte-6aa5c9bd-7943-482f-ada1-f7958e13e1d9" acquired by "delete_volume" :: waited 0.016s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:32:51 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[db1ebce7-21d3-4a44-81c5-4d0d7fc942e4]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:32:51 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-25573128-8742-4977-9e4c-d67a65ecb4fb tempest-ProjectMemberTests-475949430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-6aa5c9bd-7943-482f-ada1-f7958e13e1d9 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:32:51 devstack sudo[109838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-6aa5c9bd-7943-482f-ada1-f7958e13e1d9 Aug 05 06:32:51 devstack sudo[109838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:32:51 devstack sudo[109838]: pam_unix(sudo:session): session closed for user root Aug 05 06:32:51 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-25573128-8742-4977-9e4c-d67a65ecb4fb tempest-ProjectMemberTests-475949430 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-6aa5c9bd-7943-482f-ada1-f7958e13e1d9" returned: 0 in 0.372s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:32:51 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-25573128-8742-4977-9e4c-d67a65ecb4fb tempest-ProjectMemberTests-475949430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-6aa5c9bd-7943-482f-ada1-f7958e13e1d9 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:32:51 devstack sudo[109849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-6aa5c9bd-7943-482f-ada1-f7958e13e1d9 Aug 05 06:32:51 devstack sudo[109849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:32:52 devstack sudo[109849]: pam_unix(sudo:session): session closed for user root Aug 05 06:32:52 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-25573128-8742-4977-9e4c-d67a65ecb4fb tempest-ProjectMemberTests-475949430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-6aa5c9bd-7943-482f-ada1-f7958e13e1d9" returned: 0 in 0.255s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:32:52 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-25573128-8742-4977-9e4c-d67a65ecb4fb tempest-ProjectMemberTests-475949430 None] Lock "cinder-quobyte-6aa5c9bd-7943-482f-ada1-f7958e13e1d9" released by "delete_volume" :: held 0.683s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:32:52 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-25573128-8742-4977-9e4c-d67a65ecb4fb tempest-ProjectMemberTests-475949430 None] Created reservations ['8dbfbc18-017a-4016-9d7c-fc46bda55185', '77e3f87f-d5fb-46f5-8594-619ee6afd6bd', '85ba1c94-b85e-4c75-a68a-b78b6d4d4988', 'c8312a17-b4c6-4719-b9ba-8f9771931bc0'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:32:52 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-25573128-8742-4977-9e4c-d67a65ecb4fb tempest-ProjectMemberTests-475949430 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:32:52 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-25573128-8742-4977-9e4c-d67a65ecb4fb tempest-ProjectMemberTests-475949430 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:32:52 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-25573128-8742-4977-9e4c-d67a65ecb4fb tempest-ProjectMemberTests-475949430 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:32:52 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-25573128-8742-4977-9e4c-d67a65ecb4fb tempest-ProjectMemberTests-475949430 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:32:52 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-25573128-8742-4977-9e4c-d67a65ecb4fb tempest-ProjectMemberTests-475949430 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:32:52 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-25573128-8742-4977-9e4c-d67a65ecb4fb tempest-ProjectMemberTests-475949430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:32:52 devstack sudo[109852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce Aug 05 06:32:52 devstack sudo[109852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:32:52 devstack sudo[109852]: pam_unix(sudo:session): session closed for user root Aug 05 06:32:52 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-25573128-8742-4977-9e4c-d67a65ecb4fb tempest-ProjectMemberTests-475949430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce" returned: 0 in 0.276s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:32:52 devstack cinder-volume[88695]: DEBUG cinder.manager [None req-25573128-8742-4977-9e4c-d67a65ecb4fb tempest-ProjectMemberTests-475949430 None] Notifying Schedulers of capabilities ... {{(pid=88695) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 06:32:52 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-25573128-8742-4977-9e4c-d67a65ecb4fb tempest-ProjectMemberTests-475949430 None] Deleted volume successfully. Aug 05 06:32:52 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-25573128-8742-4977-9e4c-d67a65ecb4fb tempest-ProjectMemberTests-475949430 None] Lock "cinder-6aa5c9bd-7943-482f-ada1-f7958e13e1d9-delete_volume" released by "delete_volume" :: held 1.159s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:32:56 devstack cinder-volume[88695]: DEBUG cinder.volume.flows.manager.create_volume [None req-67c8dcb6-28b9-4123-b640-3bf69bb34fb4 tempest-ProjectReaderTests-788405257 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88695) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 06:32:56 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-67c8dcb6-28b9-4123-b640-3bf69bb34fb4 tempest-ProjectReaderTests-788405257 None] Flow 'volume_create_manager' (2e6f4359-9787-4b1d-8d17-b41f23e1c97b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:32:56 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-67c8dcb6-28b9-4123-b640-3bf69bb34fb4 tempest-ProjectReaderTests-788405257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4177a0c-12c3-4b8c-bf6a-303de849e37c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:32:56 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-67c8dcb6-28b9-4123-b640-3bf69bb34fb4 tempest-ProjectReaderTests-788405257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4177a0c-12c3-4b8c-bf6a-303de849e37c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:32:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-531185662',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3654056f-65d8-4558-8de3-2853972c19e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95ec897d23f64c4aa28c9f99de062aee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:32:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:32:57Z,use_quota=True,user_id='97d0bbdbc29b47d08c8978b94311d171',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:32:56 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-67c8dcb6-28b9-4123-b640-3bf69bb34fb4 tempest-ProjectReaderTests-788405257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47dc35a7-e5ef-48b2-83c7-0ea34e33398e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:32:56 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-67c8dcb6-28b9-4123-b640-3bf69bb34fb4 tempest-ProjectReaderTests-788405257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47dc35a7-e5ef-48b2-83c7-0ea34e33398e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:32:56 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-67c8dcb6-28b9-4123-b640-3bf69bb34fb4 tempest-ProjectReaderTests-788405257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d5e4f17-9a3f-4f47-88a7-bd5b0dbc950e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:32:56 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-67c8dcb6-28b9-4123-b640-3bf69bb34fb4 tempest-ProjectReaderTests-788405257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d5e4f17-9a3f-4f47-88a7-bd5b0dbc950e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3654056f-65d8-4558-8de3-2853972c19e4', 'volume_name': 'volume-3654056f-65d8-4558-8de3-2853972c19e4', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:32:56 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-67c8dcb6-28b9-4123-b640-3bf69bb34fb4 tempest-ProjectReaderTests-788405257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5ea5600-1c57-4d20-888c-b3f76c650abf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:32:56 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-67c8dcb6-28b9-4123-b640-3bf69bb34fb4 tempest-ProjectReaderTests-788405257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5ea5600-1c57-4d20-888c-b3f76c650abf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:32:56 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-67c8dcb6-28b9-4123-b640-3bf69bb34fb4 tempest-ProjectReaderTests-788405257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58765bc9-8227-4ff9-9f27-0009658fa6f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:32:56 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-67c8dcb6-28b9-4123-b640-3bf69bb34fb4 tempest-ProjectReaderTests-788405257 None] Volume 3654056f-65d8-4558-8de3-2853972c19e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3654056f-65d8-4558-8de3-2853972c19e4', 'volume_size': 1} Aug 05 06:32:56 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-67c8dcb6-28b9-4123-b640-3bf69bb34fb4 tempest-ProjectReaderTests-788405257 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:32:56 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-67c8dcb6-28b9-4123-b640-3bf69bb34fb4 tempest-ProjectReaderTests-788405257 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:32:56 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-67c8dcb6-28b9-4123-b640-3bf69bb34fb4 tempest-ProjectReaderTests-788405257 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:32:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-531185662',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3654056f-65d8-4558-8de3-2853972c19e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95ec897d23f64c4aa28c9f99de062aee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:32:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:32:57Z,use_quota=True,user_id='97d0bbdbc29b47d08c8978b94311d171',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)}" {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 06:32:56 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-67c8dcb6-28b9-4123-b640-3bf69bb34fb4 tempest-ProjectReaderTests-788405257 None] Creating volume 3654056f-65d8-4558-8de3-2853972c19e4 {{(pid=88695) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 06:32:56 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-67c8dcb6-28b9-4123-b640-3bf69bb34fb4 tempest-ProjectReaderTests-788405257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:32:56 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-67c8dcb6-28b9-4123-b640-3bf69bb34fb4 tempest-ProjectReaderTests-788405257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:32:56 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-67c8dcb6-28b9-4123-b640-3bf69bb34fb4 tempest-ProjectReaderTests-788405257 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:32:56 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-67c8dcb6-28b9-4123-b640-3bf69bb34fb4 tempest-ProjectReaderTests-788405257 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:32:56 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-67c8dcb6-28b9-4123-b640-3bf69bb34fb4 tempest-ProjectReaderTests-788405257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:32:56 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-67c8dcb6-28b9-4123-b640-3bf69bb34fb4 tempest-ProjectReaderTests-788405257 None] Selected osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 as target Quobyte volume. {{(pid=88695) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 06:32:56 devstack cinder-volume[88695]: INFO cinder.volume.drivers.remotefs [None req-67c8dcb6-28b9-4123-b640-3bf69bb34fb4 tempest-ProjectReaderTests-788405257 None] casted to osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 Aug 05 06:32:56 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-67c8dcb6-28b9-4123-b640-3bf69bb34fb4 tempest-ProjectReaderTests-788405257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-3654056f-65d8-4558-8de3-2853972c19e4 1073741824 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:32:56 devstack sudo[109855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-3654056f-65d8-4558-8de3-2853972c19e4 1073741824 Aug 05 06:32:56 devstack sudo[109855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:32:57 devstack sudo[109855]: pam_unix(sudo:session): session closed for user root Aug 05 06:32:57 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-67c8dcb6-28b9-4123-b640-3bf69bb34fb4 tempest-ProjectReaderTests-788405257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-3654056f-65d8-4558-8de3-2853972c19e4 1073741824" returned: 0 in 0.438s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:32:57 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-67c8dcb6-28b9-4123-b640-3bf69bb34fb4 tempest-ProjectReaderTests-788405257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-3654056f-65d8-4558-8de3-2853972c19e4 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:32:57 devstack sudo[109860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-3654056f-65d8-4558-8de3-2853972c19e4 Aug 05 06:32:57 devstack sudo[109860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:32:57 devstack sudo[109860]: pam_unix(sudo:session): session closed for user root Aug 05 06:32:57 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-67c8dcb6-28b9-4123-b640-3bf69bb34fb4 tempest-ProjectReaderTests-788405257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-3654056f-65d8-4558-8de3-2853972c19e4" returned: 0 in 0.235s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:32:57 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-67c8dcb6-28b9-4123-b640-3bf69bb34fb4 tempest-ProjectReaderTests-788405257 None] <== create_volume: return (717ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'} {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 06:32:57 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-67c8dcb6-28b9-4123-b640-3bf69bb34fb4 tempest-ProjectReaderTests-788405257 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.721s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:32:57 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-67c8dcb6-28b9-4123-b640-3bf69bb34fb4 tempest-ProjectReaderTests-788405257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58765bc9-8227-4ff9-9f27-0009658fa6f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3654056f-65d8-4558-8de3-2853972c19e4', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:32:57 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-67c8dcb6-28b9-4123-b640-3bf69bb34fb4 tempest-ProjectReaderTests-788405257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (921a2d78-5a1c-458f-a60e-fb92263c7642) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:32:57 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-67c8dcb6-28b9-4123-b640-3bf69bb34fb4 tempest-ProjectReaderTests-788405257 None] Volume volume-3654056f-65d8-4558-8de3-2853972c19e4 (3654056f-65d8-4558-8de3-2853972c19e4): created successfully Aug 05 06:32:57 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-67c8dcb6-28b9-4123-b640-3bf69bb34fb4 tempest-ProjectReaderTests-788405257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (921a2d78-5a1c-458f-a60e-fb92263c7642) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:32:57 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-67c8dcb6-28b9-4123-b640-3bf69bb34fb4 tempest-ProjectReaderTests-788405257 None] Flow 'volume_create_manager' (2e6f4359-9787-4b1d-8d17-b41f23e1c97b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:32:57 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-67c8dcb6-28b9-4123-b640-3bf69bb34fb4 tempest-ProjectReaderTests-788405257 None] Created volume successfully. Aug 05 06:32:57 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-da4846ae-4845-4642-b2d8-3e1caf5bc918 tempest-ProjectReaderTests-788405257 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:32:57 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-da4846ae-4845-4642-b2d8-3e1caf5bc918 tempest-ProjectReaderTests-788405257 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:32:57 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-da4846ae-4845-4642-b2d8-3e1caf5bc918 tempest-ProjectReaderTests-788405257 None] Creating offline snapshot efc624a8-f021-472e-a105-a5bfb3aefa14 of volume 3654056f-65d8-4558-8de3-2853972c19e4 {{(pid=88695) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 06:32:57 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[48ad1937-abd9-40c4-8148-0fc606f627ba]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:32:57 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-da4846ae-4845-4642-b2d8-3e1caf5bc918 tempest-ProjectReaderTests-788405257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-3654056f-65d8-4558-8de3-2853972c19e4 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:32:57 devstack sudo[109863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-3654056f-65d8-4558-8de3-2853972c19e4 Aug 05 06:32:57 devstack sudo[109863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:32:58 devstack sudo[109863]: pam_unix(sudo:session): session closed for user root Aug 05 06:32:58 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-da4846ae-4845-4642-b2d8-3e1caf5bc918 tempest-ProjectReaderTests-788405257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-3654056f-65d8-4558-8de3-2853972c19e4" returned: 0 in 0.352s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:32:58 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-da4846ae-4845-4642-b2d8-3e1caf5bc918 tempest-ProjectReaderTests-788405257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-3654056f-65d8-4558-8de3-2853972c19e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-3654056f-65d8-4558-8de3-2853972c19e4.efc624a8-f021-472e-a105-a5bfb3aefa14 1G {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:32:58 devstack sudo[109868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-3654056f-65d8-4558-8de3-2853972c19e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-3654056f-65d8-4558-8de3-2853972c19e4.efc624a8-f021-472e-a105-a5bfb3aefa14 1G Aug 05 06:32:58 devstack sudo[109868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:32:58 devstack sudo[109868]: pam_unix(sudo:session): session closed for user root Aug 05 06:32:58 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-da4846ae-4845-4642-b2d8-3e1caf5bc918 tempest-ProjectReaderTests-788405257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-3654056f-65d8-4558-8de3-2853972c19e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-3654056f-65d8-4558-8de3-2853972c19e4.efc624a8-f021-472e-a105-a5bfb3aefa14 1G" returned: 0 in 0.384s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:32:58 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-da4846ae-4845-4642-b2d8-3e1caf5bc918 tempest-ProjectReaderTests-788405257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3654056f-65d8-4558-8de3-2853972c19e4 -F qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-3654056f-65d8-4558-8de3-2853972c19e4.efc624a8-f021-472e-a105-a5bfb3aefa14 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:32:58 devstack sudo[109874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3654056f-65d8-4558-8de3-2853972c19e4 -F qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-3654056f-65d8-4558-8de3-2853972c19e4.efc624a8-f021-472e-a105-a5bfb3aefa14 Aug 05 06:32:58 devstack sudo[109874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:32:58 devstack sudo[109874]: pam_unix(sudo:session): session closed for user root Aug 05 06:32:58 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-da4846ae-4845-4642-b2d8-3e1caf5bc918 tempest-ProjectReaderTests-788405257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3654056f-65d8-4558-8de3-2853972c19e4 -F qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-3654056f-65d8-4558-8de3-2853972c19e4.efc624a8-f021-472e-a105-a5bfb3aefa14" returned: 0 in 0.287s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:32:58 devstack cinder-volume[88695]: WARNING cinder.volume.drivers.remotefs [None req-da4846ae-4845-4642-b2d8-3e1caf5bc918 tempest-ProjectReaderTests-788405257 None] /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-3654056f-65d8-4558-8de3-2853972c19e4.efc624a8-f021-472e-a105-a5bfb3aefa14 is being set with open permissions: ugo+rw Aug 05 06:32:58 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-da4846ae-4845-4642-b2d8-3e1caf5bc918 tempest-ProjectReaderTests-788405257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-3654056f-65d8-4558-8de3-2853972c19e4.efc624a8-f021-472e-a105-a5bfb3aefa14 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:32:58 devstack sudo[109879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-3654056f-65d8-4558-8de3-2853972c19e4.efc624a8-f021-472e-a105-a5bfb3aefa14 Aug 05 06:32:58 devstack sudo[109879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:32:59 devstack sudo[109879]: pam_unix(sudo:session): session closed for user root Aug 05 06:32:59 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-da4846ae-4845-4642-b2d8-3e1caf5bc918 tempest-ProjectReaderTests-788405257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-3654056f-65d8-4558-8de3-2853972c19e4.efc624a8-f021-472e-a105-a5bfb3aefa14" returned: 0 in 0.236s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:32:59 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-da4846ae-4845-4642-b2d8-3e1caf5bc918 tempest-ProjectReaderTests-788405257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-3654056f-65d8-4558-8de3-2853972c19e4.info {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:32:59 devstack sudo[109882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-3654056f-65d8-4558-8de3-2853972c19e4.info Aug 05 06:32:59 devstack sudo[109882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:32:59 devstack sudo[109882]: pam_unix(sudo:session): session closed for user root Aug 05 06:32:59 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-da4846ae-4845-4642-b2d8-3e1caf5bc918 tempest-ProjectReaderTests-788405257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-3654056f-65d8-4558-8de3-2853972c19e4.info" returned: 0 in 0.266s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:32:59 devstack cinder-volume[88695]: WARNING cinder.volume.drivers.remotefs [None req-da4846ae-4845-4642-b2d8-3e1caf5bc918 tempest-ProjectReaderTests-788405257 None] /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-3654056f-65d8-4558-8de3-2853972c19e4.info is being set with open permissions: ugo+rw Aug 05 06:32:59 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-da4846ae-4845-4642-b2d8-3e1caf5bc918 tempest-ProjectReaderTests-788405257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-3654056f-65d8-4558-8de3-2853972c19e4.info {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:32:59 devstack sudo[109885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-3654056f-65d8-4558-8de3-2853972c19e4.info Aug 05 06:32:59 devstack sudo[109885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:32:59 devstack sudo[109885]: pam_unix(sudo:session): session closed for user root Aug 05 06:32:59 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-da4846ae-4845-4642-b2d8-3e1caf5bc918 tempest-ProjectReaderTests-788405257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-3654056f-65d8-4558-8de3-2853972c19e4.info" returned: 0 in 0.249s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:32:59 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-da4846ae-4845-4642-b2d8-3e1caf5bc918 tempest-ProjectReaderTests-788405257 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.888s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:32:59 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-da4846ae-4845-4642-b2d8-3e1caf5bc918 tempest-ProjectReaderTests-788405257 None] Create snapshot completed successfully Aug 05 06:33:00 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-3d593a5c-3d1b-457d-bded-7dc1ca301eee tempest-ProjectReaderTests-788405257 None] Acquiring lock "cinder-efc624a8-f021-472e-a105-a5bfb3aefa14-delete_snapshot" by "delete_snapshot" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:33:00 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-3d593a5c-3d1b-457d-bded-7dc1ca301eee tempest-ProjectReaderTests-788405257 None] Lock "cinder-efc624a8-f021-472e-a105-a5bfb3aefa14-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:33:00 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-3d593a5c-3d1b-457d-bded-7dc1ca301eee tempest-ProjectReaderTests-788405257 None] Acquiring lock "cinder-quobyte-3654056f-65d8-4558-8de3-2853972c19e4" by "delete_snapshot" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:33:00 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-3d593a5c-3d1b-457d-bded-7dc1ca301eee tempest-ProjectReaderTests-788405257 None] Lock "cinder-quobyte-3654056f-65d8-4558-8de3-2853972c19e4" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:33:00 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-3d593a5c-3d1b-457d-bded-7dc1ca301eee tempest-ProjectReaderTests-788405257 None] Acquiring lock "cinder-quobyte-efc624a8-f021-472e-a105-a5bfb3aefa14" by "_delete_snapshot" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:33:00 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-3d593a5c-3d1b-457d-bded-7dc1ca301eee tempest-ProjectReaderTests-788405257 None] Lock "cinder-quobyte-efc624a8-f021-472e-a105-a5bfb3aefa14" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:33:00 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-3d593a5c-3d1b-457d-bded-7dc1ca301eee tempest-ProjectReaderTests-788405257 None] Deleting offline snapshot efc624a8-f021-472e-a105-a5bfb3aefa14 of volume 3654056f-65d8-4558-8de3-2853972c19e4 {{(pid=88695) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 06:33:00 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-3d593a5c-3d1b-457d-bded-7dc1ca301eee tempest-ProjectReaderTests-788405257 None] snapshot_file for this snap is: volume-3654056f-65d8-4558-8de3-2853972c19e4.efc624a8-f021-472e-a105-a5bfb3aefa14 {{(pid=88695) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 06:33:00 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[193f531d-a442-4618-81e8-98101887984b]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:33:00 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-3d593a5c-3d1b-457d-bded-7dc1ca301eee tempest-ProjectReaderTests-788405257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-3654056f-65d8-4558-8de3-2853972c19e4.efc624a8-f021-472e-a105-a5bfb3aefa14 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:33:00 devstack sudo[109888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-3654056f-65d8-4558-8de3-2853972c19e4.efc624a8-f021-472e-a105-a5bfb3aefa14 Aug 05 06:33:00 devstack sudo[109888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:33:00 devstack cinder-volume[88695]: DEBUG oslo_service.periodic_task [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88695) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 06:33:00 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:33:00 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:33:00 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:33:00 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:33:00 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:33:00 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:33:00 devstack sudo[109892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce Aug 05 06:33:00 devstack sudo[109892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:33:00 devstack sudo[109888]: pam_unix(sudo:session): session closed for user root Aug 05 06:33:00 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-3d593a5c-3d1b-457d-bded-7dc1ca301eee tempest-ProjectReaderTests-788405257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-3654056f-65d8-4558-8de3-2853972c19e4.efc624a8-f021-472e-a105-a5bfb3aefa14" returned: 0 in 0.390s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:33:00 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-3d593a5c-3d1b-457d-bded-7dc1ca301eee tempest-ProjectReaderTests-788405257 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3654056f-65d8-4558-8de3-2853972c19e4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88695) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 06:33:00 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdedad7a-2f2b-4185-a8e4-5b936557dda0]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:33:00 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-3d593a5c-3d1b-457d-bded-7dc1ca301eee tempest-ProjectReaderTests-788405257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-3654056f-65d8-4558-8de3-2853972c19e4 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:33:00 devstack sudo[109895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-3654056f-65d8-4558-8de3-2853972c19e4 Aug 05 06:33:00 devstack sudo[109895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:33:00 devstack sudo[109892]: pam_unix(sudo:session): session closed for user root Aug 05 06:33:00 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce" returned: 0 in 0.273s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:33:00 devstack cinder-volume[88695]: DEBUG cinder.manager [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] Notifying Schedulers of capabilities ... {{(pid=88695) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 06:33:00 devstack cinder-volume[88695]: DEBUG oslo_service.periodic_task [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] Running periodic task VolumeManager._thread_info {{(pid=88695) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 06:33:00 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] thread count: 28 {{(pid=88695) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 05 06:33:00 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] thread info: [<_MainThread(MainThread, started 134469211893888)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88695) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 05 06:33:00 devstack sudo[109895]: pam_unix(sudo:session): session closed for user root Aug 05 06:33:00 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-3d593a5c-3d1b-457d-bded-7dc1ca301eee tempest-ProjectReaderTests-788405257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-3654056f-65d8-4558-8de3-2853972c19e4" returned: 0 in 0.375s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:33:00 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-3d593a5c-3d1b-457d-bded-7dc1ca301eee tempest-ProjectReaderTests-788405257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-3654056f-65d8-4558-8de3-2853972c19e4.efc624a8-f021-472e-a105-a5bfb3aefa14 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:33:00 devstack sudo[109901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-3654056f-65d8-4558-8de3-2853972c19e4.efc624a8-f021-472e-a105-a5bfb3aefa14 Aug 05 06:33:00 devstack sudo[109901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:33:01 devstack sudo[109901]: pam_unix(sudo:session): session closed for user root Aug 05 06:33:01 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-3d593a5c-3d1b-457d-bded-7dc1ca301eee tempest-ProjectReaderTests-788405257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-3654056f-65d8-4558-8de3-2853972c19e4.efc624a8-f021-472e-a105-a5bfb3aefa14" returned: 0 in 0.334s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:33:01 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-3d593a5c-3d1b-457d-bded-7dc1ca301eee tempest-ProjectReaderTests-788405257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-3654056f-65d8-4558-8de3-2853972c19e4.efc624a8-f021-472e-a105-a5bfb3aefa14 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:33:01 devstack sudo[109906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-3654056f-65d8-4558-8de3-2853972c19e4.efc624a8-f021-472e-a105-a5bfb3aefa14 Aug 05 06:33:01 devstack sudo[109906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:33:01 devstack sudo[109906]: pam_unix(sudo:session): session closed for user root Aug 05 06:33:01 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-3d593a5c-3d1b-457d-bded-7dc1ca301eee tempest-ProjectReaderTests-788405257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-3654056f-65d8-4558-8de3-2853972c19e4.efc624a8-f021-472e-a105-a5bfb3aefa14" returned: 0 in 0.249s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:33:01 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-3d593a5c-3d1b-457d-bded-7dc1ca301eee tempest-ProjectReaderTests-788405257 None] Lock "cinder-quobyte-efc624a8-f021-472e-a105-a5bfb3aefa14" released by "_delete_snapshot" :: held 1.443s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:33:01 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-3d593a5c-3d1b-457d-bded-7dc1ca301eee tempest-ProjectReaderTests-788405257 None] Lock "cinder-quobyte-3654056f-65d8-4558-8de3-2853972c19e4" released by "delete_snapshot" :: held 1.467s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:33:01 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-3d593a5c-3d1b-457d-bded-7dc1ca301eee tempest-ProjectReaderTests-788405257 None] Created reservations ['ffbada74-d76c-4d1f-8138-d0364f3e1628', '73ab3424-76e7-4ea5-a8ca-e4e7678437a3', 'fa1e0495-9217-4ce2-b9c0-d3e93d2bcf50', '7ba02013-685d-4f5e-bba5-0a026aca40c9'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:33:01 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-3d593a5c-3d1b-457d-bded-7dc1ca301eee tempest-ProjectReaderTests-788405257 None] Delete snapshot completed successfully. Aug 05 06:33:01 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-3d593a5c-3d1b-457d-bded-7dc1ca301eee tempest-ProjectReaderTests-788405257 None] Lock "cinder-efc624a8-f021-472e-a105-a5bfb3aefa14-delete_snapshot" released by "delete_snapshot" :: held 1.594s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:33:02 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-900b9a2e-77f6-427e-8caa-c583c571454f tempest-ProjectReaderTests-788405257 None] Acquiring lock "cinder-3654056f-65d8-4558-8de3-2853972c19e4-delete_volume" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:33:02 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-900b9a2e-77f6-427e-8caa-c583c571454f tempest-ProjectReaderTests-788405257 None] Lock "cinder-3654056f-65d8-4558-8de3-2853972c19e4-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:33:02 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-900b9a2e-77f6-427e-8caa-c583c571454f tempest-ProjectReaderTests-788405257 None] Acquiring lock "cinder-quobyte-3654056f-65d8-4558-8de3-2853972c19e4" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:33:02 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-900b9a2e-77f6-427e-8caa-c583c571454f tempest-ProjectReaderTests-788405257 None] Lock "cinder-quobyte-3654056f-65d8-4558-8de3-2853972c19e4" acquired by "delete_volume" :: waited 0.017s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:33:02 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[46a20860-ef5f-46f8-a2f0-00ceafac9f0a]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:33:02 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-900b9a2e-77f6-427e-8caa-c583c571454f tempest-ProjectReaderTests-788405257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-3654056f-65d8-4558-8de3-2853972c19e4 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:33:02 devstack sudo[109909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-3654056f-65d8-4558-8de3-2853972c19e4 Aug 05 06:33:02 devstack sudo[109909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:33:02 devstack sudo[109909]: pam_unix(sudo:session): session closed for user root Aug 05 06:33:02 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-900b9a2e-77f6-427e-8caa-c583c571454f tempest-ProjectReaderTests-788405257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-3654056f-65d8-4558-8de3-2853972c19e4" returned: 0 in 0.389s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:33:02 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-900b9a2e-77f6-427e-8caa-c583c571454f tempest-ProjectReaderTests-788405257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-3654056f-65d8-4558-8de3-2853972c19e4 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:33:02 devstack sudo[109914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-3654056f-65d8-4558-8de3-2853972c19e4 Aug 05 06:33:02 devstack sudo[109914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:33:02 devstack sudo[109914]: pam_unix(sudo:session): session closed for user root Aug 05 06:33:02 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-900b9a2e-77f6-427e-8caa-c583c571454f tempest-ProjectReaderTests-788405257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-3654056f-65d8-4558-8de3-2853972c19e4" returned: 0 in 0.250s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:33:02 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-900b9a2e-77f6-427e-8caa-c583c571454f tempest-ProjectReaderTests-788405257 None] Lock "cinder-quobyte-3654056f-65d8-4558-8de3-2853972c19e4" released by "delete_volume" :: held 0.702s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:33:03 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-900b9a2e-77f6-427e-8caa-c583c571454f tempest-ProjectReaderTests-788405257 None] Created reservations ['6fe25b3d-367e-4100-b69c-ea32a3e08d84', '321d9cac-5c87-419a-bef2-7b10d5ddfd6b', 'a7035607-6c93-42a6-af3b-77db5a497fda', 'bb12726b-ff47-4260-b3de-23918c12fe92'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:33:03 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-900b9a2e-77f6-427e-8caa-c583c571454f tempest-ProjectReaderTests-788405257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:33:03 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-900b9a2e-77f6-427e-8caa-c583c571454f tempest-ProjectReaderTests-788405257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:33:03 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-900b9a2e-77f6-427e-8caa-c583c571454f tempest-ProjectReaderTests-788405257 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:33:03 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-900b9a2e-77f6-427e-8caa-c583c571454f tempest-ProjectReaderTests-788405257 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:33:03 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-900b9a2e-77f6-427e-8caa-c583c571454f tempest-ProjectReaderTests-788405257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:33:03 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-900b9a2e-77f6-427e-8caa-c583c571454f tempest-ProjectReaderTests-788405257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:33:03 devstack sudo[109917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce Aug 05 06:33:03 devstack sudo[109917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:33:03 devstack sudo[109917]: pam_unix(sudo:session): session closed for user root Aug 05 06:33:03 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-900b9a2e-77f6-427e-8caa-c583c571454f tempest-ProjectReaderTests-788405257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce" returned: 0 in 0.263s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:33:03 devstack cinder-volume[88695]: DEBUG cinder.manager [None req-900b9a2e-77f6-427e-8caa-c583c571454f tempest-ProjectReaderTests-788405257 None] Notifying Schedulers of capabilities ... {{(pid=88695) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 06:33:03 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-900b9a2e-77f6-427e-8caa-c583c571454f tempest-ProjectReaderTests-788405257 None] Deleted volume successfully. Aug 05 06:33:03 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-900b9a2e-77f6-427e-8caa-c583c571454f tempest-ProjectReaderTests-788405257 None] Lock "cinder-3654056f-65d8-4558-8de3-2853972c19e4-delete_volume" released by "delete_volume" :: held 1.165s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:33:03 devstack cinder-volume[88695]: DEBUG cinder.volume.flows.manager.create_volume [None req-b43f3ac2-78e2-4221-9fc0-30acdb0c49a8 tempest-ProjectReaderTests-788405257 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88695) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 06:33:03 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-b43f3ac2-78e2-4221-9fc0-30acdb0c49a8 tempest-ProjectReaderTests-788405257 None] Flow 'volume_create_manager' (bdc7afc6-dd23-4dc4-bed2-e540934af327) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:33:03 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-b43f3ac2-78e2-4221-9fc0-30acdb0c49a8 tempest-ProjectReaderTests-788405257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80839544-f216-4484-b320-745c70288ab3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:33:03 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-b43f3ac2-78e2-4221-9fc0-30acdb0c49a8 tempest-ProjectReaderTests-788405257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80839544-f216-4484-b320-745c70288ab3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:33:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2073218475',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfc9e56b-c49b-4de2-b76a-4ba98e75ca51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95ec897d23f64c4aa28c9f99de062aee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:33:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:33:04Z,use_quota=True,user_id='97d0bbdbc29b47d08c8978b94311d171',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:33:03 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-b43f3ac2-78e2-4221-9fc0-30acdb0c49a8 tempest-ProjectReaderTests-788405257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16402fea-6ed0-422d-b1b6-1012cfdada84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:33:03 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-b43f3ac2-78e2-4221-9fc0-30acdb0c49a8 tempest-ProjectReaderTests-788405257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16402fea-6ed0-422d-b1b6-1012cfdada84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:33:03 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-b43f3ac2-78e2-4221-9fc0-30acdb0c49a8 tempest-ProjectReaderTests-788405257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e41d0816-16a5-4829-a118-df059c9eb30a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:33:03 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-b43f3ac2-78e2-4221-9fc0-30acdb0c49a8 tempest-ProjectReaderTests-788405257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e41d0816-16a5-4829-a118-df059c9eb30a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dfc9e56b-c49b-4de2-b76a-4ba98e75ca51', 'volume_name': 'volume-dfc9e56b-c49b-4de2-b76a-4ba98e75ca51', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:33:03 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-b43f3ac2-78e2-4221-9fc0-30acdb0c49a8 tempest-ProjectReaderTests-788405257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92caa880-9923-4cf3-8f1f-e42e3a47a9bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:33:03 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-b43f3ac2-78e2-4221-9fc0-30acdb0c49a8 tempest-ProjectReaderTests-788405257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92caa880-9923-4cf3-8f1f-e42e3a47a9bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:33:03 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-b43f3ac2-78e2-4221-9fc0-30acdb0c49a8 tempest-ProjectReaderTests-788405257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e53d9609-7e7a-4607-83b5-b8e1fcb4550f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:33:03 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-b43f3ac2-78e2-4221-9fc0-30acdb0c49a8 tempest-ProjectReaderTests-788405257 None] Volume dfc9e56b-c49b-4de2-b76a-4ba98e75ca51: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dfc9e56b-c49b-4de2-b76a-4ba98e75ca51', 'volume_size': 1} Aug 05 06:33:03 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-b43f3ac2-78e2-4221-9fc0-30acdb0c49a8 tempest-ProjectReaderTests-788405257 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:33:03 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-b43f3ac2-78e2-4221-9fc0-30acdb0c49a8 tempest-ProjectReaderTests-788405257 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:33:03 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-b43f3ac2-78e2-4221-9fc0-30acdb0c49a8 tempest-ProjectReaderTests-788405257 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:33:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2073218475',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfc9e56b-c49b-4de2-b76a-4ba98e75ca51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95ec897d23f64c4aa28c9f99de062aee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:33:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:33:04Z,use_quota=True,user_id='97d0bbdbc29b47d08c8978b94311d171',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)}" {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 06:33:03 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-b43f3ac2-78e2-4221-9fc0-30acdb0c49a8 tempest-ProjectReaderTests-788405257 None] Creating volume dfc9e56b-c49b-4de2-b76a-4ba98e75ca51 {{(pid=88695) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 06:33:03 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-b43f3ac2-78e2-4221-9fc0-30acdb0c49a8 tempest-ProjectReaderTests-788405257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:33:03 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-b43f3ac2-78e2-4221-9fc0-30acdb0c49a8 tempest-ProjectReaderTests-788405257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:33:03 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-b43f3ac2-78e2-4221-9fc0-30acdb0c49a8 tempest-ProjectReaderTests-788405257 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:33:03 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-b43f3ac2-78e2-4221-9fc0-30acdb0c49a8 tempest-ProjectReaderTests-788405257 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:33:03 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-b43f3ac2-78e2-4221-9fc0-30acdb0c49a8 tempest-ProjectReaderTests-788405257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:33:03 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-b43f3ac2-78e2-4221-9fc0-30acdb0c49a8 tempest-ProjectReaderTests-788405257 None] Selected osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 as target Quobyte volume. {{(pid=88695) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 06:33:03 devstack cinder-volume[88695]: INFO cinder.volume.drivers.remotefs [None req-b43f3ac2-78e2-4221-9fc0-30acdb0c49a8 tempest-ProjectReaderTests-788405257 None] casted to osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 Aug 05 06:33:03 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-b43f3ac2-78e2-4221-9fc0-30acdb0c49a8 tempest-ProjectReaderTests-788405257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-dfc9e56b-c49b-4de2-b76a-4ba98e75ca51 1073741824 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:33:03 devstack sudo[109920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-dfc9e56b-c49b-4de2-b76a-4ba98e75ca51 1073741824 Aug 05 06:33:03 devstack sudo[109920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:33:04 devstack sudo[109920]: pam_unix(sudo:session): session closed for user root Aug 05 06:33:04 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-b43f3ac2-78e2-4221-9fc0-30acdb0c49a8 tempest-ProjectReaderTests-788405257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-dfc9e56b-c49b-4de2-b76a-4ba98e75ca51 1073741824" returned: 0 in 0.448s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:33:04 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-b43f3ac2-78e2-4221-9fc0-30acdb0c49a8 tempest-ProjectReaderTests-788405257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-dfc9e56b-c49b-4de2-b76a-4ba98e75ca51 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:33:04 devstack sudo[109925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-dfc9e56b-c49b-4de2-b76a-4ba98e75ca51 Aug 05 06:33:04 devstack sudo[109925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:33:04 devstack sudo[109925]: pam_unix(sudo:session): session closed for user root Aug 05 06:33:04 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-b43f3ac2-78e2-4221-9fc0-30acdb0c49a8 tempest-ProjectReaderTests-788405257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-dfc9e56b-c49b-4de2-b76a-4ba98e75ca51" returned: 0 in 0.246s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:33:04 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-b43f3ac2-78e2-4221-9fc0-30acdb0c49a8 tempest-ProjectReaderTests-788405257 None] <== create_volume: return (736ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'} {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 06:33:04 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-b43f3ac2-78e2-4221-9fc0-30acdb0c49a8 tempest-ProjectReaderTests-788405257 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.739s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:33:04 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-b43f3ac2-78e2-4221-9fc0-30acdb0c49a8 tempest-ProjectReaderTests-788405257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e53d9609-7e7a-4607-83b5-b8e1fcb4550f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dfc9e56b-c49b-4de2-b76a-4ba98e75ca51', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:33:04 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-b43f3ac2-78e2-4221-9fc0-30acdb0c49a8 tempest-ProjectReaderTests-788405257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f743e03c-7167-43ab-a3e5-dfa095a80937) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:33:04 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-b43f3ac2-78e2-4221-9fc0-30acdb0c49a8 tempest-ProjectReaderTests-788405257 None] Volume volume-dfc9e56b-c49b-4de2-b76a-4ba98e75ca51 (dfc9e56b-c49b-4de2-b76a-4ba98e75ca51): created successfully Aug 05 06:33:04 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-b43f3ac2-78e2-4221-9fc0-30acdb0c49a8 tempest-ProjectReaderTests-788405257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f743e03c-7167-43ab-a3e5-dfa095a80937) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:33:04 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-b43f3ac2-78e2-4221-9fc0-30acdb0c49a8 tempest-ProjectReaderTests-788405257 None] Flow 'volume_create_manager' (bdc7afc6-dd23-4dc4-bed2-e540934af327) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:33:04 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-b43f3ac2-78e2-4221-9fc0-30acdb0c49a8 tempest-ProjectReaderTests-788405257 None] Created volume successfully. Aug 05 06:33:05 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-d24a7404-cbf8-44f1-a124-cbbf8b2e849d tempest-ProjectReaderTests-788405257 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:33:05 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-d24a7404-cbf8-44f1-a124-cbbf8b2e849d tempest-ProjectReaderTests-788405257 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:33:05 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-d24a7404-cbf8-44f1-a124-cbbf8b2e849d tempest-ProjectReaderTests-788405257 None] Creating offline snapshot 9bae0f47-4611-43b1-ac3b-990771baf87d of volume dfc9e56b-c49b-4de2-b76a-4ba98e75ca51 {{(pid=88695) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 06:33:05 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d67bc09-ef09-4241-ad93-fb36923b89b5]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:33:05 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-d24a7404-cbf8-44f1-a124-cbbf8b2e849d tempest-ProjectReaderTests-788405257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-dfc9e56b-c49b-4de2-b76a-4ba98e75ca51 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:33:05 devstack sudo[109928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-dfc9e56b-c49b-4de2-b76a-4ba98e75ca51 Aug 05 06:33:05 devstack sudo[109928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:33:05 devstack sudo[109928]: pam_unix(sudo:session): session closed for user root Aug 05 06:33:05 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-d24a7404-cbf8-44f1-a124-cbbf8b2e849d tempest-ProjectReaderTests-788405257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-dfc9e56b-c49b-4de2-b76a-4ba98e75ca51" returned: 0 in 0.377s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:33:05 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-d24a7404-cbf8-44f1-a124-cbbf8b2e849d tempest-ProjectReaderTests-788405257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-dfc9e56b-c49b-4de2-b76a-4ba98e75ca51,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-dfc9e56b-c49b-4de2-b76a-4ba98e75ca51.9bae0f47-4611-43b1-ac3b-990771baf87d 1G {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:33:05 devstack sudo[109933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-dfc9e56b-c49b-4de2-b76a-4ba98e75ca51,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-dfc9e56b-c49b-4de2-b76a-4ba98e75ca51.9bae0f47-4611-43b1-ac3b-990771baf87d 1G Aug 05 06:33:05 devstack sudo[109933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:33:05 devstack sudo[109933]: pam_unix(sudo:session): session closed for user root Aug 05 06:33:05 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-d24a7404-cbf8-44f1-a124-cbbf8b2e849d tempest-ProjectReaderTests-788405257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-dfc9e56b-c49b-4de2-b76a-4ba98e75ca51,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-dfc9e56b-c49b-4de2-b76a-4ba98e75ca51.9bae0f47-4611-43b1-ac3b-990771baf87d 1G" returned: 0 in 0.385s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:33:05 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-d24a7404-cbf8-44f1-a124-cbbf8b2e849d tempest-ProjectReaderTests-788405257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dfc9e56b-c49b-4de2-b76a-4ba98e75ca51 -F qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-dfc9e56b-c49b-4de2-b76a-4ba98e75ca51.9bae0f47-4611-43b1-ac3b-990771baf87d {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:33:05 devstack sudo[109938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dfc9e56b-c49b-4de2-b76a-4ba98e75ca51 -F qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-dfc9e56b-c49b-4de2-b76a-4ba98e75ca51.9bae0f47-4611-43b1-ac3b-990771baf87d Aug 05 06:33:05 devstack sudo[109938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:33:06 devstack sudo[109938]: pam_unix(sudo:session): session closed for user root Aug 05 06:33:06 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-d24a7404-cbf8-44f1-a124-cbbf8b2e849d tempest-ProjectReaderTests-788405257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dfc9e56b-c49b-4de2-b76a-4ba98e75ca51 -F qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-dfc9e56b-c49b-4de2-b76a-4ba98e75ca51.9bae0f47-4611-43b1-ac3b-990771baf87d" returned: 0 in 0.317s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:33:06 devstack cinder-volume[88695]: WARNING cinder.volume.drivers.remotefs [None req-d24a7404-cbf8-44f1-a124-cbbf8b2e849d tempest-ProjectReaderTests-788405257 None] /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-dfc9e56b-c49b-4de2-b76a-4ba98e75ca51.9bae0f47-4611-43b1-ac3b-990771baf87d is being set with open permissions: ugo+rw Aug 05 06:33:06 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-d24a7404-cbf8-44f1-a124-cbbf8b2e849d tempest-ProjectReaderTests-788405257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-dfc9e56b-c49b-4de2-b76a-4ba98e75ca51.9bae0f47-4611-43b1-ac3b-990771baf87d {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:33:06 devstack sudo[109943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-dfc9e56b-c49b-4de2-b76a-4ba98e75ca51.9bae0f47-4611-43b1-ac3b-990771baf87d Aug 05 06:33:06 devstack sudo[109943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:33:06 devstack sudo[109943]: pam_unix(sudo:session): session closed for user root Aug 05 06:33:06 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-d24a7404-cbf8-44f1-a124-cbbf8b2e849d tempest-ProjectReaderTests-788405257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-dfc9e56b-c49b-4de2-b76a-4ba98e75ca51.9bae0f47-4611-43b1-ac3b-990771baf87d" returned: 0 in 0.244s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:33:06 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-d24a7404-cbf8-44f1-a124-cbbf8b2e849d tempest-ProjectReaderTests-788405257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-dfc9e56b-c49b-4de2-b76a-4ba98e75ca51.info {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:33:06 devstack sudo[109946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-dfc9e56b-c49b-4de2-b76a-4ba98e75ca51.info Aug 05 06:33:06 devstack sudo[109946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:33:06 devstack sudo[109946]: pam_unix(sudo:session): session closed for user root Aug 05 06:33:06 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-d24a7404-cbf8-44f1-a124-cbbf8b2e849d tempest-ProjectReaderTests-788405257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-dfc9e56b-c49b-4de2-b76a-4ba98e75ca51.info" returned: 0 in 0.255s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:33:06 devstack cinder-volume[88695]: WARNING cinder.volume.drivers.remotefs [None req-d24a7404-cbf8-44f1-a124-cbbf8b2e849d tempest-ProjectReaderTests-788405257 None] /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-dfc9e56b-c49b-4de2-b76a-4ba98e75ca51.info is being set with open permissions: ugo+rw Aug 05 06:33:06 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-d24a7404-cbf8-44f1-a124-cbbf8b2e849d tempest-ProjectReaderTests-788405257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-dfc9e56b-c49b-4de2-b76a-4ba98e75ca51.info {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:33:06 devstack sudo[109949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-dfc9e56b-c49b-4de2-b76a-4ba98e75ca51.info Aug 05 06:33:06 devstack sudo[109949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:33:06 devstack sudo[109949]: pam_unix(sudo:session): session closed for user root Aug 05 06:33:06 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-d24a7404-cbf8-44f1-a124-cbbf8b2e849d tempest-ProjectReaderTests-788405257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-dfc9e56b-c49b-4de2-b76a-4ba98e75ca51.info" returned: 0 in 0.272s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:33:06 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-d24a7404-cbf8-44f1-a124-cbbf8b2e849d tempest-ProjectReaderTests-788405257 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.930s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:33:06 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-d24a7404-cbf8-44f1-a124-cbbf8b2e849d tempest-ProjectReaderTests-788405257 None] Create snapshot completed successfully Aug 05 06:33:07 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-4bea4114-00df-4f48-8924-30a82693f6c2 tempest-ProjectReaderTests-788405257 None] Acquiring lock "cinder-9bae0f47-4611-43b1-ac3b-990771baf87d-delete_snapshot" by "delete_snapshot" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:33:07 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-4bea4114-00df-4f48-8924-30a82693f6c2 tempest-ProjectReaderTests-788405257 None] Lock "cinder-9bae0f47-4611-43b1-ac3b-990771baf87d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:33:07 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-4bea4114-00df-4f48-8924-30a82693f6c2 tempest-ProjectReaderTests-788405257 None] Acquiring lock "cinder-quobyte-dfc9e56b-c49b-4de2-b76a-4ba98e75ca51" by "delete_snapshot" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:33:07 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-4bea4114-00df-4f48-8924-30a82693f6c2 tempest-ProjectReaderTests-788405257 None] Lock "cinder-quobyte-dfc9e56b-c49b-4de2-b76a-4ba98e75ca51" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:33:07 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-4bea4114-00df-4f48-8924-30a82693f6c2 tempest-ProjectReaderTests-788405257 None] Acquiring lock "cinder-quobyte-9bae0f47-4611-43b1-ac3b-990771baf87d" by "_delete_snapshot" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:33:07 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-4bea4114-00df-4f48-8924-30a82693f6c2 tempest-ProjectReaderTests-788405257 None] Lock "cinder-quobyte-9bae0f47-4611-43b1-ac3b-990771baf87d" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:33:07 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-4bea4114-00df-4f48-8924-30a82693f6c2 tempest-ProjectReaderTests-788405257 None] Deleting offline snapshot 9bae0f47-4611-43b1-ac3b-990771baf87d of volume dfc9e56b-c49b-4de2-b76a-4ba98e75ca51 {{(pid=88695) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 06:33:07 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-4bea4114-00df-4f48-8924-30a82693f6c2 tempest-ProjectReaderTests-788405257 None] snapshot_file for this snap is: volume-dfc9e56b-c49b-4de2-b76a-4ba98e75ca51.9bae0f47-4611-43b1-ac3b-990771baf87d {{(pid=88695) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 06:33:07 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[de44c73c-4608-458b-beeb-22b33689db92]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:33:07 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-4bea4114-00df-4f48-8924-30a82693f6c2 tempest-ProjectReaderTests-788405257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-dfc9e56b-c49b-4de2-b76a-4ba98e75ca51.9bae0f47-4611-43b1-ac3b-990771baf87d {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:33:07 devstack sudo[109952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-dfc9e56b-c49b-4de2-b76a-4ba98e75ca51.9bae0f47-4611-43b1-ac3b-990771baf87d Aug 05 06:33:07 devstack sudo[109952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:33:07 devstack sudo[109952]: pam_unix(sudo:session): session closed for user root Aug 05 06:33:07 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-4bea4114-00df-4f48-8924-30a82693f6c2 tempest-ProjectReaderTests-788405257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-dfc9e56b-c49b-4de2-b76a-4ba98e75ca51.9bae0f47-4611-43b1-ac3b-990771baf87d" returned: 0 in 0.403s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:33:07 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-4bea4114-00df-4f48-8924-30a82693f6c2 tempest-ProjectReaderTests-788405257 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dfc9e56b-c49b-4de2-b76a-4ba98e75ca51(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88695) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 06:33:07 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[be8def67-9730-4874-9e4d-50b9e70c1a96]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:33:07 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-4bea4114-00df-4f48-8924-30a82693f6c2 tempest-ProjectReaderTests-788405257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-dfc9e56b-c49b-4de2-b76a-4ba98e75ca51 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:33:07 devstack sudo[109957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-dfc9e56b-c49b-4de2-b76a-4ba98e75ca51 Aug 05 06:33:07 devstack sudo[109957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:33:08 devstack sudo[109957]: pam_unix(sudo:session): session closed for user root Aug 05 06:33:08 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-4bea4114-00df-4f48-8924-30a82693f6c2 tempest-ProjectReaderTests-788405257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-dfc9e56b-c49b-4de2-b76a-4ba98e75ca51" returned: 0 in 0.427s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:33:08 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-4bea4114-00df-4f48-8924-30a82693f6c2 tempest-ProjectReaderTests-788405257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-dfc9e56b-c49b-4de2-b76a-4ba98e75ca51.9bae0f47-4611-43b1-ac3b-990771baf87d {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:33:08 devstack sudo[109964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-dfc9e56b-c49b-4de2-b76a-4ba98e75ca51.9bae0f47-4611-43b1-ac3b-990771baf87d Aug 05 06:33:08 devstack sudo[109964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:33:08 devstack sudo[109964]: pam_unix(sudo:session): session closed for user root Aug 05 06:33:08 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-4bea4114-00df-4f48-8924-30a82693f6c2 tempest-ProjectReaderTests-788405257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-dfc9e56b-c49b-4de2-b76a-4ba98e75ca51.9bae0f47-4611-43b1-ac3b-990771baf87d" returned: 0 in 0.379s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:33:08 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-4bea4114-00df-4f48-8924-30a82693f6c2 tempest-ProjectReaderTests-788405257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-dfc9e56b-c49b-4de2-b76a-4ba98e75ca51.9bae0f47-4611-43b1-ac3b-990771baf87d {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:33:08 devstack sudo[109970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-dfc9e56b-c49b-4de2-b76a-4ba98e75ca51.9bae0f47-4611-43b1-ac3b-990771baf87d Aug 05 06:33:08 devstack sudo[109970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:33:08 devstack sudo[109970]: pam_unix(sudo:session): session closed for user root Aug 05 06:33:08 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-4bea4114-00df-4f48-8924-30a82693f6c2 tempest-ProjectReaderTests-788405257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-dfc9e56b-c49b-4de2-b76a-4ba98e75ca51.9bae0f47-4611-43b1-ac3b-990771baf87d" returned: 0 in 0.282s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:33:08 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-4bea4114-00df-4f48-8924-30a82693f6c2 tempest-ProjectReaderTests-788405257 None] Lock "cinder-quobyte-9bae0f47-4611-43b1-ac3b-990771baf87d" released by "_delete_snapshot" :: held 1.597s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:33:08 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-4bea4114-00df-4f48-8924-30a82693f6c2 tempest-ProjectReaderTests-788405257 None] Lock "cinder-quobyte-dfc9e56b-c49b-4de2-b76a-4ba98e75ca51" released by "delete_snapshot" :: held 1.620s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:33:08 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-4bea4114-00df-4f48-8924-30a82693f6c2 tempest-ProjectReaderTests-788405257 None] Created reservations ['edb26bea-c5d7-471e-ac9a-76e5af929237', '0fb036f4-9675-4fb6-b9b6-fed5e0415065', '349b5a92-1f28-468a-804c-8dd6ffd6afce', '9b3ed636-1772-42dc-abbe-eaeadbd8b4fd'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:33:08 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-4bea4114-00df-4f48-8924-30a82693f6c2 tempest-ProjectReaderTests-788405257 None] Delete snapshot completed successfully. Aug 05 06:33:08 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-4bea4114-00df-4f48-8924-30a82693f6c2 tempest-ProjectReaderTests-788405257 None] Lock "cinder-9bae0f47-4611-43b1-ac3b-990771baf87d-delete_snapshot" released by "delete_snapshot" :: held 1.765s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:33:09 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-856288be-f70c-439e-be2d-617fb4b83921 tempest-ProjectReaderTests-788405257 None] Acquiring lock "cinder-dfc9e56b-c49b-4de2-b76a-4ba98e75ca51-delete_volume" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:33:09 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-856288be-f70c-439e-be2d-617fb4b83921 tempest-ProjectReaderTests-788405257 None] Lock "cinder-dfc9e56b-c49b-4de2-b76a-4ba98e75ca51-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:33:09 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-856288be-f70c-439e-be2d-617fb4b83921 tempest-ProjectReaderTests-788405257 None] Acquiring lock "cinder-quobyte-dfc9e56b-c49b-4de2-b76a-4ba98e75ca51" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:33:09 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-856288be-f70c-439e-be2d-617fb4b83921 tempest-ProjectReaderTests-788405257 None] Lock "cinder-quobyte-dfc9e56b-c49b-4de2-b76a-4ba98e75ca51" acquired by "delete_volume" :: waited 0.014s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:33:09 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[662322ee-9e1d-429d-9c65-9e7f5f0e3eb4]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:33:09 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-856288be-f70c-439e-be2d-617fb4b83921 tempest-ProjectReaderTests-788405257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-dfc9e56b-c49b-4de2-b76a-4ba98e75ca51 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:33:09 devstack sudo[109973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-dfc9e56b-c49b-4de2-b76a-4ba98e75ca51 Aug 05 06:33:09 devstack sudo[109973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:33:09 devstack sudo[109973]: pam_unix(sudo:session): session closed for user root Aug 05 06:33:09 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-856288be-f70c-439e-be2d-617fb4b83921 tempest-ProjectReaderTests-788405257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-dfc9e56b-c49b-4de2-b76a-4ba98e75ca51" returned: 0 in 0.417s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:33:09 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-856288be-f70c-439e-be2d-617fb4b83921 tempest-ProjectReaderTests-788405257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-dfc9e56b-c49b-4de2-b76a-4ba98e75ca51 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:33:09 devstack sudo[109978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-dfc9e56b-c49b-4de2-b76a-4ba98e75ca51 Aug 05 06:33:09 devstack sudo[109978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:33:10 devstack sudo[109978]: pam_unix(sudo:session): session closed for user root Aug 05 06:33:10 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-856288be-f70c-439e-be2d-617fb4b83921 tempest-ProjectReaderTests-788405257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-dfc9e56b-c49b-4de2-b76a-4ba98e75ca51" returned: 0 in 0.258s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:33:10 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-856288be-f70c-439e-be2d-617fb4b83921 tempest-ProjectReaderTests-788405257 None] Lock "cinder-quobyte-dfc9e56b-c49b-4de2-b76a-4ba98e75ca51" released by "delete_volume" :: held 0.744s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:33:10 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-856288be-f70c-439e-be2d-617fb4b83921 tempest-ProjectReaderTests-788405257 None] Created reservations ['ff454e7c-5d4a-43ba-a054-d0954077cc91', '276239f9-ba0a-47dd-896c-5a5324e8bc21', '31b61a44-705f-45ea-829f-506dd0798d8c', '7efd8737-e379-4d85-bb48-20189713f530'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:33:10 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-856288be-f70c-439e-be2d-617fb4b83921 tempest-ProjectReaderTests-788405257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:33:10 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-856288be-f70c-439e-be2d-617fb4b83921 tempest-ProjectReaderTests-788405257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:33:10 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-856288be-f70c-439e-be2d-617fb4b83921 tempest-ProjectReaderTests-788405257 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:33:10 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-856288be-f70c-439e-be2d-617fb4b83921 tempest-ProjectReaderTests-788405257 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:33:10 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-856288be-f70c-439e-be2d-617fb4b83921 tempest-ProjectReaderTests-788405257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:33:10 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-856288be-f70c-439e-be2d-617fb4b83921 tempest-ProjectReaderTests-788405257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:33:10 devstack sudo[109981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce Aug 05 06:33:10 devstack sudo[109981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:33:10 devstack sudo[109981]: pam_unix(sudo:session): session closed for user root Aug 05 06:33:10 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-856288be-f70c-439e-be2d-617fb4b83921 tempest-ProjectReaderTests-788405257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce" returned: 0 in 0.292s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:33:10 devstack cinder-volume[88695]: DEBUG cinder.manager [None req-856288be-f70c-439e-be2d-617fb4b83921 tempest-ProjectReaderTests-788405257 None] Notifying Schedulers of capabilities ... {{(pid=88695) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 06:33:10 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-856288be-f70c-439e-be2d-617fb4b83921 tempest-ProjectReaderTests-788405257 None] Deleted volume successfully. Aug 05 06:33:10 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-856288be-f70c-439e-be2d-617fb4b83921 tempest-ProjectReaderTests-788405257 None] Lock "cinder-dfc9e56b-c49b-4de2-b76a-4ba98e75ca51-delete_volume" released by "delete_volume" :: held 1.250s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:33:11 devstack cinder-volume[88695]: DEBUG cinder.volume.flows.manager.create_volume [None req-f46bade3-9857-4592-9794-05e476ff3b2e tempest-ProjectReaderTests-788405257 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88695) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 06:33:11 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-f46bade3-9857-4592-9794-05e476ff3b2e tempest-ProjectReaderTests-788405257 None] Flow 'volume_create_manager' (c59749de-64bd-45a9-9335-27f73590c177) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:33:11 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-f46bade3-9857-4592-9794-05e476ff3b2e tempest-ProjectReaderTests-788405257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c42bb89a-f1d2-4e1f-89b4-e03a3355003b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:33:11 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-f46bade3-9857-4592-9794-05e476ff3b2e tempest-ProjectReaderTests-788405257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c42bb89a-f1d2-4e1f-89b4-e03a3355003b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:33:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-840441766',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16823667-73ae-4d18-a49f-e73fdf80509c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95ec897d23f64c4aa28c9f99de062aee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:33:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:33:11Z,use_quota=True,user_id='97d0bbdbc29b47d08c8978b94311d171',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:33:11 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-f46bade3-9857-4592-9794-05e476ff3b2e tempest-ProjectReaderTests-788405257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5415815c-30c8-4a1d-9d12-ea05fe0806c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:33:11 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-f46bade3-9857-4592-9794-05e476ff3b2e tempest-ProjectReaderTests-788405257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5415815c-30c8-4a1d-9d12-ea05fe0806c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:33:11 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-f46bade3-9857-4592-9794-05e476ff3b2e tempest-ProjectReaderTests-788405257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b67a5a2-e83d-49d0-96a5-9c0e02720ae2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:33:11 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-f46bade3-9857-4592-9794-05e476ff3b2e tempest-ProjectReaderTests-788405257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b67a5a2-e83d-49d0-96a5-9c0e02720ae2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '16823667-73ae-4d18-a49f-e73fdf80509c', 'volume_name': 'volume-16823667-73ae-4d18-a49f-e73fdf80509c', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:33:11 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-f46bade3-9857-4592-9794-05e476ff3b2e tempest-ProjectReaderTests-788405257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edeaaa7a-24b9-4630-aa14-86d964b24198) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:33:11 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-f46bade3-9857-4592-9794-05e476ff3b2e tempest-ProjectReaderTests-788405257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edeaaa7a-24b9-4630-aa14-86d964b24198) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:33:11 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-f46bade3-9857-4592-9794-05e476ff3b2e tempest-ProjectReaderTests-788405257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c46f8f83-66de-4dfa-9578-cb523074822a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:33:11 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-f46bade3-9857-4592-9794-05e476ff3b2e tempest-ProjectReaderTests-788405257 None] Volume 16823667-73ae-4d18-a49f-e73fdf80509c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-16823667-73ae-4d18-a49f-e73fdf80509c', 'volume_size': 1} Aug 05 06:33:11 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-f46bade3-9857-4592-9794-05e476ff3b2e tempest-ProjectReaderTests-788405257 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:33:11 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-f46bade3-9857-4592-9794-05e476ff3b2e tempest-ProjectReaderTests-788405257 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:33:11 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-f46bade3-9857-4592-9794-05e476ff3b2e tempest-ProjectReaderTests-788405257 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:33:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-840441766',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16823667-73ae-4d18-a49f-e73fdf80509c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95ec897d23f64c4aa28c9f99de062aee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:33:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:33:11Z,use_quota=True,user_id='97d0bbdbc29b47d08c8978b94311d171',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)}" {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 06:33:11 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-f46bade3-9857-4592-9794-05e476ff3b2e tempest-ProjectReaderTests-788405257 None] Creating volume 16823667-73ae-4d18-a49f-e73fdf80509c {{(pid=88695) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 06:33:11 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-f46bade3-9857-4592-9794-05e476ff3b2e tempest-ProjectReaderTests-788405257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:33:11 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-f46bade3-9857-4592-9794-05e476ff3b2e tempest-ProjectReaderTests-788405257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:33:11 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-f46bade3-9857-4592-9794-05e476ff3b2e tempest-ProjectReaderTests-788405257 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:33:11 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-f46bade3-9857-4592-9794-05e476ff3b2e tempest-ProjectReaderTests-788405257 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:33:11 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-f46bade3-9857-4592-9794-05e476ff3b2e tempest-ProjectReaderTests-788405257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:33:11 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-f46bade3-9857-4592-9794-05e476ff3b2e tempest-ProjectReaderTests-788405257 None] Selected osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 as target Quobyte volume. {{(pid=88695) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 06:33:11 devstack cinder-volume[88695]: INFO cinder.volume.drivers.remotefs [None req-f46bade3-9857-4592-9794-05e476ff3b2e tempest-ProjectReaderTests-788405257 None] casted to osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 Aug 05 06:33:11 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-f46bade3-9857-4592-9794-05e476ff3b2e tempest-ProjectReaderTests-788405257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-16823667-73ae-4d18-a49f-e73fdf80509c 1073741824 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:33:11 devstack sudo[109985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-16823667-73ae-4d18-a49f-e73fdf80509c 1073741824 Aug 05 06:33:11 devstack sudo[109985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:33:11 devstack sudo[109985]: pam_unix(sudo:session): session closed for user root Aug 05 06:33:11 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-f46bade3-9857-4592-9794-05e476ff3b2e tempest-ProjectReaderTests-788405257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-16823667-73ae-4d18-a49f-e73fdf80509c 1073741824" returned: 0 in 0.423s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:33:11 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-f46bade3-9857-4592-9794-05e476ff3b2e tempest-ProjectReaderTests-788405257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-16823667-73ae-4d18-a49f-e73fdf80509c {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:33:11 devstack sudo[109990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-16823667-73ae-4d18-a49f-e73fdf80509c Aug 05 06:33:11 devstack sudo[109990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:33:11 devstack sudo[109990]: pam_unix(sudo:session): session closed for user root Aug 05 06:33:11 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-f46bade3-9857-4592-9794-05e476ff3b2e tempest-ProjectReaderTests-788405257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-16823667-73ae-4d18-a49f-e73fdf80509c" returned: 0 in 0.254s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:33:11 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-f46bade3-9857-4592-9794-05e476ff3b2e tempest-ProjectReaderTests-788405257 None] <== create_volume: return (721ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'} {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 06:33:11 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-f46bade3-9857-4592-9794-05e476ff3b2e tempest-ProjectReaderTests-788405257 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.724s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:33:11 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-f46bade3-9857-4592-9794-05e476ff3b2e tempest-ProjectReaderTests-788405257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c46f8f83-66de-4dfa-9578-cb523074822a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16823667-73ae-4d18-a49f-e73fdf80509c', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:33:11 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-f46bade3-9857-4592-9794-05e476ff3b2e tempest-ProjectReaderTests-788405257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33ed7095-ef97-4ab7-a6af-b6334e05e77a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:33:11 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-f46bade3-9857-4592-9794-05e476ff3b2e tempest-ProjectReaderTests-788405257 None] Volume volume-16823667-73ae-4d18-a49f-e73fdf80509c (16823667-73ae-4d18-a49f-e73fdf80509c): created successfully Aug 05 06:33:11 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-f46bade3-9857-4592-9794-05e476ff3b2e tempest-ProjectReaderTests-788405257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33ed7095-ef97-4ab7-a6af-b6334e05e77a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:33:11 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-f46bade3-9857-4592-9794-05e476ff3b2e tempest-ProjectReaderTests-788405257 None] Flow 'volume_create_manager' (c59749de-64bd-45a9-9335-27f73590c177) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:33:11 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-f46bade3-9857-4592-9794-05e476ff3b2e tempest-ProjectReaderTests-788405257 None] Created volume successfully. Aug 05 06:33:12 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-c66fe680-b1d5-46fc-b782-7d77fd146b18 tempest-ProjectReaderTests-788405257 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:33:12 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-c66fe680-b1d5-46fc-b782-7d77fd146b18 tempest-ProjectReaderTests-788405257 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:33:12 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-c66fe680-b1d5-46fc-b782-7d77fd146b18 tempest-ProjectReaderTests-788405257 None] Creating offline snapshot 0f40ec00-db5c-41f6-b801-031735adda81 of volume 16823667-73ae-4d18-a49f-e73fdf80509c {{(pid=88695) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 06:33:12 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9461463-200e-4462-b71a-0a6dad9f0e0d]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:33:12 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-c66fe680-b1d5-46fc-b782-7d77fd146b18 tempest-ProjectReaderTests-788405257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-16823667-73ae-4d18-a49f-e73fdf80509c {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:33:12 devstack sudo[109993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-16823667-73ae-4d18-a49f-e73fdf80509c Aug 05 06:33:12 devstack sudo[109993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:33:12 devstack sudo[109993]: pam_unix(sudo:session): session closed for user root Aug 05 06:33:12 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-c66fe680-b1d5-46fc-b782-7d77fd146b18 tempest-ProjectReaderTests-788405257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-16823667-73ae-4d18-a49f-e73fdf80509c" returned: 0 in 0.365s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:33:12 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-c66fe680-b1d5-46fc-b782-7d77fd146b18 tempest-ProjectReaderTests-788405257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-16823667-73ae-4d18-a49f-e73fdf80509c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-16823667-73ae-4d18-a49f-e73fdf80509c.0f40ec00-db5c-41f6-b801-031735adda81 1G {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:33:12 devstack sudo[109998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-16823667-73ae-4d18-a49f-e73fdf80509c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-16823667-73ae-4d18-a49f-e73fdf80509c.0f40ec00-db5c-41f6-b801-031735adda81 1G Aug 05 06:33:12 devstack sudo[109998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:33:12 devstack sudo[109998]: pam_unix(sudo:session): session closed for user root Aug 05 06:33:12 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-c66fe680-b1d5-46fc-b782-7d77fd146b18 tempest-ProjectReaderTests-788405257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-16823667-73ae-4d18-a49f-e73fdf80509c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-16823667-73ae-4d18-a49f-e73fdf80509c.0f40ec00-db5c-41f6-b801-031735adda81 1G" returned: 0 in 0.412s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:33:12 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-c66fe680-b1d5-46fc-b782-7d77fd146b18 tempest-ProjectReaderTests-788405257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-16823667-73ae-4d18-a49f-e73fdf80509c -F qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-16823667-73ae-4d18-a49f-e73fdf80509c.0f40ec00-db5c-41f6-b801-031735adda81 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:33:13 devstack sudo[110003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-16823667-73ae-4d18-a49f-e73fdf80509c -F qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-16823667-73ae-4d18-a49f-e73fdf80509c.0f40ec00-db5c-41f6-b801-031735adda81 Aug 05 06:33:13 devstack sudo[110003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:33:13 devstack sudo[110003]: pam_unix(sudo:session): session closed for user root Aug 05 06:33:13 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-c66fe680-b1d5-46fc-b782-7d77fd146b18 tempest-ProjectReaderTests-788405257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-16823667-73ae-4d18-a49f-e73fdf80509c -F qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-16823667-73ae-4d18-a49f-e73fdf80509c.0f40ec00-db5c-41f6-b801-031735adda81" returned: 0 in 0.278s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:33:13 devstack cinder-volume[88695]: WARNING cinder.volume.drivers.remotefs [None req-c66fe680-b1d5-46fc-b782-7d77fd146b18 tempest-ProjectReaderTests-788405257 None] /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-16823667-73ae-4d18-a49f-e73fdf80509c.0f40ec00-db5c-41f6-b801-031735adda81 is being set with open permissions: ugo+rw Aug 05 06:33:13 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-c66fe680-b1d5-46fc-b782-7d77fd146b18 tempest-ProjectReaderTests-788405257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-16823667-73ae-4d18-a49f-e73fdf80509c.0f40ec00-db5c-41f6-b801-031735adda81 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:33:13 devstack sudo[110008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-16823667-73ae-4d18-a49f-e73fdf80509c.0f40ec00-db5c-41f6-b801-031735adda81 Aug 05 06:33:13 devstack sudo[110008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:33:13 devstack sudo[110008]: pam_unix(sudo:session): session closed for user root Aug 05 06:33:13 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-c66fe680-b1d5-46fc-b782-7d77fd146b18 tempest-ProjectReaderTests-788405257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-16823667-73ae-4d18-a49f-e73fdf80509c.0f40ec00-db5c-41f6-b801-031735adda81" returned: 0 in 0.242s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:33:13 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-c66fe680-b1d5-46fc-b782-7d77fd146b18 tempest-ProjectReaderTests-788405257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-16823667-73ae-4d18-a49f-e73fdf80509c.info {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:33:13 devstack sudo[110011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-16823667-73ae-4d18-a49f-e73fdf80509c.info Aug 05 06:33:13 devstack sudo[110011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:33:13 devstack sudo[110011]: pam_unix(sudo:session): session closed for user root Aug 05 06:33:13 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-c66fe680-b1d5-46fc-b782-7d77fd146b18 tempest-ProjectReaderTests-788405257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-16823667-73ae-4d18-a49f-e73fdf80509c.info" returned: 0 in 0.269s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:33:13 devstack cinder-volume[88695]: WARNING cinder.volume.drivers.remotefs [None req-c66fe680-b1d5-46fc-b782-7d77fd146b18 tempest-ProjectReaderTests-788405257 None] /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-16823667-73ae-4d18-a49f-e73fdf80509c.info is being set with open permissions: ugo+rw Aug 05 06:33:13 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-c66fe680-b1d5-46fc-b782-7d77fd146b18 tempest-ProjectReaderTests-788405257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-16823667-73ae-4d18-a49f-e73fdf80509c.info {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:33:13 devstack sudo[110014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-16823667-73ae-4d18-a49f-e73fdf80509c.info Aug 05 06:33:13 devstack sudo[110014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:33:14 devstack sudo[110014]: pam_unix(sudo:session): session closed for user root Aug 05 06:33:14 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-c66fe680-b1d5-46fc-b782-7d77fd146b18 tempest-ProjectReaderTests-788405257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-16823667-73ae-4d18-a49f-e73fdf80509c.info" returned: 0 in 0.232s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:33:14 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-c66fe680-b1d5-46fc-b782-7d77fd146b18 tempest-ProjectReaderTests-788405257 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.882s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:33:14 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-c66fe680-b1d5-46fc-b782-7d77fd146b18 tempest-ProjectReaderTests-788405257 None] Create snapshot completed successfully Aug 05 06:33:14 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-27a80942-d2be-43a1-b26f-a9a549ef3b25 tempest-ProjectReaderTests-788405257 None] Acquiring lock "cinder-0f40ec00-db5c-41f6-b801-031735adda81-delete_snapshot" by "delete_snapshot" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:33:14 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-27a80942-d2be-43a1-b26f-a9a549ef3b25 tempest-ProjectReaderTests-788405257 None] Lock "cinder-0f40ec00-db5c-41f6-b801-031735adda81-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:33:14 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-27a80942-d2be-43a1-b26f-a9a549ef3b25 tempest-ProjectReaderTests-788405257 None] Acquiring lock "cinder-quobyte-16823667-73ae-4d18-a49f-e73fdf80509c" by "delete_snapshot" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:33:14 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-27a80942-d2be-43a1-b26f-a9a549ef3b25 tempest-ProjectReaderTests-788405257 None] Lock "cinder-quobyte-16823667-73ae-4d18-a49f-e73fdf80509c" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:33:14 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-27a80942-d2be-43a1-b26f-a9a549ef3b25 tempest-ProjectReaderTests-788405257 None] Acquiring lock "cinder-quobyte-0f40ec00-db5c-41f6-b801-031735adda81" by "_delete_snapshot" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:33:14 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-27a80942-d2be-43a1-b26f-a9a549ef3b25 tempest-ProjectReaderTests-788405257 None] Lock "cinder-quobyte-0f40ec00-db5c-41f6-b801-031735adda81" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:33:14 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-27a80942-d2be-43a1-b26f-a9a549ef3b25 tempest-ProjectReaderTests-788405257 None] Deleting offline snapshot 0f40ec00-db5c-41f6-b801-031735adda81 of volume 16823667-73ae-4d18-a49f-e73fdf80509c {{(pid=88695) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 06:33:14 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-27a80942-d2be-43a1-b26f-a9a549ef3b25 tempest-ProjectReaderTests-788405257 None] snapshot_file for this snap is: volume-16823667-73ae-4d18-a49f-e73fdf80509c.0f40ec00-db5c-41f6-b801-031735adda81 {{(pid=88695) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 06:33:14 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[0df92c2d-dbdc-4f31-a4ef-ced8800bfee2]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:33:14 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-27a80942-d2be-43a1-b26f-a9a549ef3b25 tempest-ProjectReaderTests-788405257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-16823667-73ae-4d18-a49f-e73fdf80509c.0f40ec00-db5c-41f6-b801-031735adda81 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:33:14 devstack sudo[110017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-16823667-73ae-4d18-a49f-e73fdf80509c.0f40ec00-db5c-41f6-b801-031735adda81 Aug 05 06:33:14 devstack sudo[110017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:33:14 devstack sudo[110017]: pam_unix(sudo:session): session closed for user root Aug 05 06:33:14 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-27a80942-d2be-43a1-b26f-a9a549ef3b25 tempest-ProjectReaderTests-788405257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-16823667-73ae-4d18-a49f-e73fdf80509c.0f40ec00-db5c-41f6-b801-031735adda81" returned: 0 in 0.341s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:33:14 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-27a80942-d2be-43a1-b26f-a9a549ef3b25 tempest-ProjectReaderTests-788405257 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-16823667-73ae-4d18-a49f-e73fdf80509c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88695) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 06:33:14 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f663237-b624-471c-b3c9-173da1f874eb]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:33:14 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-27a80942-d2be-43a1-b26f-a9a549ef3b25 tempest-ProjectReaderTests-788405257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-16823667-73ae-4d18-a49f-e73fdf80509c {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:33:14 devstack sudo[110022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-16823667-73ae-4d18-a49f-e73fdf80509c Aug 05 06:33:14 devstack sudo[110022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:33:15 devstack sudo[110022]: pam_unix(sudo:session): session closed for user root Aug 05 06:33:15 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-27a80942-d2be-43a1-b26f-a9a549ef3b25 tempest-ProjectReaderTests-788405257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-16823667-73ae-4d18-a49f-e73fdf80509c" returned: 0 in 0.350s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:33:15 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-27a80942-d2be-43a1-b26f-a9a549ef3b25 tempest-ProjectReaderTests-788405257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-16823667-73ae-4d18-a49f-e73fdf80509c.0f40ec00-db5c-41f6-b801-031735adda81 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:33:15 devstack sudo[110027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-16823667-73ae-4d18-a49f-e73fdf80509c.0f40ec00-db5c-41f6-b801-031735adda81 Aug 05 06:33:15 devstack sudo[110027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:33:15 devstack sudo[110027]: pam_unix(sudo:session): session closed for user root Aug 05 06:33:15 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-27a80942-d2be-43a1-b26f-a9a549ef3b25 tempest-ProjectReaderTests-788405257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-16823667-73ae-4d18-a49f-e73fdf80509c.0f40ec00-db5c-41f6-b801-031735adda81" returned: 0 in 0.308s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:33:15 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-27a80942-d2be-43a1-b26f-a9a549ef3b25 tempest-ProjectReaderTests-788405257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-16823667-73ae-4d18-a49f-e73fdf80509c.0f40ec00-db5c-41f6-b801-031735adda81 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:33:15 devstack sudo[110033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-16823667-73ae-4d18-a49f-e73fdf80509c.0f40ec00-db5c-41f6-b801-031735adda81 Aug 05 06:33:15 devstack sudo[110033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:33:15 devstack sudo[110033]: pam_unix(sudo:session): session closed for user root Aug 05 06:33:15 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-27a80942-d2be-43a1-b26f-a9a549ef3b25 tempest-ProjectReaderTests-788405257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-16823667-73ae-4d18-a49f-e73fdf80509c.0f40ec00-db5c-41f6-b801-031735adda81" returned: 0 in 0.241s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:33:15 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-27a80942-d2be-43a1-b26f-a9a549ef3b25 tempest-ProjectReaderTests-788405257 None] Lock "cinder-quobyte-0f40ec00-db5c-41f6-b801-031735adda81" released by "_delete_snapshot" :: held 1.322s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:33:15 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-27a80942-d2be-43a1-b26f-a9a549ef3b25 tempest-ProjectReaderTests-788405257 None] Lock "cinder-quobyte-16823667-73ae-4d18-a49f-e73fdf80509c" released by "delete_snapshot" :: held 1.346s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:33:15 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-27a80942-d2be-43a1-b26f-a9a549ef3b25 tempest-ProjectReaderTests-788405257 None] Created reservations ['919b2bbb-c7e3-481d-9bba-98a4b387df27', '816276bb-32c3-4618-affb-96eb4c9af636', '0086e66c-3eeb-430f-b12a-352eae613925', '857e1abb-170f-4443-a6d2-03275e4f0c80'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:33:15 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-27a80942-d2be-43a1-b26f-a9a549ef3b25 tempest-ProjectReaderTests-788405257 None] Delete snapshot completed successfully. Aug 05 06:33:15 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-27a80942-d2be-43a1-b26f-a9a549ef3b25 tempest-ProjectReaderTests-788405257 None] Lock "cinder-0f40ec00-db5c-41f6-b801-031735adda81-delete_snapshot" released by "delete_snapshot" :: held 1.477s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:33:16 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-d1874eca-a43e-405e-bd63-fcdf40f11819 tempest-ProjectReaderTests-788405257 None] Acquiring lock "cinder-16823667-73ae-4d18-a49f-e73fdf80509c-delete_volume" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:33:16 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-d1874eca-a43e-405e-bd63-fcdf40f11819 tempest-ProjectReaderTests-788405257 None] Lock "cinder-16823667-73ae-4d18-a49f-e73fdf80509c-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:33:16 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-d1874eca-a43e-405e-bd63-fcdf40f11819 tempest-ProjectReaderTests-788405257 None] Acquiring lock "cinder-quobyte-16823667-73ae-4d18-a49f-e73fdf80509c" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:33:16 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-d1874eca-a43e-405e-bd63-fcdf40f11819 tempest-ProjectReaderTests-788405257 None] Lock "cinder-quobyte-16823667-73ae-4d18-a49f-e73fdf80509c" acquired by "delete_volume" :: waited 0.015s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:33:16 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d36b48b-ff76-4b25-bb52-8a9eab4e45ed]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:33:16 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-d1874eca-a43e-405e-bd63-fcdf40f11819 tempest-ProjectReaderTests-788405257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-16823667-73ae-4d18-a49f-e73fdf80509c {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:33:16 devstack sudo[110036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-16823667-73ae-4d18-a49f-e73fdf80509c Aug 05 06:33:16 devstack sudo[110036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:33:16 devstack sudo[110036]: pam_unix(sudo:session): session closed for user root Aug 05 06:33:16 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-d1874eca-a43e-405e-bd63-fcdf40f11819 tempest-ProjectReaderTests-788405257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-16823667-73ae-4d18-a49f-e73fdf80509c" returned: 0 in 0.372s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:33:16 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-d1874eca-a43e-405e-bd63-fcdf40f11819 tempest-ProjectReaderTests-788405257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-16823667-73ae-4d18-a49f-e73fdf80509c {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:33:16 devstack sudo[110041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-16823667-73ae-4d18-a49f-e73fdf80509c Aug 05 06:33:16 devstack sudo[110041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:33:17 devstack sudo[110041]: pam_unix(sudo:session): session closed for user root Aug 05 06:33:17 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-d1874eca-a43e-405e-bd63-fcdf40f11819 tempest-ProjectReaderTests-788405257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-16823667-73ae-4d18-a49f-e73fdf80509c" returned: 0 in 0.240s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:33:17 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-d1874eca-a43e-405e-bd63-fcdf40f11819 tempest-ProjectReaderTests-788405257 None] Lock "cinder-quobyte-16823667-73ae-4d18-a49f-e73fdf80509c" released by "delete_volume" :: held 0.669s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:33:17 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-d1874eca-a43e-405e-bd63-fcdf40f11819 tempest-ProjectReaderTests-788405257 None] Created reservations ['503cde5d-de14-4b69-9a4b-85a5edb98f12', '0df8d899-586d-4e63-a3cb-5a4379caaa85', '8f096b59-4499-4689-a09d-ea29eb134941', 'a79cbc7b-6b3c-47f2-a954-ff61ec67d88c'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:33:17 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-d1874eca-a43e-405e-bd63-fcdf40f11819 tempest-ProjectReaderTests-788405257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:33:17 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-d1874eca-a43e-405e-bd63-fcdf40f11819 tempest-ProjectReaderTests-788405257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:33:17 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-d1874eca-a43e-405e-bd63-fcdf40f11819 tempest-ProjectReaderTests-788405257 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:33:17 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-d1874eca-a43e-405e-bd63-fcdf40f11819 tempest-ProjectReaderTests-788405257 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:33:17 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-d1874eca-a43e-405e-bd63-fcdf40f11819 tempest-ProjectReaderTests-788405257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:33:17 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-d1874eca-a43e-405e-bd63-fcdf40f11819 tempest-ProjectReaderTests-788405257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:33:17 devstack sudo[110044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce Aug 05 06:33:17 devstack sudo[110044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:33:17 devstack sudo[110044]: pam_unix(sudo:session): session closed for user root Aug 05 06:33:17 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-d1874eca-a43e-405e-bd63-fcdf40f11819 tempest-ProjectReaderTests-788405257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce" returned: 0 in 0.250s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:33:17 devstack cinder-volume[88695]: DEBUG cinder.manager [None req-d1874eca-a43e-405e-bd63-fcdf40f11819 tempest-ProjectReaderTests-788405257 None] Notifying Schedulers of capabilities ... {{(pid=88695) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 06:33:17 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-d1874eca-a43e-405e-bd63-fcdf40f11819 tempest-ProjectReaderTests-788405257 None] Deleted volume successfully. Aug 05 06:33:17 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-d1874eca-a43e-405e-bd63-fcdf40f11819 tempest-ProjectReaderTests-788405257 None] Lock "cinder-16823667-73ae-4d18-a49f-e73fdf80509c-delete_volume" released by "delete_volume" :: held 1.117s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:33:18 devstack cinder-volume[88695]: DEBUG cinder.volume.flows.manager.create_volume [None req-114f3f14-3316-428a-9f05-e617fee1685e tempest-ProjectReaderTests-788405257 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88695) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 06:33:18 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-114f3f14-3316-428a-9f05-e617fee1685e tempest-ProjectReaderTests-788405257 None] Flow 'volume_create_manager' (1c3e2812-aa1b-4074-bdc1-2bd831255f3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:33:18 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-114f3f14-3316-428a-9f05-e617fee1685e tempest-ProjectReaderTests-788405257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce6a0b76-8822-4643-8515-a48bdd90a60d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:33:18 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-114f3f14-3316-428a-9f05-e617fee1685e tempest-ProjectReaderTests-788405257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce6a0b76-8822-4643-8515-a48bdd90a60d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:33:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1424990802',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36bbed4c-5938-4154-b995-6e505d8bb40a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95ec897d23f64c4aa28c9f99de062aee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:33:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:33:18Z,use_quota=True,user_id='97d0bbdbc29b47d08c8978b94311d171',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:33:18 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-114f3f14-3316-428a-9f05-e617fee1685e tempest-ProjectReaderTests-788405257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa29d3a3-c1c0-4442-8373-084fa88d5f3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:33:18 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-114f3f14-3316-428a-9f05-e617fee1685e tempest-ProjectReaderTests-788405257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa29d3a3-c1c0-4442-8373-084fa88d5f3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:33:18 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-114f3f14-3316-428a-9f05-e617fee1685e tempest-ProjectReaderTests-788405257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a5931a8-4bfe-4151-9e5d-1d5e4b9e2b59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:33:18 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-114f3f14-3316-428a-9f05-e617fee1685e tempest-ProjectReaderTests-788405257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a5931a8-4bfe-4151-9e5d-1d5e4b9e2b59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36bbed4c-5938-4154-b995-6e505d8bb40a', 'volume_name': 'volume-36bbed4c-5938-4154-b995-6e505d8bb40a', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:33:18 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-114f3f14-3316-428a-9f05-e617fee1685e tempest-ProjectReaderTests-788405257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33c7f8ac-db28-4987-a203-9a007e71fe81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:33:18 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-114f3f14-3316-428a-9f05-e617fee1685e tempest-ProjectReaderTests-788405257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33c7f8ac-db28-4987-a203-9a007e71fe81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:33:18 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-114f3f14-3316-428a-9f05-e617fee1685e tempest-ProjectReaderTests-788405257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e6a932f-3d5b-4782-b0ba-6161a627c860) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:33:18 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-114f3f14-3316-428a-9f05-e617fee1685e tempest-ProjectReaderTests-788405257 None] Volume 36bbed4c-5938-4154-b995-6e505d8bb40a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36bbed4c-5938-4154-b995-6e505d8bb40a', 'volume_size': 1} Aug 05 06:33:18 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-114f3f14-3316-428a-9f05-e617fee1685e tempest-ProjectReaderTests-788405257 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:33:18 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-114f3f14-3316-428a-9f05-e617fee1685e tempest-ProjectReaderTests-788405257 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:33:18 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-114f3f14-3316-428a-9f05-e617fee1685e tempest-ProjectReaderTests-788405257 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:33:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1424990802',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36bbed4c-5938-4154-b995-6e505d8bb40a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95ec897d23f64c4aa28c9f99de062aee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:33:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:33:18Z,use_quota=True,user_id='97d0bbdbc29b47d08c8978b94311d171',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)}" {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 06:33:18 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-114f3f14-3316-428a-9f05-e617fee1685e tempest-ProjectReaderTests-788405257 None] Creating volume 36bbed4c-5938-4154-b995-6e505d8bb40a {{(pid=88695) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 06:33:18 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-114f3f14-3316-428a-9f05-e617fee1685e tempest-ProjectReaderTests-788405257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:33:18 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-114f3f14-3316-428a-9f05-e617fee1685e tempest-ProjectReaderTests-788405257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:33:18 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-114f3f14-3316-428a-9f05-e617fee1685e tempest-ProjectReaderTests-788405257 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:33:18 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-114f3f14-3316-428a-9f05-e617fee1685e tempest-ProjectReaderTests-788405257 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:33:18 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-114f3f14-3316-428a-9f05-e617fee1685e tempest-ProjectReaderTests-788405257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:33:18 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-114f3f14-3316-428a-9f05-e617fee1685e tempest-ProjectReaderTests-788405257 None] Selected osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 as target Quobyte volume. {{(pid=88695) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 06:33:18 devstack cinder-volume[88695]: INFO cinder.volume.drivers.remotefs [None req-114f3f14-3316-428a-9f05-e617fee1685e tempest-ProjectReaderTests-788405257 None] casted to osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 Aug 05 06:33:18 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-114f3f14-3316-428a-9f05-e617fee1685e tempest-ProjectReaderTests-788405257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-36bbed4c-5938-4154-b995-6e505d8bb40a 1073741824 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:33:18 devstack sudo[110047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-36bbed4c-5938-4154-b995-6e505d8bb40a 1073741824 Aug 05 06:33:18 devstack sudo[110047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:33:18 devstack sudo[110047]: pam_unix(sudo:session): session closed for user root Aug 05 06:33:18 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-114f3f14-3316-428a-9f05-e617fee1685e tempest-ProjectReaderTests-788405257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-36bbed4c-5938-4154-b995-6e505d8bb40a 1073741824" returned: 0 in 0.429s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:33:18 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-114f3f14-3316-428a-9f05-e617fee1685e tempest-ProjectReaderTests-788405257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-36bbed4c-5938-4154-b995-6e505d8bb40a {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:33:18 devstack sudo[110053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-36bbed4c-5938-4154-b995-6e505d8bb40a Aug 05 06:33:18 devstack sudo[110053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:33:18 devstack sudo[110053]: pam_unix(sudo:session): session closed for user root Aug 05 06:33:18 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-114f3f14-3316-428a-9f05-e617fee1685e tempest-ProjectReaderTests-788405257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-36bbed4c-5938-4154-b995-6e505d8bb40a" returned: 0 in 0.241s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:33:18 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-114f3f14-3316-428a-9f05-e617fee1685e tempest-ProjectReaderTests-788405257 None] <== create_volume: return (712ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'} {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 06:33:18 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-114f3f14-3316-428a-9f05-e617fee1685e tempest-ProjectReaderTests-788405257 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.714s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:33:18 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-114f3f14-3316-428a-9f05-e617fee1685e tempest-ProjectReaderTests-788405257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e6a932f-3d5b-4782-b0ba-6161a627c860) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36bbed4c-5938-4154-b995-6e505d8bb40a', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:33:18 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-114f3f14-3316-428a-9f05-e617fee1685e tempest-ProjectReaderTests-788405257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37d749a3-f7c1-4746-89c7-d8006b11f57b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:33:18 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-114f3f14-3316-428a-9f05-e617fee1685e tempest-ProjectReaderTests-788405257 None] Volume volume-36bbed4c-5938-4154-b995-6e505d8bb40a (36bbed4c-5938-4154-b995-6e505d8bb40a): created successfully Aug 05 06:33:18 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-114f3f14-3316-428a-9f05-e617fee1685e tempest-ProjectReaderTests-788405257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37d749a3-f7c1-4746-89c7-d8006b11f57b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:33:18 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-114f3f14-3316-428a-9f05-e617fee1685e tempest-ProjectReaderTests-788405257 None] Flow 'volume_create_manager' (1c3e2812-aa1b-4074-bdc1-2bd831255f3b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:33:18 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-114f3f14-3316-428a-9f05-e617fee1685e tempest-ProjectReaderTests-788405257 None] Created volume successfully. Aug 05 06:33:19 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-a2d05110-92b4-4de0-8ee4-eadbad3d40fd tempest-ProjectReaderTests-788405257 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:33:19 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-a2d05110-92b4-4de0-8ee4-eadbad3d40fd tempest-ProjectReaderTests-788405257 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:33:19 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-a2d05110-92b4-4de0-8ee4-eadbad3d40fd tempest-ProjectReaderTests-788405257 None] Creating offline snapshot 6d55a213-48ac-4709-812d-6c013bb6d087 of volume 36bbed4c-5938-4154-b995-6e505d8bb40a {{(pid=88695) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 06:33:19 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[06041ff1-adb1-427b-98d5-45215de8280a]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:33:19 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-a2d05110-92b4-4de0-8ee4-eadbad3d40fd tempest-ProjectReaderTests-788405257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-36bbed4c-5938-4154-b995-6e505d8bb40a {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:33:19 devstack sudo[110056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-36bbed4c-5938-4154-b995-6e505d8bb40a Aug 05 06:33:19 devstack sudo[110056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:33:19 devstack sudo[110056]: pam_unix(sudo:session): session closed for user root Aug 05 06:33:19 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-a2d05110-92b4-4de0-8ee4-eadbad3d40fd tempest-ProjectReaderTests-788405257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-36bbed4c-5938-4154-b995-6e505d8bb40a" returned: 0 in 0.381s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:33:19 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-a2d05110-92b4-4de0-8ee4-eadbad3d40fd tempest-ProjectReaderTests-788405257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-36bbed4c-5938-4154-b995-6e505d8bb40a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-36bbed4c-5938-4154-b995-6e505d8bb40a.6d55a213-48ac-4709-812d-6c013bb6d087 1G {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:33:19 devstack sudo[110061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-36bbed4c-5938-4154-b995-6e505d8bb40a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-36bbed4c-5938-4154-b995-6e505d8bb40a.6d55a213-48ac-4709-812d-6c013bb6d087 1G Aug 05 06:33:19 devstack sudo[110061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:33:20 devstack sudo[110061]: pam_unix(sudo:session): session closed for user root Aug 05 06:33:20 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-a2d05110-92b4-4de0-8ee4-eadbad3d40fd tempest-ProjectReaderTests-788405257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-36bbed4c-5938-4154-b995-6e505d8bb40a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-36bbed4c-5938-4154-b995-6e505d8bb40a.6d55a213-48ac-4709-812d-6c013bb6d087 1G" returned: 0 in 0.394s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:33:20 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-a2d05110-92b4-4de0-8ee4-eadbad3d40fd tempest-ProjectReaderTests-788405257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36bbed4c-5938-4154-b995-6e505d8bb40a -F qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-36bbed4c-5938-4154-b995-6e505d8bb40a.6d55a213-48ac-4709-812d-6c013bb6d087 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:33:20 devstack sudo[110066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36bbed4c-5938-4154-b995-6e505d8bb40a -F qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-36bbed4c-5938-4154-b995-6e505d8bb40a.6d55a213-48ac-4709-812d-6c013bb6d087 Aug 05 06:33:20 devstack sudo[110066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:33:20 devstack sudo[110066]: pam_unix(sudo:session): session closed for user root Aug 05 06:33:20 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-a2d05110-92b4-4de0-8ee4-eadbad3d40fd tempest-ProjectReaderTests-788405257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36bbed4c-5938-4154-b995-6e505d8bb40a -F qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-36bbed4c-5938-4154-b995-6e505d8bb40a.6d55a213-48ac-4709-812d-6c013bb6d087" returned: 0 in 0.307s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:33:20 devstack cinder-volume[88695]: WARNING cinder.volume.drivers.remotefs [None req-a2d05110-92b4-4de0-8ee4-eadbad3d40fd tempest-ProjectReaderTests-788405257 None] /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-36bbed4c-5938-4154-b995-6e505d8bb40a.6d55a213-48ac-4709-812d-6c013bb6d087 is being set with open permissions: ugo+rw Aug 05 06:33:20 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-a2d05110-92b4-4de0-8ee4-eadbad3d40fd tempest-ProjectReaderTests-788405257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-36bbed4c-5938-4154-b995-6e505d8bb40a.6d55a213-48ac-4709-812d-6c013bb6d087 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:33:20 devstack sudo[110071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-36bbed4c-5938-4154-b995-6e505d8bb40a.6d55a213-48ac-4709-812d-6c013bb6d087 Aug 05 06:33:20 devstack sudo[110071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:33:20 devstack sudo[110071]: pam_unix(sudo:session): session closed for user root Aug 05 06:33:20 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-a2d05110-92b4-4de0-8ee4-eadbad3d40fd tempest-ProjectReaderTests-788405257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-36bbed4c-5938-4154-b995-6e505d8bb40a.6d55a213-48ac-4709-812d-6c013bb6d087" returned: 0 in 0.241s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:33:20 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-a2d05110-92b4-4de0-8ee4-eadbad3d40fd tempest-ProjectReaderTests-788405257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-36bbed4c-5938-4154-b995-6e505d8bb40a.info {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:33:20 devstack sudo[110074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-36bbed4c-5938-4154-b995-6e505d8bb40a.info Aug 05 06:33:20 devstack sudo[110074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:33:20 devstack sudo[110074]: pam_unix(sudo:session): session closed for user root Aug 05 06:33:20 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-a2d05110-92b4-4de0-8ee4-eadbad3d40fd tempest-ProjectReaderTests-788405257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-36bbed4c-5938-4154-b995-6e505d8bb40a.info" returned: 0 in 0.241s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:33:20 devstack cinder-volume[88695]: WARNING cinder.volume.drivers.remotefs [None req-a2d05110-92b4-4de0-8ee4-eadbad3d40fd tempest-ProjectReaderTests-788405257 None] /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-36bbed4c-5938-4154-b995-6e505d8bb40a.info is being set with open permissions: ugo+rw Aug 05 06:33:20 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-a2d05110-92b4-4de0-8ee4-eadbad3d40fd tempest-ProjectReaderTests-788405257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-36bbed4c-5938-4154-b995-6e505d8bb40a.info {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:33:20 devstack sudo[110077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-36bbed4c-5938-4154-b995-6e505d8bb40a.info Aug 05 06:33:20 devstack sudo[110077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:33:21 devstack sudo[110077]: pam_unix(sudo:session): session closed for user root Aug 05 06:33:21 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-a2d05110-92b4-4de0-8ee4-eadbad3d40fd tempest-ProjectReaderTests-788405257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-36bbed4c-5938-4154-b995-6e505d8bb40a.info" returned: 0 in 0.232s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:33:21 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-a2d05110-92b4-4de0-8ee4-eadbad3d40fd tempest-ProjectReaderTests-788405257 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.877s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:33:21 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-a2d05110-92b4-4de0-8ee4-eadbad3d40fd tempest-ProjectReaderTests-788405257 None] Create snapshot completed successfully Aug 05 06:33:21 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-147b5dac-89f5-4881-9c33-089a510e28a8 tempest-ProjectReaderTests-788405257 None] Acquiring lock "cinder-6d55a213-48ac-4709-812d-6c013bb6d087-delete_snapshot" by "delete_snapshot" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:33:21 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-147b5dac-89f5-4881-9c33-089a510e28a8 tempest-ProjectReaderTests-788405257 None] Lock "cinder-6d55a213-48ac-4709-812d-6c013bb6d087-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:33:21 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-147b5dac-89f5-4881-9c33-089a510e28a8 tempest-ProjectReaderTests-788405257 None] Acquiring lock "cinder-quobyte-36bbed4c-5938-4154-b995-6e505d8bb40a" by "delete_snapshot" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:33:21 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-147b5dac-89f5-4881-9c33-089a510e28a8 tempest-ProjectReaderTests-788405257 None] Lock "cinder-quobyte-36bbed4c-5938-4154-b995-6e505d8bb40a" acquired by "delete_snapshot" :: waited 0.014s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:33:21 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-147b5dac-89f5-4881-9c33-089a510e28a8 tempest-ProjectReaderTests-788405257 None] Acquiring lock "cinder-quobyte-6d55a213-48ac-4709-812d-6c013bb6d087" by "_delete_snapshot" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:33:21 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-147b5dac-89f5-4881-9c33-089a510e28a8 tempest-ProjectReaderTests-788405257 None] Lock "cinder-quobyte-6d55a213-48ac-4709-812d-6c013bb6d087" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:33:21 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-147b5dac-89f5-4881-9c33-089a510e28a8 tempest-ProjectReaderTests-788405257 None] Deleting offline snapshot 6d55a213-48ac-4709-812d-6c013bb6d087 of volume 36bbed4c-5938-4154-b995-6e505d8bb40a {{(pid=88695) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 06:33:21 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-147b5dac-89f5-4881-9c33-089a510e28a8 tempest-ProjectReaderTests-788405257 None] snapshot_file for this snap is: volume-36bbed4c-5938-4154-b995-6e505d8bb40a.6d55a213-48ac-4709-812d-6c013bb6d087 {{(pid=88695) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 06:33:21 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[d14530ff-aab9-475d-bcca-0ea2a68ef7ff]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:33:21 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-147b5dac-89f5-4881-9c33-089a510e28a8 tempest-ProjectReaderTests-788405257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-36bbed4c-5938-4154-b995-6e505d8bb40a.6d55a213-48ac-4709-812d-6c013bb6d087 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:33:21 devstack sudo[110080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-36bbed4c-5938-4154-b995-6e505d8bb40a.6d55a213-48ac-4709-812d-6c013bb6d087 Aug 05 06:33:21 devstack sudo[110080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:33:21 devstack sudo[110080]: pam_unix(sudo:session): session closed for user root Aug 05 06:33:21 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-147b5dac-89f5-4881-9c33-089a510e28a8 tempest-ProjectReaderTests-788405257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-36bbed4c-5938-4154-b995-6e505d8bb40a.6d55a213-48ac-4709-812d-6c013bb6d087" returned: 0 in 0.340s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:33:21 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-147b5dac-89f5-4881-9c33-089a510e28a8 tempest-ProjectReaderTests-788405257 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-36bbed4c-5938-4154-b995-6e505d8bb40a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88695) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 06:33:21 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[cde13bc9-6d29-4f2e-bba2-65097bb88f15]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:33:21 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-147b5dac-89f5-4881-9c33-089a510e28a8 tempest-ProjectReaderTests-788405257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-36bbed4c-5938-4154-b995-6e505d8bb40a {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:33:21 devstack sudo[110085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-36bbed4c-5938-4154-b995-6e505d8bb40a Aug 05 06:33:21 devstack sudo[110085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:33:22 devstack sudo[110085]: pam_unix(sudo:session): session closed for user root Aug 05 06:33:22 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-147b5dac-89f5-4881-9c33-089a510e28a8 tempest-ProjectReaderTests-788405257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-36bbed4c-5938-4154-b995-6e505d8bb40a" returned: 0 in 0.344s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:33:22 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-147b5dac-89f5-4881-9c33-089a510e28a8 tempest-ProjectReaderTests-788405257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-36bbed4c-5938-4154-b995-6e505d8bb40a.6d55a213-48ac-4709-812d-6c013bb6d087 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:33:22 devstack sudo[110090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-36bbed4c-5938-4154-b995-6e505d8bb40a.6d55a213-48ac-4709-812d-6c013bb6d087 Aug 05 06:33:22 devstack sudo[110090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:33:22 devstack sudo[110090]: pam_unix(sudo:session): session closed for user root Aug 05 06:33:22 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-147b5dac-89f5-4881-9c33-089a510e28a8 tempest-ProjectReaderTests-788405257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-36bbed4c-5938-4154-b995-6e505d8bb40a.6d55a213-48ac-4709-812d-6c013bb6d087" returned: 0 in 0.321s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:33:22 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-147b5dac-89f5-4881-9c33-089a510e28a8 tempest-ProjectReaderTests-788405257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-36bbed4c-5938-4154-b995-6e505d8bb40a.6d55a213-48ac-4709-812d-6c013bb6d087 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:33:22 devstack sudo[110096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-36bbed4c-5938-4154-b995-6e505d8bb40a.6d55a213-48ac-4709-812d-6c013bb6d087 Aug 05 06:33:22 devstack sudo[110096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:33:22 devstack sudo[110096]: pam_unix(sudo:session): session closed for user root Aug 05 06:33:22 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-147b5dac-89f5-4881-9c33-089a510e28a8 tempest-ProjectReaderTests-788405257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-36bbed4c-5938-4154-b995-6e505d8bb40a.6d55a213-48ac-4709-812d-6c013bb6d087" returned: 0 in 0.254s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:33:22 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-147b5dac-89f5-4881-9c33-089a510e28a8 tempest-ProjectReaderTests-788405257 None] Lock "cinder-quobyte-6d55a213-48ac-4709-812d-6c013bb6d087" released by "_delete_snapshot" :: held 1.347s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:33:22 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-147b5dac-89f5-4881-9c33-089a510e28a8 tempest-ProjectReaderTests-788405257 None] Lock "cinder-quobyte-36bbed4c-5938-4154-b995-6e505d8bb40a" released by "delete_snapshot" :: held 1.373s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:33:22 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-147b5dac-89f5-4881-9c33-089a510e28a8 tempest-ProjectReaderTests-788405257 None] Created reservations ['c3527715-5e8a-468d-b80d-f7ddb1069960', 'a699665c-b890-4d24-bc6d-85e9a2ea0d63', '36d3a60e-5eb2-41e9-84b5-6e5f44dbe507', 'f1ceae36-6344-4e98-87c3-3061493bd884'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:33:22 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-147b5dac-89f5-4881-9c33-089a510e28a8 tempest-ProjectReaderTests-788405257 None] Delete snapshot completed successfully. Aug 05 06:33:22 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-147b5dac-89f5-4881-9c33-089a510e28a8 tempest-ProjectReaderTests-788405257 None] Lock "cinder-6d55a213-48ac-4709-812d-6c013bb6d087-delete_snapshot" released by "delete_snapshot" :: held 1.514s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:33:23 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-7d76af15-393e-4c1c-99ea-6a96e1405f33 tempest-ProjectReaderTests-788405257 None] Acquiring lock "cinder-36bbed4c-5938-4154-b995-6e505d8bb40a-delete_volume" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:33:23 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-7d76af15-393e-4c1c-99ea-6a96e1405f33 tempest-ProjectReaderTests-788405257 None] Lock "cinder-36bbed4c-5938-4154-b995-6e505d8bb40a-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:33:23 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-7d76af15-393e-4c1c-99ea-6a96e1405f33 tempest-ProjectReaderTests-788405257 None] Acquiring lock "cinder-quobyte-36bbed4c-5938-4154-b995-6e505d8bb40a" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:33:23 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-7d76af15-393e-4c1c-99ea-6a96e1405f33 tempest-ProjectReaderTests-788405257 None] Lock "cinder-quobyte-36bbed4c-5938-4154-b995-6e505d8bb40a" acquired by "delete_volume" :: waited 0.017s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:33:23 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ae5148c-d795-4cf7-ac8c-c406c7717d6a]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:33:23 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-7d76af15-393e-4c1c-99ea-6a96e1405f33 tempest-ProjectReaderTests-788405257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-36bbed4c-5938-4154-b995-6e505d8bb40a {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:33:23 devstack sudo[110099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-36bbed4c-5938-4154-b995-6e505d8bb40a Aug 05 06:33:23 devstack sudo[110099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:33:23 devstack sudo[110099]: pam_unix(sudo:session): session closed for user root Aug 05 06:33:23 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-7d76af15-393e-4c1c-99ea-6a96e1405f33 tempest-ProjectReaderTests-788405257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-36bbed4c-5938-4154-b995-6e505d8bb40a" returned: 0 in 0.361s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:33:23 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-7d76af15-393e-4c1c-99ea-6a96e1405f33 tempest-ProjectReaderTests-788405257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-36bbed4c-5938-4154-b995-6e505d8bb40a {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:33:24 devstack sudo[110104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-36bbed4c-5938-4154-b995-6e505d8bb40a Aug 05 06:33:24 devstack sudo[110104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:33:24 devstack sudo[110104]: pam_unix(sudo:session): session closed for user root Aug 05 06:33:24 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-7d76af15-393e-4c1c-99ea-6a96e1405f33 tempest-ProjectReaderTests-788405257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-36bbed4c-5938-4154-b995-6e505d8bb40a" returned: 0 in 0.259s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:33:24 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-7d76af15-393e-4c1c-99ea-6a96e1405f33 tempest-ProjectReaderTests-788405257 None] Lock "cinder-quobyte-36bbed4c-5938-4154-b995-6e505d8bb40a" released by "delete_volume" :: held 0.681s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:33:24 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-7d76af15-393e-4c1c-99ea-6a96e1405f33 tempest-ProjectReaderTests-788405257 None] Created reservations ['5d184ed9-5676-4dec-af30-e46a504af820', '3473af9a-0adf-4145-840b-9e36786e5c97', '1ac03b7a-76a9-4a62-b38b-1b9053ff063e', '0cf9f919-2226-4c26-bda6-5be19721888c'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:33:24 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-7d76af15-393e-4c1c-99ea-6a96e1405f33 tempest-ProjectReaderTests-788405257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:33:24 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-7d76af15-393e-4c1c-99ea-6a96e1405f33 tempest-ProjectReaderTests-788405257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:33:24 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-7d76af15-393e-4c1c-99ea-6a96e1405f33 tempest-ProjectReaderTests-788405257 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:33:24 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-7d76af15-393e-4c1c-99ea-6a96e1405f33 tempest-ProjectReaderTests-788405257 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:33:24 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-7d76af15-393e-4c1c-99ea-6a96e1405f33 tempest-ProjectReaderTests-788405257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:33:24 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-7d76af15-393e-4c1c-99ea-6a96e1405f33 tempest-ProjectReaderTests-788405257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:33:24 devstack sudo[110107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce Aug 05 06:33:24 devstack sudo[110107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:33:24 devstack sudo[110107]: pam_unix(sudo:session): session closed for user root Aug 05 06:33:24 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-7d76af15-393e-4c1c-99ea-6a96e1405f33 tempest-ProjectReaderTests-788405257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce" returned: 0 in 0.254s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:33:24 devstack cinder-volume[88695]: DEBUG cinder.manager [None req-7d76af15-393e-4c1c-99ea-6a96e1405f33 tempest-ProjectReaderTests-788405257 None] Notifying Schedulers of capabilities ... {{(pid=88695) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 06:33:24 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-7d76af15-393e-4c1c-99ea-6a96e1405f33 tempest-ProjectReaderTests-788405257 None] Deleted volume successfully. Aug 05 06:33:24 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-7d76af15-393e-4c1c-99ea-6a96e1405f33 tempest-ProjectReaderTests-788405257 None] Lock "cinder-36bbed4c-5938-4154-b995-6e505d8bb40a-delete_volume" released by "delete_volume" :: held 1.142s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:33:25 devstack cinder-volume[88695]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad2bf907-1cd8-4692-a82c-dbdb96968859 tempest-ProjectReaderTests-788405257 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88695) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 06:33:25 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-ad2bf907-1cd8-4692-a82c-dbdb96968859 tempest-ProjectReaderTests-788405257 None] Flow 'volume_create_manager' (e67ef52e-c6c3-4c36-8af9-c18b36fc488f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:33:25 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-ad2bf907-1cd8-4692-a82c-dbdb96968859 tempest-ProjectReaderTests-788405257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2873a49a-2b0a-494c-ae50-4875c92e7ba2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:33:25 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-ad2bf907-1cd8-4692-a82c-dbdb96968859 tempest-ProjectReaderTests-788405257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2873a49a-2b0a-494c-ae50-4875c92e7ba2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:33:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1445246357',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9f6ab13-79c5-4cd5-98e8-0972aa538a71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95ec897d23f64c4aa28c9f99de062aee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:33:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:33:25Z,use_quota=True,user_id='97d0bbdbc29b47d08c8978b94311d171',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:33:25 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-ad2bf907-1cd8-4692-a82c-dbdb96968859 tempest-ProjectReaderTests-788405257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4dff4ee7-8370-46f6-8598-54b4620b3fa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:33:25 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-ad2bf907-1cd8-4692-a82c-dbdb96968859 tempest-ProjectReaderTests-788405257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4dff4ee7-8370-46f6-8598-54b4620b3fa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:33:25 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-ad2bf907-1cd8-4692-a82c-dbdb96968859 tempest-ProjectReaderTests-788405257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18bea1e9-a9d6-415b-b2be-7244e42a6494) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:33:25 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-ad2bf907-1cd8-4692-a82c-dbdb96968859 tempest-ProjectReaderTests-788405257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18bea1e9-a9d6-415b-b2be-7244e42a6494) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a9f6ab13-79c5-4cd5-98e8-0972aa538a71', 'volume_name': 'volume-a9f6ab13-79c5-4cd5-98e8-0972aa538a71', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:33:25 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-ad2bf907-1cd8-4692-a82c-dbdb96968859 tempest-ProjectReaderTests-788405257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02740844-8247-4a2f-94e5-7cd0896c16ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:33:25 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-ad2bf907-1cd8-4692-a82c-dbdb96968859 tempest-ProjectReaderTests-788405257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02740844-8247-4a2f-94e5-7cd0896c16ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:33:25 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-ad2bf907-1cd8-4692-a82c-dbdb96968859 tempest-ProjectReaderTests-788405257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3362707-21b7-41f2-8a8d-b51ba812f05e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:33:25 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-ad2bf907-1cd8-4692-a82c-dbdb96968859 tempest-ProjectReaderTests-788405257 None] Volume a9f6ab13-79c5-4cd5-98e8-0972aa538a71: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a9f6ab13-79c5-4cd5-98e8-0972aa538a71', 'volume_size': 1} Aug 05 06:33:25 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-ad2bf907-1cd8-4692-a82c-dbdb96968859 tempest-ProjectReaderTests-788405257 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:33:25 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-ad2bf907-1cd8-4692-a82c-dbdb96968859 tempest-ProjectReaderTests-788405257 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:33:25 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-ad2bf907-1cd8-4692-a82c-dbdb96968859 tempest-ProjectReaderTests-788405257 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:33:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1445246357',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9f6ab13-79c5-4cd5-98e8-0972aa538a71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95ec897d23f64c4aa28c9f99de062aee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:33:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:33:25Z,use_quota=True,user_id='97d0bbdbc29b47d08c8978b94311d171',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)}" {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 06:33:25 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-ad2bf907-1cd8-4692-a82c-dbdb96968859 tempest-ProjectReaderTests-788405257 None] Creating volume a9f6ab13-79c5-4cd5-98e8-0972aa538a71 {{(pid=88695) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 06:33:25 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-ad2bf907-1cd8-4692-a82c-dbdb96968859 tempest-ProjectReaderTests-788405257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:33:25 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-ad2bf907-1cd8-4692-a82c-dbdb96968859 tempest-ProjectReaderTests-788405257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:33:25 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-ad2bf907-1cd8-4692-a82c-dbdb96968859 tempest-ProjectReaderTests-788405257 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:33:25 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-ad2bf907-1cd8-4692-a82c-dbdb96968859 tempest-ProjectReaderTests-788405257 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:33:25 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-ad2bf907-1cd8-4692-a82c-dbdb96968859 tempest-ProjectReaderTests-788405257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:33:25 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-ad2bf907-1cd8-4692-a82c-dbdb96968859 tempest-ProjectReaderTests-788405257 None] Selected osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 as target Quobyte volume. {{(pid=88695) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 06:33:25 devstack cinder-volume[88695]: INFO cinder.volume.drivers.remotefs [None req-ad2bf907-1cd8-4692-a82c-dbdb96968859 tempest-ProjectReaderTests-788405257 None] casted to osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 Aug 05 06:33:25 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-ad2bf907-1cd8-4692-a82c-dbdb96968859 tempest-ProjectReaderTests-788405257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a9f6ab13-79c5-4cd5-98e8-0972aa538a71 1073741824 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:33:25 devstack sudo[110110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a9f6ab13-79c5-4cd5-98e8-0972aa538a71 1073741824 Aug 05 06:33:25 devstack sudo[110110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:33:25 devstack sudo[110110]: pam_unix(sudo:session): session closed for user root Aug 05 06:33:25 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-ad2bf907-1cd8-4692-a82c-dbdb96968859 tempest-ProjectReaderTests-788405257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a9f6ab13-79c5-4cd5-98e8-0972aa538a71 1073741824" returned: 0 in 0.451s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:33:25 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-ad2bf907-1cd8-4692-a82c-dbdb96968859 tempest-ProjectReaderTests-788405257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a9f6ab13-79c5-4cd5-98e8-0972aa538a71 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:33:25 devstack sudo[110115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a9f6ab13-79c5-4cd5-98e8-0972aa538a71 Aug 05 06:33:25 devstack sudo[110115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:33:26 devstack sudo[110115]: pam_unix(sudo:session): session closed for user root Aug 05 06:33:26 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-ad2bf907-1cd8-4692-a82c-dbdb96968859 tempest-ProjectReaderTests-788405257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a9f6ab13-79c5-4cd5-98e8-0972aa538a71" returned: 0 in 0.234s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:33:26 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-ad2bf907-1cd8-4692-a82c-dbdb96968859 tempest-ProjectReaderTests-788405257 None] <== create_volume: return (730ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'} {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 06:33:26 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-ad2bf907-1cd8-4692-a82c-dbdb96968859 tempest-ProjectReaderTests-788405257 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.733s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:33:26 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-ad2bf907-1cd8-4692-a82c-dbdb96968859 tempest-ProjectReaderTests-788405257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3362707-21b7-41f2-8a8d-b51ba812f05e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9f6ab13-79c5-4cd5-98e8-0972aa538a71', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:33:26 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-ad2bf907-1cd8-4692-a82c-dbdb96968859 tempest-ProjectReaderTests-788405257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54c51dcf-5680-480e-82bc-21f869f6d8de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:33:26 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-ad2bf907-1cd8-4692-a82c-dbdb96968859 tempest-ProjectReaderTests-788405257 None] Volume volume-a9f6ab13-79c5-4cd5-98e8-0972aa538a71 (a9f6ab13-79c5-4cd5-98e8-0972aa538a71): created successfully Aug 05 06:33:26 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-ad2bf907-1cd8-4692-a82c-dbdb96968859 tempest-ProjectReaderTests-788405257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54c51dcf-5680-480e-82bc-21f869f6d8de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:33:26 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-ad2bf907-1cd8-4692-a82c-dbdb96968859 tempest-ProjectReaderTests-788405257 None] Flow 'volume_create_manager' (e67ef52e-c6c3-4c36-8af9-c18b36fc488f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:33:26 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-ad2bf907-1cd8-4692-a82c-dbdb96968859 tempest-ProjectReaderTests-788405257 None] Created volume successfully. Aug 05 06:33:27 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-2a33d562-e184-458e-8a7c-99d79a666109 tempest-ProjectReaderTests-788405257 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:33:27 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-2a33d562-e184-458e-8a7c-99d79a666109 tempest-ProjectReaderTests-788405257 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:33:27 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-2a33d562-e184-458e-8a7c-99d79a666109 tempest-ProjectReaderTests-788405257 None] Creating offline snapshot 1b26c29f-1e5f-4409-8f21-7a3383bc55f6 of volume a9f6ab13-79c5-4cd5-98e8-0972aa538a71 {{(pid=88695) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 06:33:27 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e5b2d49-6cba-420c-9070-4d8b682be769]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:33:27 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-2a33d562-e184-458e-8a7c-99d79a666109 tempest-ProjectReaderTests-788405257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a9f6ab13-79c5-4cd5-98e8-0972aa538a71 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:33:27 devstack sudo[110118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a9f6ab13-79c5-4cd5-98e8-0972aa538a71 Aug 05 06:33:27 devstack sudo[110118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:33:27 devstack sudo[110118]: pam_unix(sudo:session): session closed for user root Aug 05 06:33:27 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-2a33d562-e184-458e-8a7c-99d79a666109 tempest-ProjectReaderTests-788405257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a9f6ab13-79c5-4cd5-98e8-0972aa538a71" returned: 0 in 0.364s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:33:27 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-2a33d562-e184-458e-8a7c-99d79a666109 tempest-ProjectReaderTests-788405257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a9f6ab13-79c5-4cd5-98e8-0972aa538a71,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a9f6ab13-79c5-4cd5-98e8-0972aa538a71.1b26c29f-1e5f-4409-8f21-7a3383bc55f6 1G {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:33:27 devstack sudo[110123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a9f6ab13-79c5-4cd5-98e8-0972aa538a71,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a9f6ab13-79c5-4cd5-98e8-0972aa538a71.1b26c29f-1e5f-4409-8f21-7a3383bc55f6 1G Aug 05 06:33:27 devstack sudo[110123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:33:28 devstack sudo[110123]: pam_unix(sudo:session): session closed for user root Aug 05 06:33:28 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-2a33d562-e184-458e-8a7c-99d79a666109 tempest-ProjectReaderTests-788405257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a9f6ab13-79c5-4cd5-98e8-0972aa538a71,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a9f6ab13-79c5-4cd5-98e8-0972aa538a71.1b26c29f-1e5f-4409-8f21-7a3383bc55f6 1G" returned: 0 in 0.414s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:33:28 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-2a33d562-e184-458e-8a7c-99d79a666109 tempest-ProjectReaderTests-788405257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a9f6ab13-79c5-4cd5-98e8-0972aa538a71 -F qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a9f6ab13-79c5-4cd5-98e8-0972aa538a71.1b26c29f-1e5f-4409-8f21-7a3383bc55f6 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:33:28 devstack sudo[110129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a9f6ab13-79c5-4cd5-98e8-0972aa538a71 -F qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a9f6ab13-79c5-4cd5-98e8-0972aa538a71.1b26c29f-1e5f-4409-8f21-7a3383bc55f6 Aug 05 06:33:28 devstack sudo[110129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:33:28 devstack sudo[110129]: pam_unix(sudo:session): session closed for user root Aug 05 06:33:28 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-2a33d562-e184-458e-8a7c-99d79a666109 tempest-ProjectReaderTests-788405257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a9f6ab13-79c5-4cd5-98e8-0972aa538a71 -F qcow2 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a9f6ab13-79c5-4cd5-98e8-0972aa538a71.1b26c29f-1e5f-4409-8f21-7a3383bc55f6" returned: 0 in 0.276s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:33:28 devstack cinder-volume[88695]: WARNING cinder.volume.drivers.remotefs [None req-2a33d562-e184-458e-8a7c-99d79a666109 tempest-ProjectReaderTests-788405257 None] /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a9f6ab13-79c5-4cd5-98e8-0972aa538a71.1b26c29f-1e5f-4409-8f21-7a3383bc55f6 is being set with open permissions: ugo+rw Aug 05 06:33:28 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-2a33d562-e184-458e-8a7c-99d79a666109 tempest-ProjectReaderTests-788405257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a9f6ab13-79c5-4cd5-98e8-0972aa538a71.1b26c29f-1e5f-4409-8f21-7a3383bc55f6 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:33:28 devstack sudo[110135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a9f6ab13-79c5-4cd5-98e8-0972aa538a71.1b26c29f-1e5f-4409-8f21-7a3383bc55f6 Aug 05 06:33:28 devstack sudo[110135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:33:28 devstack sudo[110135]: pam_unix(sudo:session): session closed for user root Aug 05 06:33:28 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-2a33d562-e184-458e-8a7c-99d79a666109 tempest-ProjectReaderTests-788405257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a9f6ab13-79c5-4cd5-98e8-0972aa538a71.1b26c29f-1e5f-4409-8f21-7a3383bc55f6" returned: 0 in 0.243s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:33:28 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-2a33d562-e184-458e-8a7c-99d79a666109 tempest-ProjectReaderTests-788405257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a9f6ab13-79c5-4cd5-98e8-0972aa538a71.info {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:33:28 devstack sudo[110138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a9f6ab13-79c5-4cd5-98e8-0972aa538a71.info Aug 05 06:33:28 devstack sudo[110138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:33:29 devstack sudo[110138]: pam_unix(sudo:session): session closed for user root Aug 05 06:33:29 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-2a33d562-e184-458e-8a7c-99d79a666109 tempest-ProjectReaderTests-788405257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a9f6ab13-79c5-4cd5-98e8-0972aa538a71.info" returned: 0 in 0.252s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:33:29 devstack cinder-volume[88695]: WARNING cinder.volume.drivers.remotefs [None req-2a33d562-e184-458e-8a7c-99d79a666109 tempest-ProjectReaderTests-788405257 None] /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a9f6ab13-79c5-4cd5-98e8-0972aa538a71.info is being set with open permissions: ugo+rw Aug 05 06:33:29 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-2a33d562-e184-458e-8a7c-99d79a666109 tempest-ProjectReaderTests-788405257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a9f6ab13-79c5-4cd5-98e8-0972aa538a71.info {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:33:29 devstack sudo[110141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a9f6ab13-79c5-4cd5-98e8-0972aa538a71.info Aug 05 06:33:29 devstack sudo[110141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:33:29 devstack sudo[110141]: pam_unix(sudo:session): session closed for user root Aug 05 06:33:29 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-2a33d562-e184-458e-8a7c-99d79a666109 tempest-ProjectReaderTests-788405257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a9f6ab13-79c5-4cd5-98e8-0972aa538a71.info" returned: 0 in 0.242s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:33:29 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-2a33d562-e184-458e-8a7c-99d79a666109 tempest-ProjectReaderTests-788405257 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.867s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:33:29 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-2a33d562-e184-458e-8a7c-99d79a666109 tempest-ProjectReaderTests-788405257 None] Create snapshot completed successfully Aug 05 06:33:29 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-cf23b468-ed53-443f-912e-699078f99d4d tempest-ProjectReaderTests-788405257 None] Acquiring lock "cinder-1b26c29f-1e5f-4409-8f21-7a3383bc55f6-delete_snapshot" by "delete_snapshot" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:33:29 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-cf23b468-ed53-443f-912e-699078f99d4d tempest-ProjectReaderTests-788405257 None] Lock "cinder-1b26c29f-1e5f-4409-8f21-7a3383bc55f6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:33:29 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-cf23b468-ed53-443f-912e-699078f99d4d tempest-ProjectReaderTests-788405257 None] Acquiring lock "cinder-quobyte-a9f6ab13-79c5-4cd5-98e8-0972aa538a71" by "delete_snapshot" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:33:29 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-cf23b468-ed53-443f-912e-699078f99d4d tempest-ProjectReaderTests-788405257 None] Lock "cinder-quobyte-a9f6ab13-79c5-4cd5-98e8-0972aa538a71" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:33:29 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-cf23b468-ed53-443f-912e-699078f99d4d tempest-ProjectReaderTests-788405257 None] Acquiring lock "cinder-quobyte-1b26c29f-1e5f-4409-8f21-7a3383bc55f6" by "_delete_snapshot" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:33:29 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-cf23b468-ed53-443f-912e-699078f99d4d tempest-ProjectReaderTests-788405257 None] Lock "cinder-quobyte-1b26c29f-1e5f-4409-8f21-7a3383bc55f6" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:33:29 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-cf23b468-ed53-443f-912e-699078f99d4d tempest-ProjectReaderTests-788405257 None] Deleting offline snapshot 1b26c29f-1e5f-4409-8f21-7a3383bc55f6 of volume a9f6ab13-79c5-4cd5-98e8-0972aa538a71 {{(pid=88695) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 06:33:29 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-cf23b468-ed53-443f-912e-699078f99d4d tempest-ProjectReaderTests-788405257 None] snapshot_file for this snap is: volume-a9f6ab13-79c5-4cd5-98e8-0972aa538a71.1b26c29f-1e5f-4409-8f21-7a3383bc55f6 {{(pid=88695) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 06:33:29 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ae9810e-27a6-480d-9a0e-14e9094918e9]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:33:29 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-cf23b468-ed53-443f-912e-699078f99d4d tempest-ProjectReaderTests-788405257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a9f6ab13-79c5-4cd5-98e8-0972aa538a71.1b26c29f-1e5f-4409-8f21-7a3383bc55f6 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:33:29 devstack sudo[110144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a9f6ab13-79c5-4cd5-98e8-0972aa538a71.1b26c29f-1e5f-4409-8f21-7a3383bc55f6 Aug 05 06:33:29 devstack sudo[110144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:33:29 devstack sudo[110144]: pam_unix(sudo:session): session closed for user root Aug 05 06:33:29 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-cf23b468-ed53-443f-912e-699078f99d4d tempest-ProjectReaderTests-788405257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a9f6ab13-79c5-4cd5-98e8-0972aa538a71.1b26c29f-1e5f-4409-8f21-7a3383bc55f6" returned: 0 in 0.345s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:33:29 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-cf23b468-ed53-443f-912e-699078f99d4d tempest-ProjectReaderTests-788405257 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a9f6ab13-79c5-4cd5-98e8-0972aa538a71(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88695) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 06:33:29 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[303d2bb7-4f23-41fc-a878-cf548d1b0cfb]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:33:29 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-cf23b468-ed53-443f-912e-699078f99d4d tempest-ProjectReaderTests-788405257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a9f6ab13-79c5-4cd5-98e8-0972aa538a71 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:33:30 devstack sudo[110149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a9f6ab13-79c5-4cd5-98e8-0972aa538a71 Aug 05 06:33:30 devstack sudo[110149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:33:30 devstack sudo[110149]: pam_unix(sudo:session): session closed for user root Aug 05 06:33:30 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-cf23b468-ed53-443f-912e-699078f99d4d tempest-ProjectReaderTests-788405257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a9f6ab13-79c5-4cd5-98e8-0972aa538a71" returned: 0 in 0.352s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:33:30 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-cf23b468-ed53-443f-912e-699078f99d4d tempest-ProjectReaderTests-788405257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a9f6ab13-79c5-4cd5-98e8-0972aa538a71.1b26c29f-1e5f-4409-8f21-7a3383bc55f6 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:33:30 devstack sudo[110154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a9f6ab13-79c5-4cd5-98e8-0972aa538a71.1b26c29f-1e5f-4409-8f21-7a3383bc55f6 Aug 05 06:33:30 devstack sudo[110154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:33:30 devstack sudo[110154]: pam_unix(sudo:session): session closed for user root Aug 05 06:33:30 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-cf23b468-ed53-443f-912e-699078f99d4d tempest-ProjectReaderTests-788405257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a9f6ab13-79c5-4cd5-98e8-0972aa538a71.1b26c29f-1e5f-4409-8f21-7a3383bc55f6" returned: 0 in 0.355s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:33:30 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-cf23b468-ed53-443f-912e-699078f99d4d tempest-ProjectReaderTests-788405257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a9f6ab13-79c5-4cd5-98e8-0972aa538a71.1b26c29f-1e5f-4409-8f21-7a3383bc55f6 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:33:30 devstack sudo[110159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a9f6ab13-79c5-4cd5-98e8-0972aa538a71.1b26c29f-1e5f-4409-8f21-7a3383bc55f6 Aug 05 06:33:30 devstack sudo[110159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:33:30 devstack sudo[110159]: pam_unix(sudo:session): session closed for user root Aug 05 06:33:30 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-cf23b468-ed53-443f-912e-699078f99d4d tempest-ProjectReaderTests-788405257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a9f6ab13-79c5-4cd5-98e8-0972aa538a71.1b26c29f-1e5f-4409-8f21-7a3383bc55f6" returned: 0 in 0.232s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:33:30 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-cf23b468-ed53-443f-912e-699078f99d4d tempest-ProjectReaderTests-788405257 None] Lock "cinder-quobyte-1b26c29f-1e5f-4409-8f21-7a3383bc55f6" released by "_delete_snapshot" :: held 1.366s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:33:30 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-cf23b468-ed53-443f-912e-699078f99d4d tempest-ProjectReaderTests-788405257 None] Lock "cinder-quobyte-a9f6ab13-79c5-4cd5-98e8-0972aa538a71" released by "delete_snapshot" :: held 1.388s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:33:31 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-cf23b468-ed53-443f-912e-699078f99d4d tempest-ProjectReaderTests-788405257 None] Created reservations ['46a033bb-26f6-4f9a-bdff-e616a701d991', '6624d428-362a-4ada-be7b-eebd8e178521', 'ad4a03fa-c01e-4ac8-85fb-8c6fd6dab19e', '09283980-b975-4fb0-82a8-2832e01d0e17'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:33:31 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-cf23b468-ed53-443f-912e-699078f99d4d tempest-ProjectReaderTests-788405257 None] Delete snapshot completed successfully. Aug 05 06:33:31 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-cf23b468-ed53-443f-912e-699078f99d4d tempest-ProjectReaderTests-788405257 None] Lock "cinder-1b26c29f-1e5f-4409-8f21-7a3383bc55f6-delete_snapshot" released by "delete_snapshot" :: held 1.515s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:33:31 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-6d1fc1b6-8f81-435e-8070-d322a3c81572 tempest-ProjectReaderTests-788405257 None] Acquiring lock "cinder-a9f6ab13-79c5-4cd5-98e8-0972aa538a71-delete_volume" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:33:31 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-6d1fc1b6-8f81-435e-8070-d322a3c81572 tempest-ProjectReaderTests-788405257 None] Lock "cinder-a9f6ab13-79c5-4cd5-98e8-0972aa538a71-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:33:31 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-6d1fc1b6-8f81-435e-8070-d322a3c81572 tempest-ProjectReaderTests-788405257 None] Acquiring lock "cinder-quobyte-a9f6ab13-79c5-4cd5-98e8-0972aa538a71" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:33:31 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-6d1fc1b6-8f81-435e-8070-d322a3c81572 tempest-ProjectReaderTests-788405257 None] Lock "cinder-quobyte-a9f6ab13-79c5-4cd5-98e8-0972aa538a71" acquired by "delete_volume" :: waited 0.016s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:33:31 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[55155b9c-6c4c-4201-b089-ffcc644261f5]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:33:31 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-6d1fc1b6-8f81-435e-8070-d322a3c81572 tempest-ProjectReaderTests-788405257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a9f6ab13-79c5-4cd5-98e8-0972aa538a71 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:33:31 devstack sudo[110162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a9f6ab13-79c5-4cd5-98e8-0972aa538a71 Aug 05 06:33:31 devstack sudo[110162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:33:32 devstack sudo[110162]: pam_unix(sudo:session): session closed for user root Aug 05 06:33:32 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-6d1fc1b6-8f81-435e-8070-d322a3c81572 tempest-ProjectReaderTests-788405257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a9f6ab13-79c5-4cd5-98e8-0972aa538a71" returned: 0 in 0.385s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:33:32 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-6d1fc1b6-8f81-435e-8070-d322a3c81572 tempest-ProjectReaderTests-788405257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a9f6ab13-79c5-4cd5-98e8-0972aa538a71 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:33:32 devstack sudo[110167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a9f6ab13-79c5-4cd5-98e8-0972aa538a71 Aug 05 06:33:32 devstack sudo[110167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:33:32 devstack sudo[110167]: pam_unix(sudo:session): session closed for user root Aug 05 06:33:32 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-6d1fc1b6-8f81-435e-8070-d322a3c81572 tempest-ProjectReaderTests-788405257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-a9f6ab13-79c5-4cd5-98e8-0972aa538a71" returned: 0 in 0.252s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:33:32 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-6d1fc1b6-8f81-435e-8070-d322a3c81572 tempest-ProjectReaderTests-788405257 None] Lock "cinder-quobyte-a9f6ab13-79c5-4cd5-98e8-0972aa538a71" released by "delete_volume" :: held 0.695s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:33:32 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-6d1fc1b6-8f81-435e-8070-d322a3c81572 tempest-ProjectReaderTests-788405257 None] Created reservations ['89a3510c-2bc5-43f0-be4d-55ada13885d6', 'e336f1d6-1177-49b2-be2b-a3b38593ea59', 'e75c48b0-3a65-46a4-a445-a13a5b2d33ba', 'b0353aeb-0f41-4159-86bb-13fc1a80afd4'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:33:32 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-6d1fc1b6-8f81-435e-8070-d322a3c81572 tempest-ProjectReaderTests-788405257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:33:32 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-6d1fc1b6-8f81-435e-8070-d322a3c81572 tempest-ProjectReaderTests-788405257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:33:32 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-6d1fc1b6-8f81-435e-8070-d322a3c81572 tempest-ProjectReaderTests-788405257 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:33:32 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-6d1fc1b6-8f81-435e-8070-d322a3c81572 tempest-ProjectReaderTests-788405257 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:33:32 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-6d1fc1b6-8f81-435e-8070-d322a3c81572 tempest-ProjectReaderTests-788405257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:33:32 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-6d1fc1b6-8f81-435e-8070-d322a3c81572 tempest-ProjectReaderTests-788405257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:33:32 devstack sudo[110170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce Aug 05 06:33:32 devstack sudo[110170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:33:32 devstack sudo[110170]: pam_unix(sudo:session): session closed for user root Aug 05 06:33:32 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-6d1fc1b6-8f81-435e-8070-d322a3c81572 tempest-ProjectReaderTests-788405257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce" returned: 0 in 0.276s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:33:32 devstack cinder-volume[88695]: DEBUG cinder.manager [None req-6d1fc1b6-8f81-435e-8070-d322a3c81572 tempest-ProjectReaderTests-788405257 None] Notifying Schedulers of capabilities ... {{(pid=88695) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 06:33:32 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-6d1fc1b6-8f81-435e-8070-d322a3c81572 tempest-ProjectReaderTests-788405257 None] Deleted volume successfully. Aug 05 06:33:32 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-6d1fc1b6-8f81-435e-8070-d322a3c81572 tempest-ProjectReaderTests-788405257 None] Lock "cinder-a9f6ab13-79c5-4cd5-98e8-0972aa538a71-delete_volume" released by "delete_volume" :: held 1.179s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:33:42 devstack cinder-volume[88695]: DEBUG dbcounter [-] [88695] Writing DB stats cinder:UPDATE=129,cinder:SELECT=87,cinder:DELETE=13,cinder:INSERT=34 {{(pid=88695) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 06:33:42 devstack cinder-volume[88695]: DEBUG dbcounter [-] [88695] Writing DB stats cinder:SELECT=107,cinder:INSERT=36,cinder:UPDATE=122,cinder:DELETE=8 {{(pid=88695) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 06:33:45 devstack cinder-volume[88695]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6f4e88a-d0a7-40bd-93c9-aac73e96a9a8 tempest-ProjectReaderTests-1646537941 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88695) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 06:33:45 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-c6f4e88a-d0a7-40bd-93c9-aac73e96a9a8 tempest-ProjectReaderTests-1646537941 None] Flow 'volume_create_manager' (fff6756f-f864-4e1f-a508-c5a6aa3723d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:33:45 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-c6f4e88a-d0a7-40bd-93c9-aac73e96a9a8 tempest-ProjectReaderTests-1646537941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e505c92c-1e06-412a-b100-dbe888950036) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:33:45 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-c6f4e88a-d0a7-40bd-93c9-aac73e96a9a8 tempest-ProjectReaderTests-1646537941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e505c92c-1e06-412a-b100-dbe888950036) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:33:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1461829421',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0779be90-be8b-460f-abe0-8e77c5ddce63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10613c2d23404f829fcccad269801b01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:33:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:33:45Z,use_quota=True,user_id='60f370bdd7e24b9da5d608957de4e8b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:33:45 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-c6f4e88a-d0a7-40bd-93c9-aac73e96a9a8 tempest-ProjectReaderTests-1646537941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd57e084-ed88-4dd5-b7db-f59e6784333a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:33:45 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-c6f4e88a-d0a7-40bd-93c9-aac73e96a9a8 tempest-ProjectReaderTests-1646537941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd57e084-ed88-4dd5-b7db-f59e6784333a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:33:45 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-c6f4e88a-d0a7-40bd-93c9-aac73e96a9a8 tempest-ProjectReaderTests-1646537941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f1cd143-bf2a-455d-a812-44f56b51d7a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:33:45 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-c6f4e88a-d0a7-40bd-93c9-aac73e96a9a8 tempest-ProjectReaderTests-1646537941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f1cd143-bf2a-455d-a812-44f56b51d7a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0779be90-be8b-460f-abe0-8e77c5ddce63', 'volume_name': 'volume-0779be90-be8b-460f-abe0-8e77c5ddce63', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:33:45 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-c6f4e88a-d0a7-40bd-93c9-aac73e96a9a8 tempest-ProjectReaderTests-1646537941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (216c2f88-6b93-4af1-8605-16ec624f90a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:33:45 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-c6f4e88a-d0a7-40bd-93c9-aac73e96a9a8 tempest-ProjectReaderTests-1646537941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (216c2f88-6b93-4af1-8605-16ec624f90a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:33:45 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-c6f4e88a-d0a7-40bd-93c9-aac73e96a9a8 tempest-ProjectReaderTests-1646537941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d885d2e-b7a9-4970-8d5e-9b230aa70bfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:33:45 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-c6f4e88a-d0a7-40bd-93c9-aac73e96a9a8 tempest-ProjectReaderTests-1646537941 None] Volume 0779be90-be8b-460f-abe0-8e77c5ddce63: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0779be90-be8b-460f-abe0-8e77c5ddce63', 'volume_size': 1} Aug 05 06:33:45 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-c6f4e88a-d0a7-40bd-93c9-aac73e96a9a8 tempest-ProjectReaderTests-1646537941 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:33:45 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-c6f4e88a-d0a7-40bd-93c9-aac73e96a9a8 tempest-ProjectReaderTests-1646537941 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:33:45 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-c6f4e88a-d0a7-40bd-93c9-aac73e96a9a8 tempest-ProjectReaderTests-1646537941 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:33:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1461829421',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0779be90-be8b-460f-abe0-8e77c5ddce63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10613c2d23404f829fcccad269801b01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:33:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:33:45Z,use_quota=True,user_id='60f370bdd7e24b9da5d608957de4e8b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)}" {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 06:33:45 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-c6f4e88a-d0a7-40bd-93c9-aac73e96a9a8 tempest-ProjectReaderTests-1646537941 None] Creating volume 0779be90-be8b-460f-abe0-8e77c5ddce63 {{(pid=88695) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 06:33:45 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-c6f4e88a-d0a7-40bd-93c9-aac73e96a9a8 tempest-ProjectReaderTests-1646537941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:33:45 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-c6f4e88a-d0a7-40bd-93c9-aac73e96a9a8 tempest-ProjectReaderTests-1646537941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:33:45 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-c6f4e88a-d0a7-40bd-93c9-aac73e96a9a8 tempest-ProjectReaderTests-1646537941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:33:45 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-c6f4e88a-d0a7-40bd-93c9-aac73e96a9a8 tempest-ProjectReaderTests-1646537941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:33:45 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-c6f4e88a-d0a7-40bd-93c9-aac73e96a9a8 tempest-ProjectReaderTests-1646537941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:33:45 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-c6f4e88a-d0a7-40bd-93c9-aac73e96a9a8 tempest-ProjectReaderTests-1646537941 None] Selected osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 as target Quobyte volume. {{(pid=88695) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 06:33:45 devstack cinder-volume[88695]: INFO cinder.volume.drivers.remotefs [None req-c6f4e88a-d0a7-40bd-93c9-aac73e96a9a8 tempest-ProjectReaderTests-1646537941 None] casted to osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 Aug 05 06:33:45 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-c6f4e88a-d0a7-40bd-93c9-aac73e96a9a8 tempest-ProjectReaderTests-1646537941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-0779be90-be8b-460f-abe0-8e77c5ddce63 1073741824 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:33:45 devstack sudo[110178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-0779be90-be8b-460f-abe0-8e77c5ddce63 1073741824 Aug 05 06:33:45 devstack sudo[110178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:33:45 devstack sudo[110178]: pam_unix(sudo:session): session closed for user root Aug 05 06:33:45 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-c6f4e88a-d0a7-40bd-93c9-aac73e96a9a8 tempest-ProjectReaderTests-1646537941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-0779be90-be8b-460f-abe0-8e77c5ddce63 1073741824" returned: 0 in 0.461s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:33:46 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-c6f4e88a-d0a7-40bd-93c9-aac73e96a9a8 tempest-ProjectReaderTests-1646537941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-0779be90-be8b-460f-abe0-8e77c5ddce63 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:33:46 devstack sudo[110217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-0779be90-be8b-460f-abe0-8e77c5ddce63 Aug 05 06:33:46 devstack sudo[110217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:33:46 devstack sudo[110217]: pam_unix(sudo:session): session closed for user root Aug 05 06:33:46 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-c6f4e88a-d0a7-40bd-93c9-aac73e96a9a8 tempest-ProjectReaderTests-1646537941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-0779be90-be8b-460f-abe0-8e77c5ddce63" returned: 0 in 0.283s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:33:46 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-c6f4e88a-d0a7-40bd-93c9-aac73e96a9a8 tempest-ProjectReaderTests-1646537941 None] <== create_volume: return (788ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'} {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 06:33:46 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-c6f4e88a-d0a7-40bd-93c9-aac73e96a9a8 tempest-ProjectReaderTests-1646537941 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.791s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:33:46 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-c6f4e88a-d0a7-40bd-93c9-aac73e96a9a8 tempest-ProjectReaderTests-1646537941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d885d2e-b7a9-4970-8d5e-9b230aa70bfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0779be90-be8b-460f-abe0-8e77c5ddce63', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:33:46 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-c6f4e88a-d0a7-40bd-93c9-aac73e96a9a8 tempest-ProjectReaderTests-1646537941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b63e894b-0d18-4520-aa6d-77aa1ce96f3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:33:46 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-c6f4e88a-d0a7-40bd-93c9-aac73e96a9a8 tempest-ProjectReaderTests-1646537941 None] Volume volume-0779be90-be8b-460f-abe0-8e77c5ddce63 (0779be90-be8b-460f-abe0-8e77c5ddce63): created successfully Aug 05 06:33:46 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-c6f4e88a-d0a7-40bd-93c9-aac73e96a9a8 tempest-ProjectReaderTests-1646537941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b63e894b-0d18-4520-aa6d-77aa1ce96f3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:33:46 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-c6f4e88a-d0a7-40bd-93c9-aac73e96a9a8 tempest-ProjectReaderTests-1646537941 None] Flow 'volume_create_manager' (fff6756f-f864-4e1f-a508-c5a6aa3723d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:33:46 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-c6f4e88a-d0a7-40bd-93c9-aac73e96a9a8 tempest-ProjectReaderTests-1646537941 None] Created volume successfully. Aug 05 06:33:47 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-44a7b235-9e2f-404d-b31a-c9e11102ca78 tempest-ProjectReaderTests-1646537941 None] Acquiring lock "cinder-0779be90-be8b-460f-abe0-8e77c5ddce63-delete_volume" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:33:47 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-44a7b235-9e2f-404d-b31a-c9e11102ca78 tempest-ProjectReaderTests-1646537941 None] Lock "cinder-0779be90-be8b-460f-abe0-8e77c5ddce63-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:33:47 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-44a7b235-9e2f-404d-b31a-c9e11102ca78 tempest-ProjectReaderTests-1646537941 None] Acquiring lock "cinder-quobyte-0779be90-be8b-460f-abe0-8e77c5ddce63" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:33:47 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-44a7b235-9e2f-404d-b31a-c9e11102ca78 tempest-ProjectReaderTests-1646537941 None] Lock "cinder-quobyte-0779be90-be8b-460f-abe0-8e77c5ddce63" acquired by "delete_volume" :: waited 0.016s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:33:47 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[09330c84-2f0d-4ff1-a88c-79ff02110f18]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:33:47 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-44a7b235-9e2f-404d-b31a-c9e11102ca78 tempest-ProjectReaderTests-1646537941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-0779be90-be8b-460f-abe0-8e77c5ddce63 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:33:47 devstack sudo[110222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-0779be90-be8b-460f-abe0-8e77c5ddce63 Aug 05 06:33:47 devstack sudo[110222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:33:48 devstack sudo[110222]: pam_unix(sudo:session): session closed for user root Aug 05 06:33:48 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-44a7b235-9e2f-404d-b31a-c9e11102ca78 tempest-ProjectReaderTests-1646537941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-0779be90-be8b-460f-abe0-8e77c5ddce63" returned: 0 in 0.410s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:33:48 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-44a7b235-9e2f-404d-b31a-c9e11102ca78 tempest-ProjectReaderTests-1646537941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-0779be90-be8b-460f-abe0-8e77c5ddce63 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:33:48 devstack sudo[110227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-0779be90-be8b-460f-abe0-8e77c5ddce63 Aug 05 06:33:48 devstack sudo[110227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:33:48 devstack sudo[110227]: pam_unix(sudo:session): session closed for user root Aug 05 06:33:48 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-44a7b235-9e2f-404d-b31a-c9e11102ca78 tempest-ProjectReaderTests-1646537941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-0779be90-be8b-460f-abe0-8e77c5ddce63" returned: 0 in 0.264s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:33:48 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-44a7b235-9e2f-404d-b31a-c9e11102ca78 tempest-ProjectReaderTests-1646537941 None] Lock "cinder-quobyte-0779be90-be8b-460f-abe0-8e77c5ddce63" released by "delete_volume" :: held 0.717s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:33:48 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-44a7b235-9e2f-404d-b31a-c9e11102ca78 tempest-ProjectReaderTests-1646537941 None] Created reservations ['cd9a34b3-6ab3-44ab-81fe-bb3162e0bffa', 'de5cbe9c-6671-4c3d-ab74-b36f33ef9d80', 'a7dea6ad-25a6-4fa9-bcf7-9082e1b19ad1', '2daebcdc-2cae-47e5-bc64-61a025807c23'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:33:48 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-44a7b235-9e2f-404d-b31a-c9e11102ca78 tempest-ProjectReaderTests-1646537941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:33:48 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-44a7b235-9e2f-404d-b31a-c9e11102ca78 tempest-ProjectReaderTests-1646537941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:33:48 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-44a7b235-9e2f-404d-b31a-c9e11102ca78 tempest-ProjectReaderTests-1646537941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:33:48 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-44a7b235-9e2f-404d-b31a-c9e11102ca78 tempest-ProjectReaderTests-1646537941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:33:48 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-44a7b235-9e2f-404d-b31a-c9e11102ca78 tempest-ProjectReaderTests-1646537941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:33:48 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-44a7b235-9e2f-404d-b31a-c9e11102ca78 tempest-ProjectReaderTests-1646537941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:33:48 devstack sudo[110231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce Aug 05 06:33:48 devstack sudo[110231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:33:48 devstack sudo[110231]: pam_unix(sudo:session): session closed for user root Aug 05 06:33:48 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-44a7b235-9e2f-404d-b31a-c9e11102ca78 tempest-ProjectReaderTests-1646537941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce" returned: 0 in 0.278s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:33:48 devstack cinder-volume[88695]: DEBUG cinder.manager [None req-44a7b235-9e2f-404d-b31a-c9e11102ca78 tempest-ProjectReaderTests-1646537941 None] Notifying Schedulers of capabilities ... {{(pid=88695) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 06:33:48 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-44a7b235-9e2f-404d-b31a-c9e11102ca78 tempest-ProjectReaderTests-1646537941 None] Deleted volume successfully. Aug 05 06:33:48 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-44a7b235-9e2f-404d-b31a-c9e11102ca78 tempest-ProjectReaderTests-1646537941 None] Lock "cinder-0779be90-be8b-460f-abe0-8e77c5ddce63-delete_volume" released by "delete_volume" :: held 1.224s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:33:49 devstack cinder-volume[88695]: DEBUG cinder.volume.flows.manager.create_volume [None req-760b1703-a48b-4419-84a2-35c5e8fcae9d tempest-ProjectReaderTests-1646537941 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88695) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 06:33:49 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-760b1703-a48b-4419-84a2-35c5e8fcae9d tempest-ProjectReaderTests-1646537941 None] Flow 'volume_create_manager' (928f312e-faa6-4b9c-a8d1-aace50e3cfaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:33:49 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-760b1703-a48b-4419-84a2-35c5e8fcae9d tempest-ProjectReaderTests-1646537941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74652711-8cfa-48ff-b504-9892e605f6dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:33:49 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-760b1703-a48b-4419-84a2-35c5e8fcae9d tempest-ProjectReaderTests-1646537941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74652711-8cfa-48ff-b504-9892e605f6dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:33:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-985889446',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=562ab60b-48d7-4795-bcc8-dfbdd404b00d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10613c2d23404f829fcccad269801b01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:33:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:33:49Z,use_quota=True,user_id='60f370bdd7e24b9da5d608957de4e8b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:33:49 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-760b1703-a48b-4419-84a2-35c5e8fcae9d tempest-ProjectReaderTests-1646537941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47e9dda8-839e-4b35-855f-37c2c85c2e90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:33:49 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-760b1703-a48b-4419-84a2-35c5e8fcae9d tempest-ProjectReaderTests-1646537941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47e9dda8-839e-4b35-855f-37c2c85c2e90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:33:49 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-760b1703-a48b-4419-84a2-35c5e8fcae9d tempest-ProjectReaderTests-1646537941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc1f466b-22a0-4429-bdd0-650092f2f4e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:33:49 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-760b1703-a48b-4419-84a2-35c5e8fcae9d tempest-ProjectReaderTests-1646537941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc1f466b-22a0-4429-bdd0-650092f2f4e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '562ab60b-48d7-4795-bcc8-dfbdd404b00d', 'volume_name': 'volume-562ab60b-48d7-4795-bcc8-dfbdd404b00d', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:33:49 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-760b1703-a48b-4419-84a2-35c5e8fcae9d tempest-ProjectReaderTests-1646537941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8753731-ea4b-4962-88f1-9b71fedb79af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:33:49 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-760b1703-a48b-4419-84a2-35c5e8fcae9d tempest-ProjectReaderTests-1646537941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8753731-ea4b-4962-88f1-9b71fedb79af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:33:49 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-760b1703-a48b-4419-84a2-35c5e8fcae9d tempest-ProjectReaderTests-1646537941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9cc552a-5e7f-4bb2-947d-314cadd3b590) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:33:49 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-760b1703-a48b-4419-84a2-35c5e8fcae9d tempest-ProjectReaderTests-1646537941 None] Volume 562ab60b-48d7-4795-bcc8-dfbdd404b00d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-562ab60b-48d7-4795-bcc8-dfbdd404b00d', 'volume_size': 1} Aug 05 06:33:49 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-760b1703-a48b-4419-84a2-35c5e8fcae9d tempest-ProjectReaderTests-1646537941 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:33:49 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-760b1703-a48b-4419-84a2-35c5e8fcae9d tempest-ProjectReaderTests-1646537941 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:33:49 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-760b1703-a48b-4419-84a2-35c5e8fcae9d tempest-ProjectReaderTests-1646537941 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T04:33:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-985889446',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=562ab60b-48d7-4795-bcc8-dfbdd404b00d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10613c2d23404f829fcccad269801b01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T04:33:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T04:33:49Z,use_quota=True,user_id='60f370bdd7e24b9da5d608957de4e8b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dd712e-5837-48ec-9e45-bb11109601e1),volume_type_id=f5dd712e-5837-48ec-9e45-bb11109601e1)}" {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 06:33:49 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.remotefs [None req-760b1703-a48b-4419-84a2-35c5e8fcae9d tempest-ProjectReaderTests-1646537941 None] Creating volume 562ab60b-48d7-4795-bcc8-dfbdd404b00d {{(pid=88695) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 06:33:49 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-760b1703-a48b-4419-84a2-35c5e8fcae9d tempest-ProjectReaderTests-1646537941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:33:49 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-760b1703-a48b-4419-84a2-35c5e8fcae9d tempest-ProjectReaderTests-1646537941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:33:49 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-760b1703-a48b-4419-84a2-35c5e8fcae9d tempest-ProjectReaderTests-1646537941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:33:49 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-760b1703-a48b-4419-84a2-35c5e8fcae9d tempest-ProjectReaderTests-1646537941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:33:49 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-760b1703-a48b-4419-84a2-35c5e8fcae9d tempest-ProjectReaderTests-1646537941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:33:49 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-760b1703-a48b-4419-84a2-35c5e8fcae9d tempest-ProjectReaderTests-1646537941 None] Selected osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 as target Quobyte volume. {{(pid=88695) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 06:33:49 devstack cinder-volume[88695]: INFO cinder.volume.drivers.remotefs [None req-760b1703-a48b-4419-84a2-35c5e8fcae9d tempest-ProjectReaderTests-1646537941 None] casted to osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087 Aug 05 06:33:49 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-760b1703-a48b-4419-84a2-35c5e8fcae9d tempest-ProjectReaderTests-1646537941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-562ab60b-48d7-4795-bcc8-dfbdd404b00d 1073741824 {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:33:49 devstack sudo[110234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-562ab60b-48d7-4795-bcc8-dfbdd404b00d 1073741824 Aug 05 06:33:49 devstack sudo[110234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:33:49 devstack sudo[110234]: pam_unix(sudo:session): session closed for user root Aug 05 06:33:49 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-760b1703-a48b-4419-84a2-35c5e8fcae9d tempest-ProjectReaderTests-1646537941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-562ab60b-48d7-4795-bcc8-dfbdd404b00d 1073741824" returned: 0 in 0.461s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:33:50 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-760b1703-a48b-4419-84a2-35c5e8fcae9d tempest-ProjectReaderTests-1646537941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-562ab60b-48d7-4795-bcc8-dfbdd404b00d {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:33:50 devstack sudo[110240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-562ab60b-48d7-4795-bcc8-dfbdd404b00d Aug 05 06:33:50 devstack sudo[110240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:33:50 devstack sudo[110240]: pam_unix(sudo:session): session closed for user root Aug 05 06:33:50 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-760b1703-a48b-4419-84a2-35c5e8fcae9d tempest-ProjectReaderTests-1646537941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-562ab60b-48d7-4795-bcc8-dfbdd404b00d" returned: 0 in 0.282s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:33:50 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-760b1703-a48b-4419-84a2-35c5e8fcae9d tempest-ProjectReaderTests-1646537941 None] <== create_volume: return (840ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'} {{(pid=88695) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 06:33:50 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-760b1703-a48b-4419-84a2-35c5e8fcae9d tempest-ProjectReaderTests-1646537941 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.842s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:33:50 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-760b1703-a48b-4419-84a2-35c5e8fcae9d tempest-ProjectReaderTests-1646537941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9cc552a-5e7f-4bb2-947d-314cadd3b590) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-562ab60b-48d7-4795-bcc8-dfbdd404b00d', 'volume_size': 1}' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:33:50 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-760b1703-a48b-4419-84a2-35c5e8fcae9d tempest-ProjectReaderTests-1646537941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e4cfbf1-52b6-4d46-a759-c67d3d17b918) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 06:33:50 devstack cinder-volume[88695]: INFO cinder.volume.flows.manager.create_volume [None req-760b1703-a48b-4419-84a2-35c5e8fcae9d tempest-ProjectReaderTests-1646537941 None] Volume volume-562ab60b-48d7-4795-bcc8-dfbdd404b00d (562ab60b-48d7-4795-bcc8-dfbdd404b00d): created successfully Aug 05 06:33:50 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-760b1703-a48b-4419-84a2-35c5e8fcae9d tempest-ProjectReaderTests-1646537941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e4cfbf1-52b6-4d46-a759-c67d3d17b918) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88695) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 06:33:50 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-760b1703-a48b-4419-84a2-35c5e8fcae9d tempest-ProjectReaderTests-1646537941 None] Flow 'volume_create_manager' (928f312e-faa6-4b9c-a8d1-aace50e3cfaf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88695) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 06:33:50 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-760b1703-a48b-4419-84a2-35c5e8fcae9d tempest-ProjectReaderTests-1646537941 None] Created volume successfully. Aug 05 06:33:51 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-b0e444a6-5655-46ac-b80b-522aa244e0ab tempest-ProjectReaderTests-1646537941 None] Acquiring lock "cinder-562ab60b-48d7-4795-bcc8-dfbdd404b00d-delete_volume" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:33:51 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-b0e444a6-5655-46ac-b80b-522aa244e0ab tempest-ProjectReaderTests-1646537941 None] Lock "cinder-562ab60b-48d7-4795-bcc8-dfbdd404b00d-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:33:51 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-b0e444a6-5655-46ac-b80b-522aa244e0ab tempest-ProjectReaderTests-1646537941 None] Acquiring lock "cinder-quobyte-562ab60b-48d7-4795-bcc8-dfbdd404b00d" by "delete_volume" {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 06:33:51 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-b0e444a6-5655-46ac-b80b-522aa244e0ab tempest-ProjectReaderTests-1646537941 None] Lock "cinder-quobyte-562ab60b-48d7-4795-bcc8-dfbdd404b00d" acquired by "delete_volume" :: waited 0.018s {{(pid=88695) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 06:33:51 devstack cinder-volume[88695]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e19ffa9-3e84-40d1-9290-d40e93810da3]: (4, 'qcow2') {{(pid=89672) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 06:33:51 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-b0e444a6-5655-46ac-b80b-522aa244e0ab tempest-ProjectReaderTests-1646537941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-562ab60b-48d7-4795-bcc8-dfbdd404b00d {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:33:51 devstack sudo[110243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-562ab60b-48d7-4795-bcc8-dfbdd404b00d Aug 05 06:33:51 devstack sudo[110243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:33:52 devstack sudo[110243]: pam_unix(sudo:session): session closed for user root Aug 05 06:33:52 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-b0e444a6-5655-46ac-b80b-522aa244e0ab tempest-ProjectReaderTests-1646537941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-562ab60b-48d7-4795-bcc8-dfbdd404b00d" returned: 0 in 0.400s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:33:52 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-b0e444a6-5655-46ac-b80b-522aa244e0ab tempest-ProjectReaderTests-1646537941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-562ab60b-48d7-4795-bcc8-dfbdd404b00d {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:33:52 devstack sudo[110254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-562ab60b-48d7-4795-bcc8-dfbdd404b00d Aug 05 06:33:52 devstack sudo[110254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:33:52 devstack sudo[110254]: pam_unix(sudo:session): session closed for user root Aug 05 06:33:52 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-b0e444a6-5655-46ac-b80b-522aa244e0ab tempest-ProjectReaderTests-1646537941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce/volume-562ab60b-48d7-4795-bcc8-dfbdd404b00d" returned: 0 in 0.284s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:33:52 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-b0e444a6-5655-46ac-b80b-522aa244e0ab tempest-ProjectReaderTests-1646537941 None] Lock "cinder-quobyte-562ab60b-48d7-4795-bcc8-dfbdd404b00d" released by "delete_volume" :: held 0.731s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:33:52 devstack cinder-volume[88695]: DEBUG cinder.quota [None req-b0e444a6-5655-46ac-b80b-522aa244e0ab tempest-ProjectReaderTests-1646537941 None] Created reservations ['31e1a591-9b91-4caa-813b-876f23cbfaa4', '4021180b-d4a4-4071-947b-f941a65c1482', 'db73895f-f4d5-477a-a932-85b8fc3c33e4', '3b451335-5e92-4224-a4cc-7f61a5692cf4'] {{(pid=88695) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 06:33:52 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-b0e444a6-5655-46ac-b80b-522aa244e0ab tempest-ProjectReaderTests-1646537941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:33:52 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-b0e444a6-5655-46ac-b80b-522aa244e0ab tempest-ProjectReaderTests-1646537941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:33:52 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-b0e444a6-5655-46ac-b80b-522aa244e0ab tempest-ProjectReaderTests-1646537941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:33:52 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-b0e444a6-5655-46ac-b80b-522aa244e0ab tempest-ProjectReaderTests-1646537941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:33:52 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-b0e444a6-5655-46ac-b80b-522aa244e0ab tempest-ProjectReaderTests-1646537941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:33:52 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-b0e444a6-5655-46ac-b80b-522aa244e0ab tempest-ProjectReaderTests-1646537941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:33:52 devstack sudo[110257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce Aug 05 06:33:52 devstack sudo[110257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:33:52 devstack sudo[110257]: pam_unix(sudo:session): session closed for user root Aug 05 06:33:52 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-b0e444a6-5655-46ac-b80b-522aa244e0ab tempest-ProjectReaderTests-1646537941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce" returned: 0 in 0.303s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:33:52 devstack cinder-volume[88695]: DEBUG cinder.manager [None req-b0e444a6-5655-46ac-b80b-522aa244e0ab tempest-ProjectReaderTests-1646537941 None] Notifying Schedulers of capabilities ... {{(pid=88695) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 06:33:52 devstack cinder-volume[88695]: INFO cinder.volume.manager [None req-b0e444a6-5655-46ac-b80b-522aa244e0ab tempest-ProjectReaderTests-1646537941 None] Deleted volume successfully. Aug 05 06:33:52 devstack cinder-volume[88695]: DEBUG cinder.coordination [None req-b0e444a6-5655-46ac-b80b-522aa244e0ab tempest-ProjectReaderTests-1646537941 None] Lock "cinder-562ab60b-48d7-4795-bcc8-dfbdd404b00d-delete_volume" released by "delete_volume" :: held 1.253s {{(pid=88695) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 06:34:00 devstack cinder-volume[88695]: DEBUG oslo_service.periodic_task [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88695) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 06:34:00 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 06:34:00 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 06:34:00 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087': None} {{(pid=88695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 06:34:00 devstack cinder-volume[88695]: DEBUG cinder.volume.drivers.quobyte [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0ccada92-4966-46ec-9229-689e7df82087'] {{(pid=88695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 06:34:00 devstack cinder-volume[88695]: DEBUG oslo_concurrency.lockutils [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 06:34:00 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 06:34:00 devstack sudo[110265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce Aug 05 06:34:00 devstack sudo[110265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 06:34:00 devstack sudo[110265]: pam_unix(sudo:session): session closed for user root Aug 05 06:34:00 devstack cinder-volume[88695]: DEBUG oslo_concurrency.processutils [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/47bb2adce5a6b842ace73fc1db89bcce" returned: 0 in 0.293s {{(pid=88695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 06:34:00 devstack cinder-volume[88695]: DEBUG cinder.manager [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] Notifying Schedulers of capabilities ... {{(pid=88695) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 06:34:00 devstack cinder-volume[88695]: DEBUG oslo_service.periodic_task [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] Running periodic task VolumeManager._thread_info {{(pid=88695) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 06:34:00 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] thread count: 28 {{(pid=88695) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 05 06:34:00 devstack cinder-volume[88695]: DEBUG cinder.volume.manager [None req-6a06ff5a-9b11-449e-a344-535ee0c2c791 None None] thread info: [<_MainThread(MainThread, started 134469211893888)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88695) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 05 06:34:02 devstack cinder-volume[88695]: DEBUG dbcounter [-] [88695] Writing DB stats cinder:SELECT=12,cinder:UPDATE=25,cinder:INSERT=7,cinder:DELETE=3 {{(pid=88695) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 06:34:02 devstack cinder-volume[88695]: DEBUG dbcounter [-] [88695] Writing DB stats cinder:UPDATE=20,cinder:SELECT=17,cinder:INSERT=3,cinder:DELETE=1 {{(pid=88695) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}